Findings in Reliable Bulk Data Transfer Experiments GGB project Sukun Kim, David Culler, James Demmel, Gregory Fenves, Steve Glaser, Shamim Pakzad NEST.

Slides:



Advertisements
Similar presentations
IP Router Architectures. Outline Basic IP Router Functionalities IP Router Architectures.
Advertisements

24-1 Chapter 24. Congestion Control and Quality of Service (part 1) 23.1 Data Traffic 23.2 Congestion 23.3 Congestion Control 23.4 Two Examples.
1 Transport Protocols & TCP CSE 3213 Fall April 2015.
Computer Networks Transport Layer. Topics F Introduction (6.1)  F Connection Issues ( ) F TCP (6.4)
Prentice HallHigh Performance TCP/IP Networking, Hassan-Jain Chapter 2 TCP/IP Fundamentals.
CSCI 4550/8556 Computer Networks
BZUPAGES.COM 1 User Datagram Protocol - UDP RFC 768, Protocol 17 Provides unreliable, connectionless on top of IP Minimal overhead, high performance –No.
Lecture 3  A round up of the most important basics I haven’t covered yet.  A round up of some of the (many) things I am missing out of this course (ATM,
What is Flow Control ? Flow Control determines how a network resources, such as channel bandwidth, buffer capacity and control state are allocated to packet.
Monday, June 01, 2015 ARRIVE: Algorithm for Robust Routing in Volatile Environments 1 NEST Retreat, Lake Tahoe, June
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 ECSE-4690: Experimental Networking Informal Quiz: TCP Shiv Kalyanaraman:
Wireless Sensor Networks for High Fidelity Sampling Sukun Kim Qualifying Examination Dec 1, 2005.
Congestion control in data centers
DOT3 Radio Stack Sukun KimJaein Jeong A DOT3 Mote Design & Implementation Motivation Evaluation MICA is not enough for large scale applications. DOT3 is.
CSEE W4140 Networking Laboratory Lecture 7: TCP flow control and congestion control Jong Yul Kim
CSCE 515: Computer Network Programming Chin-Tser Huang University of South Carolina.
Wireless Sensor Networks for High Fidelity Sampling Sukun Kim Electrical Engineering and Computer Sciences University of California at Berkeley Committee:
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 ECSE-6961:Internet Protocols Quiz 1: Solutions Time: 60 min (strictly enforced) Points: 50 YOUR.
DOT3 Radio Stack Jaein Jeong, Sukun Kim Nest Retreat January 16, 2003.
Radio Stack Iteration How to improve the CC1000 Joe Polastre January 15, 2004 NEST Retreat.
A Real-Time Video Multicast Architecture for Assured Forwarding Services Ashraf Matrawy, Ioannis Lambadaris IEEE TRANSACTIONS ON MULTIMEDIA, AUGUST 2005.
Lecture 5: Congestion Control l Challenge: how do we efficiently share network resources among billions of hosts? n Last time: TCP n This time: Alternative.
1 K. Salah Module 6.1: TCP Flow and Congestion Control Connection establishment & Termination Flow Control Congestion Control QoS.
5/12/05CS118/Spring051 A Day in the Life of an HTTP Query 1.HTTP Brower application Socket interface 3.TCP 4.IP 5.Ethernet 2.DNS query 6.IP router 7.Running.
Empirical Analysis of Transmission Power Control Algorithms for Wireless Sensor Networks CENTS Retreat – May 26, 2005 Jaein Jeong (1), David Culler (1),
Junxian Huang 1 Feng Qian 2 Yihua Guo 1 Yuanyuan Zhou 1 Qiang Xu 1 Z. Morley Mao 1 Subhabrata Sen 2 Oliver Spatscheck 2 1 University of Michigan 2 AT&T.
ECE 544 Project 3 Content Based Routing Neelakantan Nurani Krishnan Shikha Kakkar Suja Srinivasan.
TCP: flow and congestion control. Flow Control Flow Control is a technique for speed-matching of transmitter and receiver. Flow control ensures that a.
1 Token Passing: IEEE802.5 standard  4 Mbps  maximum token holding time: 10 ms, limiting packet length  packet (token, data) format:  SD, ED mark start,
Opersating Mode DCF: distributed coordination function
Acceleration Based Pedometer
CS540/TE630 Computer Network Architecture Spring 2009 Tu/Th 10:30am-Noon Sue Moon.
Token Passing: IEEE802.5 standard  4 Mbps  maximum token holding time: 10 ms, limiting packet length  packet (token, data) format:  SD, ED mark start,
Computer Networks Performance Metrics. Performance Metrics Outline Generic Performance Metrics Network performance Measures Components of Hop and End-to-End.
SMUCSE 4344 transport layer. SMUCSE 4344 transport layer end-to-end protocols –transport code runs only on endpoint hosts encapsulates network communications.
SELECTIVE ACKNOWLEDGEMENT (SACK) DUPLICATE SELECTIVE ACKNOWLEDGMENT
Chapter 12 Transmission Control Protocol (TCP)
ENERGY-EFFICIENT FORWARDING STRATEGIES FOR GEOGRAPHIC ROUTING in LOSSY WIRELESS SENSOR NETWORKS Presented by Prasad D. Karnik.
High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.
2000 년 11 월 20 일 전북대학교 분산처리실험실 TCP Flow Control (nagle’s algorithm) 오 남 호 분산 처리 실험실
HighSpeed TCP for High Bandwidth-Delay Product Networks Raj Kettimuthu.
Copyright 2008 Kenneth M. Chipps Ph.D. Controlling Flow Last Update
Networking Fundamentals. Basics Network – collection of nodes and links that cooperate for communication Nodes – computer systems –Internal (routers,
TCP with Variance Control for Multihop IEEE Wireless Networks Jiwei Chen, Mario Gerla, Yeng-zhong Lee.
Efficient Cache Structures of IP Routers to Provide Policy-Based Services Graduate School of Engineering Osaka City University
CSC 600 Internetworking with TCP/IP Unit 5: IP, IP Routing, and ICMP (ch. 7, ch. 8, ch. 9, ch. 10) Dr. Cheer-Sun Yang Spring 2001.
A Bandwidth Estimation Method for IP Version 6 Networks Marshall Crocker Department of Electrical and Computer Engineering Mississippi State University.
Deadline-based Resource Management for Information- Centric Networks Somaya Arianfar, Pasi Sarolahti, Jörg Ott Aalto University, Department of Communications.
1 CS 4396 Computer Networks Lab TCP – Part II. 2 Flow Control Congestion Control Retransmission Timeout TCP:
TCP OVER ADHOC NETWORK. TCP Basics TCP (Transmission Control Protocol) was designed to provide reliable end-to-end delivery of data over unreliable networks.
Link Layer Support for Unified Radio Power Management in Wireless Sensor Networks IPSN 2007 Kevin Klues, Guoliang Xing and Chenyang Lu Database Lab.
TCP continued. Discussion – TCP Throughput TCP will most likely generate the saw tooth type of traffic. – A rough estimate is that the congestion window.
Network Coding and Reliable Communications Group Modeling Network Coded TCP Throughput: A Simple Model and its Validation MinJi Kim*, Muriel Médard*, João.
Retransmission. Automatic Repeat reQuest (ARQ) 2 Time Packet ACK Timeout Automatic Repeat Request –Receiver sends acknowledgment (ACK) when it receives.
IP1 The Underlying Technologies. What is inside the Internet? Or What are the key underlying technologies that make it work so successfully? –Packet Switching.
TCP/IP1 Address Resolution Protocol Internet uses IP address to recognize a computer. But IP address needs to be translated to physical address (NIC).
Token Passing: IEEE802.5 standard  4 Mbps  maximum token holding time: 10 ms, limiting packet length  packet (token, data) format:
TCP Selective Acknowledgement Options
Topics discussed in this section:
David S. L. Wei Joint Work with Alex Chia-Chun Hsu and C.-C. Jay Kuo
TCP Vegas: New Techniques for Congestion Detection and Avoidance
Data Link Layer What does it do?
Transport Layer Unit 5.
Data Compression.
Automatic TCP Buffer Tuning
The University of Adelaide, School of Computer Science
Ajay Vyasapeetam Brijesh Shetty Karol Gryczynski
Congestion Control in TCP
How MAC interacts with Capacity of Ad-hoc Networks – Interference problem Capacity of Wireless Networks – Part Page 1.
Presentation transcript:

Findings in Reliable Bulk Data Transfer Experiments GGB project Sukun Kim, David Culler, James Demmel, Gregory Fenves, Steve Glaser, Shamim Pakzad NEST Meeting Mar 9, 2005

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

State Diagram of Sender More Start Request / Set Timer Yes / Read Timer Fired / Send No / Stop Timer Simple (intelligence in receiver) Interface is simple –read(start, size, *buffer) Send everything once, and fill holes Read depth in routing tree, and adjust shooting speed, RTT estimate, etc

State Diagram of Receiver Start More Send Network-Info Request Receive / Send Transfer Request, Set Timer Receive & Last || Timeout / count = 0 Timeout / FAIL Receive & not Last / Set Timer Yes / Send Read Request, Set Timer Receive / count = 0 More in Round count < threshold Yes No Yes / ++count No / FAIL No / SUCCESS Timeout

Test Result 95.6% 560B/s 96.6% 576B/s 91.4% 296B/s 91.8% 304B/s 93.2% 299B/s * End-to-end Raw Reliability Effective Bandwidth (Byte/s) 10KB of data –500 packets Mica2dot, 36 bytes/pkt Max in theory –630B/s for 1 hop Up to 91.4% efficiency –352B/s for 2 hops Up to 86.4% efficiency

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

Mica2, 36bytes/pkt

For Mica2, packet size = 36 bytes Channel capacity –UART: 57.6Kbps = 200pkts/s –Radio: 19.2Kbps = 66.7pkts/s –1 hop: 50pkts/s Usable capacity –UART: 120pkts/s –Radio: 42pkts/s –Routing: 31pkts/s (1 hop) –Reliable: 29.4pkts/s (1 hop)

Mica2, 36bytes/pkt

Effect of header is considered here

Mica2, 36bytes/pkt

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

Options for Increasing Bandwidth Multiple Base Station radio Larger Packet Size Compression

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

Effect on Bandwidth Doubled packet size: 36B  72B Payload: 20B  56B (2.8 times) Packets/sec: 29.4  20.9 (71%) Bandwidth doubled: 588B/s  1172B/s (1.99 times)

RAM space From 3437 to 4733 –36Bytes RAM increase per 1Byte increase in packet size Reason – Packet buffer space –4 below GenericComm –3 in TimeSync –16 in Routing –4 in Bcast –2 + 5 in Reliable –2 in application Basic services (Comm + TimeSync + Routing + Bcast + Reliable) can go beyond 4KB RAM with packet size = 72Bytes

Why so much RAM (packet buffer)? GenericComm Routing Forward QueuedSend Drip RBRComponent 2 Component 1 Forward *There is mismatch between incoming speed and outgoing speed of packets Not to drop packet, forward buffer is needed for each component Each end component using network has at least 1 buffer – 2 or more if we don’t want to wait Component 3 Queue of pointers Bcast Forward

Sharing packet buffer GenericComm Routing Forward QueuedSend Drip RBRComponent 2 Component 1 Forward Component 3 Actual packet buffer Bcast Forward

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

Run Length Encoding (RLE) 94720, 94704, 94715, becomes , 04, 15, 08 Exception –94720, 94704, 92345, becomes – , 04, \92345, 08 Run simulation on footbridge vibration data Fragment Size: 4 Threshold: 2

High Resolution Footbridge data

Low Resolution Footbridge data

Analysis High ResolutionLow Resolution RLE66%45% gzip *68%49% Theory56.25% (9 random bits) 37.5% (6 random bits) Basic algorithm of gzip utilizes repetition of same pattern Algorithm of RLE fits better to sensor data * Windows zip showed 0.64% increase

Analysis (continued) There exists room for lossless or lossy compression Compression ratio is sensitive to parameters (even go above 100%) Selecting RLE parameter (either statically or dynamically) is critical Similar  Compress Random garbage  Drop

Table of Content 1.Reliable Bulk Transfer 2.Where Packet Time Goes? 3.Increasing Bandwidth 1.Larger Packet Size 2.Compression 4.Conclusion

Conclusion Reliable Bulk Transfer –5.2% decrease in packet throughput –13.8% decrease in bandwidth Packet is small compared to the size of header, so doubling packet size doubles bandwidth –RAM limit due to many packet buffers RLE decreases the size of vibration data by 45%, and will be applicable to other sensor data

Questions

For Mica2, packet size = 36 bytes Top, Left: Packet Size Bottom, Right: pkts/sec

Test Result 99.0% % % % % % 49.0 * End-to-end Connection Quality Effective Bandwidth (Byte/s) 2KB of data –143 packets Mica2dot