Using Loss Pairs to Discover Network Properties Jun Liu, Mark Crovella Computer Science Dept. Boston University.

Slides:



Advertisements
Similar presentations
Martin Suchara, Ryan Witt, Bartek Wydrowski California Institute of Technology Pasadena, U.S.A. TCP MaxNet Implementation and Experiments on the WAN in.
Advertisements

Multicast congestion control on many-to- many videoconferencing Xuan Zhang Network Research Center Tsinghua University, China.
Helping TCP Work at Gbps Cheng Jin the FAST project at Caltech
TCP Probe: A TCP with Built-in Path Capacity Estimation Anders Persson, Cesar Marcondes, Ling-Jyh Chen, Li Lao, M. Y. Sanadidi, Mario Gerla Computer Science.
By Arjuna Sathiaseelan Tomasz Radzik Department of Computer Science King’s College London EPDN: Explicit Packet Drop Notification and its uses.
Practice Questions: Congestion Control and Queuing
Md. Manzoor MurshedAdaptive RED with Dynamic Threshold Adjustment CprE599: Creative Component Adaptive RED with Dynamic Threshold Adjustment.
Selfish Behavior and Stability of the Internet: A Game-Theoretic Analysis of TCP Presented by Shariq Rizvi CS 294-4: Peer-to-Peer Systems.
Simulating Large Networks using Fluid Flow Model Yong Liu Joint work with Francesco LoPresti, Vishal Misra Don Towsley, Yu Gu.
On Impact of Non-Conformant Flows on a Network of Drop-Tail Gateways Kartikeya Chandrayana Shivkumar Kalyanaraman ECSE Dept., R.P.I. (
The War Between Mice and Elephants LIANG GUO, IBRAHIM MATTA Computer Science Department Boston University ICNP (International Conference on Network Protocols)
TFRC for Voice: the VoIP Variant Sally Floyd, Eddie Kohler. March 2005, presentation to AVT draft-ietf-dccp-tfrc-voip-01.txt.
End-to-end Asymmetric Link Capacity Estimation Ling-Jyh Chen, Tony Sun, Guang Yang, M.Y. Sanadidi, Mario Gerla Dept. of Computer Science, University of.
Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.
1 Estimating Shared Congestion Among Internet Paths Weidong Cui, Sridhar Machiraju Randy H. Katz, Ion Stoica Electrical Engineering and Computer Science.
The War Between Mice and Elephants Presented By Eric Wang Liang Guo and Ibrahim Matta Boston University ICNP
Advanced Computer Networks: RED 1 Random Early Detection Gateways for Congestion Avoidance * Sally Floyd and Van Jacobson, IEEE Transactions on Networking,
“On Designing Improved Controllers for AQM Routers Supporting TCP Flows” The PI Controller Presented by Bob Kinicki.
1 Minseok Kwon and Sonia Fahmy Department of Computer Sciences Purdue University {kwonm, All our slides and papers.
ABE: Providing a Low Delay within Best Effort P. Hurley, M. Kara, J. Le Boudec, and P. Thiran ICA, Swiss Federal Institute of Technology, Lausanne, Switzerland.
AQM for Congestion Control1 A Study of Active Queue Management for Congestion Control Victor Firoiu Marty Borden.
1 Modeling and Taming Parallel TCP on the Wide Area Network Dong Lu,Yi Qiao Peter Dinda, Fabian Bustamante Department of Computer Science Northwestern.
Buffer Sizing for Congested Internet Links Chi Yin Cheung Cs 395 Advanced Networking.
6/16/20151 On Designing Improved Controllers for AQM Routers Supporting TCP flows By C.V Hollot, Vishal Mishra, Don Towsley and Wei-Bo Gong Presented by.
Diffusion Mechanisms for Active Queue Management Department of Electrical and Computer Engineering University of Delaware May 19th / 2004 Rafael Nunez.
High speed TCP’s. Why high-speed TCP? Suppose that the bottleneck bandwidth is 10Gbps and RTT = 200ms. Bandwidth delay product is packets (1500.
EE689 Lecture 5 Review of last lecture More on HPF RED.
TCP Congestion Control TCP sources change the sending rate by modifying the window size: Window = min {Advertised window, Congestion Window} In other words,
1 Random Early Detection Gateways for Congestion Avoidance Sally Floyd and Van Jacobson, IEEE Transactions on Networking, Vol.1, No. 4, (Aug 1993), pp
1 End-to-End Detection of Shared Bottlenecks Sridhar Machiraju and Weidong Cui Sahara Winter Retreat 2003.
ACN: AVQ1 Analysis and Design of an Adaptive Virtual Queue (AVQ) Algorithm for Active Queue Managment Srisankar Kunniyur and R. Srikant SIGCOMM’01 San.
On Efficient On-line Grouping of Flows with Shared Bottlenecks at Loaded Servers by O. Younis and S. Fahmy Department of Computer Sciences, Purdue University.
1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.
FTDCS 2003 Network Tomography based Unresponsive Flow Detection and Control Authors Ahsan Habib, Bharat Bhragava Presenter Mohamed.
The War Between Mice and Elephants By Liang Guo (Graduate Student) Ibrahim Matta (Professor) Boston University ICNP’2001 Presented By Preeti Phadnis.
Bandwidth Measurements Jeng Lung WebTP Meeting 10/25/99.
Core Stateless Fair Queueing Stoica, Shanker and Zhang - SIGCOMM 98 Rigorous fair Queueing requires per flow state: too costly in high speed core routers.
Rafael C. Nunez - Gonzalo R. Arce Department of Electrical and Computer Engineering University of Delaware May 19 th, 2005 Diffusion Marking Mechanisms.
Diffusion Mechanisms for Active Queue Management Department of Electrical and Computer Engineering University of Delaware May 19th / 2004 Rafael Nunez.
Congestion Control for High Bandwidth-Delay Product Environments Dina Katabi Mark Handley Charlie Rohrs.
Ns Simulation Final presentation Stella Pantofel Igor Berman Michael Halperin
1 A State Feedback Control Approach to Stabilizing Queues for ECN- Enabled TCP Connections Yuan Gao and Jennifer Hou IEEE INFOCOM 2003, San Francisco,
Analysis of Active Queue Management Jae Chung and Mark Claypool Computer Science Department Worcester Polytechnic Institute Worcester, Massachusetts, USA.
Computer Science 1 Characterizing Link Properties Using “Loss-pairs” Jun Liu (joint work with Prof. Mark Crovella)
Discriminating Congestion Losses from Wireless Losses using Inter- Arrival Times at the Receiver By Saad Biaz,Nitin H.Vaidya Texas A&M University IEEE.
Diffusion Early Marking Department of Electrical and Computer Engineering University of Delaware May / 2004 Rafael Nunez Gonzalo Arce.
Core Stateless Fair Queueing Stoica, Shanker and Zhang - SIGCOMM 98 Fair Queueing requires per flow state: too costly in high speed core routers Yet, some.
TCP Enhancement for Random Loss Jiang Wu Computer Science Lakehead University.
Estimating Link Capacity in High Speed Networks Ling-Jyh Chen 1, Tony Sun 2, Li Lao 2, Guang Yang 2, M.Y. Sanadidi 2, Mario Gerla 2 1 Institute of Information.
TFRC: TCP Friendly Rate Control using TCP Equation Based Congestion Model CS 218 W 2003 Oct 29, 2003.
Estimating Bandwidth of Mobile Users Sept 2003 Rohit Kapoor CSD, UCLA.
ACN: RED paper1 Random Early Detection Gateways for Congestion Avoidance Sally Floyd and Van Jacobson, IEEE Transactions on Networking, Vol.1, No. 4, (Aug.
1 On Class-based Isolation of UDP, Short-lived and Long-lived TCP Flows by Selma Yilmaz Ibrahim Matta Computer Science Department Boston University.
Packet Dispersion in IEEE Wireless Networks Mingzhe Li, Mark Claypool and Bob Kinicki WPI Computer Science Department Worcester, MA 01609
Requirements for Simulation and Modeling Tools Sally Floyd NSF Workshop August 2005.
15744 Course Project1 Evaluation of Queue Management Algorithms Ningning Hu, Liu Ren, Jichuan Chang 30 April 2001.
TFRC for Voice: the VoIP Variant Sally Floyd, Eddie Kohler. March draft-ietf-dccp-tfrc-voip-01.txt
AQM & TCP models Courtesy of Sally Floyd with ICIR Raj Jain with OSU.
1 Capacity Dimensioning Based on Traffic Measurement in the Internet Kazumine Osaka University Shingo Ata (Osaka City Univ.)
Deadline-based Resource Management for Information- Centric Networks Somaya Arianfar, Pasi Sarolahti, Jörg Ott Aalto University, Department of Communications.
CS640: Introduction to Computer Networks Aditya Akella Lecture 15 TCP – III Reliability and Implementation Issues.
CS640: Introduction to Computer Networks Aditya Akella Lecture 15 TCP – III Reliability and Implementation Issues.
Time-Dependent Dynamics in Networked Sensing and Control Justin R. Hartman Michael S. Branicky Vincenzo Liberatore.
Bandwidth estimation: metrics, measurement techniques, and tools Presenter: Yuhang Wang.
Johns Hopkins university
Other Methods of Dealing with Congestion
Computer Science Division
Modeling and Taming Parallel TCP on the Wide Area Network
15-744: Computer Networking
Designing a Relative Delay Estimator for Multipath Transport
Presentation transcript:

Using Loss Pairs to Discover Network Properties Jun Liu, Mark Crovella Computer Science Dept. Boston University

Discovering Network Properties What is the state of the network when packets are being dropped? E.g., What is the buffer occupancy when packets are being dropped? For a DropTail queue, indicates buffer size; For an AQM queue, indicates dropping policy.

Benefits and Difficulties Why is this useful? Characterizing existing networks; Using information gained to adapt applications to network status; Debugging network elements. Why is this hard? Dropped packets carry no information to the endpoint; Noisy measurements require robust estimation methods.

The Basic Idea A packet traveling close to a dropped packet sees similar network state as the dropped one. We propose a method called Loss Pairs to characterize the dropping function of a network element under some assumptions.

Loss Pairs A non-dropped packet that is close to a dropped packet can inform the endpoint about network state seen by the dropped packet. We define a loss pair as two packets p1 and p2 such that p2 initially follows p1 with time between the trailing edge of p1 and the leading edge of p2; Exactly one of p1 and p2 happens to be dropped in the network; p1 and p2 traverse the same sequence of links and routers up to the point one is dropped. Generally, we consider to be 0.

Assumptions For Using Loss Pairs in Practice 1. Most of the packet losses and delays happen at the bottleneck. 2. The round-trip path and the bottleneck stay stable during measurement. 3. To estimate queue state, packet scheduling must be FCFS. 4. To convert queue occupancy to bytes, bottleneck bandwidth must be known.

Network Setting For Evaluation We consider a 3-hop sample network setting. Capable of varying cross traffic upstream, downstream and at the bottleneck. Workload : heavy tailed ON/OFF TCP sources. Goal : Characterize the queue between B and C by passive measurements taken at the sender. A D C B Visable Traffic Upstream Cross Traffic Downstream Cross Traffic Bottleneck Cross Traffic Bottleneck Link

Varying Buffer Size Of A DropTail Router The queue state seen by a dropped packet is a linear function of buffer size.

Estimating Buffer Size of DropTail Routers Tq = the most common RTT of Loss Pairs. Tp = minimum RTT of all non-dropped packets. C = link bandwidth of the bottleneck link Buffer size = C * (Tq – Tp)

Filtering Ability of Loss Pairs Normal RTT RTT of Loss Pairs Corresponds to empty buffer Corresponds to full buffer

Estimation Accuracy Under Light Cross Traffic Each crossing path has 1/10th the sources of the main path. The estimation results are quite good -- all assumptions are met.

Estimation Accuracy Under Moderate Cross Traffic Each crossing path has 50% of the sources of the main path. Estimation results are still acceptable -- assumptions are partially met. Queue delays in non- bottleneck queues are prominent for small buffer sizes.

Estimation Accuracy Under Heavy Cross Traffic Each crossing path has as many sources as the main path. Estimation results are poor for small buffers -- assumptions are violated. However, the results are acceptable on large buffers.

Effect of Cross Traffic Heavy cross traffic upstream, downstream or on return path affects accuracy. Cross traffic at the bottleneck doesnt affect accuracy -- only affects the number of samples on Loss Pairs.

Characterizing Dropping Curves of AQM Routers New assumption : packet drops are independent. Estimation Method: # loss pairs with RTT = x Dropping ratio = # trial pairs with RTT = x A trial pair with RTT = x is a pair of packets with at least one packet not having been dropped.

Characterizing the Dropping Curve of a RED Router Parameters: min_threshold=9KB, max_threshold=18KB, Mp=0.1 Measured By Loss Pairs Actual Behavior

Characterizing the Dropping Curve of a BLUE Router Parameters: B=500 pkts, Incr=Decr=0.0025, Holding time = 0.01 sec.

Related Work Measurement of bandwidth by Packet Pairs Keshav (1991), Bolot (1993), Paxson (1995), Carter & Crovella (1996, Bprobe) Measurement of bandwidth, delay, mean queue occupancy, etc. by individual packet Jacobson (1997, pathchar), Downey (1999, pchar), Mah (1999, clink), Lai and Baker (2000), Harfoush et al. (2001) Measurement of loss rate Duffield et. al. (1999, MINC) Harfoush et. al. (2000, MINT)

Conclusion We propose a new technique for characterizing the packet dropping behavior of network elements. By simulation, we have shown that this method is effective in characterizing the dropping patterns of routers. This method can be used to characterize the queue management scheme being used at the bottleneck link. For DropTail queues, this method can be used to determine router buffer size.