Multiplicative Wavelet Traffic Model and pathChirp: Efficient Available Bandwidth Estimation Vinay Ribeiro.

Slides:



Advertisements
Similar presentations
Congestion Control and Fairness Models Nick Feamster CS 4251 Computer Networking II Spring 2008.
Advertisements

Internet Measurement Conference 2003 Source-Level IP Packet Bursts: Causes and Effects Hao Jiang Constantinos Dovrolis (hjiang,
Edge-based Network Modeling and Inference
Collaborators: Mark Coates, Rui Castro, Ryan King, Mike Rabbat, Yolanda Tsang, Vinay Ribeiro, Shri Sarvotham, Rolf Reidi Network Bandwidth Estimation and.
Connection-level Analysis and Modeling of Network Traffic understanding the cause of bursts control and improve performance detect changes of network state.
Available Bandwidth Estimation Manish Jain Networking and Telecom Group CoC, Georgia Tech.
pathChirp Efficient Available Bandwidth Estimation
Min-Plus Linear Systems Theory and Bandwidth Estimation Min-Plus Linear Systems Theory and Bandwidth Estimation TexPoint fonts used in EMF. Read the TexPoint.
Bandwidth Estimation Workshop 2003 Evaluating pathrate and pathload with realistic cross-traffic Ravi Prasad Manish Jain Constantinos Dovrolis (ravi, jain,
A Measurement Study of Available Bandwidth Estimation Tools MIT - CSAIL with Jacob Strauss & Frans Kaashoek Dina Katabi.
Traffic and routing. Network Queueing Model Packets are buffered in egress queues waiting for serialization on line Link capacity is C bps Average packet.
Pathload A measurement tool for end-to-end available bandwidth Manish Jain, Univ-Delaware Constantinos Dovrolis, Univ-Delaware Sigcomm 02.
1 CONGESTION CONTROL. 2 Congestion Control When one part of the subnet (e.g. one or more routers in an area) becomes overloaded, congestion results. Because.
1 End to End Bandwidth Estimation in TCP to improve Wireless Link Utilization S. Mascolo, A.Grieco, G.Pau, M.Gerla, C.Casetti Presented by Abhijit Pandey.
What do packet dispersion techniques measure? Internet Systems and Technologies - Monitoring.
Path Optimization in Computer Networks Roman Ciloci.
Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.
End-to-End Available Bandwidth: Measurement Methodology, Dynamics, and Relation with TCP Throughput Manish Jain Constantinos Dovrolis SIGCOMM 2002 Presented.
CapProbe: A Simple and Accurate Capacity Estimation Technique Kapoor et al., SIGCOMM ‘04.
One More Bit Is Enough Yong Xia, RPI Lakshminarayanan Subramanian, UCB Ion Stoica, UCB Shivkumar Kalyanaraman, RPI SIGCOMM’05, August 22-26, 2005, Philadelphia,
AQM for Congestion Control1 A Study of Active Queue Management for Congestion Control Victor Firoiu Marty Borden.
Network Traffic Measurement and Modeling CSCI 780, Fall 2005.
Available bandwidth measurement as simple as running wget D. Antoniades, M. Athanatos, A. Papadogiannakis, P. Markatos Institute of Computer Science (ICS),
1 Active Probing for Available Bandwidth Estimation Sridhar Machiraju UC Berkeley OASIS Retreat, Jan 2005 Joint work with D.Veitch, F.Baccelli, A.Nucci,
FTDCS 2003 Network Tomography based Unresponsive Flow Detection and Control Authors Ahsan Habib, Bharat Bhragava Presenter Mohamed.
Performance and Robustness Testing of Explicit-Rate ABR Flow Control Schemes Milan Zoranovic Carey Williamson October 26, 1999.
Inline Path Characteristic Estimation to Improve TCP Performance in High Bandwidth-Delay Networks HIDEyuki Shimonishi Takayuki Hama Tutomu Murase Cesar.
Congestion Control for High Bandwidth-Delay Product Environments Dina Katabi Mark Handley Charlie Rohrs.
Bandwidth Estimation: Metrics Mesurement Techniques and Tools By Ravi Prasad, Constantinos Dovrolis, Margaret Murray and Kc Claffy IEEE Network, Nov/Dec.
Ch. 28 Q and A IS 333 Spring Q1 Q: What is network latency? 1.Changes in delay and duration of the changes 2.time required to transfer data across.
A Machine Learning-based Approach for Estimating Available Bandwidth Ling-Jyh Chen 1, Cheng-Fu Chou 2 and Bo-Chun Wang 2 1 Academia Sinica 2 National Taiwan.
Multiscale Traffic Processing Techniques for Network Inference and Control R. Baraniuk R. Nowak E. Knightly R. Riedi V. Ribeiro S. Sarvotham A. Keshavarz.
Alok Shriram and Jasleen Kaur Presented by Moonyoung Chung Empirical Evaluation of Techniques for Measuring Available Bandwidth.
Bandwidth Estimation TexPoint fonts used in EMF.
Packet-Pair Dispersion for Bandwidth Probing: Probabilistic and Sample-Path Approaches M. J. Tunnicliffe Faculty of Computing, Information Systems and.
Computer Networks Performance Metrics. Performance Metrics Outline Generic Performance Metrics Network performance Measures Components of Hop and End-to-End.
Multiscale Traffic Processing Techniques for Network Inference and Control Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi Rice University INCITE.
Estimating Bandwidth of Mobile Users Sept 2003 Rohit Kapoor CSD, UCLA.
Development of a New Efficient and Accurate Available Bandwidth Estimation Method Péter Hága Attila Pásztor István Csabai Darryl Veitch Viktória Hunyadi.
Comparison of Public End-to-End Bandwidth Estimation tools on High-Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
Comparison of Public End-to-End Bandwidth Estimation tools on High- Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
11 Experimental and Analytical Evaluation of Available Bandwidth Estimation Tools Cesar D. Guerrero and Miguel A. Labrador Department of Computer Science.
1 IEEE Meeting July 19, 2006 Raj Jain Modeling of BCN V2.0 Jinjing Jiang and Raj Jain Washington University in Saint Louis Saint Louis, MO
Requirements for Simulation and Modeling Tools Sally Floyd NSF Workshop August 2005.
Bandwidth Estimation Workshop 2003 Evaluating pathrate and pathload with realistic cross-traffic Ravi Prasad Manish Jain Constantinos Dovrolis (ravi, jain,
Optimal Sampling Strategies for Multiscale Stochastic Processes Vinay Ribeiro Rolf Riedi, Rich Baraniuk (Rice University)
PathChirp Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
T. S. Eugene Ngeugeneng at cs.rice.edu Rice University1 COMP/ELEC 429/556 Introduction to Computer Networks Principles of Congestion Control Some slides.
Rice University, SPiN Group spin.rice.edu Multiscale Traffic Processing Techniques for Network Inference and Control R. Baraniuk R. Nowak E. Knightly R.
Analysis of RED Goal: impact of RED on loss and delay of bursty (TCP) and less bursty or smooth (UDP) traffic RED eliminates loss bias against bursty traffic.
Rice University, SPiN Group spin.rice.edu Multiscale Traffic Processing Techniques for Network Inference and Control R. Baraniuk R. Nowak E. Knightly R.
The Macroscopic behavior of the TCP Congestion Avoidance Algorithm.
INCITE: Traffic Processing Techniques for Network Inference and Control Effort 1: Chirp Probing Objective : Reduced complexity, multiscale link models.
End-to-end Bandwidth Estimation in the Wide Internet Daniele Croce PhD dissertation, April 16, 2010.
Péter Hága Eötvös Loránd University, Hungary European Conference on Complex Systems 2008 Jerusalem, Israel.
Grid Computing slide to be used anywhere Harness global resources to improve performance.
Multiscale Tools for Networking Vinay J. Ribeiro Ph.D. Thesis Proposal.
Internet Measurement and Analysis Vinay Ribeiro Shriram Sarvotham Rolf Riedi Richard Baraniuk Rice University.
PathChirp & STAB Measuring Available Bandwidth and Locating Bottlenecks in Packet Networks Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University spin.rice.edu.
PathChirp Efficient Available Bandwidth Estimation Vinay Ribeiro Rice University Rolf Riedi Rich Baraniuk.
Queuing Analysis of Tree-Based LRD Traffic Models Vinay J. Ribeiro R. Riedi, M. Crouse, R. Baraniuk.
Bandwidth Estimation of a Network Path ET-4285 Measuring & Simulating the internet Bandwidth Estimation of a Network Path Group 4: S. Ngabonziza Rugemintwaza.
Bandwidth Estimation: Metrics Measurement Techniques and Tools
Rohit Kapoor, Ling-Jyh Chen, M. Y. Sanadidi, Mario Gerla
Open Issues in Router Buffer Sizing
CONGESTION CONTROL.
Richard Baraniuk Edward Knightly Robert Nowak Rolf Riedi
pathChirp Efficient Available Bandwidth Estimation
pathChirp Efficient Available Bandwidth Estimation
Presentation transcript:

Multiplicative Wavelet Traffic Model and pathChirp: Efficient Available Bandwidth Estimation Vinay Ribeiro

The Internet Congestion key problem

Network Traffic Modeling Traffic = packet arrival process on a link Traffic is bursty Bursts can cause buffer overflows Need accurate traffic models for –Simulation, estimation, prediction, control

Multiscale Aggregation Analysis of Traffic time unit 4 ms 2 ms 1 ms

Failure of Classical Models time unit 600 ms 60 ms 6 ms Internet Traffic Classical Traffic Model Internet traffic is self-similar: looks similar at different time scales

Why Self-similarity is Important Self-similarity leads to larger queues Classical models are overly optimistic

Multiscale Tree Structure time unit 4 ms 2 ms 1 ms

Additive Traffic Model Generate additive innovations, W Match variance at each level in tree Fast O(N) algorithm Coarse-to-fine multiscale synthesis

Additive Model Sample Realization Iteration/scale

Limitations of Additive Models Addition  Gaussian process Gaussian, takes negative values Gaussian not spiky Goal: model that gives positive and spiky data

Multiplicative Traffic Model Generate independent positive multiplicative innovations, Fast O(N) synthesis algorithm Coarse-to-fine multiscale synthesis

Multiplicative Model Realization Iteration/scale

Time Series Comparison of Models time unit 24 ms 12 ms 6 ms Berkeley data Multiplicative model Additive model

Histogram Comparison of Models time unit 24 ms 12 ms 6 ms Berkeley data Multiplicative model Additive model

Queuing Experiments Study queue overflow probability P(Q>b)

Queuing Results Plot log P(Q>b) vs. b Additive model underestimates losses (congestion) Berkeley traffic Multiplicative model Additive model

Advantages of Multiplicative Model Synthesized traffic –Positive –Spiky –Self-similar Algorithm –Fast O(N) synthesis Queuing –Outperforms additive model Uses –Simulation, estimation, congestion control, prediction

From Links to Paths Inferring path properties useful for many applications

pathChirp Efficient Available Bandwidth Estimation

Available Bandwidth Unused capacity along path Available bandwidth: Goal: estimate available bandwidth from probe packet transfer delays Delay=speed of light propagation + queuing delay

Applications Network monitoring Server selection Route selection (e.g. BGP) SLA verification Congestion control

Available Bandwidth Probing Tool Requirements Fast estimate within few RTTs Unobtrusive introduce light probing load Accurate No topology information (e.g. link speeds) Robust to multiple congested links No topology information (e.g. link speeds) Robust to multiple congested links

Principle of Self-Induced Congestion Advantages –No topology information required –Robust to multiple bottlenecks TCP-Vegas uses self-induced congestion principle Probing rate < available bw  no delay increase Probing rate > available bw  delay increases

Trains of Packet-Pairs (TOPP) [Melander et al] Vary sender packet-pair spacing Compute avg. receiver packet-pair spacing Constrained regression based estimate Shortcoming: packet-pairs do not capture temporal queuing behavior useful for available bandwidth estimation Packet-pairs Packet train

Pathload [Jain & Dovrolis] Constant bit rate (CBR) packet trains Vary rate of successive trains Converge to available bandwidth Shortcoming Efficiency: only one data rate per train

Chirp Packet Trains Exponentially decrease packet spacing within packet train Wide range of probing rates Efficient: few packets

CBR Cross-Traffic Scenario Point of onset of increase in queuing delay gives available bandwidth

Bursty Cross-Traffic Scenario Goal: exploit information in queuing delay signature Use principle of self-induced congestion

pathChirp Tool UDP probe packets No clock synchronization required, only uses relative queuing delay within a chirp duration Computation at receiver Context switching detection User specified average probing rate open source distribution at spin.rice.edu

Internet Experiments 3 common hops between SLAC  Rice and Chicago  Rice paths Estimates fall in proportion to introduced Poisson traffic

Comparison with TOPP 30% utilization Equal avg. probing rates for pathChirp and TOPP Result: pathChirp outperforms TOPP 70% utilization

Comparison with Pathload 100Mbps links pathChirp uses 10 times fewer bytes for comparable accuracy Available bandwidth EfficiencyAccuracy pathchirppathloadpathChirp 10-90% pathload Avg.min-max 30Mbps0.35MB3.9MB19-29Mbps16-31Mbps 50Mbps0.75MB5.6MB39-48Mbps39-52Mbps 70Mbps0.6MB8.6MB54-63Mbps63-74Mbps

Summary Multiplicative wavelet model for traffic –Positive and spiky data –Outperforms additive Gaussian models –Freeware code: dsp.rice.edu pathChirp –Special chirp packet trains –Efficient available bandwidth estimation –Freeware code: spin.rice.edu