My Experiences, results and remarks to TCP BW and CT Measurements Tools Jiří Navrátil SLAC.

Slides:



Advertisements
Similar presentations
Edge-based Network Modeling and Inference
Advertisements

Ningning HuCarnegie Mellon University1 Towards Tunable Measurement Techniques for Available Bandwidth Ningning Hu, Peter Steenkiste Carnegie Mellon University.
pathChirp Efficient Available Bandwidth Estimation
Bandwidth Estimation Workshop 2003 Evaluating pathrate and pathload with realistic cross-traffic Ravi Prasad Manish Jain Constantinos Dovrolis (ravi, jain,
A Measurement Study of Available Bandwidth Estimation Tools MIT - CSAIL with Jacob Strauss & Frans Kaashoek Dina Katabi.
Cheng Jin David Wei Steven Low FAST TCP: design and experiments.
Pathload A measurement tool for end-to-end available bandwidth Manish Jain, Univ-Delaware Constantinos Dovrolis, Univ-Delaware Sigcomm 02.
Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.
XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.
By Aaron Thomas. Quick Network Protocol Intro. Layers 1- 3 of the 7 layer OSI Open System Interconnection Reference Model  Layer 1 Physical Transmission.
WBest: a Bandwidth Estimation Tool for IEEE Wireless Networks Presented by Feng Li Mingzhe Li, Mark Claypool, and.
1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.
Internet Bandwidth Measurement Techniques Muhammad Ali Dec 17 th 2005.
Inline Path Characteristic Estimation to Improve TCP Performance in High Bandwidth-Delay Networks HIDEyuki Shimonishi Takayuki Hama Tutomu Murase Cesar.
Congestion Control for High Bandwidth-Delay Product Environments Dina Katabi Mark Handley Charlie Rohrs.
Bandwidth Estimation: Metrics Mesurement Techniques and Tools By Ravi Prasad, Constantinos Dovrolis, Margaret Murray and Kc Claffy IEEE Network, Nov/Dec.
Sven Ubik, CESNET TNC2004, Rhodos, 9 June 2004 Performance monitoring of high-speed networks from NREN perspective.
The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.
Internet Traffic Management. Basic Concept of Traffic Need of Traffic Management Measuring Traffic Traffic Control and Management Quality and Pricing.
Comparison of Public End-to-End Bandwidth Estimation tools on High-Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
Comparison of Public End-to-End Bandwidth Estimation tools on High- Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
SProbe: Another Tool for Measuring Bottleneck Link Bandwidth Stefan Saroiu P. Krishna Gummadi Steven Gribble University of Washington.
DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.
1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.
Multiplicative Wavelet Traffic Model and pathChirp: Efficient Available Bandwidth Estimation Vinay Ribeiro.
Iperf Quick Mode Ajay Tirumala & Les Cottrell. Sep 12, 2002 Iperf Quick Mode at LBL – Les Cottrell & Ajay Tirumala Iperf QUICK Mode Problem – Current.
Bandwidth Estimation Workshop 2003 Evaluating pathrate and pathload with realistic cross-traffic Ravi Prasad Manish Jain Constantinos Dovrolis (ravi, jain,
PathChirp Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
Introduction Jiří Navrátil SLAC. Rice University Richard Baraniuk, Edward Knightly, Robert Nowak, Rudolf Riedi Xin Wang, Yolanda Tsang, Shriram Sarvotham,
DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.
TCP continued. Discussion – TCP Throughput TCP will most likely generate the saw tooth type of traffic. – A rough estimate is that the congestion window.
TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot
Internet Measurement and Analysis Vinay Ribeiro Shriram Sarvotham Rolf Riedi Richard Baraniuk Rice University.
PathChirp & STAB Measuring Available Bandwidth and Locating Bottlenecks in Packet Networks Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University spin.rice.edu.
INDIANAUNIVERSITYINDIANAUNIVERSITY Status of FAST TCP and other TCP alternatives John Hicks TransPAC HPCC Engineer Indiana University APAN Meeting – Hawaii.
PathChirp Efficient Available Bandwidth Estimation Vinay Ribeiro Rice University Rolf Riedi Rich Baraniuk.
CS492B Project #2 TCP Tutorial # Jin Hyun Ju.
Proposal Presentation Inferring Geographic proximity of the Internet Node using a Compound Metric M. Kamran Nishat.
Access Link Capacity Monitoring with TFRC Probe Ling-Jyh Chen, Tony Sun, Dan Xu, M. Y. Sanadidi, Mario Gerla Computer Science Department, University of.
25/09/2016 INASP: Effective Network Management Workshops Unit 6: Solving Network Problems.
Bandwidth Estimation: Metrics Measurement Techniques and Tools
CUBIC Marcos Vieira.
Top-Down Network Design Chapter Thirteen Optimizing Your Network Design Copyright 2010 Cisco Press & Priscilla Oppenheimer.
Chapter 6 Congestion Avoidance
Protocols for Low Power
Prepared by Les Cottrell & Hadrien Bullot, SLAC & EPFL, for the
Rohit Kapoor, Ling-Jyh Chen, M. Y. Sanadidi, Mario Gerla
Muhammad Murtaza Yousaf, Michael Welzl
BOF Discussion: Uploading IEPM-BW data to MonALISA
Khiem Lam Jimmy Vuong Andrew Yang
TransPAC HPCC Engineer
Measuring Service in Multi-Class Networks
A Framework for Automatic Resource and Accuracy Management in A Cloud Environment Smita Vijayakumar.
Open Issues in Router Buffer Sizing
Using Netflow data for forecasting
HighSpeed TCP for Large Congestion Windows
Prepared by Les Cottrell & Hadrien Bullot, SLAC & EPFL, for the
Wide Area Networking at SLAC, Feb ‘03
Amogh Dhamdhere, Hao Jiang and Constantinos Dovrolis
ABwE: Available Bandwidth Estimator Jiri Navratil R. Les
CS640: Introduction to Computer Networks
IEPM. Warren Matthews (SLAC)
By Manish Jain and Constantinos Dovrolis 2003
pathChirp Efficient Available Bandwidth Estimation
Adaptive RED: An Algorithm for Increasing the Robustness of RED’s Active Queue Management or How I learned to stop worrying and love RED Presented by:
pathChirp Efficient Available Bandwidth Estimation
Review of Internet Protocols Transport Layer
Achieving reliable high performance in LFNs (long-fat networks)
Summer 2002 at SLAC Ajay Tirumala.
Presentation transcript:

My Experiences, results and remarks to TCP BW and CT Measurements Tools Jiří Navrátil SLAC

My interests concerns on How to achieve full BW utilization Analysis ofTools for BW estimation New methods of CT detection

Inspiration Les Cottrell IEPM metrics Jin Gujun (LBNL) netest-2 recommendation Feng Wu-Chun (LANL) simulations Diana Katabi, Charles Blake (MIT) bottleneck detection

Area of saturation = area of full utilization TCP windows size (not sufficient for HSL) Parallel streams combination

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit Saturation point

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

No big difference between speed for P2,P4,P8, .. Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit No big difference between speed for P2,P4,P8, ..

Inflexion point Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Why such distribution of throughput for individual streams ?

Internet path Out In Virtual queue

Problems of slow and high loaded lines All parallel streams share same “virtual queue” All “my traffic” share same queue with outside CT visible in statistics for “streams speed” visible in time reports (In iperf)

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Why I cannot achieve more bandwidth with less streams? Is there a CT ? I don’t know !

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

The other TCP applications behave very similarly in same environment Conclusion: The other TCP applications behave very similarly in same environment But not all applications are so aggressive as Iperf !

Used tools for BW estimations Pathrate Pathload Iperf Netest-2 Incite BWe UDPmon

Short characteristic of methods Patharate + accurate - not very reliable, long run time Pathload + accurate, fast, light - limited range of operation ( < 155 Mbps)

Small comparisons

Short characteristic of methods Iperf + reliable - must be configured to use full BW and postprocessed - heavy load of lines during operation Netest-2 + reliable, good reports - must be configured to use full BW, - accurate (different timing scheme)

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

INCITE: Edge-based Traffic Processing and Service Inference for High-Performance Networks Richard Baraniuk, Rice University; Les Cottrell, SLAC; Wu-chun Feng, LANL Incite BW estimator

P2 P1 BWe ~f(VQ) =f(dTR) dTR <0,RTT> dTS (20 ms) Time P1 P2 P1 P2 dtp2 dTR RTT P1 P2 dtp1

Plop – linux (LANL) 2x 22 Mbit, 4x24 Mbit, 8x24Mbit

dt ~ F(VQ) ~ F(Internet) freq= volume/dt volume ~ pkt_length*8 dt ~ F(VQ) ~ F(Internet) BWe=Mean(freq) Open Problem What is pkt_length?

Virtual queue All “my test traffic” share same queue with outside CT (It means that delay caused to my pkts by VQ is not dependent only on my pkt_lengths !) The accuracy is dependent on knowlegde of packet distribution on particular path. The average packet length ~1000 bytes gives reasonable results. Virtual queue

Filtering & Averaging ANL Current/Average CERN Current/Average

Good Morning !

KPNQest UK-problems

Load balancing on one path router

Incite CT detection CT = f (dTR) INCITE: Edge-based Traffic Processing and Service Inference for High-Performance Networks Richard Baraniuk, Rice University; Les Cottrell, SLAC; Wu-chun Feng, LANL Incite CT detection CT = f (dTR)

MF-CT Features and benefits No need access to routers ! Current monitoring systems for Load of traffic are based on SNMP or Flows (needs access to routers) Low cost: Allows permanent monitoring (20 pkts/sec ~ overhead 10 Kbytes/sec) Can be used as data provider for ABW prediction (ABW=BW-CT) We have 2 data points of CT per second !! Weak point for common use MATLAB code

MF-CT verification model UDP echo SNMP counter CERN SNMP counter internet SNMP counter SNMP counter IN2P3 SLAC SNMP counter MF-CT Simulator UDP echo