1 Capacity Dimensioning Based on Traffic Measurement in the Internet Kazumine Osaka University Shingo Ata (Osaka City Univ.)

Slides:



Advertisements
Similar presentations
Martin Suchara, Ryan Witt, Bartek Wydrowski California Institute of Technology Pasadena, U.S.A. TCP MaxNet Implementation and Experiments on the WAN in.
Advertisements

Congestion Control and Fairness Models Nick Feamster CS 4251 Computer Networking II Spring 2008.
Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.
Computer Networks Performance Metrics Computer Networks Term B10.
Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
CS640: Introduction to Computer Networks Mozafar Bag-Mohammadi Lecture 3 TCP Congestion Control.
Restricted Slow-Start for TCP William Allcock 1,2, Sanjay Hegde 3 and Rajkumar Kettimuthu 1,2 1 Argonne National Laboratory 2 The University of Chicago.
Lecture 3  A round up of the most important basics I haven’t covered yet.  A round up of some of the (many) things I am missing out of this course (ATM,
Performance Improvement of TCP in Wireless Cellular Network Based on Acknowledgement Control Osaka University Masahiro Miyoshi, Masashi Sugano, Masayuki.
1 Modeling and Emulation of Internet Paths Pramod Sanaga, Jonathon Duerig, Robert Ricci, Jay Lepreau University of Utah.
Internet Traffic Patterns Learning outcomes –Be aware of how information is transmitted on the Internet –Understand the concept of Internet traffic –Identify.
Modeling TCP Throughput Jeng Lung WebTP Meeting 11/1/99.
1 Modeling and Taming Parallel TCP on the Wide Area Network Dong Lu,Yi Qiao Peter Dinda, Fabian Bustamante Department of Computer Science Northwestern.
Computer Networks: Performance Measures1 Computer Network Performance Measures.
Available bandwidth measurement as simple as running wget D. Antoniades, M. Athanatos, A. Papadogiannakis, P. Markatos Institute of Computer Science (ICS),
1 Design study for multimedia transport protocol in heterogeneous networks Haitao Wu; Qian Zhang; Wenwu Zhu; Communications, ICC '03. IEEE International.
On Efficient On-line Grouping of Flows with Shared Bottlenecks at Loaded Servers by O. Younis and S. Fahmy Department of Computer Sciences, Purdue University.
1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.
Bandwidth Measurements Jeng Lung WebTP Meeting 10/25/99.
1 K. Salah Module 6.1: TCP Flow and Congestion Control Connection establishment & Termination Flow Control Congestion Control QoS.
TCP Congestion Control
Network Measurement Bandwidth Analysis. Why measure bandwidth? Network congestion has increased tremendously. Network congestion has increased tremendously.
PCP: Efficient Endpoint Congestion Control To appear in NSDI, 2006 Thomas Anderson, Andrew Collins, Arvind Krishnamurthy and John Zahorjan University of.
Bandwidth Estimation: Metrics Mesurement Techniques and Tools By Ravi Prasad, Constantinos Dovrolis, Margaret Murray and Kc Claffy IEEE Network, Nov/Dec.
All rights reserved © 2006, Alcatel Accelerating TCP Traffic on Broadband Access Networks  Ing-Jyh Tsang 
Bottleneck Bandwidth Estimation Instructor: Dr. Aggarwal Present by: Jason Wei.
A Machine Learning-based Approach for Estimating Available Bandwidth Ling-Jyh Chen 1, Cheng-Fu Chou 2 and Bo-Chun Wang 2 1 Academia Sinica 2 National Taiwan.
Advanced Network Architecture Research Group 2001/11/149 th International Conference on Network Protocols Scalable Socket Buffer Tuning for High-Performance.
Chapter 4. After completion of this chapter, you should be able to: Explain “what is the Internet? And how we connect to the Internet using an ISP. Explain.
Alok Shriram and Jasleen Kaur Presented by Moonyoung Chung Empirical Evaluation of Techniques for Measuring Available Bandwidth.
TCP Enhancement for Random Loss Jiang Wu Computer Science Lakehead University.
These materials are licensed under the Creative Commons Attribution-Noncommercial 3.0 Unported license (
POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 2. Network Monitoring Metrics.
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
Computer Networks Performance Metrics. Performance Metrics Outline Generic Performance Metrics Network performance Measures Components of Hop and End-to-End.
3: Transport Layer3b-1 TCP: Overview RFCs: 793, 1122, 1323, 2018, 2581 r full duplex data: m bi-directional data flow in same connection m MSS: maximum.
Estimating Bandwidth of Mobile Users Sept 2003 Rohit Kapoor CSD, UCLA.
TCP1 Transmission Control Protocol (TCP). TCP2 Outline Transmission Control Protocol.
Transport over Wireless Networks Myungchul Kim
I-Path : Network Transparency Project Shigeki Goto* Akihiro Shimoda*, Ichiro Murase* Dai Mochinaga**, and Katsushi Kobayashi*** 1 * Waseda University **
workshop eugene, oregon Network Performance Metrics Unix/IP Preparation Course July 19, 2009 Eugene, Oregon, USA Original Materials.
SProbe: Another Tool for Measuring Bottleneck Link Bandwidth Stefan Saroiu P. Krishna Gummadi Steven Gribble University of Washington.
27th, Nov 2001 GLOBECOM /16 Analysis of Dynamic Behaviors of Many TCP Connections Sharing Tail-Drop / RED Routers Go Hasegawa Osaka University, Japan.
Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.
Rate Control Rate control tunes the packet sending rate. No more than one packet can be sent during each packet sending period. Additive Increase: Every.
TCP Trunking: Design, Implementation and Performance H.T. Kung and S. Y. Wang.
Deadline-based Resource Management for Information- Centric Networks Somaya Arianfar, Pasi Sarolahti, Jörg Ott Aalto University, Department of Communications.
CS640: Introduction to Computer Networks Aditya Akella Lecture 15 TCP – III Reliability and Implementation Issues.
2010 kigali, rwanda Network Performance Metrics Unix/IP Preparation Course May 23, 2010 Kigali, Rwanda Original Materials by.
Development of a QoE Model Himadeepa Karlapudi 03/07/03.
© Janice Regan, CMPT 128, CMPT 371 Data Communications and Networking Congestion Control 0.
9/29/04 GGF Random Thoughts on Application Performance and Network Characteristics Distributed Systems Department Lawrence Berkeley National Laboratory.
Access Link Capacity Monitoring with TFRC Probe Ling-Jyh Chen, Tony Sun, Dan Xu, M. Y. Sanadidi, Mario Gerla Computer Science Department, University of.
A special acknowledge goes to J.F Kurose and K.W. Ross Some of the slides used in this lecture are adapted from their original slides that accompany the.
Bandwidth estimation: metrics, measurement techniques, and tools Presenter: Yuhang Wang.
Sandeep Kakumanu Smita Vemulapalli Gnan
Bandwidth Estimation: Metrics Measurement Techniques and Tools
Window Control Adjust transmission rate by changing Window Size
The Transport Layer (TCP)
Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting
Generalizing The Network Performance Interference Problem
TCP Congestion Control
Amogh Dhamdhere, Hao Jiang and Constantinos Dovrolis
ECE 599: Multimedia Networking Thinh Nguyen
Measurement and Classification of Out-of-Sequence Packets in a Tier-1 IP Backbone Sharad Jaiswal, Gianluca Iannaccone, Member, IEEE, Christophe Diot, Jim.
Modeling and Taming Parallel TCP on the Wide Area Network
TCP Congestion Control
Network Performance Definitions
Congestion Control (from Chapter 05)
Presentation transcript:

1 Capacity Dimensioning Based on Traffic Measurement in the Internet Kazumine Osaka University Shingo Ata (Osaka City Univ.) Masayuki Murata (Osaka Univ.) Now in Fujitsu Laboratories Kazumine Osaka University Shingo Ata (Osaka City Univ.) Masayuki Murata (Osaka Univ.) Now in Fujitsu Laboratories * *

2 Measuring Networks ISPs need to offer stable QoS (Quality of Service) for redesigning current ISP’s network, end-to-end network characteristics is needed propose network planning framework based on current end-to-end network characteristics propose network planning framework based on current end-to-end network characteristics Important QoS metric is measured only by end users e.g. Web document download time measurement from end user

3 Capacity Dimensioning Active Traffic Measurement Analysis of the measurement result Internet User Server Bottleneck Link 1. find the bottleneck area between end hosts 2. measure the bottleneck link utilization 3. propose the design framework for determining link capacity Network Capacity Dimensioning

4 Contents Capacity Dimensioning 1. Measurement Based Identification Method of Performance Bottleneck 2. Measurement Method of Bottleneck Link Utilization 3. Capacity Dimensioning Based on Traffic Measurement Conclusion

5 Bottleneck Classification Three kinds of bottlenecks in the end-to-end communication Sender Side Configuration collect information about TCP communication User Target Path Server Receiver Side Configuration (Buffer size) Network Condition (Congestion)

6 How to Detect Each Bottleneck? TCP throughput (estimated value)* take no thought of sender side configuration * J.Padhye, V.Firoiu, D.Toesley.,and J.Kurose, “Modeling TCP throughput: A simple model and its empirical validation”, Proceedings of ACM SIGCOMM’98, pp , September expected window size of TCP connection actual throughput << estimated throughput ① sender side configuration ② check buffer size (receiver side) b : duplicate ACK number p : packet loss rate ③ check network congestion (network condition) congested router queue and/or drop packets large RTT and high packet loss rate * bottleneck is sender! buffer size is insufficient! network is congested!

7 - buffer size is insufficient - when buffer size is increased, TCP throughput becomes high Bottleneck Classification Process measure RTT, Packet Loss Rate, and TCP throughput check socket buffer size of receiver host repeat measurement, changing socket buffer size - sufficient size of buffer - high packet loss rate - large RTT - no relationship between buffer size and throughput - actual throughput << estimated throughput ① sender side configuration ② buffer size (receiver side) ③ network congestion (network condition)

8 Server 2Server 1 Classification Experimens in the Internet Estimated throughput Actual throughput No special feature buffer increase ⇒ Throughput increase Larger than Actual throughput Buffer size is insufficient Network ConditionReceiver SideSender Side Packet Loss Rate Round Trip Time Large RTT High Packet Loss Rate For each bottleneck, their characteristics can be found For each bottleneck, their characteristics can be found Server 3

9 Contents Capacity Dimensioning 1. Measurement Based Identification Method of Performance Bottleneck 2. Measurement Method of Bottleneck Link Utilization 3. Capacity Dimensioning Based on Traffic Measurement Conclusion

10 Estimate Link Utilization measure and estimate capacity of bottleneck link Pathchar, Pchar, Clink, etc. c c r r b b r r b b u u c c   estimate bottleneck link utilization measure the amount of cross traffic passing through the bottleneck link

11 need these items! Estimate Throughput of Cross Traffic assume probe packets are queued at router n cross traffic c r probe packet Bottleneck Router n Router n+1 Bottleneck Link n+1 l n l sb lb llr nnc   1 the amount of cross traffic s :size of probe packet b :capacity of link n+1 throughput of cross traffic n n c l sb l r    1 client host send ICMP ECHO packet continuously router n and n+1 return reply packets observe returned packet and calculate interval of arrival time client host send ICMP ECHO packet continuously router n and n+1 return reply packets observe returned packet and calculate interval of arrival time n n l l n+1 l l

12 Estimation Results of Link Utilization measure bottleneck link between two universities Estimation error is under 10% in link utilization link utilization (cross traffic) estimation 15.9% (0.95 Mbps)22.8% 27.9% (1.7 Mbps)27.8% 38.5% (2.3 Mbps)32.1% 69.5% (4.1 Mbps)60.3% 77.6% (4.6Mbps)81.6% Bottleneck link 6Mbps Osaka City Univ. Osaka Univ. Measurement Host Router n Router n+1 Target Host

13 Contents Capacity Dimensioning 1. Measurement Based Identification Method of Performance Bottleneck 2. Measurement Method of Bottleneck Link Utilization 3. Capacity Dimensioning Based on Traffic Measurement Conclusion

14 Capacity Dimensioning from user’s viewpoint fulfill a demand of user Designing network for each bottleneck 1. sender or receiver side configuration 2. network configuration (link bandwidth) based on end-to-end network characteristics propose a design framework

15 Capacity Dimensioning 1: Bottleneck Resides in the End Host Sender side configuration remove the cause of bottleneck Ex. configure rate shaping, upgrade hardwares, etc. Receiver side configuration (buffer size) increase buffer size to f f RTT t t f f ' ' ' '   t t ' ' : throughput which user needs : Round Trip Time RTT ' ' Bottleneck may shift to another area need to upgrade link capacity?

16 Designing Link Capacity: Bottleneck Resides in the End Host most thin available bandwidth link time cross traffic user’s traffic C C t t C C A A       t t C C ) ) 1 1 ( (       link utilization t t   t t t t A A C C         ' ' lower bound of new link capacity lower bound of new link capacity link capacity determine new link capacity C : link capacity A : throughput of cross traffic t : throughput of user ’ s traffic

17 user traffic both of the user and cross traffic Capacity Dimensioning 2: Bottleneck Resides in Network time send data time cross traffic user’s traffic t time cross traffic time cross traffic user’s traffic send data cross traffic A link capacity same as the former capacity decision t t AC     ' predict amount of future cross traffic upgrade cross traffic may increase

18 Designing Link Capacity: Bottleneck Resides in Network assume and simplify the situation bottleneck router is M/M/1 queueing system current link capacity C will increase to C’ =a C choose following  user traffic will increase to t’ a a T T bp t t T T     ' ' 1 1   T : packet service time at bottleneck router b : the number of arrival packets notified one ACK p : packet loss rate T a : constant (=RTT-T) T : packet service time at bottleneck router b : the number of arrival packets notified one ACK p : packet loss rate T a : constant (=RTT-T)

19 Conclusion Capacity dimensioning based on traffic measurement in the Internet Identification method of performance bottleneck classify into 3 kinds of bottlenecks Measurement method of link utilization focused on the bottleneck link Capacity dimensioning Modeling the router as an M/M/1 queueing system

20 The End

21 Available Bandwidth Existing Method to Estimate Link Utilization Bottleneck link packet pair packet stream probe packet affects measurement result but not take into consideration only focus on the end-to-end performance User Server - capacity of bottleneck link - available bandwidth in end- to-end communication