Network Tomography through End- End Multicast Measurements D. Towsley U. Massachusetts collaborators: R. Caceres, N. Duffield, F. Lo Presti (AT&T) T. Bu,

Slides:



Advertisements
Similar presentations
Collaborators: Mark Coates, Rui Castro, Ryan King, Mike Rabbat, Yolanda Tsang, Vinay Ribeiro, Shri Sarvotham, Rolf Reidi Network Bandwidth Estimation and.
Advertisements

pathChirp Efficient Available Bandwidth Estimation
Path Optimization in Computer Networks Roman Ciloci.
1 Estimating Shared Congestion Among Internet Paths Weidong Cui, Sridhar Machiraju Randy H. Katz, Ion Stoica Electrical Engineering and Computer Science.
Lo Presti 1 Network Tomography Francesco Lo Presti Dipartimento di Informatica - Università dell’Aquila.
Distributed Algorithms for Secure Multipath Routing
Trajectory Sampling for Direct Traffic Observation Matthias Grossglauser joint work with Nick Duffield AT&T Labs – Research.
1 Ossama Younis and Sonia Fahmy Department of Computer Sciences Purdue University For slides, technical report, and implementation, please see:
Passive Inference of Path Correlation Lili Wang, James N. Griffioen, Kenneth L. Calvert, Sherlia Shi Laboratory for Advanced Networking University of Kentucky.
Traffic Engineering With Traditional IP Routing Protocols
 Don Towsley 2000 Network Tomography for the Internet: Open Problems D. Towsley U. Massachusetts.
Server-based Inference of Internet Performance V. N. Padmanabhan, L. Qiu, and H. Wang.
Network Tomography CS 552 Richard Martin. What is Network Tomography? Derive internal state of the network from: –external measurements (probes) –Some.
1 A General Introduction to Tomography & Link Delay Inference with EM Algorithm Presented by Joe, Wenjie Jiang 21/02/2004.
Network Tomography CS 552 Richard Martin. What is Network Tomography? Derive internal state of the network from: –external measurements (probes) –Some.
Maximum Likelihood Network Topology Identification Mark Coates McGill University Robert Nowak Rui Castro Rice University DYNAMICS May 5 th,2003.
1 Network Tomography Venkat Padmanabhan Lili Qiu MSR Tab Meeting 22 Oct 2001.
Measurement and Analysis of Link Quality in Wireless Networks: An Application Perspective V. Kolar, Saquib Razak, P. Mahonen, N. Abu-Ghazaleh Carnegie.
Predictive End-to-End Reservations via A Hierarchical Clearing House Endeavour Retreat June 19-21, 2000 Chen-Nee Chuah (Advisor: Professor Randy H. Katz)
Network Tomography from Multiple Senders Rob Nowak Thursday, January 15, 2004 In collaboration with Mark Coates and Michael Rabbat.
Monitoring Persistently Congested Internet Links Leiwen (Karl) Deng Aleksandar Kuzmanovic Northwestern University
1 End-to-End Detection of Shared Bottlenecks Sridhar Machiraju and Weidong Cui Sahara Winter Retreat 2003.
Detecting Shared Congestion of Flows Via End- to-end Measurement (and other inference problems) Dan Rubenstein joint work with Jim Kurose and Don Towsley.
FTDCS 2003 Network Tomography based Unresponsive Flow Detection and Control Authors Ahsan Habib, Bharat Bhragava Presenter Mohamed.
Network Monitoring for Internet Traffic Engineering Jennifer Rexford AT&T Labs – Research Florham Park, NJ 07932
Network Tomography (A presentation for STAT 593E) Mingyan Li Radha Sampigethaya.
Yao Zhao 1, Yan Chen 1, David Bindel 2 Towards Unbiased End-to-End Diagnosis 1.Lab for Internet & Security Tech, Northwestern Univ 2.EECS department, UC.
Ningning HuCarnegie Mellon University1 A Measurement Study of Internet Bottlenecks Ningning Hu (CMU) Joint work with Li Erran Li (Bell Lab) Zhuoqing Morley.
Detecting Shared Congestion of Flows Via End- to-end Measurement Dan Rubenstein Jim Kurose Don Towsley Computer Networks Research Group.
1 Network Tomography Don Towsley UMass-Amherst. 2 Network Tomography - I Goal: obtain detailed picture of a network/internet from end-to-end views  infer.
Not All Microseconds are Equal: Fine-Grained Per-Flow Measurements with Reference Latency Interpolation Myungjin Lee †, Nick Duffield‡, Ramana Rao Kompella†
MATE: MPLS Adaptive Traffic Engineering Anwar Elwalid, et. al. IEEE INFOCOM 2001.
The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.
Prentice HallHigh Performance TCP/IP Networking, Hassan-Jain Chapter 3 Performance Measurement of TCP/IP Networks.
Particle Filtering in Network Tomography
Parameter Estimation and Performance Analysis of Several Network Applications Sara Alouf Ph.D. defense - November 8, 2002 Advisor: Philippe Nain.
CS790 Technical Writing for Computer Scientists Summer 2007 How to Write Short Project Descriptions Sue Moon KAIST.
2005/10/211 A Survey on Physical Network Topology Estimation October 21, 2005 Chikayama-Taura Lab. Tatsuya Shirai.
Multiple Source, Multiple Destination Network Tomography Michael Rabbat IEEE Infocom, Hong Kong Wednesday, March 10, 2004 Co-Authors: Mark Coates and Robert.
Advanced Networking Lab. Given two IP addresses, the estimation algorithm for the path and latency between them is as follows: Step 1: Map IP addresses.
Measurement and Modeling of Packet Loss in the Internet Maya Yajnik.
1 Passive Network Tomography Using Bayesian Inference Lili Qiu Joint work with Venkata N. Padmanabhan and Helen J. Wang Microsoft Research Internet Measurement.
Hung X. Nguyen and Matthew Roughan The University of Adelaide, Australia SAIL: Statistically Accurate Internet Loss Measurements.
Comparison of Public End-to-End Bandwidth Estimation tools on High-Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
Comparison of Public End-to-End Bandwidth Estimation tools on High- Speed Links Alok Shriram, Margaret Murray, Young Hyun, Nevil Brownlee, Andre Broido,
CS551: End-to-End Packet Dynamics Paxon’99 Christos Papadopoulos (
1 Flow and Congestion Control for Reliable Multicast Communication In Wide-Area Networks Supratik Bhattacharyya Department of Computer Science University.
Internet Performance Measurements and Measurement Techniques Jim Kurose Department of Computer Science University of Massachusetts/Amherst
Detecting the Long-Range Dependence in the Internet Traffic with Packet Trains Péter Hága, Gábor Vattay Department Of Physics of Complex Systems Eötvös.
Multiplicative Wavelet Traffic Model and pathChirp: Efficient Available Bandwidth Estimation Vinay Ribeiro.
KAIS T High-throughput multicast routing metrics in wireless mesh networks Sabyasachi Roy, Dimitrios Koutsonikolas, Saumitra Das, and Y. Charlie Hu ICDCS.
N. Hu (CMU)L. Li (Bell labs) Z. M. Mao. (U. Michigan) P. Steenkiste (CMU) J. Wang (AT&T) Infocom 2005 Presented By Mohammad Malli PhD student seminar Planete.
PathChirp Spatio-Temporal Available Bandwidth Estimation Vinay Ribeiro Rolf Riedi, Richard Baraniuk Rice University.
Flow and Congestion Control for Reliable Multicast Communication In Wide-Area Networks Supratik Bhattacharyya Department of Computer Science University.
1 Network Tomography Using Passive End-to-End Measurements Venkata N. Padmanabhan Lili Qiu Helen J. Wang Microsoft Research DIMACS’2002.
Measurement in the Internet Measurement in the Internet Paul Barford University of Wisconsin - Madison Spring, 2001.
Masking Failures Using Anti Entropy and Redundant Independent Paths Rebecca Braynard and Amin Vahdat Internet Systems and Storage Group Duke University.
Development of a QoE Model Himadeepa Karlapudi 03/07/03.
Precision Measurements with the EVERGROW Traffic Observatory Péter Hága István Csabai.
Measurement and Modelling of the Temporal Dependence in Packet loss Maya Yajnik, Sue Moon, Jim Kurose, Don Towsley Department of Computer Science University.
PathChirp Efficient Available Bandwidth Estimation Vinay Ribeiro Rice University Rolf Riedi Rich Baraniuk.
Lo Presti 1 Ne X tworking’03 June 23-25,2003, Chania, Crete, Greece The First COST-IST(EU)-NSF(USA) Workshop on EXCHANGES & TRENDS IN N ETWORKING Network.
1 Network Tomography Using Passive End-to-End Measurements Lili Qiu Joint work with Venkata N. Padmanabhan and Helen J. Wang.
March 22, 2010IETF 77 – Anaheim, USA1 A method for IP multicast performance monitoring draft-cociglio-mboned-multicast-pm-00 Alessandro Capello Luca Castaldelli.
Queuing Analysis of Tree-Based LRD Traffic Models Vinay J. Ribeiro R. Riedi, M. Crouse, R. Baraniuk.
Monitoring Persistently Congested Internet Links
A Study of Group-Tree Matching in Large Scale Group Communications
Chapter-5 Traffic Engineering.
pathChirp Efficient Available Bandwidth Estimation
pathChirp Efficient Available Bandwidth Estimation
Presentation transcript:

Network Tomography through End- End Multicast Measurements D. Towsley U. Massachusetts collaborators: R. Caceres, N. Duffield, F. Lo Presti (AT&T) T. Bu, J. Horowitz, J. Kurose, S. Moon (UMass) V. Paxson (ACIRI)

Network Tomography Goal: obtain detailed picture of a network/internet from end-to-end views ? infrastructure Avg. Delay cross section view LOSS % cross section view LOSS % Avg. Delay cross section view composition of views LOSS % Delay ?

Ingredients o end-end measurement methodology, determine internal behavior from one view, composition from multiple views, view layout o measurement infrastructure, hardware platforms, software –experiment setup –trace collection –analysis and display

MINC (Multicast Inference of Network Characteristics Point to point measurements (snapshots) o good for end-end performance metrics but not link behavior but not link behavior Why? lack of correlation  use multicast end-end measurements

Basic Idea behind MINC o multicast probes o correlated performance observed by receivers o exploit correlation to estimate link behavior, loss rates, delay statistics, bottleneck bandwidth, available bandwidth, topology receivers source 11  3  ,  ,   ^^^

Inference Methodology (Losses) o model, known multicast tree topology T =(V,E) –mtrace  independent Bernoulli processes across all links with unknown loss prob.  k for link k  V o methodology  maximum likelihood estimates for {  k } –asymptotic consistency –optimality –robust to relaxation of independence assumption –validated against simulation (2-8 rcvrs), measurements

Scatter Plots probe loss vs inferred loss background loss vs inf. loss probe loss background loss inferred loss o good agreement between inferred and probe loss o increased variability between probe and background loss o 2-8 rcvrs, TCP/UDP background traffic o deterministic and Poisson probes

MINC: Mbone Results o experiments with 2- 8 receivers (100ms probes) summer ‘98 o topology determined using mtrace o validation against mtrace atlanta cambridge SF saona erlang WO LA edgar rhea alps excalibur conviction kentucky

Extensions: Link Delays o link delay distribution, D k integer valued, k  V, independent between links, estimator is extension of MLE for loss o estimator performance (23 receiver tree) Delay (ms) compl. of CDF... Delay (ms) complement of CDF... o delay variance (simpler estimators)

Extension: Topology Identification o given function f of node k in tree, increasing along path from root, can estimate from measurements o examples, Prob[probe lost on path from root 0 to k], average delay from root to node k, delay variance from root to node k o recursively build tree by grouping nodes, to maximize function f

Open Problems o relation to unicast o how to compose multiple views o how to layout multiple views, reduce number of trees?, reduce probe traffic? o integrate existing tools (mtrace,...)

Infrastructure o hardware platforms, National Internet Measurement Infrastructure (NIMI): platforms, Surveyor? 50+ platforms, routers with added functionality? o software infrastructure, NIMI (zing, natalie) generates traces, RTCP for performance reports, MRM (multicast route monitor), MINT for analysis and visualization

Summary o design for network tomography based on end2end measurements, multicast to introduce correlation, losses, delays, topology discovery o efficient estimators exist for link metrics o several possible infrastructures, NIMI + RTCP + MINT