1 Network Topology Measurement Yang Chen CS 8803.

Slides:



Advertisements
Similar presentations
University of Nevada, Reno Router-level Internet Topology Mapping CS790 Presentation Modified from Dr. Gunes slides by Talha OZ.
Advertisements

Measurement: Techniques, Strategies, and Pitfalls Nick Feamster CS 7260 February 7, 2007.
User-level Internet Path Diagnosis Ratul Mahajan, Neil Spring, David Wetherall and Thomas Anderson Designed by Yao Zhao.
By Hitesh Ballani, Paul Francis, Xinyang Zhang Slides by Benson Luk for CS 217B.
1 Internet Path Inflation Xenofontas Dimitropoulos.
Topology Generation Suat Mercan. 2 Outline Motivation Topology Characterization Levels of Topology Modeling Techniques Types of Topology Generators.
Chapter 4: Network Layer 4. 1 Introduction 4.2 Virtual circuit and datagram networks 4.3 What’s inside a router 4.4 IP: Internet Protocol –Datagram format.
Detecting Traffic Differentiation in Backbone ISPs with NetPolice Ying Zhang Zhuoqing Morley Mao Ming Zhang.
Internet Topology Mapping
Router-level Internet Topology Mapping By Talha OZ.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.
1 A survey of Internet Topology Discovery. 2 Outline Motivations Internet topology IP Interface Level Router Level AS Level PoP Level.
1 Path Splicing Author: Murtaza Motiwala, Megan Elmore, Nick Feamster and Santosh Vempala Publisher: SIGCOMM’08 Presenter: Hsin-Mao Chen Date:2009/12/09.
1 Traffic Engineering for ISP Networks Jennifer Rexford IP Network Management and Performance AT&T Labs - Research; Florham Park, NJ
CSE331: Introduction to Networks and Security Lecture 9 Fall 2002.
On Power-Law Relationships of the Internet Topology CSCI 780, Fall 2005.
Delayed Internet Routing Convergence Craig Labovitz, Abha Ahuja, Abhijit Bose, Farham Jahanian Presented By Harpal Singh Bassali.
Heuristics for Internet Map Discovery Ramesh Govindan USC/Information Sciences Institute Joint work with Hongsuda Tangmunarunkit.
Dynamics of Hot-Potato Routing in IP Networks Renata Teixeira (UC San Diego) with Aman Shaikh (AT&T), Tim Griffin(Intel),
User-level Internet Path Diagnosis R. Mahajan, N. Spring, D. Wetherall and T. Anderson.
Network Monitoring for Internet Traffic Engineering Jennifer Rexford AT&T Labs – Research Florham Park, NJ 07932
Internet Routing (COS 598A) Today: Interdomain Topology Jennifer Rexford Tuesdays/Thursdays 11:00am-12:20pm.
1 Deriving Traffic Demands for Operational IP Networks: Methodology and Experience Anja Feldmann*, Albert Greenberg, Carsten Lund, Nick Reingold, Jennifer.
Heuristics for Internet Map Discovery R. Govindan, H. Tangmunarunkit Presented by Zach Schneirov.
Network Measurement Bandwidth Analysis. Why measure bandwidth? Network congestion has increased tremendously. Network congestion has increased tremendously.
Measuring ISP topologies with Rocketfuel Ratul Mahajan Neil Spring David Wetherall University of Washington ACM SIGCOMM 2002.
IPlane Status Harsha V. Madhyastha University of California San Diego.
INTERNET TOPOLOGY MAPPING INTERNET MAPPING PROBING OVERHEAD MINIMIZATION  Intra- and inter-monitor redundancy reduction IBRAHIM ETHEM COSKUN University.
CRIO: Scaling IP Routing with the Core Router-Integrated Overlay Xinyang (Joy) Zhang Paul Francis Jia Wang Kaoru Yoshida.
TRACENET M.Engin TozalKamil Sarac The University of Texas at Dallas.
Network Sensitivity to Hot-Potato Disruptions Renata Teixeira (UC San Diego) with Aman Shaikh (AT&T), Tim Griffin(Intel),
1 Meeyoung Cha, Sue Moon, Chong-Dae Park Aman Shaikh Placing Relay Nodes for Intra-Domain Path Diversity To appear in IEEE INFOCOM 2006.
Measuring ISP Toplogies with Rocketfuel Neil Spring, Ratul Mahajan, and David Wetherall Presented By: David Deschenes March 25, 2003.
Authors Renata Teixeira, Aman Shaikh and Jennifer Rexford(AT&T), Tim Griffin(Intel) Presenter : Farrukh Shahzad.
Courtesy: Nick McKeown, Stanford More on IP and Packet Forwarding Tahir Azim.
Quantifying the Causes of Path Inflation Neil Spring, Ratul Mahajan, and Thomas Anderson Presented by Luv Kohli COMP November 24, 2003.
FIDEMO 2009, Nov. 18 A Step Towards a Planet-scale Measurements Retrieval Infrastructure In this work, we propose to design an end-to-end path and delay.
Traffic Engineering for ISP Networks Jennifer Rexford Internet and Networking Systems AT&T Labs - Research; Florham Park, NJ
CSC 600 Internetworking with TCP/IP Unit 8: IP Multicasting (Ch. 17) Dr. Cheer-Sun Yang Spring 2001.
Issues with Inferring Internet Topological Attributes Lisa Amini ab, Anees Shaikh a, Henning Schulzrinne b a IBM T.J. Watson Research Center b Columbia.
On AS-Level Path Inference Jia Wang (AT&T Labs Research) Joint work with Z. Morley Mao (University of Michigan, Ann Arbor) Lili Qiu (University of Texas,
1 GIRO: Geographically Informed Inter-domain Routing Ricardo Oliveira, Mohit Lad, Beichuan Zhang, Lixia Zhang.
Advanced Networking Lab. Given two IP addresses, the estimation algorithm for the path and latency between them is as follows: Step 1: Map IP addresses.
TDTS21: Advanced Networking Lecture 7: Internet topology Based on slides from P. Gill and D. Choffnes Revised 2015 by N. Carlsson.
A Routing Underlay for Overlay Networks Akihiro Nakao Larry Peterson Andy Bavier SIGCOMM’03 Reviewer: Jing lu.
How DNS Misnaming Distorts Internet Topology Mapping Ming Zhang, Microsoft Research Yaoping Ruan, IBM Research Vivek Pai, Jennifer Rexford, Princeton University.
Chelebi: Subnet-level Internet Mapper Mehmet H. Gunes University of Nevada, Reno.
Detection of Routing Loops and Analysis of Its Causes Sue Moon Dept. of Computer Science KAIST Joint work with Urs Hengartner, Ashwin Sridharan, Richard.
April 4th, 2002George Wai Wong1 Deriving IP Traffic Demands for an ISP Backbone Network Prepared for EECE565 – Data Communications.
TCOM 509 – Internet Protocols (TCP/IP) Lecture 06_a Routing Protocols: RIP, OSPF, BGP Instructor: Dr. Li-Chuan Chen Date: 10/06/2003 Based in part upon.
Eliminating Packet Loss Caused by BGP Convergence Nate Kushman Srikanth Kandula, Dina Katabi, and Bruce Maggs.
CSE534- Fundamentals of Computer Networking Lecture 12-13: Internet Connectivity + IXPs (The Underbelly of the Internet) Based on slides by D. Choffnes.
Advanced Technology Laboratories 8 December 2000 page 1 Characterization of Traffic at a Backbone POP Nina Taft Supratik Bhattacharyya Jorjeta Jetcheva.
Routing Algorithms and IP Addressing Routing Algorithms must be ▪ Correctness ▪ Simplicity ▪ Robustness ▪ Stability ▪ Fairness ▪ Optimality.
INTERNET MEASUREMENT INTERNET MAPPING OVERHEAD MINIMIZATION  Intra- and inter-monitor redundancy reduction IBRAHIM ETHEM COSKUN University of Nevada,
University of Nevada, Reno Resolving Anonymous Routers Hakan KARDES CS 790g Complex Networks.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—6-1 Scaling Service Provider Networks Scaling IGP and BGP in Service Provider Networks.
1 Effective Diagnosis of Routing Disruptions from End Systems Ying Zhang Z. Morley Mao Ming Zhang.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Placing Relay Nodes for Intra-Domain Path Diversity Meeyoung Cha Sue Moon Chong-Dae Park Aman Shaikh Proc. of IEEE INFOCOM 2006 Speaker 游鎮鴻.
PATH DIVERSITY WITH FORWARD ERROR CORRECTION SYSTEM FOR PACKET SWITCHED NETWORKS Thinh Nguyen and Avideh Zakhor IEEE INFOCOM 2003.
Topology Discovery Using an Address Prefix Stopping Rule Benoit Donnet Joint work with Timur Friedman Eunice 2005 – Madrid (Spain)
1 On the Impact of Route Monitor Selection Ying Zhang* Zheng Zhang # Z. Morley Mao* Y. Charlie Hu # Bruce M. Maggs ^ University of Michigan* Purdue University.
A CIDR Prefix Stopping Rule for Topology Discovery Benoit Donnet joint work with Timur Friedman Algotel 2005 – Presqu'Ile de Giens.
RESOLVING IP ALIASES USING DISTRIBUTED SYSTEMS
Measured Impact of Crooked Traceroute
Delivery and Routing of IP Packets
Multipath tracing with Paris Traceroute
Lecture 26: Internet Topology CS 765: Complex Networks.
An Empirical Evaluation of Wide-Area Internet Bottlenecks
Presentation transcript:

1 Network Topology Measurement Yang Chen CS 8803

2 Outline Big Picture ISP Topology Measurement Statistical Results Problems & Solutions

3 Heuristics for Internet Map Discovery R. Govindan and H. Tangmunarunkit INFOCOM 2000

4 Why do we need the topology? Understand the macroscopic properties of the Internet physical structure Network management Topology-aware algorithms Simulation and topology generation tools

5 On-going efforts CAIDA SkitterRouter View

6 Fundamental: traceroute Prober sends packets with successively increased TTL. A router responds with ICMP time exceeded when the probe is with TTL=1

7 Fundamental: traceroute Geographic info can help on building up the topology. * Data from

8 Fundamental: Tree => map 1)Source routing 2)Multiple Vantage points

9 Address scan space BGP tables Route Table Database Informed Random Address Probing –A response from some IP address is considered as a sign that some prefix P of A must contain addressable nodes; –If P is an addressable prefix, the neighboring prefixes of P are also considered as possibly addressable. (128.8/16 and /16 are neighbors of 128.9/16)

10 Some results 150,000 interfaces and nearly 200,000 links Findings related to source route –Simulation demonstrated that In relatively sparse random networks, a few source route capable nodes (< 5%) are sufficient to discover 90% of the links. In fact, there are 8% routers support source route. –Source route discovered links do not skew the qualitative conclusion on the network statistics.

11 For example: degree distribution Similar observation on hop-pair distribution

12 Measuring ISP Topologies with Rocketfuel N.Spring, R. Mahajan and D. Wetherall ACM Sigcomm 2002

13 ISP network infrastructure Access Router Backbone Router Backbone Link

14 ISP topology measurement An old story: the blinds and the elephant ISP Traceroute

15 ISP topology measurement Traceroute Server

16 Focusing on one ISP – Directed probing Network Next Hop M/LP/Weight Path * i * i * i * i * i *> i * i * i * i blackrose.org (Ann Arbor) through AS234 Verio (MAE-WEST) through AS2914 Sprint (Stockton) through AS1239 MCI (San Francisco) through AS3561 LINX (London) through AS5459 CERFnet (San Diego) through AS1740 IIJ (Japan) through AS2497 PIPEX (London) through AS1849 IAGnet (Chicago) through AS1225 * BGP table source: RouteView project

17 Focusing on one ISP – Directed probing Traceroutes to dependent prefixes: All traceroutes to these prefixes from any vantage point should transit the ISP. Dependent prefixes can be readily identified from the BGP table. All AS-paths for the prefix would contain the number of the AS being mapped. Traceroutes from insiders: We call a traceroute server located in a dependent prefix an insider. Traceroutes from insiders to any prefix should transit the ISP. Traceroutes that are likely to transit the ISP based on some AS-path are called up/down traces.

18 Path/Query reduction Share IngressShare egress Same next-hop AS number

19 Impacts of directed probing 1)Fraction of useful but pruned traces from 0.1 to 7% 2)Unnecessary traces around 6% over all the ISPs * Comparison based on Skitter data

20 Impacts of ingress reduction Overall, ingress reduction keeps only 12% of the traces chosen by directed probing. The number of vantage points that share an ingress by rank

21 Impacts of egress reduction The number of dependent prefixes that share an egress by rank Overall, egress reduction keeps only 18% of the Dependent prefix traces chosen by directed probing.

22 Impacts of next-hop reduction Overall, Next-hop AS reduction Reduces the number of traces to 5% of those chosen by directed probing.

23 POP sizes analysis

24 Power Law Complementary cumulative distribution function (CCDF) P(X>x) Pareto Distribution Power Law

25 Router degree distribution

26 Peering structure

27 Difficulties in topology discovery Shared media Backup links Router Identification and annotation Alias resolution Completeness Validation Currently, none of them is completely solved!

28 POP hierarchy Naming convention, DNS information and neighbor inferring

29 Backbone topology AT&T Level 3

30 Alias Problem OR

31 Alias: is it a big deal?

32 Alias resolution Send a packet with unreachable port to certain interfaces which are possible alias. The corresponding ICMP port unreachable response will contain the source address. IP identifier

33 Completeness validation Comparison with Router Views Comparison with Skitter IP address space –Search prefixes of ISP’s address space for additional IP addresses Validation with ISPs –Is “Good” enough?

34 In Search of Path Diversity in ISP Networks P. Teixeira, K. Marzullo, S. Savage and G. M. Voelker IMC 2003

35 Real metric instead of counting links Path diversity –Metric that reflects the number of routes available between two points in the network An extreme example

36 Real topology speaks Inter-PoP Path diversity in the Sprint Network Inter-PoP Path diversity inferred by Rocketfuel

37 Take a closer look

38 Inaccuracy introduced during probing Lack of vantage points –How many points are sufficient? Incomplete traceroutes –What can we do if ISP turns off traceroute functionality? Changes in the path of a probe Incorrect DNS record

39 Inaccuracy from processing probed links Alias Resolution Adding reverse links Missed and added links in Rocketfuel PoP topology relative to the number of links in the Sprint real topology

40 Questions?