Routing State Distance: A Path-based Metric for Network Analysis Natali Ruchansky Gonca Gürsun, Evimaria Terzi, and Mark Crovella.

Slides:



Advertisements
Similar presentations
ABSTRACT Due to the Internets sheer size, complexity, and various routing policies, it is difficult if not impossible to locate the causes of large volumes.
Advertisements

Hidden Metric Spaces and Navigability of Complex Networks
Topology Modeling via Cluster Graphs Balachander Krishnamurthy and Jia Wang AT&T Labs Research.
Understanding Geolocation Accuracy using Network Geometry Brian Eriksson Technicolor Palo Alto Mark Crovella Boston University.
Social network partition Presenter: Xiaofei Cao Partick Berg.
1 IP-Lookup and Packet Classification Advanced Algorithms & Data Structures Lecture Theme 08 – Part I Prof. Dr. Th. Ottmann Summer Semester 2006.
1 BGP Policy Atoms Yehuda Afek Omer Ben-Shalom Anat Bremler-Barr Tel-Aviv University.
LASTor: A Low-Latency AS-Aware Tor Client
1 Greedy Forwarding in Dynamic Scale-Free Networks Embedded in Hyperbolic Metric Spaces Dmitri Krioukov CAIDA/UCSD Joint work with F. Papadopoulos, M.
Analysis and Modeling of Social Networks Foudalis Ilias.
The Connectivity and Fault-Tolerance of the Internet Topology
An Introduction to Routing the Internet Geoff Huston APNIC.
Principal Component Analysis (PCA) for Clustering Gene Expression Data K. Y. Yeung and W. L. Ruzzo.
Fundamentals of Computer Networks ECE 478/578 Lecture #18: Policy-Based Routing Instructor: Loukas Lazos Dept of Electrical and Computer Engineering University.
Dynamic Routing Scalable Infrastructure Workshop, AfNOG2008.
Data Clustering Methods
Inferring Autonomous System Relationships in the Internet Lixin Gao Dept. of Electrical and Computer Engineering University of Massachusetts, Amherst
Inferring Autonomous System Relationships in the Internet Lixin Gao.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.
PROXY FOR CONNECTIVITY We consider the k shortest edge disjoint paths between a pair of nodes and define a hyperlink, whose ‘connectivity’ is defined as:
Image Segmentation Today’s Readings Intelligent Scissors, Mortensen et. al, SIGGRAPH 1995Intelligent Scissors From Sandlot ScienceSandlot Science.
Computer Science Sampling Biases in IP Topology Measurements John Byers with Anukool Lakhina, Mark Crovella and Peng Xie Department of Computer Science.
1 Efficient Placement and Dispatch of Sensors in a Wireless Sensor Network Prof. Yu-Chee Tseng Department of Computer Science National Chiao-Tung University.
1 Network Topology Measurement Yang Chen CS 8803.
Evaluating Performance for Data Mining Techniques
Principal Component Analysis (PCA) for Clustering Gene Expression Data K. Y. Yeung and W. L. Ruzzo.
Routing Protocols and CIDR BSAD 146 Dave Novak Sources: Network+ Guide to Networks, Dean 2013.
1 Chapter 27 Internetwork Routing (Static and automatic routing; route propagation; BGP, RIP, OSPF; multicast routing)
«Tag-based Social Interest Discovery» Proceedings of the 17th International World Wide Web Conference (WWW2008) Xin Li, Lei Guo, Yihong Zhao Yahoo! Inc.,
Routing Algorithms (Ch5 of Computer Network by A. Tanenbaum)
Introduction to Routing and Routing Protocols By Ashar Anwar.
Constructing Inter-Domain Packet Filters to Control IP Spoofing Based on BGP Updates Zhenhai Duan, Xin Yuan Department of Computer Science Florida State.
Using Bayesian Networks to Analyze Expression Data N. Friedman, M. Linial, I. Nachman, D. Hebrew University.
Complex network geometry and navigation Dmitri Krioukov CAIDA/UCSD F. Papadopoulos, M. Kitsak, kc claffy, A. Vahdat M. Á. Serrano, M. Boguñá UCSD, December.
1 The Research on Analyzing Time- Series Data and Anomaly Detection in Internet Flow Yoshiaki HARADA Graduate School of Information Science and Electrical.
On AS-Level Path Inference Jia Wang (AT&T Labs Research) Joint work with Z. Morley Mao (University of Michigan, Ann Arbor) Lili Qiu (University of Texas,
Advanced Networking Lab. Given two IP addresses, the estimation algorithm for the path and latency between them is as follows: Step 1: Map IP addresses.
Chapter 9 Routing. Contents Definition Differences from switching Autonomous systems Routing tables Viewing routes Routing protocols Route aggregation.
A Graph-based Friend Recommendation System Using Genetic Algorithm
David Wetherall Professor of Computer Science & Engineering Introduction to Computer Networks Hierarchical Routing (§5.2.6)
Network Technologies essentials Week 5: Routing Compilation made by Tim Moors, UNSW Australia Original slides by David Wetherall, University of Washington.
1 Internet Routing. 2 Terminology Forwarding –Refers to datagram transfer –Performed by host or router –Uses routing table Routing –Refers to propagation.
More on Internet Routing A large portion of this lecture material comes from BGP tutorial given by Philip Smith from Cisco (ftp://ftp- eng.cisco.com/pfs/seminars/APRICOT2004.
InterConnection Network Topologies to Minimize graph diameter: Low Diameter Regular graphs and Physical Wire Length Constrained networks Nilesh Choudhury.
Copyright 1999, S.D. Personick. All Rights Reserved. Telecommunications Networking II Lecture 34 Routing Algorithms Ref: Tanenbaum pp ;
Advancements in the Inference of AS Relationships Xenofontas Dimitropoulos (Fontas) (CAIDA/GaTech) Dmitri Krioukov Bradley Huffaker k claffy George Riley.
CS 4396 Computer Networks Lab BGP. Inter-AS routing in the Internet: (BGP)
EigenSpokes: Surprising Patterns and Scalable Community Chipping in Large Graphs Zhe Jin.
7/11/0666th IETF1 QoS Enhancements to BGP in Support of Multiple Classes of Service Andreas Terzis Computer Science Department Johns Hopkins University.
A Simulation-Based Study of Overlay Routing Performance CS 268 Course Project Andrey Ermolinskiy, Hovig Bayandorian, Daniel Chen.
Community structure in graphs Santo Fortunato. More links “inside” than “outside” Graphs are “sparse” “Communities”
Analyzing Networks. Milgram’s Experiments “Six degrees of Separation” Milgram’s letters to various recruits in Nebraska who were asked to forward the.
1 Effective Diagnosis of Routing Disruptions from End Systems Ying Zhang Z. Morley Mao Ming Zhang.
Efficient Placement and Dispatch of Sensors in a Wireless Sensor Network You-Chiun Wang, Chun-Chi Hu, and Yu-Chee Tseng IEEE Transactions on Mobile Computing.
Shrinking and Controlling Routing Table Size Xinyang (Joy) Zhang Paul Francis Jia Wang Kaoru Yoshida.
DATA MINING: CLUSTER ANALYSIS Instructor: Dr. Chun Yu School of Statistics Jiangxi University of Finance and Economics Fall 2015.
Graph clustering to detect network modules
Optimizing Routing 1. Using Multiple Routing Protocols
Prof. Yu-Chee Tseng Department of Computer Science
Lecture 13 – Network Mapping
Improved Algorithms for Network Topology Discovery
COMP 3270 Computer Networks
by Hyunwoo Park and Kichun Lee Knowledge-Based Systems 60 (2014) 58–72
Fine-Grained Complexity Analysis of Improving Traveling Salesman Tours
Department of Computer Science University of York
COMPUTER NETWORKS CS610 Lecture-42 Hammad Khalid Khan.
Feifei Li, Ching Chang, George Kollios, Azer Bestavros
Announcements Project 1 is out today
COMPUTER NETWORKS CS610 Lecture-41 Hammad Khalid Khan.
Visualization of Temporal Difference of BGP Routing Information
Presentation transcript:

Routing State Distance: A Path-based Metric for Network Analysis Natali Ruchansky Gonca Gürsun, Evimaria Terzi, and Mark Crovella

Shortest Path Distance Distance Metrics for Analyzing Routing 2 Similarly Routed

Based on this distance intuition we develop a new metric based on paths and show it is good for: o Visualization of networks and routes o Characterizing routes o Detecting significant patterns o Gaining insight about routing A New Metric 3

We call this path-based distance metric: Routing State Distance 4

Conceptually… 5 Sources Destinations

Routing State Distance 6

More Formally 7

RSD to BGP 8 A few issues arise… 1.Missing Values 2.Multiple next hops

Our Data 9

Let’s take a look at its properties… 10

RSD versus Hop Distance 11 No relation between RSD and hop distance

Finer Grained Measure Varies smoothly and has a gradual slope. Allows fine granularity 12 Increase of 1 encompasses many prefixes

1.Highly structured 2.Allows 2D visualization 13

14 This happens with any random sample  Internet-wide

Yeah, but a cluster of what!?! 15

16 Small cluster “C”Large Cluster Small cluster “C” Large cluster

A local atom is a set of prefixes that are routed similarly in some region of the internet. So the smaller cluster is a local atom of certain prefixes that are routed similarly by a large set of ASes 17

Why these specific prefixes? Level3 Hurricane Electric Sprint 18

19

Can We Find More Clusters? 20

RS-Clustering Problem 21

Optimal is Hard 22

Pivot Clustering Algorithm 23

5 largest clusters Clusters show a clear separation Each cluster corresponds to a local atom 24

25 Size of CSize of SDestinations C115016Ukraine 83% Czech. Rep 10% C21709Romania 33% Poland 33% C31267India 93% US 2% C44848Russia 73% Czech rep. 10% C537515US 74% Australia 16% Interpreting Clusters

To address this we propose a formalism called Overlap Clustering and show that it is capable of extracting such clusters. We ask ourselves if a partition is really best? 26 Seek a clustering that captures overlap

Related Work Reported that BGP tables provide an incomplete view of the AS graph. [Roughan et. al. ‘11] Visualization based on AS degree and geo-location. [Huffaker and k. claffy ‘10] Small scale visualization through BGPlay and bgpviz Clustering on the inferred AS graph. [Gkantsidis et. al. ‘03] Grouping prefixes that share the same BGP paths into policy atoms. [Broido and k. claffy ‘01] Methods for calculating policy atoms and characteristics. [Afek et. al. ‘02] 27

Take-Away Analysis with typical distance metrics is hard We introduce a new one -- Routing State Distance – that is simple and based only on paths Overcome BGP hurdles and show it can be used for: o In-depth analysis of BGP o Capturing closeness useful for visualization o Uncovering surprising patterns o General setting Developed a new set of tools for extracting insight from BGP measurements 28

Code, data, and more information is available on our website at: csr.bu.edu/rsd 29 Code Pivot Clustering Overlap Clustering RSD Computation Data Prefix List Pairwise RSD

Natali Ruchansky Gonca Gürsun, Evimaria Terzi, and Mark Crovella Thank you!!