Progress in inferring business relationships between ASs Dmitri Krioukov 4 th CAIDA-WIDE Workshop.

Slides:



Advertisements
Similar presentations
Impact of Interference on Multi-hop Wireless Network Performance Kamal Jain, Jitu Padhye, Venkat Padmanabhan and Lili Qiu Microsoft Research Redmond.
Advertisements

~1~ Infocom’04 Mar. 10th On Finding Disjoint Paths in Single and Dual Link Cost Networks Chunming Qiao* LANDER, CSE Department SUNY at Buffalo *Collaborators:
1 Greedy Forwarding in Dynamic Scale-Free Networks Embedded in Hyperbolic Metric Spaces Dmitri Krioukov CAIDA/UCSD Joint work with F. Papadopoulos, M.
1 Routing and Wavelength Assignment in Wavelength Routing Networks.
Online Social Networks and Media. Graph partitioning The general problem – Input: a graph G=(V,E) edge (u,v) denotes similarity between u and v weighted.
Analysis of peering strategy adoption by transit providers in the Internet Aemen Lodhi (Georgia Tech) Amogh Dhamdhere (CAIDA) Constantine Dovrolis (Georgia.
Graduate Center/City University of New York University of Helsinki FINDING OPTIMAL BAYESIAN NETWORK STRUCTURES WITH CONSTRAINTS LEARNED FROM DATA Xiannian.
Inferring Autonomous System Relationships in the Internet Lixin Gao Dept. of Electrical and Computer Engineering University of Massachusetts, Amherst
Inferring Autonomous System Relationships in the Internet Lixin Gao.
Inferring Autonomous System Relationships in the Internet Lixin Gao Presented by Santhosh R Thampuran.
1 Internet Path Inflation Xenofontas Dimitropoulos.
Something We Always Wanted to Know about ASs: Relationships and Taxonomy Dmitri Krioukov X. Dimitropoulos, M. Fomenkov, B. Huffaker, Y.
Part II: Inter-domain Routing Policies. March 8, What is routing policy? ISP1 ISP4ISP3 Cust1Cust2 ISP2 traffic Connectivity DOES NOT imply reachability!
Computing the relationships between autonomous systems giuseppe di battista maurizio patrignani maurizio pizzonia univ. of rome III
Computing the relationships between autonomous systems giuseppe di battista maurizio patrignani maurizio pizzonia univ. of rome III
University of Nevada, Reno Ten Years in the Evolution of the Internet Ecosystem Paper written by: Amogh Dhamdhere, Constantine Dovrolis School of Computer.
1 Tutorial 5 Safe “Peering Backup” Routing With BGP Based on:
Detecting Network Intrusions via Sampling : A Game Theoretic Approach Presented By: Matt Vidal Murali Kodialam T.V. Lakshman July 22, 2003 Bell Labs, Lucent.
NP-Complete Problems Reading Material: Chapter 10 Sections 1, 2, 3, and 4 only.
Internet Networking Spring 2004 Tutorial 5 Safe “Peering Backup” Routing With BGP.
1 A Cryptographic Approach to Safe Inter-domain Traffic Engineering Sridhar Machiraju SAHARA Retreat, Summer 2004.
On Power-Law Relationships of the Internet Topology CSCI 780, Fall 2005.
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Near-Deterministic Inference of AS Relationships Udi Weinsberg A thesis submitted toward the degree of Master of Science in Electrical and Electronic Engineering.
Graphs and Topology Yao Zhao. Background of Graph A graph is a pair G =(V,E) –Undirected graph and directed graph –Weighted graph and unweighted graph.
Network Monitoring for Internet Traffic Engineering Jennifer Rexford AT&T Labs – Research Florham Park, NJ 07932
University of Massachusetts, Amherst 1 On the Evaluation of AS Relationship Inferences Jianhong Xia and Lixin Gao Department of Electrical and Computer.
Stable Internet Routing Without Global Coordination Jennifer Rexford AT&T Labs--Research Joint work with Lixin Gao.
1 Network Topology Measurement Yang Chen CS 8803.
Introduction to compact routing Dmitri Krioukov UCSD/CAIDA IDRWS 2004.
Package Transportation Scheduling Albert Lee Robert Z. Lee.
Graph-based consensus clustering for class discovery from gene expression data Zhiwen Yum, Hau-San Wong and Hongqiang Wang Bioinformatics, 2007.
Special Topics on Algorithmic Aspects of Wireless Networking Donghyun (David) Kim Department of Mathematics and Computer Science North Carolina Central.
1 Meeyoung Cha, Sue Moon, Chong-Dae Park Aman Shaikh Placing Relay Nodes for Intra-Domain Path Diversity To appear in IEEE INFOCOM 2006.
Communication Systems Group (CSG) Policy-Compliant Path Diversity and Bisection Bandwidth Rowan Klöti 1, Vasileios Kotronis 1, Bernhard Ager 1, Xenofontas.
Computing the relationships between autonomous systems giuseppe di battista maurizio patrignani maurizio pizzonia univ. of rome III
Quantifying the Causes of Path Inflation Neil Spring, Ratul Mahajan, and Thomas Anderson Presented by Luv Kohli COMP November 24, 2003.
Popularity versus Similarity in Growing Networks Fragiskos Papadopoulos Cyprus University of Technology M. Kitsak, M. Á. Serrano, M. Boguñá, and Dmitri.
Complex network geometry and navigation Dmitri Krioukov CAIDA/UCSD F. Papadopoulos, M. Kitsak, kc claffy, A. Vahdat M. Á. Serrano, M. Boguñá UCSD, December.
Optimal serverless networks attacks, complexity and some approximate algorithms Carlos Aguirre Maeso Escuela Politécnica Superior Universidad Autónoma.
Network Aware Resource Allocation in Distributed Clouds.
All that remains is to connect the edges in the variable-setters to the appropriate clause-checkers in the way that we require. This is done by the convey.
1 Spectral Analysis of Power-Law Graphs and its Application to Internet Topologies Milena Mihail Georgia Tech.
On AS-Level Path Inference Jia Wang (AT&T Labs Research) Joint work with Z. Morley Mao (University of Michigan, Ann Arbor) Lili Qiu (University of Texas,
June 21, 2007 Minimum Interference Channel Assignment in Multi-Radio Wireless Mesh Networks Anand Prabhu Subramanian, Himanshu Gupta.
Introduction to Graphs. Introduction Graphs are a generalization of trees –Nodes or verticies –Edges or arcs Two kinds of graphs –Directed –Undirected.
RR-FS Status Report Dmitri Krioukov CAIDA IETF-60.
Improved Approximation Algorithms for the Quality of Service Steiner Tree Problem M. Karpinski Bonn University I. Măndoiu UC San Diego A. Olshevsky GaTech.
Aemen Lodhi (Georgia Tech) Amogh Dhamdhere (CAIDA)
A New Hybrid Wireless Sensor Network Localization System Ahmed A. Ahmed, Hongchi Shi, and Yi Shang Department of Computer Science University of Missouri-Columbia.
Advancements in the Inference of AS Relationships Xenofontas Dimitropoulos (Fontas) (CAIDA/GaTech) Dmitri Krioukov Bradley Huffaker k claffy George Riley.
Introduction to compact routing Dmitri Krioukov UCSD/CAIDA 3 rd CAIDA-WIDE Workshop.
Scaling Properties of the Internet Graph Aditya Akella, CMU With Shuchi Chawla, Arvind Kannan and Srinivasan Seshan PODC 2003.
A Simulation-Based Study of Overlay Routing Performance CS 268 Course Project Andrey Ermolinskiy, Hovig Bayandorian, Daniel Chen.
Inferring AS Relationships. The Problem  One view  AS relationships  BGP route tables  The other view  BGP route tables  AS relationships  Available.
GLOBECOM 2007 Exit Policy Violations in Multi-hop Overlay Routes Srinivasan Seetharaman, Mostafa Ammar Networking and Telecommunications Group College.
Placing Relay Nodes for Intra-Domain Path Diversity Meeyoung Cha Sue Moon Chong-Dae Park Aman Shaikh Proc. of IEEE INFOCOM 2006 Speaker 游鎮鴻.
Roman Barták (Charles University in Prague, Czech Republic) ACAT 2010.
Scaling Properties of the Internet Graph Aditya Akella With Shuchi Chawla, Arvind Kannan and Srinivasan Seshan PODC 2003.
1 On the Impact of Route Monitor Selection Ying Zhang* Zheng Zhang # Z. Morley Mao* Y. Charlie Hu # Bruce M. Maggs ^ University of Michigan* Purdue University.
Inferring Autonomous System Relationships in the Internet Lixin Gao Dept. of Electrical and Computer Engineering University of Massachusetts, Amherst.
computing the relationships between autonomous systems
The minimum cost flow problem
No Direction Home: The True cost of Routing Around Decoys
ISP and Egress Path Selection for Multihomed Networks
Measured Impact of Crooked Traceroute
1.3 Modeling with exponentially many constr.
COS 461: Computer Networks
Trevor Brown DC 2338, Office hour M3-4pm
Stable and Practical AS Relationship Inference with ProbLink
Presentation transcript:

Progress in inferring business relationships between ASs Dmitri Krioukov 4 th CAIDA-WIDE Workshop

Outline Overview of ongoing projects AS relationship inference Motivation Problems with recent heuristics How we fix them Future work

Outline Overview of ongoing projects AS relationship inference Motivation Problems with recent heuristics How we fix them Future work

Projects Routing is dormant Comparative analysis of Internet topologies (with P. Mahadevan, UCSD) Internet topology evolution modeling (with R. Liu, UCLA) Improving AS business relationship inference heuristics (with X. Dimitropoulos, Georgia Tech, and B. Huffaker, CAIDA)

Outline Overview of ongoing projects AS relationship inference Motivation Problems with recent heuristics How we fix them Future work

Motivation Practical (providers, vendors, government) Money/power flow Traffic flow Network robustness Theoretical (research community) Routing  Topology  Modeling  Validation (real data)

Outline Overview of ongoing projects AS relationship inference Motivation Problems with recent heuristics How we fix them Future work

Previous results: Gao and SARK L. Gao. On inferring Autonomous System relationships in the Internet. ToN (Gao) BGP policies  (in)valid paths AS degree-based heuristic Too many invalid paths L. Subramanian, et al. Characterizing the Internet hierarchy from multiple vantage points. INFOCOM (SARK) Combinatorial optimization to minimize the number of invalid paths (ToR problem) Heuristic to solve it

Previous results: DPP and EHS G. Di Battista, et al., Computing the types of the relationships between Autonomous Systems, INFOCOM, 2003, (DPP); and T. Erlebach, et al., Classifying customer-provider relationships in the Internet, IASTED CCN, 2002, (EHS). No peering can be inferred in ToR ToR is NP- and APX-complete More rigorous approach to find an approximate solution Smaller number of invalid paths (than in SARK) Induced AS hierarchies are incorrect

Outline Overview of ongoing projects AS relationship inference Motivation Problems with recent heuristics How we fix them Future work

Idea at the high level Objective function adjustment

ToR Given a set of BGP paths P, Extract the undirected AS-level graph G. Every edge in G is a link between pair of ASs. Assuming edge direction is from customer to provider, Direct all edges in G (2 m combinations), Inducing direction of edges in P, Such that the number of invalid paths in P is minimized. Invalid path is a path containing a provider-to-customer link followed by customer-to-provider link

ToR and MAX2SAT Split all paths in P into pairs of adjacent links (involving triplets of nodes) Perform mapping…

Mapping to MAX2SAT

Two 2SAT observations All clauses can be satisfied (all paths can be made valid) if there is no variable x i belonging with its negation to the same SCC in G 2SAT (conflict variable/edge) SCC (strongly connected component) is a set of mutually reachable nodes in a directed graph Proper direction of non-conflict edges can be done via topological sorting in G 2SAT (if the variable negation is before the variable itself, then the variable is true, and vice versa) Topological sorting is a natural ordering of nodes in directed acyclic graphs

MAX2SAT: DPP vs. EHS If P is large, not all paths (clauses) can be made valid (satisfied): 2SAT  MAX2SAT DPP: find the maximum subset of paths that can all be made valid EHS: use known algorithms to approximate MAX2SAT SDP (semidefinite programming) relaxation (with certain twists) delivers approximation ratio of Inapproximability ratio is 0.954

SDP relaxation to MAX2SAT

Physical interpretation

Gains and losses What’s good Extremely small number of invalid paths (99.7%) What’s bad Skewed/incorrect AS hierarchies: several small ASs are inferred as providers of large ISPs But why!?

Causes of the problem and their resolutions Case 1: some edges can be directed any way without causing invalid paths Fix: introduce additional incentive to direct edge along the node degree gradient Case 2: trying to infer sibling links leads to proliferation of error Fix: try to discover sibling links using the WHOIS database sibling ? cust-prov

Case 1: Multiobjective optimization Maximize number of invalid paths: 2-link clauses w kl (x k  x l ) Direct along the node degree gradient: 1-link clauses w kk (x k  x k )

Final form of the generalized problem formulation

Execution process BGP data: RouteViews and 18 route servers from traceroute.org ( paths, ASs, link clauses/edges, link clauses/pairs of adjacent edges) Resolve siblings that can be found via WHOIS Direct all edges along the node degree gradient Strip non-conflict edges whose non-conflict direction, inferred by topological sorting in G 2SAT, satisfy all clauses containing corresponding variables (remains: 1590 ASs, links, links) Execute the algorithm for different values of  : intensive usage of: LEDA library DSDP solver

First results: invalid paths

First results: AS hierarchy

Conclusion and future work What’s done Using a standard multiobjective optimization method, resolved issues associated with two polar approaches What’s to be done Peering Further analysis of the ‘trade-off surface’ Further analysis of the directed AS graph Validation Other AS-ranking mechanisms AS-ranking webpage update