Employing Agent-based Models to study Interdomain Network Formation, Dynamics & Economics Aemen Lodhi (Georgia Tech) 1 Workshop on Internet Topology &

Slides:



Advertisements
Similar presentations
An Agent-based Model of Interdomain Interconnection in the Internet Amogh Dhamdhere (CAIDA/UCSD) With Constantine Dovrolis (Georgia Tech) Aemen Lodhi (Georgia.
Advertisements

Selecting an IXP Where to peer?. THE TOP 10 IXP SELECTION CRITERIA How do network operators choose an Internet Exchange Point? 2.
Data and Computer Communications
COS 461 Fall 1997 Routing COS 461 Fall 1997 Typical Structure.
Employing Agent-based Models to study Interdomain Network Formation, Dynamics & Economics Aemen Lodhi (Georgia Tech) 1 Workshop on Internet Topology &
Internet Economics: the use of Shapley value for ISP settlement Richard T.B. Ma Columbia University Dah-ming Chiu, John C.S. Lui The Chinese University.
1/27 Evaluating Potential Routing Diversity for Internet Failure Recovery *Chengchen Hu, + Kai Chen, + Yan Chen, *Bin Liu *Tsinghua University, + Northwestern.
© J. Liebeherr, All rights reserved 1 Border Gateway Protocol This lecture is largely based on a BGP tutorial by T. Griffin from AT&T Research.
Analysis of peering strategy adoption by transit providers in the Internet Aemen Lodhi (Georgia Tech) Amogh Dhamdhere (CAIDA) Constantine Dovrolis (Georgia.
On Selfish Routing In Internet-like Environments Lili Qiu (Microsoft Research) Yang Richard Yang (Yale University) Yin Zhang (AT&T Labs – Research) Scott.
A Flexible Model for Resource Management in Virtual Private Networks Presenter: Huang, Rigao Kang, Yuefang.
Consensus Routing: The Internet as a Distributed System John P. John, Ethan Katz-Bassett, Arvind Krishnamurthy, and Thomas Anderson Presented.
CS 4700 / CS 5700 Network Fundamentals Lecture 16: IXPs (The Underbelly of the Internet) Revised 3/23/2015.
1 Interdomain Routing Protocols. 2 Autonomous Systems An autonomous system (AS) is a region of the Internet that is administered by a single entity and.
Sogang University ICC Lab Using Game Theory to Analyze Wireless Ad Hoc networks.
The Structure of Networks with emphasis on information and social networks T-214-SINE Summer 2011 Chapter 8 Ýmir Vigfússon.
Interconnecting Eyeballs to Content: A Shapley Value Perspective on ISP Peering and Settlement Richard T.B. Ma Columbia University Dah-ming Chiu, John.
Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.
1 Internet Path Inflation Xenofontas Dimitropoulos.
Part II: Inter-domain Routing Policies. March 8, What is routing policy? ISP1 ISP4ISP3 Cust1Cust2 ISP2 traffic Connectivity DOES NOT imply reachability!
Topology Generation Suat Mercan. 2 Outline Motivation Topology Characterization Levels of Topology Modeling Techniques Types of Topology Generators.
University of Nevada, Reno Ten Years in the Evolution of the Internet Ecosystem Paper written by: Amogh Dhamdhere, Constantine Dovrolis School of Computer.
Vytautas Valancius 1.  When Life Was Simple: Phone Networks  Network of Networks: The Internet  Connectivity structure  Pricing in the Internet: One-Size-Fits-All.
Traffic Engineering With Traditional IP Routing Protocols
Government Expenditure Composition and Growth in Chile January 2007 Carlos J. García Central Bank of Chile Santiago Herrera World Bank Jorge E. Restrepo.
Breakout 6: Financial Networks, Agent-Based Simulation, and Large- Scale Computation secretary: Michael Wellman moderator: William Rand.
Stable Internet Routing Without Global Coordination Jennifer Rexford Princeton University Joint work with Lixin Gao (UMass-Amherst)
On Cooperative Settlement Between Content, Transit and Eyeball ISPs Richard T.B. Ma Columbia University Dah-ming Chiu, John C.S. Lui The Chinese University.
Interdomain Routing Establish routes between autonomous systems (ASes). Currently done with the Border Gateway Protocol (BGP). AT&T Qwest Comcast Verizon.
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Exterior Gateway Protocols: EGP, BGP-4, CIDR Shivkumar Kalyanaraman Rensselaer Polytechnic Institute.
The Shapley Value: Its Use and Implications on Internet Economics Richard T.B. Ma Columbia University Dah-ming Chiu, John C.S. Lui The Chinese University.
Graphs and Topology Yao Zhao. Background of Graph A graph is a pair G =(V,E) –Undirected graph and directed graph –Weighted graph and unweighted graph.
Economic Incentives in Internet Routing Jennifer Rexford Princeton University
Stable Internet Routing Without Global Coordination Jennifer Rexford AT&T Labs--Research
Stable Internet Routing Without Global Coordination Jennifer Rexford AT&T Labs--Research Joint work with Lixin Gao.
Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)
Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.
Inter-domain Routing Outline Border Gateway Protocol.
Information-Centric Networks07b-1 Week 7 / Paper 2 NIRA: A New Inter-Domain Routing Architecture –Xiaowei Yang, David Clark, Arthur W. Berger –IEEE/ACM.
Peering, network sharing, interconnects Eckart Zollner September 2014.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jennifer Rexford Princeton University With Jiayue He, Rui Zhang-Shen, Ying Li,
Impact of Prefix Hijacking on Payments of Providers Pradeep Bangera and Sergey Gorinsky Institute IMDEA Networks, Madrid, Spain Developing the Science.
NOBEL WP Szept Stockholm Game Theory in Inter-domain Routing LÓJA Krisztina - SZIGETI János - CINKLER Tibor BME TMIT Budapest,
Amogh Dhamdhere (CAIDA) Constantine Dovrolis (Georgia Tech) ITER: A Computational Model to Evaluate Provider and Peer Selection in the Internet Ecosystem.
A Value-based Framework for Internet Peering Agreements Amogh Dhamdhere (CAIDA) with Constantine Dovrolis (Georgia Tech) Pierre Francois.
SEP: Sensibility analysis of BGP convergence and scalability using network simulation Sensibility analysis of BGP convergence and scalability using network.
David Wetherall Professor of Computer Science & Engineering Introduction to Computer Networks Hierarchical Routing (§5.2.6)
Economic Incentives in Information- Centric Networking: Implications for Protocol Design and Public Policy Group Members: Muhammad Kamran Siddique Adel.
Confidential. This presentation is provided for the recipient only and cannot be reproduced or shared without Fair Isaac Corporation's express consent.
Aemen Lodhi (Georgia Tech) Amogh Dhamdhere (CAIDA)
T. S. Eugene Ngeugeneng at cs.rice.edu Rice University1 COMP/ELEC 429/556 Introduction to Computer Networks Inter-domain routing Some slides used with.
The Economics of Transit and Peering Interconnections in the Internet Amogh Dhamdhere (CAIDA/UCSD) With Constantine Dovrolis (Georgia Tech)
Can ISPs be Profitable Without Violating Network Neutrality? Amogh Dhamdhere Constantine Dovrolis Georgia Tech.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung.
6 December On Selfish Routing in Internet-like Environments paper by Lili Qiu, Yang Richard Yang, Yin Zhang, Scott Shenker presentation by Ed Spitznagel.
On Selfish Routing In Internet-like Environments Lili Qiu (Microsoft Research) Yang Richard Yang (Yale University) Yin Zhang (AT&T Labs – Research) Scott.
1 An Arc-Path Model for OSPF Weight Setting Problem Dr.Jeffery Kennington Anusha Madhavan.
Interconnect Networks Basics. Generic parallel/distributed system architecture On-chip interconnects (manycore processor) Off-chip interconnects (clusters.
Analysis of peering strategy adoption by transit providers in the Internet Aemen Lodhi (Georgia Tech) Amogh Dhamdhere (CAIDA) Constantine Dovrolis (Georgia.
1/18 Evaluating Potential Routing Diversity for Internet Failure Recovery *Chengchen Hu, + Kai Chen, + Yan Chen, *Bin Liu *Tsinghua University, + Northwestern.
Peering Strategies for Operators Building critical mass of peers.
Inter-domain Routing Outline Border Gateway Protocol.
Dynamics of Competition Between Incumbent and Emerging Network Technologies Youngmi Jin (Penn) Soumya Sen (Penn) Prof. Roch Guerin (Penn) Prof. Kartik.
1 Early Warning and Business Cycle Indicators in Analytical Frameworks International Seminar on Early Warning and Business Cycle Indicators 14 – 16 December.
1 CS716 Advanced Computer Networks By Dr. Amir Qayyum.
Internet Strucure Internet structure: network of networks Question: given millions of access ISPs, how to connect them together? access.
Border Gateway Protocol
Amogh Dhamdhere (CAIDA/UCSD) Constantine Dovrolis (Georgia Tech)
Internet Interconnection
Data and Computer Communications
Presentation transcript:

Employing Agent-based Models to study Interdomain Network Formation, Dynamics & Economics Aemen Lodhi (Georgia Tech) 1 Workshop on Internet Topology & Economics (WITE’12)

Outline Agent-based modeling for AS-level Internet Our model: GENESIS Application of GENESIS – Large-scale adoption of Open peering strategy Conclusion 2

What are we trying to model? Autonomous System level Internet Economic network 3 Enterprise customer Transit Provider Internet Enterprise customer Content Provider

What are we trying to model? Complex, dynamic environment – Mergers, acquisitions, new entrants, bankruptcies – Changing prices, traffic matrix, geographic expansion Co-evolutionary network Self-organization Information “fuzziness” Social aspects: 99% peering relationships are “handshake” agreements* *”Survey of Characteristics of Internet Carrier Interconnection Agreements 2011” – Packet Clearing House 4

What are we asking? Aggregate behavior – Is the network stable? – Is their gravitation towards a particular behavior e.g., Open peering – Is their competition in the market? Not so academic questions – Is this the right peering strategy for me? – What if I depeer AS X? – Should I establish presence at IXP Y? – CDN: Where should I place my caches? 5

Different approaches Analytical / Game-theoretic approach Empirical studies, statistical models Generative models e.g., Preferential attachment Distributed optimization Agent-based modeling 6

Why agent-based modeling Real-world constraints – Non-uniform traffic matrix – Complex geographic co-location patterns – Multiple dynamic prices per AS – Different peering strategies at different locations Scale – hundreds of agents 7

Approach Agent based computational modeling Scenarios Conservative Selective Restrictive Non-conservative Selective Restrictive Open vs.

The model: GENESIS*GENESIS* Agent based interdomain network formation model Incorporates – Co-location constraints in provider/peer selection – Traffic matrix – Public & Private peering – Set of peering strategies – Peering costs, Transit costs, Transit revenue 9 *GENESIS: An agent-based model of interdomain network formation, traffic flow and economics. To appear in InfoCom'12

The model: GENESIS*GENESIS* Fitness = Transit Revenue – Transit Cost – Peering cost Objective: Maximize economic fitness Optimize connectivity through peer and transit provider selection Choose the peering strategy that maximizes fitness

Peering strategies 11

RESULTS 12

Strategy adoption by transit providers 13

Why do transit providers adopt Open peering? xy zw v Save transit costs But your customers are doing the same! Affects: Transit Cost Transit Revenue Peering Cost

Why gravitate towards Open peering? xy zw z w, z y, traffic bypasses x x lost transit revenue Options for x? x regains lost transit revenue partially Y peering openly x adopts Open peering Not isolated decisions Network effects !! z w, traffic passes through x

Impact on fitness of transit providers switching from Selective to Open 70% providers have their fitness reduced 16

Fitness components: transit cost, transit revenue, peering cost? 17

Fitness components: transit cost, transit revenue, peering cost? Significant increase in peering costs Interplay between transit & peering cost, transit revenue

Avoid fitness loss? xy zw xy zw vs. Lack of coordination No incentive to unilaterally withdraw from peering with peer’s customer Sub-optimal equilibrium

Which transit providers gain through Open peering? Which lose? Classification of transit providers – Traffic volume – Customer cone size 20

Who loses? Who gains? Who gains: Small customer cone small traffic volume – Cannot peer with large providers using Selective – Little transit revenue loss Who loses: Large customer cone large traffic volume – Can peer with large transit providers with Selective – Customers peer extensively

Alternatives: Open peering variants Do not peer with immediate customers of peer (NPIC) Do not peer with any AS in the customer tree of peer (NPCT) 22 xy zw NPIC xy z w v NPCT

Fitness analysis Open peering variants Collective fitness with NPIC approaches Selective

47% transit providers loose fitness compared to Conservative scheme with Selective strategy 24 Fitness analysis Open peering variants OpenNPIC vs. Selective OpenNPIC vs. Open

Why the improvement? – No traffic “stealing” by peers – Aggregation of peering traffic over fewer links (economies of scale !!) – Less pressure to adopt Open peering Why did collective fitness not increase? – Non-peer transit providers peer openly with stub customers 25 Fitness analysis Open peering variants

Why NPIC gives better results than NPCT? – Valley-free routing – x has to rely on provider to reach v 26 Fitness analysis Open peering variants 26 xy z w v NPCT

Gravitation towards Open peering is a network effect for transit providers Extensive Open peering by transit providers in the network results in collective loss Coordination required to mitigate No-peer-immediate-customer can yield results closer to Selective strategy 27 Conclusion

Thank you 28

Motivation Traffic ratio requirement for peering? (source: PeeringDB 29

Introduction 30 Enterprise customer Transit Provider Internet Enterprise customer Content Provider

Traffic components Traffic consumed in the AS Transit traffic = Inbound traffic – Consumed traffic same as Transit traffic = Outbound traffic – Generated traffic 31 Autonomous system Inbound traffic Traffic transiting through the AS Traffic generated within the AS Outbound traffic

Customer-Provider traffic comparison – PeeringDB.com 32 Traffic carried by the AS

Customer-Provider traffic comparison 2500 customer-provider pairs 90% pairs: Customer traffic significantly less than provider traffic 9.5% pairs: Customer traffic larger than provider traffic (difference less than 20%) 0.05% pairs: Customer traffic significantly larger than provider traffic 33

Geographic presence & constraints 34 Link formation across geography not possible Regions corresponding to unique IXPs Peering link at top tier possible across regions Geographic overlap

Logical Connectivity 35

Traffic Matrix Traffic for ‘N’’ size network represented through an N * N matrix Illustration of traffic matrix for a 4 AS network Traffic sent by AS 0 to other ASes in the network Traffic received by AS 0 from other ASes in the network Intra-domain traffic not captured in the model Generated traffic Consumed traffic 36

Peering strategy adoption Strategy update in each round Enumerate over all available strategies Use netflow to “compute” the fitness with each strategy Choose the one which gives maximum fitness 37

Peering strategy adoption No coordination Limited foresight Eventual fitness can be different Stubs always use Open peering strategy 38 Time 123 Depeering Peering Transit Provider Selection OpenSelective Open Depeering Peering Transit Provider Selection Depeering Peering Transit Provider Selection