Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint.

Slides:



Advertisements
Similar presentations
Network Aware Forward Caching Presenter: Alexandre Gerber Jeffrey Erman, Mohammad T. Hajiaghayi, Dan Pei, Oliver Spatscheck AT&T Labs Research April 24.
Advertisements

P4P: ISPs and P2P Laird Popkin, Pando Networks Doug Pasko, Verizon.
LASTor: A Low-Latency AS-Aware Tor Client
Rarest First and Choke Algorithms are Enough Arnaud LEGOUT INRIA, Sophia Antipolis France G. Urvoy-Keller and P. Michiardi Institut Eurecom France.
On the Effectiveness of Measurement Reuse for Performance-Based Detouring David Choffnes Fabian Bustamante Fabian Bustamante Northwestern University INFOCOM.
By Hitesh Ballani, Paul Francis, Xinyang Zhang Slides by Benson Luk for CS 217B.
Best Practices for ISPs
Topology Generation Suat Mercan. 2 Outline Motivation Topology Characterization Levels of Topology Modeling Techniques Types of Topology Generators.
PROMISE: Peer-to-Peer Media Streaming Using CollectCast Mohamed Hafeeda, Ahsan Habib et al. Presented By: Abhishek Gupta.
1 School of Computing Science Simon Fraser University, Canada Modeling and Caching of P2P Traffic Mohamed Hefeeda Osama Saleh ICNP’06 15 November 2006.
University of Nevada, Reno Ten Years in the Evolution of the Internet Ecosystem Paper written by: Amogh Dhamdhere, Constantine Dovrolis School of Computer.
Cross-Layer Optimization for Video Streaming in Single- Hop Wireless Networks Cheng-Hsin Hsu Joint Work with Mohamed Hefeeda MMCN ‘09January 19, 2009 Simon.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Multimedia Streaming in Dynamic Peer-to-Peer Systems and Mobile Wireless.
Named Data Networking for Social Network Content delivery P. Truong, B. Mathieu (Orange Labs), K. Satzke (Alu) E. Stephan (Orange Labs) draft-truong-icnrg-ndn-osn-00.txt.
Traffic Engineering With Traditional IP Routing Protocols
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
1 A Framework for Lazy Replication in P2P VoD Bin Cheng 1, Lex Stein 2, Hai Jin 1, Zheng Zhang 2 1 Huazhong University of Science & Technology (HUST) 2.
Improving ISP Locality in BitTorrent Traffic via Biased Neighbor Selection Ruchir Bindal, Pei Cao, William Chan Stanford University Jan Medved, George.
Peer-Assisted Content Distribution Networks: Techniques and Challenges Pei Cao Stanford University.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
Delayed Internet Routing Convergence Craig Labovitz, Abha Ahuja, Abhijit Bose, Farham Jahanian Presented By Harpal Singh Bassali.
Quality-Aware Segment Transmission Scheduling in Peer-to-Peer Streaming Systems Cheng-Hsin Hsu Senior Research Scientist Deutsche Telekom R&D Lab USA Los.
Kyushu University Graduate School of Information Science and Electrical Engineering Department of Advanced Information Technology Supervisor: Professor.
1 Drafting Behind Akamai (Travelocity-Based Detouring) AoJan Su, David R. Choffnes, Aleksandar Kuzmanovic, and Fabian E. Bustamante Department of Electrical.
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
Graphs and Topology Yao Zhao. Background of Graph A graph is a pair G =(V,E) –Undirected graph and directed graph –Weighted graph and unweighted graph.
Routing.
A Framework for Cost-Effective Peer-to- Peer Content Distribution Mohamed Hefeeda and Bharat Bhargava Department of Computer Sciences Purdue University.
On-Demand Media Streaming Over the Internet Mohamed M. Hefeeda, Bharat K. Bhargava Presented by Sam Distributed Computing Systems, FTDCS Proceedings.
Tradeoffs in CDN Designs for Throughput Oriented Traffic Minlan Yu University of Southern California 1 Joint work with Wenjie Jiang, Haoyuan Li, and Ion.
Can Internet Video-on-Demand Be Profitable? SIGCOMM 2007 Cheng Huang (Microsoft Research), Jin Li (Microsoft Research), Keith W. Ross (Polytechnic University)
Distributing Content Simplifies ISP Traffic Engineering Abhigyan Sharma* Arun Venkataramani* Ramesh Sitaraman*~ *University of Massachusetts Amherst ~Akamai.
OpenFlow-Based Server Load Balancing GoneWild Author : Richard Wang, Dana Butnariu, Jennifer Rexford Publisher : Hot-ICE'11 Proceedings of the 11th USENIX.
CRIO: Scaling IP Routing with the Core Router-Integrated Overlay Xinyang (Joy) Zhang Paul Francis Jia Wang Kaoru Yoshida.
Ao-Jan Su, David R. Choffnes, Fabián E. Bustamante and Aleksandar Kuzmanovic Department of EECS Northwestern University Relative Network Positioning via.
Taming the Torrent: A Practical Approach to Reducing Cross-ISP Traffic in Peer-to-Peer Systems David R. Choffnes and Fabián E. Bustamante Speaker: Wally.
Quantifying the Causes of Path Inflation Neil Spring, Ratul Mahajan, and Thomas Anderson Presented by Luv Kohli COMP November 24, 2003.
Network Aware Resource Allocation in Distributed Clouds.
Routing protocols Basic Routing Routing Information Protocol (RIP) Open Shortest Path First (OSPF)
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Video Streaming over Cooperative Wireless Networks Mohamed Hefeeda (Joint.
A novel approach of gateway selection and placement in cellular Wi-Fi system Presented By Rajesh Prasad.
Scalable Web Server on Heterogeneous Cluster CHEN Ge.
Streaming over Subscription Overlay Networks Department of Computer Science Iowa State University.
Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada Optimal Partitioning of Fine-Grained Scalable Video Streams Mohamed Hefeeda.
Advanced Networking Lab. Given two IP addresses, the estimation algorithm for the path and latency between them is as follows: Step 1: Map IP addresses.
Jennifer Rexford Fall 2014 (TTh 3:00-4:20 in CS 105) COS 561: Advanced Computer Networks BGP.
TDTS21: Advanced Networking Lecture 7: Internet topology Based on slides from P. Gill and D. Choffnes Revised 2015 by N. Carlsson.
Tony McGregor RIPE NCC Visiting Researcher The University of Waikato DAR Active measurement in the large.
David Wetherall Professor of Computer Science & Engineering Introduction to Computer Networks Hierarchical Routing (§5.2.6)
Introduction to DFS. Distributed File Systems A file system whose clients, servers and storage devices are dispersed among the machines of a distributed.
Load-Balancing Routing in Multichannel Hybrid Wireless Networks With Single Network Interface So, J.; Vaidya, N. H.; Vehicular Technology, IEEE Transactions.
An IP Address Based Caching Scheme for Peer-to-Peer Networks Ronaldo Alves Ferreira Joint work with Ananth Grama and Suresh Jagannathan Department of Computer.
A Light-Weight Distributed Scheme for Detecting IP Prefix Hijacks in Real-Time Lusheng Ji†, Joint work with Changxi Zheng‡, Dan Pei†, Jia Wang†, Paul Francis‡
Detection of Routing Loops and Analysis of Its Causes Sue Moon Dept. of Computer Science KAIST Joint work with Urs Hengartner, Ashwin Sridharan, Richard.
PROP: A Scalable and Reliable P2P Assisted Proxy Streaming System Computer Science Department College of William and Mary Lei Guo, Songqing Chen, and Xiaodong.
Eliminating Packet Loss Caused by BGP Convergence Nate Kushman Srikanth Kandula, Dina Katabi, and Bruce Maggs.
6 December On Selfish Routing in Internet-like Environments paper by Lili Qiu, Yang Richard Yang, Yin Zhang, Scott Shenker presentation by Ed Spitznagel.
CS 4396 Computer Networks Lab BGP. Inter-AS routing in the Internet: (BGP)
On the Impact of Clustering on Measurement Reduction May 14 th, D. Saucez, B. Donnet, O. Bonaventure Thanks to P. François.
Yaping Zhu with: Jennifer Rexford (Princeton University) Aman Shaikh and Subhabrata Sen (ATT Research) Route Oracle: Where Have.
CSE534- Fundamentals of Computer Networking Lecture 12-13: Internet Connectivity + IXPs (The Underbelly of the Internet) Based on slides by D. Choffnes.
Chapter 25 Internet Routing. Static Routing manually configured routes that do not change Used by hosts whose routing table contains one static route.
On the Placement of Web Server Replicas Yu Cai. Paper On the Placement of Web Server Replicas Lili Qiu, Venkata N. Padmanabhan, Geoffrey M. Voelker Infocom.
Inferring AS Relationships. The Problem  One view  AS relationships  BGP route tables  The other view  BGP route tables  AS relationships  Available.
1 On the Impact of Route Monitor Selection Ying Zhang* Zheng Zhang # Z. Morley Mao* Y. Charlie Hu # Bruce M. Maggs ^ University of Michigan* Purdue University.
No Direction Home: The True cost of Routing Around Decoys
Routing.
Routing.
Presentation transcript:

Mohamed Hefeeda 1 School of Computing Science Simon Fraser University, Canada ISP-Friendly Peer Matching without ISP Collaboration Mohamed Hefeeda (Joint work with ChengHsin Hsu) 9 December 2008

Mohamed Hefeeda 2  P2P Systems (file sharing, live streaming, VoD,...) are very popular nowadays -Generating a major fraction of Internet traffic  In most of these systems, peers offer limited capacity and reliability   Client peer typically served by multiple senders  Choosing “good” senders is important for -Clients: better performance -P2P System: more capacity, better scalability -Network (ISPs): reduced load on inter- /intra-ISP links Introduction

Mohamed Hefeeda 3  Given set of potential senders for a receiver, find subset of them that minimize the load on ISPs -Load = traffic on inter-ISP links (expensive) and on intra-ISP links  General formulation/solution  can be used in different Systems -BitTorrent-like: use in tracker -Gnutella-like: use in peers -Peer-assisted CDN: use in managing servers Our Work: Peer Matching Problem

Mohamed Hefeeda 4  Find nearby peers in terms of -AS hops  reduce inter-ISP load -PoP (Point of Presence) distance  reduce intra-ISP load  Efficiently estimate AS paths & PoP distances -Small memory/CPU requirements -Use public data (BGP tables, GeoIP, …), no probing  No infrastructure need to be deployed  No need for cooperation from ISPs  No need to modify client software Our Approach

Mohamed Hefeeda 5  Provider Portal for P2P (P4P) [Xie 08] -ISPs deploy servers (iTrackers) to guide peer matching -Require cooperation from ISPs and infrastructure  Using DNS redirections [Choffnes 08] -Peers observe similar delay to CDN replicas  close to each other -Require modifying clients  Match peers within the same AS [Bindal 06] -Specific to BitTorrent -Peers outside AS are chosen randomly Related Work

Mohamed Hefeeda 6  Large ISP: PoPs at many locations  S3 is better for R than S2, though same AS distance Overview

Mohamed Hefeeda 7  We need to estimate AS hops between peers -Need AS path inference algorithm (valley-free policy) -Modified Dijkstra Algorithm [Mao 05]  very expensive, took ~2 days of running time, huge memory footprint -Our optimization: runs 1-3 hours, < 1% memory  We also need to infer PoP topology -Propose simple method to cluster IP prefixes -Use GeoIP databases to map clusters to PoPs Overview

Mohamed Hefeeda 8  Distance oracle: concise data structure, enables online matching in O(1) steps Peer Matching Distance Inference Offline Pre-processing Online Matching BGP Info AS graph IP-Geo Peer Matching Distance Oracle

Mohamed Hefeeda 9  Original algorithm [Mao 05] -O(V 3 ), V number of ASes -Currently, there are 28,000+ ASes [CAIDA] -Very expensive  Observation -Many ASes have small degree (client/stub ASes) -83% of ASes have 1 or very few C2P links [CAIDA] -  their AS paths can be inferred using their providers’ paths -  stub ASes can be removed from the AS graph AS Path Inference

Mohamed Hefeeda 10  T: transit AS, S: stub AS  Given T0 –T1 & T0—T2  T0—S can be computed   We can recursively remove ASes -Stub AS first -Transit ASes that are customers of larger ASes, and so on AS Path Inference

Mohamed Hefeeda 11  Estimate AS paths for “core” ASes first -Using any algorithm  Then paths starting/end at a transit AS  Then, the rest  Time Complexity: O(T 3 + T S + S 2 ) -T small fraction (<18%) of ASes  much faster -3 hours (instead of 2 days) for whole matrix AS Path Inference

Mohamed Hefeeda 12  Maintaining the whole distance matrix is costly -Assume each entry takes 1 byte -#of ASes = 28,594  817 MB for distance matrix  Idea: Maintain only the “core” matrix, other entries can be computed online  Tradeoff: small core vs. more online computations Distance Oracle

Mohamed Hefeeda 13  We can use a distance oracle of size 8 MB, and perform < 13 operations online on average -#operations depends on AS degree, not size of AS graph Distance Oracle: Tradeoff

Mohamed Hefeeda 14  Infer approximate PoP topology of ASes  Algorithm overview: -Collect all IP prefixes from BGP tables and map them to their ASes -For each AS, cluster IP prefixes into one or more PoPs -Analyze BGP updates to infer connectivity among PoP in same AS -Combine PoP topology with AS graph PoP Distance: Overview

Mohamed Hefeeda 15  Trace-based simulations  Use real IPs from -BitTorrent tracker: ~150,000 -Online content provider (CBC -- Canadian Broadcasting Corporation); ~ 160,000  BGP tables from RouteViews & RIPE  AS relationship data from CAIDA  Use GeoIP [maxmind.com] for IP/AS/location mapping Evaluation

Mohamed Hefeeda 16  Simulate multi-sender sessions for objects with different popularities: 1% -- 10%  Change number of chosen senders: 10 – 100  Implement -ISPF: ISP-Friendly Matching - ISPF-Lite: ISP-Friendly Matching, without PoP info -AS: Match based on AS distance only -Prefix: Match based on longest common IP prefix Uses IPs of peers  almost free -Random: currently used in many systems Evaluation

Mohamed Hefeeda 17  Some gain from (the free) Prefix  Significant gain from ISPF/ISPF-Lite Sample Results: Vary #Senders

Mohamed Hefeeda 18  Even more gain for rare objects Sample Results: Vary Object Popularity

Mohamed Hefeeda 19  ISPF achieves shorter distances Sample Results: PoP Distance

Mohamed Hefeeda 20 Dynamics of AS Graph  CAIDA AS relationship data for a full year  run AS inference algorithm once a month or so

Mohamed Hefeeda 21  Peer matching is important in multi-sender systems -P2P systems, distributed streaming, CDN, pCDN, …  Peer matching algorithms based on -AS distance -PoP distance  Do not need infrastructure, modifying peers, ISP cooperation  Efficient computation and storage of AS distance -~ 8 MB (<1% of whole matrix) for 28,000+ ASes Conclusions and Future Work

Mohamed Hefeeda 22  Currently implementing in pCDN (for CBC) and in BitTorrent tracker  Exploring link cost model -Assign weights to inter-AS links  Exploring more efficient methods for discovering & storing PoP topology Conclusions and Future Work

Mohamed Hefeeda 23 Thank You! Questions??  More info at: