Alex Sherman, Jason Nieh, Cliff Stein Columbia University.

Slides:



Advertisements
Similar presentations
P2P Streaming Protocol Pro- incentive Parameters draft-zeng-ppsp-protocol-pro-incentive-para-01 IETF79 Meeting Wenjun (Kevin) Zeng & Yingjie Gu Huawei.
Advertisements

Layered Video for Incentives in P2P Live Streaming
CALENDAR.
The 5S numbers game..
A Fractional Order (Proportional and Derivative) Motion Controller Design for A Class of Second-order Systems Center for Self-Organizing Intelligent.
Break Time Remaining 10:00.
The basics for simulations
EE, NCKU Tien-Hao Chang (Darby Chang)
BitTorrent or BitCrunch: Evidence of a credit squeeze in BitTorrent?
PP Test Review Sections 6-1 to 6-6
Taming User-Generated Content in Mobile Networks via Drop Zones Ionut Trestian Supranamaya Ranjan Aleksandar Kuzmanovic Antonio Nucci Northwestern University.
1 Sizing the Streaming Media Cluster Solution for a Given Workload Lucy Cherkasova and Wenting Tang HPLabs.
Outline Minimum Spanning Tree Maximal Flow Algorithm LP formulation 1.
Optimal Scheduling in Peer-to-Peer Networks Lee Center Workshop 5/19/06 Mortada Mehyar (with Prof. Steven Low, Netlab)
Measuring Personal Growth Attributed to Multicultural Education Constructs Personal Growth Positive psychological changes during time period of interest.
Copyright © 2012, Elsevier Inc. All rights Reserved. 1 Chapter 7 Modeling Structure with Blocks.
Peter R. Pietzuch Peer-to-Peer Computing – or how to make your BitTorrent downloads go faster... Peter Pietzuch Large-Scale Distributed.
Neighbour selection strategies in BitTorrent- like Peer-to-Peer systems L.G. Alex Sung, Herman Li March 30, 2005 for CS856 Web Data Management University.
Before Between After.
Slide R - 1 Copyright © 2009 Pearson Education, Inc. Publishing as Pearson Prentice Hall Active Learning Lecture Slides For use with Classroom Response.
Subtraction: Adding UP
Clock will move after 1 minute
A Data Warehouse Mining Tool Stephen Turner Chris Frala
Unstructured P2P Networks Achieving Robustness and Scalability in Data Dissemination Scenarios Michael Mirold Seminar on Advanced Topics in Distributed.
Rarest First and Choke Algorithms Are Enough
Rarest First and Choke Algorithms are Enough Arnaud LEGOUT INRIA, Sophia Antipolis France G. Urvoy-Keller and P. Michiardi Institut Eurecom France.
The BitTorrent Protocol. What is BitTorrent?  Efficient content distribution system using file swarming. Does not perform all the functions of a typical.
Incentives Build Robustness in BitTorrent Bram Cohen.
Agenda Introduction BT + Multimedia Experimental Conclusion 2.
Presentation by Manasee Conjeepuram Krishnamoorthy.
Cameron Dale and Jiangchuan LiuA Measurement Study of Piece Population in BitTorrent Introduction BitTorrent Experiment Results Simulation Discussion A.
1 Analysis of BitTorrent-like Protocols for On-Demand Stored Media Streaming Khandoker Nadim Parvez Carey Williamson Anirban Mahanti Niklas Carlsson.
Seed Scheduling for Peer-to-Peer Networks Flavio Esposito Ibrahim Matta Pietro Michiardi Nobuyuki Mitsutake Damiano Carra.
Clustering and Sharing Incentives in BitTorrent Systems Arnaud Legout 1, Nikitas Liogkas 2, Eddie Kohler 2, Lixia Zhang 2 1 INRIA, Projet Planète, Sophia.
Modelling and Performance Analysis of BitTorrent-Like Peer-to-Peer Networks.
Analyzing and Improving BitTorrent Ashwin R. Bharambe ( Carnegie Mellon University ) Cormac Herley ( Microsoft Research, Redmond ) Venkat Padmanabhan (
Exploiting BitTorrent For Fun (But Not Profit) Nikitas Liogkas, Robert Nelson, Eddie Kohler, Lixia Zhang University of California, Los Angeles.
Free-riding in BitTorrent Networks with the Large View Exploit Michael Sirivianos, Jong Han Park, Rex Chen and Xiaowei Yang University of California, Irvine.
CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang
Alex Sherman Jason Nieh Cliff Stein.  Lack of fairness in bandwidth allocation in P2P systems:  Users are not incentivized to contributed bandwidth.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Peer-Assisted Content Distribution Networks: Techniques and Challenges Pei Cao Stanford University.
Do Incentives Build Robustness in BitTorrent? Piatek, Isdal, Anderson, Krishnamurthy, and Venkataramani Piatek, Isdal, Anderson, Krishnamurthy, and Venkataramani.
1 Incentives Build Robustness in BitTorrent? Analysis on Bit Torrent Client performance By Jimmy Wong.
Peer-To-Peer Multimedia Streaming Using BitTorrent Purvi Shah, Jehan-François Pâris University of Houston Houston, TX.
BitTorrent Under a Microscope: Towards Static QoS Provision in Dynamic Peer-to-Peer Networks Tom H. Luan*, Xuemin (Sherman) Shen* and Danny H. K. Tsang.
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
Do incentives build robustness in BitTorrent? Michael Piatek, Tomas Isdal, Thomas Anderson, Arvind Krishnamurthy, Arun Venkataramani.
Do incentives build robustness in BitTorrent? Michael Piatek, Tomas Isdal, Thomas Anderson, Arvind Krishnamurthy, Arun Venkataramani Szabolcs Nagy, ELTE.
Bit Torrent A good or a bad?. Common methods of transferring files in the internet: Client-Server Model Peer-to-Peer Network.
MULTI-TORRENT: A PERFORMANCE STUDY Yan Yang, Alix L.H. Chow, Leana Golubchik Internet Multimedia Lab University of Southern California.
Analyzing and Improving BitTorrent Ashwin R. Bharambe ( Carnegie Mellon University ) Cormac Herley ( Microsoft Research, Redmond ) Venkat Padmanabhan (
PEAR TO PEAR PROTOCOL. Pure P2P architecture no always-on server arbitrary end systems directly communicate peers are intermittently connected and change.
Lecture XV: Real P2P Systems
An example of peer-to-peer application
FairTorrent: BrinGing Fairness to Peer-to-Peer Systems
Introduction to BitTorrent
Economics and Computation Week 7: The economics of P2P file sharing
Do incentives build robustness in BitTorrent?
Managing Inter-domain Traffic in the Presence of BitTorrent File-Sharing Srinivasan Seetharaman and Mostafa Ammar School of Computer Science Objective:
Small Is Not Always Beautiful
Do incentives build robustness in BitTorrent?
Simplified Explanation of “Do incentives build robustness in BitTorrent?” By James Hoover.
The BitTorrent Protocol
Content Distribution Networks + P2P File Sharing
Pure P2P architecture no always-on server
Chapter 2 Application Layer
Content Distribution Networks + P2P File Sharing
Presentation transcript:

Alex Sherman, Jason Nieh, Cliff Stein Columbia University

Delivering content using a P2P network is cheap, as P2P leverages user upload bandwidth… … however todays P2P networks lack strong incentives mechanisms for users to contribute bandwidth

Free-Riders and Low-Contributing peers Consume much bandwidth in P2P networks Cause much slower downloads for other users High-Contributing peers often receives much less bandwidth than they contribute

Can one design a P2P system that comes close to ideal fairness? Ideal fairness: a peer downloads data at a rate at which it uploads

Credit-Based Systems (e.g. Dandelion) No real-time fairness Peer Reputation Systems (e.g. Eigentrust) Probabilistic, inexact BitTorrent-like (most popular) Tit-for-Tat, Proportional Response, K-TFT

Seed Leechers File:

Estimates used as prediction Willing to reciprocate at a higher rate Commits BW for a duration of a round Unstable peer relationships Peer i

Leads to: Long peer discovery times [NSDI 07] Much bandwidth waste, easily exploited by strategic clients (e.g., LargeView, BitTyrant)

In each round peer reallocates upload rates in proportion to observed download rates Assumes in each round peers can accurately estimate intended rate allocations of all neighbors In practice, PropShare client [SIGCOMM 08] Cannot accurately estimate inteded rate allocations Relies on optimistic unchoking to discover better peers Exhibits poor upload/download rate convergence

Leecher L i stops uploading to leecher L j when the trade deficit reaches some threshold of K bytes Used by BitTyrant [NSDI 07] peers with one another Problem: prevents high-uploaders from utilizing their bandwidth

Bit-Torrent-like approaches rely or rate allocation Inherently imprecise Perform poorly in realistic scenarios If we do not use rate-allocation, what can be done…

Effect: ensures fast rate convergence of a leechers download and upload rates total upload and download rates peerwise data-exchange rates

Effects: Evenly splits seed bandwidth among leechers Helps new peers to bootstrap

Fast Rate Convergence of upload/download rates Resilience to Strategic Peers E.g. free-riders

LjLj LkLk LlLl LmLm Li DF ij =1 DF ik =1 DF il =0 DF im =0 R ji = data rate from L j to L i If R mi > R ji => R im > R ij Strategic

LjLj LkLk LlLl LmLm Li DF ij =1 DF ik =1 DF il =1 DF im =1 = upload capacity of L i LnLn DF in =0 Assume: Sends to new peers until:

DF ij (t) = deficit at time t Fairness metric = Maximum Deficit … the maximum number of data blocks owed to Li at any time

In a network with N leechers, with upload capacities selected uniformly from the range: [1,r] assuming leechers have data to exchange, for any leecher Li, with probability at least :

Corollary 1: fast rate convergence, because the amount of data downloaded by a leecher lags what it has uploaded by at most O(log(N)) Corollary 2: a strategic peer, such as a free- riders receives at most O(log(N)) free data blocks

Leechers L i, L j, L k with upload capacities 3,2, and 2 data blocks/sec LjLj LkLk LiLi Idea data-exchange rates:

Leechers L i, L j, L k with upload capacities 3,2, and 2 data blocks/sec LjLj LkLk LiLi FairTorrent: converges in 2 sec. LjLj LkLk LiLi BitTorrent: Li loses 1 block each sec LjLj LkLk LiLi K-TFT: capacity under- utilized

PropShare: LjLj LkLk Li Time 0 to 10 LjLj LkLk Li Time 10 to 20 LjLj LkLk Li Time 20 to 30 LjLj LkLk Li Time 30 to 40

Fast Rate Convergence Resilience to Strategic Peers Fully Distributed Simple, requires no changes to protocol Requires: No estimates of peers intended rate allocations No upload rate allocations No rounds or other parameter tuning

We implemented FairTorrent on top of the original python BitTorrent client Evaluated on PlanetLab against: Original BitTorrent client Azureus (most popular) PropShare BitTyrant (uses K-TFT with other BitTyrant clients)

Base Case: uniform distribution Live: rates picked from observed live networks Skewed: many low-contributors Running inside live BitTorrent swarms

50 leechers with rates picked uniformly from a large range 1-50 KB/s 10 seeds upload at 25 KB/s 32 MB File Repeated experiment five times with each network

Leechers that upload KB/s

FT(0.43MB), BT(8MB), AZ(8), PS(19), TY(31)

FT (756 ), BT(876), AZ(980), PS(1200), TY(1298)

Exponential-like distribution. Capacities from KB/s. Mean 17KB/s. [Piateck07] Top 10% of leecers account for 50% of total upload capacity Dynamic arrivals/departures. New leecher enters every 5 seconds. Doubled network size: 100 leechers, 20 seeds

Download times: 372 (FT), 593(BT), 733(AZ) 624(PS), and 842 (TY) seconds. FT 37%-56% faster.

FT high-uploaders reduce download times by 37% in BT, 41% in AZ, 47% in PS, 56% in TY

Download times in AZ are reduced by 41% with AZ, 5% by PS and 9% by TY

One high-uploader at 50 KB/s 49 low-contributors: upload at 1-5 KB/s

Download Times: FT 644s, 3-5 times faster than BT (1804), AZ(1859), PS(1633) and TY(3305)

FT high-uploader reduces download times by 61% in BT, 39% in AZ, 75% in PS, 81% in

Large popular swarms with thousands of users File sizes 1-10 GB Joined 40 swarms for 1500 seconds. Measured download rate Each client uploads at 300KB/s, Download capped at 600 KB/s Max Connections: 50, (default for PropShare, BitTyrant) 50 (default for Azureus)

FT outperforms AZ, PS, TY by % with 500 connections limit

FT outperforms AZ, PS, TY by 63-79% with 50 connection limit

We introduce, implement and evaluate a new simple deficit-based approach FairTorrent achieves much more optimal fairness, rate-convergence and resilience to strategic peers than rate-allocation approaches Guarantees better performance for high- contributing peers Paves the way for implementation of more reliable content delivery services over P2P

Incentives in P2P streaming Exploiting network locality

Project: torrent Project: torrent