BitTorrent Optimization Techniques (from various online sources)

Slides:



Advertisements
Similar presentations
P2P Streaming Protocol Pro- incentive Parameters draft-zeng-ppsp-protocol-pro-incentive-para-01 IETF79 Meeting Wenjun (Kevin) Zeng & Yingjie Gu Huawei.
Advertisements

Neighbour selection strategies in BitTorrent- like Peer-to-Peer systems L.G. Alex Sung, Herman Li March 30, 2005 for CS856 Web Data Management University.
Cope with selfish and malicious nodes
Rarest First and Choke Algorithms Are Enough
Rarest First and Choke Algorithms are Enough Arnaud LEGOUT INRIA, Sophia Antipolis France G. Urvoy-Keller and P. Michiardi Institut Eurecom France.
The BitTorrent Protocol
The BitTorrent Protocol. What is BitTorrent?  Efficient content distribution system using file swarming. Does not perform all the functions of a typical.
Incentives Build Robustness in BitTorrent Author: Bram Cohen Presenter: Brian Liao.
Incentives Build Robustness in BitTorrent- Bram Cohen Presented by Venkatesh Samprati.
The BitTorrent protocol A peer-to-peer file sharing protocol.
Incentives Build Robustness in BitTorrent Bram Cohen.
Bit Torrent (Nick Feamster) February 25, BitTorrent Steps for publishing – Peer creates.torrent file and uploads to a web server: contains metadata.
Presented by: Su Yingbin. Outline Introduction SocialSwam Design Notations Algorithms Evaluation Conclusion.
The Role of Prices in Peer-Assisted Content Distribution Christina Aperijis Michael J. Freedman Ramesh Johari Presented by: Kyle Chauvin and Henry Xie.
Stochastic Analysis of File Swarming Systems The Chinese University of Hong Kong John C.S. Lui Collaborators: D.M. Chiu, M.H. Lin, B. Fan.
The BitTorrent content distribution system CS217 Advanced Topics in Internet Research Guest Lecture Nikitas Liogkas, 5/11/2006.
Clustering and Sharing Incentives in BitTorrent Systems Arnaud Legout 1, Nikitas Liogkas 2, Eddie Kohler 2, Lixia Zhang 2 1 INRIA, Projet Planète, Sophia.
Analyzing and Improving BitTorrent Ashwin R. Bharambe ( Carnegie Mellon University ) Cormac Herley ( Microsoft Research, Redmond ) Venkat Padmanabhan (
CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang
CMPT 401 Summer 2007 Dr. Alexandra Fedorova Lecture XV: Real P2P Systems.
Network Coding for Large Scale Content Distribution Christos Gkantsidis Georgia Institute of Technology Pablo Rodriguez Microsoft Research IEEE INFOCOM.
Improving ISP Locality in BitTorrent Traffic via Biased Neighbor Selection Ruchir Bindal, Pei Cao, William Chan Stanford University Jan Medved, George.
Peer-Assisted Content Distribution Networks: Techniques and Challenges Pei Cao Stanford University.
Modeling and analysis of BitTorrent-like P2P network Fan Bin Oct,1 st,2004.
CS 300 – Lecture 20 Intro to Computer Architecture / Assembly Language Caches.
1 Incentives Build Robustness in BitTorrent? Analysis on Bit Torrent Client performance By Jimmy Wong.
Dynamic parallel access to replicated content in the Internet Pablo Rodriguez and Ernst W. Biersack IEEE/ACM Transactions on Networking, August 2002.
A P2P file distribution system ——BitTorrent Fan Bin Sep,25,2004.
Incentives Build Robustness in BitTorrent 1st Workshop on Economics of Peer-to-Peer Systems 2003 Bram Cohen
BitTorrent Background. Common Scenario Millions want to download the same popular huge files (for free) –ISO’s –Media (the real example!) Client-server.
distributed web crawlers1 Implementation All following experiments were conducted with 40M web pages downloaded with Stanford’s webBase crawler in Dec.
Content Overlays (Nick Feamster) February 25, 2008.
Bit Torrent (Nick Feamster) February 25, BitTorrent Steps for publishing – Peer creates.torrent file and uploads to a web server: contains metadata.
University of Bologna, Italy How to cheat BitTorrent and why nobody does Simon Patarin and David Hales University of Bologna ECCS 2006,
Application Layer – Peer-to-peer UIUC CS438: Communication Networks Summer 2014 Fred Douglas Slides: Fred, Kurose&Ross (sometimes edited)
GPS: A General Peer-to-Peer Simulator and its Use for Modeling BitTorrent Weishuai Yang Nael Abu-Ghazaleh
1 BitTorrent System Efrat Oune Bar-Ilan What is BitTorrent? BitTorrent is a peer-to-peer file distribution system (built for intensive daily use.
BitTorrent Dr. Yingwu Zhu. Bittorrent A popular P2P application for file exchange!
A P2P file distribution system ——BitTorrent Pegasus Team CMPE 208.
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
2: Application Layer1 Chapter 2: Application layer r 2.1 Principles of network applications r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail  SMTP,
Do incentives build robustness in BitTorrent? Michael Piatek, Tomas Isdal, Thomas Anderson, Arvind Krishnamurthy, Arun Venkataramani.
MULTI-TORRENT: A PERFORMANCE STUDY Yan Yang, Alix L.H. Chow, Leana Golubchik Internet Multimedia Lab University of Southern California.
Presented by Rajan Includes slides presented by Andrew Sprouse, Northeastern University CISC 856 TCP/IP and Upper Layer Protocols Date:May 03, 2011.
Application Layer 2-1 Chapter 2 Application Layer Computer Networking: A Top Down Approach 6 th edition Jim Kurose, Keith Ross Addison-Wesley March 2012.
Peer-to-Peer File Sharing Jennifer Rexford COS 461: Computer Networks Lectures: MW 10-10:50am in Architecture N101
2: Application Layer 1 Chapter 2 Application Layer Computer Networking: A Top Down Approach, 5 th edition. Jim Kurose, Keith Ross Addison-Wesley, April.
Analyzing and Improving BitTorrent Ashwin R. Bharambe ( Carnegie Mellon University ) Cormac Herley ( Microsoft Research, Redmond ) Venkat Padmanabhan (
Peer to Peer Networking. Network Models => Mainframe Ex: Terminal User needs direct connection to mainframe Secure Account driven  administrator controlled.
Lecture 7 Page 1 CS 111 Summer 2013 Dynamic Domain Allocation A concept covered in a previous lecture We’ll just review it here Domains are regions of.
PEAR TO PEAR PROTOCOL. Pure P2P architecture no always-on server arbitrary end systems directly communicate peers are intermittently connected and change.
Peer-to-Peer Networks 10 Fast Download Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg.
Traffic Localization with Information Guidance of Pseudo Peer Agent on BT-P2P Network 學生 : 楊宏昌 指導教授 : 曾黎明教授 在 BT 同儕通訊上利用參與者訊息引導對外流量之區域化節約.
November 19, 2016 Guide:- Mrs. Kale J. S. Presented By:- Hamand Amol Sambhaji. Hamand Amol Sambhaji. Pardeshi Dhananjay Rajendra. Pardeshi Dhananjay Rajendra.
Lecture XV: Real P2P Systems
An example of peer-to-peer application
Introduction to BitTorrent
Managing Data Transfer in Computer Clusters with Orchestra
Introduction to Computers
Designing a new BitTorrent Client
Economics and Computation Week 7: The economics of P2P file sharing
Angelo Sapello University of Delaware
Simplified Explanation of “Do incentives build robustness in BitTorrent?” By James Hoover.
The BitTorrent Protocol
Content Distribution Networks + P2P File Sharing
Pure P2P architecture no always-on server
Algorithms for Selecting Mirror Sites for Parallel Download
Chapter 2 Application Layer
Content Distribution Networks + P2P File Sharing
Presentation transcript:

BitTorrent Optimization Techniques (from various online sources)

Announcement No recitation next week! Final review session – Next Sunday (5/2) 5-7pm, GHC 4215 – Let us know what you want at – More specifics will be announced on the course webpage.

Announcement (2) TA Evaluations! – Your comments / feedbacks are welcomed Any reasonable criticism Anything you liked or didn’t like Anything you would like to do / see – Helps us improve the recitations and our teaching style!

Evaluation links 441 A Kaushik Lakshminarayanan M 441 B Rui Meireles C Daegun Won W

Before we start Everything we discuss here is about BitTorrent Not everything might be useful for the project – We’d like to make it your work to figure it out – It wouldn’t be hard

Two Important Aspects Peer selection – How to choose other peers to exchange data with Chunk selection – How to choose / prioritize chunks to download

Peer selection Employs a ‘Tit-for-Tat’ strategy 1.Unless provoked, the agent will always cooperate 2.If provoked, the agent will retaliate 3.The agent is quick to forgive 4.The agent must have a good chance of competing against the opponent more than once. Called choking algorithm

Good choking algorithm Caps the number of simultaneous uploads Avoids choking/ unchoking too quickly Reciprocate to peers who – let the peer download – try to use unused peers once in a while (get out of local maxima)

More specificially... Peer A chokes Peer B if it decides not to upload to B – Choking = temporary refusal to upload Each peer (A) unchokes at most 4 peers that have chunks that A doesn’t have – 3 peers with fastest upload rate (to A) – 1 randomly chosen peers Called ‘Optimistic Unchoking’

Optimistic Unchoking Finds potentially faster peers Allow new peers to receive their first piece Helps out ‘snubbed’ users – Snubbed users = Choked by all its peers

Chunk Selection Strategies Random First Piece Rarest First Endgame Mode

Chunk Overlaps Small overlap – Every pair can exchange something – Better utilization of bandwidth Big overlap – Only a few peers are very ‘valuable’ – Less utilization of bandwidth

What do we want? Ultimately, we want to maximize the total transfer rate of all simultaneous transfers It would be nice if every pair has something to exchange – So that we can utilize most of the possible end-to-end connections

What does it have to do with chunk selection? If something is … – Too popular So much supply but not many looking for it – Too rare So much demand but not many having it Then it is much less likely to utilize all end-to-end connections

Maximizing Bandwidth Utilization Keep all chunks as evenly popular as possible – So that we can maximize the number of simultaneous transfers

Prioritizing algorithm should aim towards uniform distribution!

Chunk Selection Strategies Random First Piece Rarest First Endgame Mode

Random First Piece Initially, the peer has nothing – Important to have some pieces to reciprocate for the choke algorithm. Need something ASAP – Randomly chosen chunks are likely to be more replicated Can download them faster – Then the peer can upload something First four piece, then switch to Rarest First

Rarest First Look at all chunks at all peers Request the ‘rarest’ piece – Owned by fewest peers Yes, aim towards UNIFORM DISTRIBUTION! What if the original seeder leaves before no one downloads the whole file? – Oh no!

Rarest First What if the original seeder leaves before no one downloads the whole file? – This policy increases the likelihood that everything is still available!

Endgame Mode Happens near the end – Request the missing blocks to everyone. – Cancel pending requests when the chunk is downloaded A bit wasteful, but… – Speeds up the completion – Not too much waste in practice – Prevents slow completion due to a single peer with slow transfer rate

Anything else you can do? There are more things you can improve…

Other things you can do You can easily improve your congestion- avoidance algorithm – Check out other algorithms such as TCP new- Reno(highly recommended) The network topology might be not totally random – May have a number of clusters and so on… And of course, look up for more on the web!

Sources /bittorrent.pdf /bittorrent.pdf /Lecture08-BitTorrent.pdf /Lecture08-BitTorrent.pdf – If the above doesn’t work, try BitTorrent.pdf+bittorrent+lecture+pdf&hl=en&gl=us&pid=bl&srcid=ADGEESgjwWMdTDIEQMWa6wRklCax3kOIhy4GKlRk- rIhFlhViP6x5dGyDsIkSlsQDkv6lquNlMycLDED- VlsocwV1i9k1AGftgzXIOgYbp7IozD2xTcR3WtLlN7Ha9j3o67o7Y5TL_RF&sig=AHIEtbSh2BXqAKN8ck4kEj-p6yg-J_DcTA 8sp/bittorrent.pdf 8sp/bittorrent.pdf ers/p20-legout.pdf ers/p20-legout.pdf