BitTorrent – from swarms to collectives Some on-going research in the tribler team at TU Delft name:David Hales date:Sept. 21, 2009 event:ECCS 2009.

Slides:



Advertisements
Similar presentations
BitTorrent or BitCrunch: Evidence of a credit squeeze in BitTorrent?
Advertisements

Towards a Quality Financial Commons? David Hales Technical University of Delft, The Netherlands
Cope with selfish and malicious nodes
Rarest First and Choke Algorithms are Enough Arnaud LEGOUT INRIA, Sophia Antipolis France G. Urvoy-Keller and P. Michiardi Institut Eurecom France.
The BitTorrent Protocol. What is BitTorrent?  Efficient content distribution system using file swarming. Does not perform all the functions of a typical.
Incentives Build Robustness in BitTorrent Author: Bram Cohen Presenter: Brian Liao.
Incentives Build Robustness in BitTorrent- Bram Cohen Presented by Venkatesh Samprati.
Incentives Build Robustness in BitTorrent Bram Cohen.
Bit Torrent (Nick Feamster) February 25, BitTorrent Steps for publishing – Peer creates.torrent file and uploads to a web server: contains metadata.
Presented by: Su Yingbin. Outline Introduction SocialSwam Design Notations Algorithms Evaluation Conclusion.
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Game Theory “Доверяй, Но Проверяй” - Russian Proverb (Trust, but Verify) - Ronald Reagan Mike Shor Lecture 6.
Evolution of Cooperation The importance of being suspicious.
An Introduction to... Evolutionary Game Theory
BitTorrent Join the swarm! BY: Joe Petruska. What is BitTorrent? a peer-to-peer file sharing protocol used for distributing large amounts of data.
Prisoner’s dilemma TEMPTATION>REWARD>PUNISHMENT>SUCKER.
Free-riding in BitTorrent Networks with the Large View Exploit Michael Sirivianos, Jong Han Park, Rex Chen and Xiaowei Yang University of California, Irvine.
CS 554. Peer-to-Peer Systems Faithfulness in Internet Algorithms Haridimos Kondylakis
CompSci 356: Computer Network Architectures Lecture 21: Content Distribution Chapter 9.4 Xiaowei Yang
CMPT 401 Summer 2007 Dr. Alexandra Fedorova Lecture XV: Real P2P Systems.
Alex Sherman Jason Nieh Cliff Stein.  Lack of fairness in bandwidth allocation in P2P systems:  Users are not incentivized to contributed bandwidth.
Cooperation and ESSs Putting Humpty together again.
Presented by Stephen Kozy. Presentation Outline Definition and explanation Comparison and Examples Advantages and Disadvantages Illegal and Legal uses.
1 Incentives Build Robustness in BitTorrent? Analysis on Bit Torrent Client performance By Jimmy Wong.
BitTorrent Background. Common Scenario Millions want to download the same popular huge files (for free) –ISO’s –Media (the real example!) Client-server.
The Socio-Economics of P2P Systems David Hales The Open University UK Lisbon, June 3 rd, 2011.
Socio-Economics Inspired Distributed Systems Design David Hales The Open University, UK Design Group Seminar, Nov. 16 th, 2011.
Virtual communities, Peer-to-Peer Networks Basic introduction to the (sociology and) economics of file-sharing in BitTorrent systems name:David Hales date:Jan.
Content Overlays (Nick Feamster) February 25, 2008.
Bit Torrent (Nick Feamster) February 25, BitTorrent Steps for publishing – Peer creates.torrent file and uploads to a web server: contains metadata.
Free-riding and incentives in P2P systems name:Michel Meulpolder date:September 8, 2008 event:Tutorial IEEE P2P 2008.
BitTorrent Presentation by: NANO Surmi Chatterjee Nagakalyani Padakanti Sajitha Iqbal Reetu Sinha Fatemeh Marashi.
University of Bologna, Italy How to cheat BitTorrent and why nobody does Simon Patarin and David Hales University of Bologna ECCS 2006,
BitTorrent How it applies to networking. What is BitTorrent P2P file sharing protocol Allows users to distribute large amounts of data without placing.
Yitzchak Rosenthal P2P Mechanism Design: Incentives in Peer-to-Peer Systems Paper By: Moshe Babaioff, John Chuang and Michal Feldman.
Economics of P2P file- sharing systems Basic introduction to the (sociology and) economics of file-sharing in BitTorrent systems name:David Hales, Tribler.
© 2006 Hewlett-Packard Development Company, L.P. You’re welcome to copy, distribute or use these slides, provided that you retain this notice Sharing in.
A P2P file distribution system ——BitTorrent Pegasus Team CMPE 208.
1 BitHoc: BitTorrent for wireless ad hoc networks Jointly with: Chadi Barakat Jayeoung Choi Anwar Al Hamra Thierry Turletti EPI PLANETE 28/02/2008 MAESTRO/PLANETE.
Do incentives build robustness in BitTorrent? Michael Piatek, Tomas Isdal, Thomas Anderson, Arvind Krishnamurthy, Arun Venkataramani.
David A. Bryan, PPSP Workshop, Beijing, China, June 17th and 18th 2010 PPSP Protocol Considerations.
Standard and Extended Form Games A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor, SIUC.
Project funded by the Future and Emerging Technologies arm of the IST Programme Cooperation with Strangers David Hales Department of.
Example Department of Computer Science University of Bologna Italy ( Decentralised, Evolving, Large-scale Information Systems (DELIS)
MULTI-TORRENT: A PERFORMANCE STUDY Yan Yang, Alix L.H. Chow, Leana Golubchik Internet Multimedia Lab University of Southern California.
Project funded by the Future and Emerging Technologies arm of the IST Programme Socially Inspired Approaches to Evolving Cooperation David Hales
P2P Interaction in Socially Intelligent ICT David Hales Delft University of Technology (Currently visiting University of Szeged, Hungary)
You are all social scientists: you just don’t know it yet David Hales (University of Bologna, Italy) SASO 2007, Cambridge. Mass.
Evolving cooperation in one-time interactions with strangers Tags produce cooperation in the single round prisoner’s dilemma and it’s.
Robert Axelrod’s Tournaments Robert Axelrod’s Tournaments, as reported in Axelrod, Robert. 1980a. “Effective Choice in the Prisoner’s Dilemma.” Journal.
The Evolution of Specialisation in Groups – Tags (again!) David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Socially Inspired Computing Engineering with Social Metaphors.
Bit Torrent Nirav A. Vasa. Topics What is BitTorrent? Related Terms How BitTorrent works Steps involved in the working Advantages and Disadvantages.
INTERNET TECHNOLOGIES Week 10 Peer to Peer Paradigm 1.
PEAR TO PEAR PROTOCOL. Pure P2P architecture no always-on server arbitrary end systems directly communicate peers are intermittently connected and change.
© 2016 A. Haeberlen, Z. Ives CIS 455/555: Internet and Web Systems 1 University of Pennsylvania Decentralized systems February 15, 2016.
Exploiting self-organisation in techno-social systems David Hales Delft University of Technology (Currently visiting University of Szeged,
Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags – The emergence of a group identity? David Hales Centre for Policy Modelling, Manchester.
Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Peer-to-Peer Networks 10 Fast Download Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg.
Indirect Reciprocity in the Selective Play Environment Nobuyuki Takahashi and Rie Mashima Department of Behavioral Science Hokkaido University 08/07/2003.
Lecture XV: Real P2P Systems
An example of peer-to-peer application
Introduction to BitTorrent
Incentives in Transformation – P2P, ABM and (a new kind of) Policy
Economics and Computation Week 7: The economics of P2P file sharing
Group Selection Design Pattern
Do incentives build robustness in BitTorrent?
Towards a Quality Financial Commons?
The BitTorrent Protocol
Presentation transcript:

BitTorrent – from swarms to collectives Some on-going research in the tribler team at TU Delft name:David Hales date:Sept. 21, 2009 event:ECCS 2009

Tribler team: 35 + collaborators tribler.org

Tribler BitTorrent Client

Talk Overview What is BitTorrent and specifically and Peer- to-Peer (P2P) systems in general? Axelrod and tit-for-tat experiment From swarms to communities: BitCrunch

What is BitTorrent BitTorrent is a Peer-to-Peer (P2P) file sharing protocol It lets users connect together to share any data they want to It self-organises and scales allowing millions of users to share files easily Current powerful economic actors don’t like it due to piracy But what is a P2P system in general?

6 What are Peer-to-Peer Systems? P2P systems are socio-economic systems Peers cooperate collectively to achieve their goals No peer in the system controls everything Performance results from interactions At the end-of-day users (people) are in control P2P designers confront socio-economic issues

Individualism v. Collectivism In socio-economic systems individual interests may conflict with collective interests: e.g. over exploitation of a common resource (a river, a field, the atmosphere etc.) e.g. banks - lending (to those who they know can not repay) to gain a commission by selling on the debt to other banks e.g. P2P file sharing system - downloading more than uploading

Individualism v. Collectivism Consider a P2P file sharing system: It is in the collective interest for all to upload to others so everyone gets the file quickly But it is in the individual interest to save bandwidth by only downloading and hence free-riding on others Free-riding (or free-loading) is a perennial problem in P2P file-sharing systems Any efficient system needs to tackle it in some way

Some BitTorrent Terminology Swarm: set of peers interested in a file file is split in smaller chunks called pieces seeder: holds a full copy of the data leecher: holds only a part of the data (initially nothing) Tracker: centralized manager keep track of all peers in the swarm return list of current peers in swarm Torrent file: meta-data contains pointer to tracker hosting the swarm details about the file - hash, no. of pieces, size etc.

BitTorrent Protocol Get a list of other peers in the swarm from the tracker Ask peers their list of pieces and tell them what is yours Exchange pieces with appropriate peers

How to avoid the commons tragedy? Central enforcement of correct behaviour require centralised agencies and policing ability to identify and track individuals centrally not suitable for pure P2P (but see: private trackers) Decentralised methods self-policing producing incentives for cooperation do not require centralised coordination more suitable for pure P2P can apply ideas from early complexity science results (Robert Axelrod: Iterated Prisoner’s Dilemma Tournament)

Robert Axelrod’s Tournament - programs as strategies Axelrod organised an open IPD tournament: Academics were asked to submit programs (BASIC or FORTRAN) that would play the IPD against each other Nobody knew competitors code The only input would be the on-going past history of the game (a string of C’s and D’s) The aim was to get the highest score (utility) based on round-robin playoffs between all pairs of programs Axelrod’s aim was to see which programs did best against all the others and understand why He wrote-up his results in the famous book “the evolution of cooperation”

Axlerod’s Tournament - what happened? Basic results were: many strategies were submitted (complex and simple) the one with the highest overall score turned out to be simple: tit-for-tat (TFT) or “look back” starts playing C, then “looked back” at the last move made by opponent and copied that move submitted by Psychologist Anatol Rapoport didn’t “win” against each strategy but did better overall on average against all strategies TFT mechanism an example of “reciprocal altruism” (Robert Trivers)

What has this got to do with BitTorrent? In the BitTorrent protocol: TFT-like method used for sharing files nodes form groups interested in a particular file (swarms) and swap or “barter” pieces with each other if a node does not upload data then this can be compared to playing defection it is punished in the future by being “choked” - not getting upload from others even if you hack your client to be selfish the chances are the standard TFT-like protocol will do better overall Bram Cohen - original BT designer - inspired by Axelrod’s tournaments

The Global Ecology of BitTorrent Clients Many bittorrent clients exist in “the wild” Bittorrent 6 (from Bittorrent.com, formally utorrent) Others: Azureus, ABC, Transmission, many others... Tribler (of course) bad guy clients: BitThief, BitTyrant Hence: The current bittorrent ecosystem is a global on-going experiment, like Axelrod’s, but with huge user base and rich interactions (not just TFT) incredible strategy sophistication This is unprecedented and could lead to new economic theory - in general!

Take home message Previous complexity work (Axelrod’s IPD) has provided a basis for protocol design in a P2P system Deployed variants of the protocol are creating a massive global economic experiment Measurements can be made and these could inform new theory and new protocols

From swarms to collectives

Communities have formed around BitTorrent Trackers

Public Trackers (e.g. PirateBay) BitTorrent uses Trackers to index swarms Public trackers let anyone join or create a swarm Sharing within a swarm is incentivised via a form of tit-for-tat (as we have seen) However there is no incentive for: Seeding (uploading after file is downloaded) Capping (creating and injecting a new file) Maintaining a Tracker in the first instance

Private Trackers (Many) Private Trackers have emerged more recently Only allow registered users to join swarms May track upload / download of each user Some keep centralised accounts for each user When users download much more than upload they may be kicked out Many different schemes: ratio, credits, points etc Some rely on users to just be nice with various “gentleman's club” methods

A little detail on credit systems We will give a little detail on credit systems in private BT communities Give a flavour of how economic / collective issues are becoming significant Present results from a simple (agent-based) model and some measurements of a real private tracker

Private Trackers - Credit Consider a scheme based on credits Uploading 1MB earns one credit Downloading 1MB costs one credit A user with no credits can’t download Users must be given some initial credit In fixed size pop. total credit remains constant Similar to a fixed supply of money in an economy (loose analogy!)

Private Trackers - Credit How much credit should be put into the system? How would it effect the efficiency of the system? When do credit squeezes occur? How can they be avoided? We define a credit squeeze as a situation in which, due to lack of credit, the efficiency of the system is significantly reduced.

Time series of simple model Initial Credit = 100

Some aggregate results C = initial credit T = total throughput = total number of units uploaded as proportion of maximum possible (infinite credit) B = proportion of nodes that are “broke” (zero credit) G = Gini measure (simple measure of inequality of credit) Phi = turnover of top 10% of peers ranked by credit (credit mobility) indicates initial credit of 100 with 1.5 credit seeding bonus

Observations from simulations Even when all peers are equal and are good guys performance of the system may be inhibited by credit shortages Adding extra capacity to the system, in the form of upload and download, can actually reduce the performance By injecting new credit into the system in the form of a “seeding bonus’’ a credit squeeze can be ameliorated

Statistics from a Private Tracker Approx. 50,000 peers per day, 10,000 swarms, access to credit balances of top 10% T = throughput in TB over all swarms Delta = total credit increase that day in the entire system Delta0 = total credit increase for top 10% of peers Delta = minimum fraction of credit increase that goes to top 10% of peers S/L = seeder to leecher ratio over all swarms

Statistics from a Private Tracker Indicates “rich getting richer” since top 10% are getting a lot of the new credit High Seeder / Leecher ratio suggestive that a credit squeeze is happening for many But need more information to verify this Would be interesting to see what happened to throughput if there was a “free day” or seeding bonus was increased

Take home message Communities formed around trackers provide an on-going global socio-economic experiment Self-organisation of socio-economic structures in measurable forms Ideas, models and theories from complexity science may inform and learn from this Cultural group selection, Indirect reciprocity, Altruistic Punishment etc. Such communities so strong don’t be surprised if they start influencing the “real world” (e.g. the PirateParty)

On-going work in Tribler team Community measurements and studies, including qualitative - Nazareno Andrade et al Alternative economic incentive models, incl. Participatory Econ.- Rameez Rahman et al Distributed credit systems, including currency-type approaches – Michel Meulpolder et al Self-organising locality for increased performance - Maciej Wojciechowski et al Many many others…

Advert / plug / shameless promotion! Download tribler 5.1 at: Comments / discussion and suggestions on: forum.tribler.org

References Nash, John (1950) Equilibrium points in n-person games. Proceedings of the National Academy of Sciences 36(1): John von Neumann and Oskar Morgenstern: Theory of Games and Economic Behavior, Princeton University Press (1944) Robert Axelrod (1984) The Evolution of Cooperation, Basic Books Nowak, M.A. and Sigmund, K. (1998) Evolution of indirect reciprocity by image scoring, Nature 393, 573. Garrett Hardin (1968) The Tragedy of the Commons Science 162, Trivers, R.L. (1971). The evolution of reciprocal altruism. Quarterly Review of Biology. 46: Maynard Smith, J. (1982) Evolution and the Theory of Games. Cambridge University Press