Emergent Group-Like Selection in a Peer-to-Peer Network ECCS Conference Paris, Nov. 16 th, 2005 David Hales University of Bologna, Italy www.davidhales.com.

Slides:



Advertisements
Similar presentations
Reinforcement Learning
Advertisements

Scalable and Dynamic Quorum Systems Moni Naor & Udi Wieder The Weizmann Institute of Science.
SP 5: Biologically Inspired Techniques for “Organic IT” Final Year Report Participants UniBO, UPF, Telenor, RAL Lead partner: Bologna (UniBO)
Solving Collective Commons Problems: Future Scenarios for P2P Finance David Hales, University of Szeged, Hungary Diversity in Macro.
VDR: Proactive element Conclusions VDR reaches 3.5% more nodes than VDR-R and 9% more nodes than our modified random walk routing strategy (RWR) VDR shows.
UNIVERSITY OF JYVÄSKYLÄ Building NeuroSearch – Intelligent Evolutionary Search Algorithm For Peer-to-Peer Environment Master’s Thesis by Joni Töyrylä
Improving Peer-to-Peer Networks “Limited Reputation Sharing in P2P Systems” “Robust Incentive Techniques for P2P Networks”
Generated Waypoint Efficiency: The efficiency considered here is defined as follows: As can be seen from the graph, for the obstruction radius values (200,
Search and Replication in Unstructured Peer-to-Peer Networks Pei Cao, Christine Lv., Edith Cohen, Kai Li and Scott Shenker ICS 2002.
1 SLIC: A Selfish Link-based Incentive Mechanism for Unstructured P2P Networks Qixiang Sun Hector Garcia-Molina Stanford University.
Improving Robustness in Distributed Systems Jeremy Russell Software Engineering Honours Project.
UNIVERSITY OF JYVÄSKYLÄ Topology Management in Unstructured P2P Networks Using Neural Networks Presentation for IEEE Congress on Evolutionary Computing.
Efficient Content Location Using Interest-based Locality in Peer-to-Peer Systems Presented by: Lin Wing Kai.
Protecting Free Expression Online with Freenet Presented by Ho Tsz Kin I. Clarke, T. W. Hong, S. G. Miller, O. Sandberg, and B. Wiley 14/08/2003.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery Using NeuroSearch Presentation for the Agora Center InBCT-seminar Mikko Vapa, researcher InBCT 3.2.
University of Bologna, Italy How to cheat BitTorrent and why nobody does Simon Patarin and David Hales University of Bologna ECCS 2006,
Project funded by the Future and Emerging Technologies arm of the IST Programme Recent directions in DELIS / Overview of on-going work David Hales
Cooperation through the endogenous evolution of social structure David Hales & Shade Shutters The Open University & Arizona State University
Learning in Multiagent systems
CSS-TW1 Cooperation in Selfish Systems incorporating TagWorld I Welcome! David Hales, University of Bologna.
When Simple Networks Fail: Characterising Social Networks Using Simulation Bruce Edmonds Centre for Policy Modelling Manchester Metropolitan University.
Using the Small-World Model to Improve Freenet Performance Hui Zhang Ashish Goel Ramesh Govindan USC.
Towards Cooperative Self- Organized Replica Management Work in Progress David Hales, Andrea Marcozzi (University of Bologna) Giovanni Cortese (University.
Project funded by the Future and Emerging Technologies arm of the IST Programme Cooperation with Strangers David Hales Department of.
Example Department of Computer Science University of Bologna Italy ( Decentralised, Evolving, Large-scale Information Systems (DELIS)
Rationality meets the tribe: Some models of cultural group selection David Hales, The Open University Hales, D., (2010) Rationality.
Engineering with Sociological Metaphors: Examples and Prospects University of Bologna This work is partially supported by the European.
Researchers: Preet Bola Mike Earnest Kevin Varela-O’Hara Han Zou Advisor: Walter Rusin Data Storage Networks.
SLAC and SLACER: Simple copy & rewire algorithms for trust and cooperation in P2P David Hales, Stefano Arteconi, Ozalp Babaoglu University of Bologna,
ACN: RED paper1 Random Early Detection Gateways for Congestion Avoidance Sally Floyd and Van Jacobson, IEEE Transactions on Networking, Vol.1, No. 4, (Aug.
SP 5: Biologically Inspired Techniques for “Organic IT” Plan for months Participants UniBO, UPF, Telenor, TILS presented by David Hales (UniBO)
Project funded by the Future and Emerging Technologies arm of the IST Programme Socially Inspired Approaches to Evolving Cooperation David Hales
Can Tags Build Working Systems? From MABS to ESOA Attempting to apply results gained from Multi-Agent- Based Social Simulation (MABSS)
P2P Interaction in Socially Intelligent ICT David Hales Delft University of Technology (Currently visiting University of Szeged, Hungary)
Multi-Patch Cooperative Specialists With Tags Can Resist Strong Cheaters, Bruce Edmonds, Feb 2013, ECMS 2013, Aalesund, Norway, slide 1 Multi-Patch Cooperative.
Evolving networks for cooperation Dagstuhl CCT3 DELIS Workshop Sept 3rd-4th 2005 Presented by David Hales University of Bologna, Italy
Self-Organising Networks of Services without Money or Contracts David Hales, University of Bologna, Italy First International Workshop and Summer School.
You are all social scientists: you just don’t know it yet David Hales (University of Bologna, Italy) SASO 2007, Cambridge. Mass.
Putting “tags” to work Attempting to apply results gained from agent- based social simulation (ABSS) to MAS. Dr David Hales
David Hales (University of Bologna) University of Bologna, Italywww.davidhales.com WARNING! Superficial sociological interpretation followed by simplistic.
Evolving cooperation in one-time interactions with strangers Tags produce cooperation in the single round prisoner’s dilemma and it’s.
The new protocol of freenet Taken from Ian Clarke and Oskar Sandberg (The Freenet Project)
Evolving Social Rationality for MAS using “Tags” Trying to “make things work” by applying results gained from Agent-Based Social Simulation.
6 December On Selfish Routing in Internet-like Environments paper by Lili Qiu, Yang Richard Yang, Yin Zhang, Scott Shenker presentation by Ed Spitznagel.
Project funded by the Future and Emerging Technologies arm of the IST Programme From Selfish Nodes to Cooperative Networks – Emergent Link-based Incentives.
Project funded by the Future and Emerging Technologies arm of the IST Programme Understanding “tag” systems by comparing “tag” models David Hales
The Evolution of Specialisation in Groups – Tags (again!) David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Aug 22, 2002Sigcomm 2002 Replication Strategies in Unstructured Peer-to-Peer Networks Edith Cohen AT&T Labs-research Scott Shenker ICIR.
Repeated Game Modeling of Multicast Overlays Mike Afergan (MIT CSAIL/Akamai) Rahul Sami (University of Michigan) April 25, 2006.
Socially Inspired Computing Engineering with Social Metaphors.
Evolving P2P overlay networks with Tags, SLAC and SLACER for Cooperation and possibly other things… Saarbrücken SP6 workshop July 19-20th 2005 Presented.
Project funded by the Future and Emerging Technologies arm of the IST Programme Altruism “for free” using Tags David Hales Department.
School of Electrical Engineering &Telecommunications UNSW Cost-effective Broadcast for Fully Decentralized Peer-to-peer Networks Marius Portmann & Aruna.
Simple Rewire Protocols for Cooperation in Dynamic Networks David Hales, Stefano Arteconi, Ozalp Babaoglu University of Bologna, Italy Bio-Inspired Workshop,
Social Simulation for Self-* Systems: An idea whose time has come? David Hales University of Bologna, Italy In collaboration with: Stefano.
Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags – The emergence of a group identity? David Hales Centre for Policy Modelling, Manchester.
Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Project funded by the Future and Emerging Technologies arm of the IST Programme Change your tags fast! - A necessary condition for cooperation? David Hales.
Evolution of Cooperation in Mobile Ad Hoc Networks Jeff Hudack (working with some Italian guy)
Emergent Group Selection: Tags, Networks and Society David Hales, The Open University ASU, Thursday, November 29th For more details.
Novel Models of Group Selection in Social Structures and Networks David Hales University of Bologna, Italy In collaboration with: Stefano.
Rationality and Power: the “gap in the middle” in ICT
Web *.0 ? Combining peer production and peer-to-peer systems
Evolution for Cooperation
Socially Inspired Approaches to Evolving Cooperation
Group Selection Design Pattern
Self-Organising, Open and Cooperative P2P Societies – From Tags to Networks David Hales Department of Computer Science University of.
Evolution for Cooperation
Altruism “for free” using Tags
Evolving cooperation in one-time interactions with strangers
Presentation transcript:

Emergent Group-Like Selection in a Peer-to-Peer Network ECCS Conference Paris, Nov. 16 th, 2005 David Hales University of Bologna, Italy This work partially supported by the EU within the 6th Framework Programme under contract (DELIS).

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The Basic Problem Consider a P2P overlay network in which each node: Offers a service (e.g. storage, processing etc.) Receives jobs submitted by users May ask neighbour nodes to help complete jobs May complete jobs for neighbours May move in the network by making and breaking links Uses local information only Behaves in a selfish way (boundedly rational) May compare its performance to other nodes May copy links, and behaviours of other nodes We want a scalable, robust, light-weight decentralised algorithm that self-organises network to maximise system level performance

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The Solution - The SLAC algorithm SLAC = Selfish Link-based Adaptation for Cooperation Demonstrated to be effective in P2P networks when: Peers play the Prisoner’s Dilemma with neighbours (ESOA’04) Peers answer queries and share files (IEEE TSMC’05) But in these previous scenarios: Nodes provided an identical service Cooperation resulted from all nodes behaving identically This new problem requires specialists nodes to work together In order to maximise system level performance nodes need to do different things, not identical things This work therefore tests if SLAC can support inter-node specialisation

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The Simulation - SkillWorld To test this produced a simulation model called SkillWorld The population consists of N nodes (fixed) Each node has the following state: A single skill from a set S  {1,2,3,4,5} (the service provided) An altruism flag A  {0,1} (indicates if node helps neighbours) A utility U  R (a performance measure) Some set of links to other nodes (max. of 20) Each node asynchronously receives and attempts to complete jobs Each job is marked with a single skill # (randomly chosen) Job must be processed by a node with matching skill If receiving node i has req. skill, job is completed Ui = Ui + 1 If node i does not have req. skill it asks its neighbours If a neighbour j is found with A = 1 and matching skill then: Job is completed, Ui = Ui +1, but, Uj = Uj

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The Simulation - SkillWorld = altruist = selfish Job(1)Job(3)Job(1)

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The SLAC algorithm SLAC follows a kind of evolutionary process Periodically each node: Engages in application level activity producing utility (SkillWorld) Compares its utility to another randomly chosen node If the other node has higher utility then Copy links and some behaviour of other node With low probability “mutate” links and behaviour

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 The SLAC algorithm in SkillWorld

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 SkillWorld simulation specifics In each cycle, 10N jobs are submitted to randomly selected nodes Each job is given a randomly selected skill requirement Nodes initialised with random skills and links (random network) Initial topology of network made little difference to results Compared initialisation of altruism flag randomly and all selfish Compared different network sizes N Measured proportion of completed jobs (CJ) in each cycle Mutation values (M = 0.001, MR = 0.01) If a node reaches its max. links (20) then a random link is discarded if a new link is required Utility for each node = CJ - total help cost Ran simulations until 90% of jobs completed

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Number of cycles to high performance for different N When PCJ > 90% over 90% of all jobs submitted to nodes are completed. Nodes are initialised at random

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Number of cycles to high performance when all nodes are initialised selfish Note that there is a reverse scaling cost here.

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Typical single run (N=1000) from random initialisation. selfish = proportion non-altruists, C = clustering coefficient, comps = components in the population (normalised by dividing by 60), conprob = average probability that a route exists between any two nodes.

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Cycle 0 Cycle 10

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Cycle 20 Cycle 30

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Simulation Results Summary From individual bounded utility maximising behaviour (SLAC) Altruistic “tribes” emerge with internal specialisation Tribes that do well - collectively - tend to recruit new nodes Tribes that perform badly - collectively - tend to lose nodes Hence productive tribes prosper, defective tribes “die” This is a kind of “tribe selection” via recruitment and retention By giving nodes the ability to choose their tribes a kind of tribe level evolution happens - evolution at the next level

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Issues, on-going and future work But SLAC produces extreme tribalism with disconnected components => SLACER (on-going work) SLAC assumes honest passing of info and utility comparison => Greedy Cheating Liars (on-going work) The SkillWorld task is an “easy” test => more realistic scenarios System performance does not attain more than about 93% If Skill mutated then can adjust to different job task loadings But if Skill is copied like the AltruismFlag then fails to converge, yet in similar scenarios it does Tribe recruitment is the key idea => (on-going work) Future work could drop utilities and move to satisficing where aspiration level is a kind of “required service level”

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005 Conclusions

David Hales, University of Bologna, Choose Your Tribe! Evolution at the next level in a P2P network ESOA2005, Utrecht, July 2005