Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags – The emergence of a group identity? David Hales Centre for Policy Modelling, Manchester.

Slides:



Advertisements
Similar presentations
The Matching Hypothesis Jeff Schank PSC 120. Mating Mating is an evolutionary imperative Much of life is structured around securing and maintaining long-term.
Advertisements

Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Evolution of Cooperation The importance of being suspicious.
Solving Collective Commons Problems: Future Scenarios for P2P Finance David Hales, University of Szeged, Hungary Diversity in Macro.
Replication, Replication and Replication – Some Hard Lessons from Model Alignment David Hales Centre for Policy Modelling, Manchester Metropolitan University,
Cooperation in Anonymous Dynamic Social Networks Brendan Lucier University of Toronto Brian Rogers Northwestern University Nicole Immorlica Northwestern.
Planning under Uncertainty
Tags and Image Scoring for Robust Cooperation By Nathan Griffiths Presented at AAMAS 2008.
A Memetic Framework for Describing and Simulating Spatial Prisoner’s Dilemma with Coalition Formation Sneak Review by Udara Weerakoon.
The Evolution of Cooperation Shade Shutters School of Life Sciences & Center for Environmental Studies.
Achieving Cooperative Social Behavior Through The Use Of Tags Critical MAS 2004Aviv Zohar.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
COMP305. Part II. Genetic Algorithms. Genetic Algorithms.
Altruism A Simulated Investigation COM SCI 194 Honors Research Fall 2007 ~ Spring 2008 Alexander Liu and Eric Chang Professor Amit Sahai.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
Bottom-Up Coordination in the El Farol Game: an agent-based model Shu-Heng Chen, Umberto Gostoli.
Checking and understanding Simulation Behaviour Bruce Edmonds Centre for Policy Modelling Manchester Metropolitan University.
University of Bologna, Italy How to cheat BitTorrent and why nobody does Simon Patarin and David Hales University of Bologna ECCS 2006,
Project funded by the Future and Emerging Technologies arm of the IST Programme Recent directions in DELIS / Overview of on-going work David Hales
Cooperation through the endogenous evolution of social structure David Hales & Shade Shutters The Open University & Arizona State University
Learning in Multiagent systems
Welcome to The 4 th International Workshop on MULTI AGENT BASED Melbourne, 14 th July.
When Simple Networks Fail: Characterising Social Networks Using Simulation Bruce Edmonds Centre for Policy Modelling Manchester Metropolitan University.
Innovative Schools toolkit Strategic Workshop 3 - Exploring good practice case studies.
Project funded by the Future and Emerging Technologies arm of the IST Programme Cooperation with Strangers David Hales Department of.
Example Department of Computer Science University of Bologna Italy ( Decentralised, Evolving, Large-scale Information Systems (DELIS)
Rationality meets the tribe: Some models of cultural group selection David Hales, The Open University Hales, D., (2010) Rationality.
SLAC and SLACER: Simple copy & rewire algorithms for trust and cooperation in P2P David Hales, Stefano Arteconi, Ozalp Babaoglu University of Bologna,
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
Project funded by the Future and Emerging Technologies arm of the IST Programme Socially Inspired Approaches to Evolving Cooperation David Hales
Can Tags Build Working Systems? From MABS to ESOA Attempting to apply results gained from Multi-Agent- Based Social Simulation (MABSS)
P2P Interaction in Socially Intelligent ICT David Hales Delft University of Technology (Currently visiting University of Szeged, Hungary)
Multi-Patch Cooperative Specialists With Tags Can Resist Strong Cheaters, Bruce Edmonds, Feb 2013, ECMS 2013, Aalesund, Norway, slide 1 Multi-Patch Cooperative.
Evolving networks for cooperation Dagstuhl CCT3 DELIS Workshop Sept 3rd-4th 2005 Presented by David Hales University of Bologna, Italy
2-Day Introduction to Agent-Based Modelling Day 2: Session 6 Mutual adaption.
Putting “tags” to work Attempting to apply results gained from agent- based social simulation (ABSS) to MAS. Dr David Hales
David Hales (University of Bologna) University of Bologna, Italywww.davidhales.com WARNING! Superficial sociological interpretation followed by simplistic.
Presented by Antú Schamberger, Amanda Douglas, and Joel Schreiber Stevens, J. R. & Hauser, M. D. (2004). Why be nice? Psychological constraints on the.
Emergent Group-Like Selection in a Peer-to-Peer Network ECCS Conference Paris, Nov. 16 th, 2005 David Hales University of Bologna, Italy
Evolving cooperation in one-time interactions with strangers Tags produce cooperation in the single round prisoner’s dilemma and it’s.
Evolving Social Rationality for MAS using “Tags” Trying to “make things work” by applying results gained from Agent-Based Social Simulation.
Project funded by the Future and Emerging Technologies arm of the IST Programme From Selfish Nodes to Cooperative Networks – Emergent Link-based Incentives.
Project funded by the Future and Emerging Technologies arm of the IST Programme Understanding “tag” systems by comparing “tag” models David Hales
The Evolution of Specialisation in Groups – Tags (again!) David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Stabilization of Tag-Mediated Interaction by Sexual Reproduction in an Evolutionary Agent System F. Alkemade D.D.B. van Braget J.A. La Poutr é Copyright.
Game Theory by James Crissey Luis Mendez James Reid.
Iterated Prisoner’s Dilemma Game in Evolutionary Computation Seung-Ryong Yang.
Ms. Carmelitano. Define Altruism: When one person helps another for no reward, and even at some cost to themselves Bell Ringer.
Evolving P2P overlay networks with Tags, SLAC and SLACER for Cooperation and possibly other things… Saarbrücken SP6 workshop July 19-20th 2005 Presented.
Project funded by the Future and Emerging Technologies arm of the IST Programme Altruism “for free” using Tags David Hales Department.
Evolving Strategies for the Prisoner’s Dilemma Jennifer Golbeck University of Maryland, College Park Department of Computer Science July 23, 2002.
Simple Rewire Protocols for Cooperation in Dynamic Networks David Hales, Stefano Arteconi, Ozalp Babaoglu University of Bologna, Italy Bio-Inspired Workshop,
Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK.
Project funded by the Future and Emerging Technologies arm of the IST Programme Change your tags fast! - A necessary condition for cooperation? David Hales.
Emergent Group Selection: Tags, Networks and Society David Hales, The Open University ASU, Thursday, November 29th For more details.
Indirect Reciprocity in the Selective Play Environment Nobuyuki Takahashi and Rie Mashima Department of Behavioral Science Hokkaido University 08/07/2003.
Novel Models of Group Selection in Social Structures and Networks David Hales University of Bologna, Italy In collaboration with: Stefano.
Haploid-Diploid Evolutionary Algorithms
The Matching Hypothesis
Haploid-Diploid Evolutionary Algorithms
Evolution for Cooperation
Socially Inspired Approaches to Evolving Cooperation
Group Selection Design Pattern
Self-Organising, Open and Cooperative P2P Societies – From Tags to Networks David Hales Department of Computer Science University of.
Presenter: Nipun Agarwal
Evolution for Cooperation
Altruism “for free” using Tags
Evolving cooperation in one-time interactions with strangers
Evolution of human cooperation without reciprocity
Presentation transcript:

Evolving Specialisation, Altruism & Group-Level Optimisation Using Tags – The emergence of a group identity? David Hales Centre for Policy Modelling, Manchester Metropolitan University, UK. Workshop on Evolvability and Identity Sept. 18 th -20 th

The Big Picture What mechanisms are sufficient to guide a population of “subsistence level” individuals to evolve into symbiotic and specialized relationships with others?

Tags! Holland (1992) discussed tags as a powerful “symmetry breaking” mechanism which could be useful for understanding complex “social- like” processes Tags are observable labels or social cues Agents can observe the tags of others Tags evolve in the same way that behavioral traits evolve Agents may evolve behavioral traits that discriminate based on tags

Recent tag models Tags may be bit strings signifying some observable cultural cue (Sugarscape model, Hales Mabs2000) Tags may be a single real number (Riolo, Cohen, Axelrod Nature2001) Earlier work by Riolo showed how tags could improve cooperation between agents playing the IPD. On-going work (Edmonds and Hales) is focusing on how tags can facilitate altruism and specialisation between highly unrelated individuals.

Recent tag models – Altruism with strangers In Hales (Mabs2000) high levels of cooperation evolved using tag game biasing in the single round PD. In Riolo et al (Nature2001) high levels of altruistic donation evolved using a tag toleration mechanism. However, in both these models the agents effectively either “cooperate” or “defect”. In both, groups of agents sharing the same tag form cooperative groups. There is a dynamic formation and dissolution of such groups – groups break down when agents invade them that do not cooperate and exploit them

Visualising the process (mabs2000)

What else can tags do? These previous models show that cooperation can evolve in groups with tags – overcoming commons dilemmas But, can tags support the formation of groups in which agents perform specialised functions – supporting each other to exploit the environment as a “team” or “productive unit” We extended the Riolo et al model to test this

The model Agents consist of a tag (real number), a tolerance (real number) and a skill (integer) Each agent is awarded some number of resources in each cycle. Resources are associated with a randomly selected skill An agent can only “harvest” a resource matching it’s own skill If it can not harvest the resource, it may donate the resource to another agent (if it can find one) that matches its tag

The model An agent is considered to “match” the tags of another if the difference between the tag values is no more than the tolerance value So a high tolerance means “donate to any agent” and a low tolerance means “only donate to those with similar tag value” When an agent attempts to make a donation it selects another agent from the population compares tags for a match and then passes the resource if the receiving agents has the required skill value

The model In the initial model, there are 2-skills, 100 agents, partner selection involves a single random selection from the population When agents make a successful donation they incur an energy cost (0.1) When an agent successfully harvests a resource it gets a unit of energy (1) After each cycle a tournament selection process based on energy, increases the number of successful agents (high energy) over those with low energy When successful agents are copied, mutation is applied to both tag, tolerance and skill

What will the results tell us? If the donation rate (over time) is non-zero, then we can conclude that: Agents are forming tag groups with a diversity of skills Agents are behaving altruistically, since donation produces immediate costs but does to produce immediate returns Therefore agents (from a myopic individual bounded rationality) form internally specialised altruistic teams

2-skills, averages of 30 runs to 30,000 generations

Results – what does it mean? A significant level of donation – confirming specialisation and altruism (of a sort!) But not so high, but if, instead of selecting potential donation partners at random, we use a “smart” matching method then significant increases in the donation rate are seen (previous slide) This smart matching can even support higher donor costs

5-skills, averages of 30 runs to 30,000 generations

Results – what does it mean? The random (or dumb) matching goes lower The smart matching goes lower too but still stays high and recovers quickly as the number of resource awards increases Hence, it would seem that to support an efficient higher degree of specialisation (more skills) smart matching is required Smart matching does evolve (even with higher costs – see Hales MABS2002, RASTA2002).

Conclusions Agents form groups based on tag similarity, containing diverse skills, donating resources to between each other, to efficiently exploit the environment – for the good of the group This happens even though individuals are selected on the basis of their individual utility We question intuitions which claim that evolution produces “selfish replicators” Can such models help us to understand how early social groups formed with specialised roles? Group distinguishing abilities (smart searching) would appear to be important Other work: does smart searching evolve (see RASTA and MABS papers). What about putting agents in social networks = smart is cheap? The Tag Clone issue! What are we really seeing here? (Edmonds and Hales forthcoming)

More generally… Tags are a minimal way of structuring donations as are certain spatial structures.

The Centre for Policy Modelling, Manchester Metropolitan University, UK.