How Cooperation Arises in Evolving Social Networks An Agent-Based Model by Ariana Strandburg-Peshkin An Agent-Based Model by Ariana Strandburg-Peshkin.

Slides:



Advertisements
Similar presentations
Game Theory. I What is Game theory? The Theory of Games and Economic Behaviour by John von Neumann and Oskar Morgenstern (1944). Especially one institution:
Advertisements

1 Small Worlds and Phase Transition in Agent Based Models with Binary Choices. Denis Phan ENST de Bretagne, Département Économie et Sciences Humaines &
29 Nov 2010Artificial Life lecture 161 Game Theory: Evolution of Communication Artificial Life methods are used to model and synthesise and understand.
Evolving Cooperation in the N-player Prisoner's Dilemma: A Social Network Model Dept Computer Science and Software Engineering Golriz Rezaei Michael Kirley.
THE EMERGING SCIENCE OF NETWORKS Duncan Watts Yahoo! Labs.
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Game Theory “Доверяй, Но Проверяй” - Russian Proverb (Trust, but Verify) - Ronald Reagan Mike Shor Lecture 6.
Evolution of Cooperation The importance of being suspicious.
NSPCS 2012 (KIAS, Seoul, 3 Jul ~ 6 July) Cooperative hierarchical structures emerging in multiadaptive games & Petter Holme (Umeå University, SungKyunKwan.
Automata-based adaptive behavior for economic modeling using game theory Rawan Ghnemat, Khalaf Khatatneh, Saleh Oqeili Al-Balqa’ Applied University, Al-Salt,
Forecasting the Future using Computer Simulation Models Presentation by Jon Roland April 18, 2006
Repeated Games and the Prisoner’s Dilemma. Prisoner’s dilemma What if the game is played “repeatedly” for several periods? DefectCooperate Defect10 yr,
On the Economics of P2P Systems Speaker Coby Fernandess.
Myopic and non-myopic agent optimization in game theory, economics, biology and artificial intelligence Michael J Gagen Institute of Molecular Bioscience.
Reinforcement Learning
Cooperation in Anonymous Dynamic Social Networks Brendan Lucier University of Toronto Brian Rogers Northwestern University Nicole Immorlica Northwestern.
Prisoner’s dilemma TEMPTATION>REWARD>PUNISHMENT>SUCKER.
EC – Tutorial / Case study Iterated Prisoner's Dilemma Ata Kaban University of Birmingham.
Sogang University ICC Lab Using Game Theory to Analyze Wireless Ad Hoc networks.
Institutions and the Evolution of Collective Action Mark Lubell UC Davis.
Satisfaction Equilibrium Stéphane Ross. Canadian AI / 21 Problem In real life multiagent systems :  Agents generally do not know the preferences.
Agent-based modeling of cooperation in collective action situations & diffusion of information Marco Janssen School of Human Evolution and Social Change.
IN SEARCH OF VALUE EQUILIBRIA By Christopher Kleven & Dustin Richwine xkcd.com.
A Memetic Framework for Describing and Simulating Spatial Prisoner’s Dilemma with Coalition Formation Sneak Review by Udara Weerakoon.
Yale Lectures 21 and Repeated Games: Cooperation vs the End Game.
The Evolution of Cooperation Shade Shutters School of Life Sciences & Center for Environmental Studies.
Neo-Liberal Institutionalism. The Prisoners’ Dilemma Player 2 Player 1.
6/2/2001 Cooperative Agent Systems: Artificial Agents Play the Ultimatum Game Steven O. Kimbrough Presented at FMEC 2001, Oslo Joint work with Fang Zhong.
Iba Laboratory Iterated Prisoner’s Dilemma on Alliance Network Tomoki Furukawazono* Yusuke Takada** Takashi Iba** *Graduate School of Media and Governance,
Game-Theoretic Models for Effects of Social Embeddedness on Trust and Cooperation Werner Raub Workshop on Social Theory, Trust, Social Networks, and Social.
QR 38 3/15/07, Repeated Games I I.The PD II.Infinitely repeated PD III.Patterns of cooperation.
Performance Analysis of Reputation-based Mechanisms for Multi-hop Wireless Networks Fabio Milan Dipartimento di Elettronica Politecnico di Torino Turin,
The Commons Dilemma. Hardin's (1968) work represents the first major contemporary analysis of the commons dilemma. Harding noted that there are no effective.
Reinforcement Learning Game playing: So far, we have told the agent the value of a given board position. How can agent learn which positions are important?
Segregation and Neighborhood Interaction Work in progress Jason Barr, Rutgers Newark Troy Tassier, Fordham October 31, 2006.
Conference title 1 A Few Bad Apples Are Enough. An Agent-Based Peer Review Game. Juan Bautista Cabotà, Francisco Grimaldo (U. València) Lorena Cadavid.
©John Wiley & Sons, Inc Huffman: Psychology in Action (8e) Evolution of cooperation: Why make friends? Why be nice, making friends must have offered.
Do Networks Facilitate Collective Action? John T. Scholz Florida State University.
Agent Based Modeling and Simulation
Cooperation through the endogenous evolution of social structure David Hales & Shade Shutters The Open University & Arizona State University
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
Standard and Extended Form Games A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor, SIUC.
Rationality meets the tribe: Some models of cultural group selection David Hales, The Open University Hales, D., (2010) Rationality.
Models of Cooperation in Social Systems Example 1: Prisoner’s Dilemma Prisoner’s Dilemma: Player 2 Player 1 cooperate defect cooperatedefect 3, 30, 5.
Daniel Ariosa Ecole Polytechnique Fédérale de Lausanne (EPFL) Institut de Physique de la Matière Complexe CH-1015 Lausanne, Switzerland and Hugo Fort Instituto.
Complexity Bruce Kogut October We are entering the epoch of the digitalization of knowledge: past, present, and future Sciences bring to this new.
“Social Capital, Social Mobility” by: Peter Q. Blair.
1. Genetic Algorithms: An Overview  Objectives - Studying basic principle of GA - Understanding applications in prisoner’s dilemma & sorting network.
International Relations
Subgames and Credible Threats (with perfect information) Econ 171.
Iterated Prisoner’s Dilemma Game in Evolutionary Computation Seung-Ryong Yang.
IJCAI’07 Emergence of Norms through Social Learning Partha Mukherjee, Sandip Sen and Stéphane Airiau Mathematical and Computer Sciences Department University.
MAIN RESULT: We assume utility exhibits strategic complementarities. We show: Membership in larger k-core implies higher actions in equilibrium Higher.
Siddhartha Gunda Sorabh Hamirwasia.  Generating small world network model.  Optimal network property for decentralized search.  Variation in epidemic.
The Role of Altruistic Punishment in Promoting Cooperation
Evolution of Cooperation in Mobile Ad Hoc Networks Jeff Hudack (working with some Italian guy)
Emergent Group Selection: Tags, Networks and Society David Hales, The Open University ASU, Thursday, November 29th For more details.
Ec1818 Economics of Discontinuous Change Section 1 [Lectures 1-4] Wei Huang Harvard University (Preliminary and subject to revisions)
1 KAIST Graduate School of Management 27 September, 2003 한상필 Organizational Learning Dynamics From managerial perspectives.
Topics in Bioinformatics Project 7 Kelsic ED, Zhao J, Vetsigian K, Kishony R. Counteraction of antibiotic production and degradation stabilizes microbial.
Social Norm, Costly Punishment and the Evolution to Cooperation : Theory, Experiment and Simulation Tongkui Yu 1, 2, Shu-Heng Chen 2, Honggang Li 1* 1.
Dissemination of Opinions And Ideas Via Complex Contagion on Social Networks Alex Stivala, Yoshihisa Kashima, Garry Robins, Michael Kirley The University.
International Relations
PRISONER’S DILEMMA BERK EROL
Project BEST Game Theory.
Dynamics of Learning & Distributed Adaptation James P
אופירה כץ אוניברסיטת תל-אביב החוג לרפואת המשפחה
CASE − Cognitive Agents for Social Environments
Evolution for Cooperation
Evolving cooperation in one-time interactions with strangers
Presentation transcript:

How Cooperation Arises in Evolving Social Networks An Agent-Based Model by Ariana Strandburg-Peshkin An Agent-Based Model by Ariana Strandburg-Peshkin

The Prisoner’s Dilemma

Networks

Evolving Networks Network Structure Network Dynamics

The Model 2, 20, 3 3, 01, 1 A strategy - probability of cooperating (0 - 1) Links to other agents (“neighbors”) Agents in a network play prisoners’ dilemma with all their “neighbors” Agent 1 Payoffs CD Agent 2 Payoffs D C Each agent has…

An Agent’s Universe Strategy Payoff Strategy Payoff Weight Strategy Payoff Strategy Payoff

Each Iteration… Play all neighbors, sum up total payoff, and update link weights Find most successful neighbor Move toward most successful strategy Break ties with worst enemy Replenish ties broken

Results Break ties --> Cooperate No breaking ties --> Defect

Why? Strategy Links

Speed of Convergence Parameters Explored: Probability of Breaking Ties Network Size (# agents) Network Density (# links) Parameters Explored: Probability of Breaking Ties Network Size (# agents) Network Density (# links)

Results - Summary Networks with any probability of breaking ties eventually converge on cooperation The speed of convergence depends on: Probability of breaking ties (> = faster) Size of network (> = slower) # of Links (> = slower) Networks with any probability of breaking ties eventually converge on cooperation The speed of convergence depends on: Probability of breaking ties (> = faster) Size of network (> = slower) # of Links (> = slower)

Implications / Limitations Social “punishment” (by breaking ties) is effective in promoting cooperation Model requires that agents be intelligent and knowledgeable about one another Keep track of neighbors / weights Know neighbors’ strategies and payoffs No complex strategies (e.g. Tit-For-Tat) Social “punishment” (by breaking ties) is effective in promoting cooperation Model requires that agents be intelligent and knowledgeable about one another Keep track of neighbors / weights Know neighbors’ strategies and payoffs No complex strategies (e.g. Tit-For-Tat)

Other Cool Things To Look At Different Payoff Schemes More complex strategies Network Structure How is it affected by the game played? Cost of keeping so many ties? Cost of making and breaking ties? Robustness Different Payoff Schemes More complex strategies Network Structure How is it affected by the game played? Cost of keeping so many ties? Cost of making and breaking ties? Robustness

Sources Abramson, Guillermo, and Marcelo Kuperman. "Social games in a social network." Physical Review E 63.3 (2001). 10 Apr Calderon, Juan. "Games on Evolving Networks." Complex Systems Summer School at Santa Fe Institute. 18 Mar < vents%2Fworkshops%2Fimages%2F6%2F6e%2FSf_csss06_calderon_et_al.pdf&ei=nbwcSI2X EJf4eZXdsOgL&usg=AFQjCNHlQ5sdWKoe37oCPMEvjLY4_t1neQ&sig2=ZGkomgzCTy37x NR9nb52Ew>. Hanaki, Nobuyuki, Alexander Peterhansl, Peter Dodds, and Duncan Watts. "Cooperation in Evolving Social Networks." Management Science 53.7 (2007): Mar < uploads%2Fpapers%2Fhanaki_cooperation.pdf&ei=4JQaSLvBFJDqgwTQk6S4Dg&usg=AFQj CNF7aLFpLvwGQQdFQEtvy4BStmta4g&sig2=WSUWZyRpQRPt-9neDtyn-Q>. Holme, Peter, Ala Trusina, Beon Jun Kim, and Petter Minnhagen. "Prisoners' Dilemma in Real- World Acquaintance Networks: Spikes and Quasiequilibria Induced by the Interplay Between Structure and Dynamics." Physical Review E 68 (2003). 10 Apr Ostrom, Elinor. "Collective Action and the Evolution of Social Norms." The Journal of Economic Perspectives 14.3 (2000): Abramson, Guillermo, and Marcelo Kuperman. "Social games in a social network." Physical Review E 63.3 (2001). 10 Apr Calderon, Juan. "Games on Evolving Networks." Complex Systems Summer School at Santa Fe Institute. 18 Mar < vents%2Fworkshops%2Fimages%2F6%2F6e%2FSf_csss06_calderon_et_al.pdf&ei=nbwcSI2X EJf4eZXdsOgL&usg=AFQjCNHlQ5sdWKoe37oCPMEvjLY4_t1neQ&sig2=ZGkomgzCTy37x NR9nb52Ew>. Hanaki, Nobuyuki, Alexander Peterhansl, Peter Dodds, and Duncan Watts. "Cooperation in Evolving Social Networks." Management Science 53.7 (2007): Mar < uploads%2Fpapers%2Fhanaki_cooperation.pdf&ei=4JQaSLvBFJDqgwTQk6S4Dg&usg=AFQj CNF7aLFpLvwGQQdFQEtvy4BStmta4g&sig2=WSUWZyRpQRPt-9neDtyn-Q>. Holme, Peter, Ala Trusina, Beon Jun Kim, and Petter Minnhagen. "Prisoners' Dilemma in Real- World Acquaintance Networks: Spikes and Quasiequilibria Induced by the Interplay Between Structure and Dynamics." Physical Review E 68 (2003). 10 Apr Ostrom, Elinor. "Collective Action and the Evolution of Social Norms." The Journal of Economic Perspectives 14.3 (2000):