Institutions and the Evolution of Collective Action Mark Lubell UC Davis.

Slides:



Advertisements
Similar presentations
Tutorial 1 Ata Kaban School of Computer Science University of Birmingham.
Advertisements

Infinitely Repeated Games
Crime, Punishment, and Forgiveness
Lecture V: Game Theory Zhixin Liu Complex Systems Research Center,
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Game Theory “Доверяй, Но Проверяй” - Russian Proverb (Trust, but Verify) - Ronald Reagan Mike Shor Lecture 6.
Game Theory “Доверяй, Но Проверяй” (“Trust, but Verify”) - Russian Proverb (Ronald Reagan) Topic 5 Repeated Games.
Evolution of Cooperation The importance of being suspicious.
1 Evolution & Economics No Evolutionary Stability in Repeated Games Played by Finite Automata K. Binmore & L. Samuelson J.E.T Automata.
6-1 LECTURE 6: MULTIAGENT INTERACTIONS An Introduction to MultiAgent Systems
Infinitely Repeated Games Econ 171. Finitely Repeated Game Take any game play it, then play it again, for a specified number of times. The game that is.
1.Major Transitions in Evolution 2.Game Theory 3.Evolution of Cooperation.
 1. Introduction to game theory and its solutions.  2. Relate Cryptography with game theory problem by introducing an example.  3. Open questions and.
Coye Cheshire & Andrew Fiore March 21, 2012 // Computer-Mediated Communication Collective Action and CMC: Game Theory Approaches and Applications.
Reciprocal Altruism Elbert Lim Anthro 179. Reciprocal Altruism Term was coined by Robert Trivers (1970’s). Refers to the offering and receiving of support,
Game Theory Lecture 8.
Maynard Smith Revisited: Spatial Mobility and Limited Resources Shaping Population Dynamics and Evolutionary Stable Strategies Pedro Ribeiro de Andrade.
Prisoner’s dilemma TEMPTATION>REWARD>PUNISHMENT>SUCKER.
Games People Play. 8: The Prisoners’ Dilemma and repeated games In this section we shall learn How repeated play of a game opens up many new strategic.
The Prisoners’ Dilemma and IR theories International Relations.
5/16/20151 VII. Cooperation & Competition The Iterated Prisoner’s Dilemma.
Conflict within Groups Outline l What is conflict? l Sources of conflict in groups: –I. Personal conflict –II. Substantive conflict –III. Procedural conflicts.
EC – Tutorial / Case study Iterated Prisoner's Dilemma Ata Kaban University of Birmingham.
Satisfaction Equilibrium Stéphane Ross. Canadian AI / 21 Problem In real life multiagent systems :  Agents generally do not know the preferences.
Evolving New Strategies The Evolution of Strategies in the Iterated Prisoner’s Dilemma 01 / 25.
A Memetic Framework for Describing and Simulating Spatial Prisoner’s Dilemma with Coalition Formation Sneak Review by Udara Weerakoon.
Yale Lectures 21 and Repeated Games: Cooperation vs the End Game.
The Evolution of Cooperation Shade Shutters School of Life Sciences & Center for Environmental Studies.
Property Right (Bromley) Claim to a benefit stream that a govt. will agree to protect through the assignment of duty to others who may wish to interfere.
Human Social Dilemmas Cooperation Between Non-Relatives Complex Evolutionary Problem Repeated Interaction, Conditional Cooperation Human Cooperation Often.
Introduction to Game Theory and Behavior Networked Life CIS 112 Spring 2009 Prof. Michael Kearns.
Game-Theoretic Models for Effects of Social Embeddedness on Trust and Cooperation Werner Raub Workshop on Social Theory, Trust, Social Networks, and Social.
UNIT III: COMPETITIVE STRATEGY Monopoly Oligopoly Strategic Behavior 7/21.
QR 38 3/15/07, Repeated Games I I.The PD II.Infinitely repeated PD III.Patterns of cooperation.
Coye Cheshire & Andrew Fiore June 28, 2015 // Computer-Mediated Communication Game Theory, Games, and CMC.
6/4/03Genetic Algorithm The Genetic Algorithm The Research of Robert Axelrod The Algorithm of John Holland Reviewed by Eyal Allweil and Ami Blonder.
Institutions and Environmental Cooperation. Today Types of global environmental problems The role of international institutions (regimes): realist vs.
The Commons Dilemma. Hardin's (1968) work represents the first major contemporary analysis of the commons dilemma. Harding noted that there are no effective.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
Peter B. Henderson Butler University
Punishment and Forgiveness in Repeated Games. A review of present values.
Unit III: The Evolution of Cooperation Can Selfishness Save the Environment? Repeated Games: the Folk Theorem Evolutionary Games A Tournament How to Promote.
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
Chapter 4: Local integration 1: Reasoning & evolutionary psychology.
Rationality meets the tribe: Some models of cultural group selection David Hales, The Open University Hales, D., (2010) Rationality.
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
Finite Iterated Prisoner’s Dilemma Revisited: Belief Change and End Game Effect Jiawei Li (Michael) & Graham Kendall University of Nottingham.
Daniel Ariosa Ecole Polytechnique Fédérale de Lausanne (EPFL) Institut de Physique de la Matière Complexe CH-1015 Lausanne, Switzerland and Hugo Fort Instituto.
Evolving cooperation in one-time interactions with strangers Tags produce cooperation in the single round prisoner’s dilemma and it’s.
TO COOPERATE OR NOT TO COOOPERATE REGIONAL ACADEMY FOR DEMOCRACY,
Section 2 – Ec1818 Jeremy Barofsky
Game Theory by James Crissey Luis Mendez James Reid.
1 Social Dilemmas. 2 The Anatomy of Cooperation How does cooperation develop and how is it sustained in an environment where individuals are rewarded.
Iterated Prisoner’s Dilemma Game in Evolutionary Computation Seung-Ryong Yang.
Repeated Game Modeling of Multicast Overlays Mike Afergan (MIT CSAIL/Akamai) Rahul Sami (University of Michigan) April 25, 2006.
Games People Play. 10: Evolutionary Games Games People Play. Evolutionary Games What if individuals aren’t as smart and calculating as we have assumed.
Evolving Strategies for the Prisoner’s Dilemma Jennifer Golbeck University of Maryland, College Park Department of Computer Science July 23, 2002.
Evolution of Cooperation in Mobile Ad Hoc Networks Jeff Hudack (working with some Italian guy)
Ec1818 Economics of Discontinuous Change Section 1 [Lectures 1-4] Wei Huang Harvard University (Preliminary and subject to revisions)
Indirect Reciprocity in the Selective Play Environment Nobuyuki Takahashi and Rie Mashima Department of Behavioral Science Hokkaido University 08/07/2003.
Game Theory and Cooperation
Reinforcement Learning Dynamics in Social Dilemmas
Evolving New Strategies
Towards Realistic Models for Evolution of Cooperation
LECTURE 6: MULTIAGENT INTERACTIONS
An environmental statement by Garrett Hardin
Evolution for Cooperation
Evolving cooperation in one-time interactions with strangers
When fairness bends rationality: Ernst Fehr meets John Nash
Presentation transcript:

Institutions and the Evolution of Collective Action Mark Lubell UC Davis

Defining Collective Action  Collective-action problem: Individual decision-making leads to socially undesirable (Pareto-inefficient) outcomes  Cooperation: Adjusting behavior to minimize socially undesirable outcomes

Tragedy of the Commons  Garrett Hardin (1968): “Therein is the tragedy. Each man is locked into a system that compels him to increase his herd without limit—in a world that is limited. Ruin is the destination towards which all men rush, each his own best interest in a society that believes in freedom of the commons.” “Mutual coercion, mutually agreed upon”  Flip side of resource use: Maintenance of ecosystems/public goods  Collective action problems are ubiquitous!

From Global….

To Local…

Paper title: “My Identity as a White Female”

Studying Collective Action Major Research Questions 1. Factors explaining cooperative behavior 2. Role of institutions (e.g., punish defection, reward cooperation) Theoretical  Philosophy  Game theory  Evolutionary game theory  Evolutionary simulations (This talk) Empirical  Field research (qualitative and quantitative)  Experimental research

Prisoner’s Dilemma Player 2 CooperateDefect Player 1 CooperateR 1 = 6 R 2 = 6 S 1 = 3 T 2 = 8 DefectT 1 = 8 S 2 = 3 P 1 = 4 P 2 = 4 Conditions: T>R>P>S; 2R>T+S Nash equilibrium: Both players defect

Collective Action Agents  Five “gene” strategies; 32 possible  Each gene determines behavior in current round on basis of outcome in last round  Important Examples: All Cooperate GRIM Trigger PAVLOV(Win-stay, lose shift) Tit-for-Tat

Structure of Simulation Generation 1 Generation 5000 Generation 1: Randomly Select 40 Strategies Round Robin Tournament: Each strategy vs. itself and all others Proportional Fitness Reproduction: P(reproduction)= Fitness i /Fitness all Next Generation: Survival of Fittest 1% Mutation Rate on Each Gene

A “Punishing” Experiment Design  Baseline 2-player repeated PD, with discount rate=.9  Examine the effect of $2 punishment for defection, with increasing probability ranging from [0,1] in.10 increments  10 runs of each experiment; 40 strategies, 5000 generations Hypotheses  Increasing levels of cooperation  Increased population stability  Shift in the population dynamics of cooperation

Baseline: No Punishment

Hobbes: Punishment p=1.0

Mean Fitness Increases With Punishment Probability

Gene Frequency: All Regimes

Strategy Frequency: All Regimes

Gene Frequency: Cooperative Regimes (Avg. Fitness>5.9)

Strategy Frequency: Cooperative Regimes

Some Correlations Overall Fitness.21 Genes Nice.11 CC.22 CD.10 DC.06 DD.24 Strategies All Defect-.18 GRIM-.03 PAVLOV.10 Suspicious PAVLOV.10 TFT.04

Conclusions  Punishment institutions increase cooperation and stability, even in noisy environment  As punishment increase, basis of cooperation shifts towards PAVLOV  Institutions change population dynamics of cooperation, even if same behaviors observed  Must square with observed human behavior; e.g.; resistance to coercion, reduced effectiveness of reciprocity in coercive environments