Yale 11 and 12 Evolutionary Stability: cooperation, mutation, and equilibrium.

Slides:



Advertisements
Similar presentations
5. Combining simultaneous and sequential moves.
Advertisements

Evolution Matt Keeling MA 999: Topics in Mathematical Modelling Tuesday Thursday 2-4.
Module 4 Game Theory To accompany Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Power Point slides created by Jeff Heyl.
Stackelberg -leader/follower game 2 firms choose quantities sequentially (1) chooses its output; then (2) chooses it output; then the market clears This.
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Defender/Offender Game With Defender Learning. Classical Game Theory Hawk-Dove Game Hawk-Dove Game Evolutionary Stable Evolutionary Stable Strategy (ESS)
1 Evolution & Economics No Evolutionary Stability in Repeated Games Played by Finite Automata K. Binmore & L. Samuelson J.E.T Automata.
Simultaneous- Move Games with Mixed Strategies Zero-sum Games.
Calibrated Learning and Correlated Equilibrium By: Dean Foster and Rakesh Vohra Presented by: Jason Sorensen.
For any player i, a strategy weakly dominates another strategy if (With at least one S -i that gives a strict inequality) strictly dominates if where.
Lectures 7&8 Revisit Elections Now range is left-wing or right-wing politics. Candidate-Voter model Assume even distribution of voters. Voters will vote.
The Structure of Networks with emphasis on information and social networks T-214-SINE Summer 2011 Chapter 7 Ýmir Vigfússon.
Social Behavior & Game Theory Social Behavior: Define by Economic Interaction Individuals Affect Each Other’s Fitness, Predict by Modeling Fitness Currency.
 1. Introduction to game theory and its solutions.  2. Relate Cryptography with game theory problem by introducing an example.  3. Open questions and.
Common Welfare, Strong Currencies and the Globalization Process Esteban Guevara Hidalgo Center for Nonlinear and Complex Systems (Como, Italy) ICTP-TRIL.
Learning in games Vincent Conitzer
What is a game?. Game: a contest between players with rules to determine a winner. Strategy: a long term plan of action designed to achieve a particular.
Working Some Problems. Telephone Game How about xexed strategies? Let Winnie call with probability p and wait with probability 1-p. For what values of.
Maynard Smith Revisited: Spatial Mobility and Limited Resources Shaping Population Dynamics and Evolutionary Stable Strategies Pedro Ribeiro de Andrade.
Chapter 6 © 2006 Thomson Learning/South-Western Game Theory.
by Vincent Conitzer of Duke
Check your (Mis)understanding? Number 3.5 page 79 Answer Key claims that: For player 1 a strictly dominates c For player 2, y strictly dominates w and.
1 Economics & Evolution Number 2. 2 Reading List.
An Introduction to Game Theory Part II: Mixed and Correlated Strategies Bernhard Nebel.
Yale 9&10 Mixed Strategies in Theory and Tennis. Overview As I randomize the strategies, the expected payoff is a weighted average of the pure strategies.
Games of pure conflict two person constant sum. Two-person constant sum game Sometimes called zero-sum game. The sum of the players’ payoffs is the same,
Evolutionary Game Theory
Static Games of Complete Information: Equilibrium Concepts
Nash Equilibrium Econ 171. Suggested Viewing A Student’s Suggestion: Video game theory lecture Open Yale Economics Ben Pollack’s Game Theory Lectures.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
On Bounded Rationality and Computational Complexity Christos Papadimitriou and Mihallis Yannakakis.
Evolutionary Games The solution concepts that we have discussed in some detail include strategically dominant solutions equilibrium solutions Pareto optimal.
Network Formation Games. Netwok Formation Games NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models:
Network Formation Games. Netwok Formation Games NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models:
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
Minimax strategies, Nash equilibria, correlated equilibria Vincent Conitzer
Evolutionary Games Econ 171. The Hawk-Dove Game Animals meet encounter each other in the woods and must decide how to share a resource. There are two.
CPS Learning in games Vincent Conitzer
CPS 170: Artificial Intelligence Game Theory Instructor: Vincent Conitzer.
Evolutionary Game Theory. Game Theory Von Neumann & Morgenstern (1953) Studying economic behavior Maynard Smith & Price (1973) Why are animal conflicts.
Tom Wenseleers Dept. of Biology, K.U.Leuven
5. Alternative Approaches. Strategic Bahavior in Business and Econ 1. Introduction 2. Individual Decision Making 3. Basic Topics in Game Theory 4. The.
Learning in Multiagent systems
Games of Strategy (Game Theory) Topic 1 – Part IV.
Nash equilibrium Nash equilibrium is defined in terms of strategies, not payoffs Every player is best responding simultaneously (everyone optimizes) This.
1 Economics & Evolution Number 3. 2 The replicator dynamics (in general)
Standard and Extended Form Games A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor, SIUC.
Bayes-Nash equilibrium with Incomplete Information.
Presenter: Chih-Yuan Chou GA-BASED ALGORITHMS FOR FINDING EQUILIBRIUM 1.
Game Theory: introduction and applications to computer networks Game Theory: introduction and applications to computer networks Lecture 2: two-person non.
The Science of Networks 6.1 Today’s topics Game Theory Normal-form games Dominating strategies Nash equilibria Acknowledgements Vincent Conitzer, Michael.
Equilibrium transitions in stochastic evolutionary games Dresden, ECCS’07 Jacek Miękisz Institute of Applied Mathematics University of Warsaw.
Section 2 – Ec1818 Jeremy Barofsky
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
CPS 570: Artificial Intelligence Game Theory Instructor: Vincent Conitzer.
Normal Form Games, Normal Form Games, Rationality and Iterated Rationality and Iterated Deletion of Dominated Strategies Deletion of Dominated Strategies.
1 UNIVERSITY OF CALIFORNIA, IRVINE, GAME THEORY AND POLITICS 2, POL SCI 130B, Lecture 2.5: AGGRESSION, VIOLENCE, AND UNCERTAINTY Recall various interpretations.
Vincent Conitzer CPS Learning in games Vincent Conitzer
Critique of Hotelling Hotelling’s “Principle of Minimum Differentiation” was flawed No pure strategy exists if firms are close together. With quadratic.
5.1.Static Games of Incomplete Information
Pondering more Problems. Enriching the Alice-Bob story Go to AGo to B Go to A Alice Go to B Go to A Go to B Go shoot pool Alice.
Games People Play. 10: Evolutionary Games Games People Play. Evolutionary Games What if individuals aren’t as smart and calculating as we have assumed.
Replicator Dynamics. Nash makes sense (arguably) if… -Uber-rational -Calculating.
Choose one of the numbers below. You will get 1 point if your number is the closest number to 3/4 of the average of the numbers chosen by all class members,
Network Formation Games. NFGs model distinct ways in which selfish agents might create and evaluate networks We’ll see two models: Global Connection Game.
Application of Game Theory to Biology A long-standing puzzle in the study of animal behavior is the prevalence of conventional fights in the competition.
Game Theory and Cooperation
Vincent Conitzer Learning in games Vincent Conitzer
Vincent Conitzer CPS Learning in games Vincent Conitzer
Presentation transcript:

Yale 11 and 12 Evolutionary Stability: cooperation, mutation, and equilibrium

Evolutionary Process Simplified model Symmetric two player games Random Matching – keep track of average payoffs Relative successful strategies grow. Assume no gene redistribution Asexual reproduction Large population. entire population is all playing the same (possibly mixed) strategy, S, (hard wired). suppose there is a mutation, S’. Will it thrive or will it die out? If all possible mutations die out, the original population is evolutionary stable. CD C2,20,3 D3,01,1

Is cooperation evolutionary stable? Randomly matching yields an expected utility of 2. As we deviate from the “C” strategy, what happens? Play C is not evolutionary stable. Invader D doesn’t die out. Is any other pure strategy evolutionary stable? (any mutation from D dies out, D is ES) If (s,s) is not a NE, then s is NOT evolutionary stable. Evolutionary solutions CAN be bad. If a strategy is strictly dominated, then it is not ES

Is “c” evolutionary stable? abc a2,20,0 b 1,1 c0,01,10,0 What can invade? What percentage of population can pick b and be happy? In pure strategies, must be on diagonal to be evolutionary stable

Can we find a NE which is not evolutionary stable? b,b is NE, but not ES Defn: : s* is Evolutionary stable if for all small mutants s’ (1-e)U 1 (s*,s*) + e U 1 (s*,s’) > (1-e)U 1 (s’,s*) + e U 1 (s’,s’) what s* expects > what invader expects ab a1,10,0 b

Defn 2: In a symmetric two player game, s* is ES in pure strategies if (s*,s*) is a symmetric NE, ie U 2 (s*,s*) > U 2 (s*,s’) for all s’ (strict ES) (s*,s*) is a symmetric NE if U 2 (s*,s*) = U 2 (s*,s’) then U 2 (s*,s’) > U 2 (s’, s’) (non-strict) ES of the most important ideas in sociology and one of the most important ideas in economics.

Is (a,a) ES? Are both a,a and b,b ES? Are strict, but both are not efficient. ab a1,1 b 0,0 ab a2,20,0 b 1,1

Chicken variant straightswerve Straight0,02,1 swerve1,20,0 No symmetric NE. Look at mixed NE. (2/3, 1/3) and (2/3, 1/3) are NE Monomorphic – only one type out there. Polymorphic – two types out there. Can have a stable polymorphic population.

2/31/3 Chickenstraightswerve 2/3Straight0,02,1 1/3swerve1,20,0 Allowing that original strategy might be mixed and a mutation might be mixed. 2/3, 1/3) and (2/3, 1/3) are NE Does (2/3, 1/3) satisfy definition? How to deviations do against it? Well, we picked the ratio so we would be indifferent to change – so it does as well. Generally, a mixed NE will never be strict. Check rule (2).

Does (2/3, 1/3) satisfy definition of ES? (p*,p*) is a symmetric NE if U(p*,p*) = U(p*,p’) then NEED u(p*,p’) > u(p’, p’). Have to check this for all possible mutations. Here is a heuristic argument. Suppose there is a mutation that is more aggressive: It will die out. It does very badly against itself – so u(p*,p’) > u(p’, p’). Suppose there is a mutation that is more passive? It will die out. It does very badly against itself – so u(p*,p’) > u(p’, p’). So, we have a mixed evolutionary stable state.

1 < v < 2 Biologist version of rock/paper/scissors Only hope is (1/3,1/3,1/3) but it is not ESS. There is NO ESS – so lots of cycling around. abc a1,1v,00,v b 1,1v,0 c 0,v1,1

1 < v < 2 Check (1/3,1/3,1/3) Mixed NE will always be a weak NE so check u(p*,p’) > u(p’,p’) (1+v)/3 < 1 So no ESS abc a1,1v,00,v b 1,1v,0 c 0,v1,1