QR 38 3/20/07, More on repeated games in IR I.Folk theorem II.Other solutions to the PD III.Repeated PDs in practice.

Slides:



Advertisements
Similar presentations
Sustaining collusion in a prisoners dilemma oligopoly context.
Advertisements

Vincent Conitzer CPS Repeated games Vincent Conitzer
Infinitely Repeated Games
Nash’s Theorem Theorem (Nash, 1951): Every finite game (finite number of players, finite number of pure strategies) has at least one mixed-strategy Nash.
Crime, Punishment, and Forgiveness
Game Theory “Доверяй, Но Проверяй” - Russian Proverb (Trust, but Verify) - Ronald Reagan Mike Shor Lecture 6.
Game Theory “Доверяй, Но Проверяй” (“Trust, but Verify”) - Russian Proverb (Ronald Reagan) Topic 5 Repeated Games.
David Bryce © Adapted from Baye © 2002 Game Theory: The Competitive Dynamics of Strategy MANEC 387 Economics of Strategy MANEC 387 Economics.
Dispute Settlement Mechanism The role of dispute settlement mechanism –information gathering and dispatching, not enforcement of trade arrangements Main.
Games With No Pure Strategy Nash Equilibrium Player 2 Player
Infinitely Repeated Games. In an infinitely repeated game, the application of subgame perfection is different - after any possible history, the continuation.
Non-Cooperative Game Theory To define a game, you need to know three things: –The set of players –The strategy sets of the players (i.e., the actions they.
Chapter 14 Infinite Horizon 1.Markov Games 2.Markov Solutions 3.Infinite Horizon Repeated Games 4.Trigger Strategy Solutions 5.Investing in Strategic Capital.
1 Game Theory. By the end of this section, you should be able to…. ► In a simultaneous game played only once, find and define:  the Nash equilibrium.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 2.5.Repeated Games Lecture
EC3224 Autumn Lecture #04 Mixed-Strategy Equilibrium
Infinitely Repeated Games Econ 171. Finitely Repeated Game Take any game play it, then play it again, for a specified number of times. The game that is.
EC941 - Game Theory Lecture 7 Prof. Francesco Squintani
Game Theory: Inside Oligopoly
Game Theory Lecture 9.
Industrial Organization - Matilde Machado Tacit Collusion Tacit Collusion Matilde Machado.
QR 38 3/22/07, Strategic moves and structure-induced equilibria I. Strategic moves II. Credibility III. Strategic moves as institutional choice.
Games People Play. 8: The Prisoners’ Dilemma and repeated games In this section we shall learn How repeated play of a game opens up many new strategic.
Dynamic Games of Complete Information.. Repeated games Best understood class of dynamic games Past play cannot influence feasible actions or payoff functions.
Chapter 6 © 2006 Thomson Learning/South-Western Game Theory.
5/16/20151 Game Theory Game theory was developed by John Von Neumann and Oscar Morgenstern in Economists! One of the fundamental principles of.
Chapter 12 Choices Involving Strategy McGraw-Hill/Irwin Copyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved.
Yale Lectures 21 and Repeated Games: Cooperation vs the End Game.
QR 38 4/10 and 4/12/07 Bayes’ Theorem I. Bayes’ Rule II. Updating beliefs in deterrence III. Hegemonic policy.
QR 38, 2/6/07 Overview of game theory I. Strategic interaction II. Game theory and international relations III. Deterrence.
APEC 8205: Applied Game Theory Fall 2007
Repeated games - example This stage game is played 2 times Any SPNE where players behave differently than in a 1-time game? Player 2 LMR L1, 10, 05, 0.
QR 38, 2/27/07 Minimax and other pure strategy equilibria I.Minimax strategies II.Cell-by-cell inspection III.Three players IV.Multiple equilibria or no.
Static Games of Complete Information: Subgame Perfection
UNIT III: COMPETITIVE STRATEGY Monopoly Oligopoly Strategic Behavior 7/21.
QR 38, 2/22/07 Strategic form: dominant strategies I.Strategic form II.Finding Nash equilibria III.Strategic form games in IR.
QR 38 3/15/07, Repeated Games I I.The PD II.Infinitely repeated PD III.Patterns of cooperation.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
Communication Networks A Second Course Jean Walrand Department of EECS University of California at Berkeley.
Problems from Chapter 12. Problem 1, Chapter 12 Find a separating equilibrium Trial-and-error. Two possible separating strategies for Player 1: – Choose.
1 Game Theory Sequential bargaining and Repeated Games Univ. Prof.dr. M.C.W. Janssen University of Vienna Winter semester Week 46 (November 14-15)
Chapter 12 Choices Involving Strategy Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written.
Game Theory Formalizing the Hobbesian Dilemma. A. Assumptions 1. Assumptions a. Rational choice – People act according to their preferences (desires,
Punishment and Forgiveness in Repeated Games. A review of present values.
Monetary Economics Game and Monetary Policymaking.
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
Dynamic Games & The Extensive Form
Chapters 29, 30 Game Theory A good time to talk about game theory since we have actually seen some types of equilibria last time. Game theory is concerned.
제 10 장 게임이론 Game Theory: Inside Oligopoly
Punishment, Detection, and Forgiveness in Repeated Games.
Mixed Strategies and Repeated Games
QR 38 Conclusion, 5/3/07 I.Why game theory is a useful tool for studying international relations II.Key insights from game theory for IR III.Limitations.
Punishment, Detection, and Forgiveness in Repeated Games.
“Group consumption, free-riding, & informal reciprocity agreements”. Why do people use informal reciprocity agreements? Most analysis answers this question.
ECO290E: Game Theory Lecture 3 Why and How is Nash Equilibrium Reached?
Bargaining games Econ 414. General bargaining games A common application of repeated games is to examine situations of two or more parties bargaining.
Econ 545, Spring 2016 Industrial Organization Dynamic Games.
OVERCOMING COORDINATION FAILURE THROUGH NEIGHBORHOOD CHOICE ~AN EXPERIMENTAL STUDY~ Maastricht University Arno Riedl Ingrid M.T. Rohde Martin Strobel.
Yuan Deng Vincent Conitzer Duke University
Dynamic Games of Complete Information
Vincent Conitzer CPS Repeated games Vincent Conitzer
Choices Involving Strategy
Learning 6.2 Game Theory.
Chapter 29 Game Theory Key Concept: Nash equilibrium and Subgame Perfect Nash equilibrium (SPNE)
Game Theory Fall Mike Shor Topic 5.
Chapter 14 & 15 Repeated Games.
Chapter 14 & 15 Repeated Games.
Game Theory Spring Mike Shor Topic 5.
Vincent Conitzer CPS Repeated games Vincent Conitzer
Presentation transcript:

QR 38 3/20/07, More on repeated games in IR I.Folk theorem II.Other solutions to the PD III.Repeated PDs in practice

I. Folk theorem Two players using TFT can sometimes maintain cooperation in an infinitely-repeated PD. However, TFT is not always the best strategy; the best depends on what the other player is doing. That is, TFT is not the only equilibrium strategy. In fact, many equilibria exist in the repeated PD. Almost anything can happen, if we allow for mixed strategies; there is an infinite number of equilibria. This proposition is known as the folk theorem.

The folk theorem CooperateDefect Cooperate5, 50, 6 Defect6, 02, 2

The folk theorem The folk theorem says that strategies that guarantee players at least what they could achieve by playing the one-shot equilibrium can be sustained by some kind of punishment strategy (if discount factors are high enough). Here, this means that outcomes with payoffs above 2, 2 can be sustained.

The folk theorem Outcomes in the region bordered by white are the feasible per-round payoffs in this game. The red lines indicate the minimum payoff that must be maintained in equilibrium. Any outcome in the resulting area ((2, 2), A, (5, 5), B) can be an equilibrium. 0, 0 6, 0 0, 6 2, 2 5, 5 A B

The folk theorem In IR, the folk theorem is usually seen as a “positive” result, since it means that cooperation can emerge. But among game theorists, more “negative” because it means that predicting the outcome of a repeated game is impossible.

II. Other solutions to the PD Are there ways other than repetition to solve the PD? Many have been suggested, but most rely on changing the payoffs so that the game is no longer a PD: Asymmetric players External enforcement External changes to payoffs (rewards or punishments)

Asymmetric players – alliance example Consider states cooperating in a military alliance. If states are about the same size, they could be in a PD, each preferring that the other spend more on defense. But if one is much larger than the other, the larger will gain most of the benefits from having an adequate defense.

Alliance example So, the payoff to the large state of cooperating (spending more) is higher than the payoff to the small state of cooperating. So the large state no longer has PD payoffs. Equilibrium outcome is exploitation of the large by the small.

Alliance example Symmet- ric alliance High spending Low spending High spending 3, 31, 4 Low spending 4, 12, 2 Asym- metric alliance High spend- ing Low spend- ing High spend- ing 4, 33, 4 Low spend- ing 2, 11, 2 Large Small

Alliance example Could generalize this example to multiple players. Application to NATO: expect the U.S. to spend disproportionately on defense, and it does.

External enforcement If external enforcement is available, can overcome the PD. But this is rarely an option in IR.

External changes to payoffs Could incorporate additional punishments for defection, such as trade sanctions. –This is an example of issue linkage, common and important in IR. Or, could use rewards rather than punishments. Provide additional foreign aid; this is common in military coalitions.

External changes to payoffs The idea of either rewards or punishments is to make defection no longer a dominant strategy. –Rewards increase the payoff to cooperation, punishments decrease the payoff to defection. But both suffer from some difficulties: –Linked payoffs must be contingent, only punish for D, reward for C –So C and D have to be clearly observable, no contaminated by accidents.

Problems with external changes to payoffs –It must be possible to stop the flow of rewards and punishments at any time; not one-shot. These are problematic. For example, if Jordan was getting increased aid to keep it from aiding Iraq, have to be able to observe whether smuggling is occurring; aid must be ongoing, not one-shot.

Problems with external changes to payoffs Credibility: punishment in the repeated PD is credible, you just revert back to the Nash equilibrium of the one-shot game. But linkages may not be an equilibrium – are they subgame perfect? U.S. may renege on promises of aid; or not be willing to bear the costs of carrying out a threat.

III. Applications to IR Analysis of the repeated PD has provided the foundation for studies of cooperation in IR. Advantages of this approach: Provides unifying framework for analysis Relies on self-enforcement and reciprocity, appropriate assumptions for IR Structure of PD widely appropriate for situations where cheating is a temptation Highlights importance of good information, use of effective punishment strategies, credibility of threats and promises

Implications of repeated games for IR A longer shadow of the future should encourage cooperation, because more weight on the future means that cheating becomes less attractive. This only holds if the underlying game is PD

Repeated games in IR Results of case studies: PD not as prevalent as many assume –Many cases look more like harmony, deadlock, or battle of the sexes; maybe chicken. Then repetition doesn’t encourage cooperation as in the PD. –Example: alliance partners often continue to cooperate after a war, because they believe they are playing an assurance game. But this dissipates over time, they move to a PD or worse.

Repeated games in IR But, fairly strong support for general idea that the shadow of the future encourages cooperation. –In 1914, leaders felt they were vulnerable and cared only about the short term. –Contrast this to debt negotiations, where bankers and debtors have long-term relationships and generally find a way to cooperate.

Limitations of repeated game analysis Where this framework falls short: Neglects domestic politics Reciprocity can backfire: “echo effects” –Reagan and the collapse of U.S.-Soviet détente –Bargaining over tariffs