Game Theory Lecture 9

problem set 9 from Osborne’s Introd. To G.T. Ex. 459.1, 459.2, 459.3

For a general game G: Repeated Games (a general treatment) C D What is the minimum that a player can guarantee? In the Prisoners’ Dilemma it was the payoff of (D,D) By playing D, player 2 can ensure that player 1 does not get more than 1 C D 2 , 2 0 , 3 3 , 0 1 , 1 For a general game G: Player 1 can always play the best response to the other’s action

Repeated Games (a general treatment) C D Player 2 can minimize the best that 1 can do by choosing t: C D 2 , 2 0 , 3 3 , 0 1 , 1 In the P.D. : In the P.D. it is a Nash equilibrium for each to play the stratgy that minimaxes the other. 3 1 In general playing the strategy that holds the other to his minimax payoff is NOT a Nash Equilibrium

Repeated Games (a general treatment) In the infinitely repeated game of G, every Nash equilibrium payoff is at least the minimax payoff If a player always plays the best response to his opponent’s action, his payoff is at least his minmax value. A folk theorem: approximately Every feasible value of G, which gives each player at least his minimax value, can be obtained as a Nash Equilibrium payoff (for δ~1)

? Repeated Games (a general treatment) If a point A is feasible, it can be (approximately) obtained by playing a cycle of actions. Consider a the following strategy: follow the cycle sequence if the sequence has been played in the past. If there was a deviation from it, play forever the action that holds the other to his minimax It is an equilibrium for both to play this strategy ?

Repeated Games (a general treatment) follow the cycle sequence if the sequence has been played in the past. If there was a deviation from it, play forever the action that holds the other to his minimax If both follow the strategy, each receives more than his minimax If one of them deviates, the other punishes him, hence the deviator gets at most his minimax. hence, he will not deviate.

Playing these strategies is Nash but not sub-game perfect equilibrium. Repeated Games (a general treatment) Would a player want to punish after a deviation??? by punishing the other his own payoff is reduced Playing these strategies is Nash but not sub-game perfect equilibrium. To make punishment ‘attractive’: it should last finitely many periods if not all participated in the punishment the counting starts again.

Repeated Games (a general treatment) An Example A B C 4 , 4 3 , 0 1 , 0 0 , 3 2 , 2 0 , 1 0 , 0 4 3 1 To ‘minimax’ the other one should play C when both play C, each gets 0

B C Repeated Games (a general treatment) A B C An Example 4 , 4 3 , 0 1 , 0 0 , 3 2 , 2 0 , 1 0 , 0 An Example a sub-game perfect equilibrium strategy: not (C,C) B C (B,B) not (B,B) (C,C) all 1 2 k .........

Incomplete Monitoring Two firms repeatedly compete in prices à la Bertrand, δ the discount rate Each observes its own profit but not the price set by the other. Demand is 0 with probability ρ, and D(p) with probability 1- ρ Assume that production unit cost is c, that D(p)0, and that (p-c)D(p) has a unique maximum at pm When demand is D(p), and both firms charge pm, each earns ½πm =½ (pm-c)D(pm).

Incomplete Monitoring Can the firms achieve cooperation (pm) ??? Let both firms play the following strategy (Sk): All pm c ½πm zero profit All 1 2 3 k For which values of k is the pair (Sk, Sk) a sub-game perfect equilibrium ???

Incomplete Monitoring Let V0 , V1 be the expected discouned payoffs at states 0,1 (respectively), when both players play Sk. 1 2 3 k pm c ½πm zero profit All

Incomplete Monitoring By the One Deviation Property, it suffices to check whether a deviation at state 0 can improve payoff. (At states 1,2,..k a deviation will not increase payoff). The best one can do at state 0, is to slightly undercut the other, this will yield a payoff of: 1 2 3 k pm c ½πm zero profit All

Incomplete Monitoring

…. …. Social Contract Overlapping Generations A person lives for 2 periods …. young old young old young old ….

Social Contract A young person produces 2 units of perishable good. An old person produces 0 units. A person’s preference for consumption over time (c1, c2), is given by: (1,1)  (2,0) It is an equilibrium for each young person to consume the 2 units he produces she produces Is there a ‘better’ equilibrium ??

Social Contract Let each young person give 1 unit to her old mother, provided the latter has, in her youth, given 1 unit to her own mother If my mother was ‘bad’ I am required to punish her, but then I will be punished in my old age. It is better not to follow this strategy.

This is a sub-game perfect equilibrium: Social Contract Let each young person give 1 unit to her old mother, provided ALL young persons in the past have contributed to their mothers. This is a sub-game perfect equilibrium: I am willing to punish my ‘bad’ mother, since I will be punished anyway.

more subtle strategies: Social Contract more subtle strategies: Punish your mother iff she is ‘bad’ A person is ‘bad’ if, either She did not provide her mother, although the mother was not ‘bad’. or: She did not punish her mother, although the mother was ‘bad’.

Incomplete Information meet avoid probability ½ probability ½ B X 2 , 1 0 , 0 1 , 2 B X 2 1 B X 2 1 B X 2 , 0 0 , 2 0 , 1 1 , 0

Incomplete Information ½ ½ B X 2 , 1 0 , 0 1 , 2 B X 2 , 0 0 , 2 0 , 1 1 , 0 meet avoid

½ ½ meet avoid 1 1 B X B X 2 2 2 2 B X B X B X B X