EC941 - Game Theory Prof. Francesco Squintani Lecture 8 1

Structure of the Lecture Ultimatum Game and Hold Up Problem Rubinstein Alternating Offer Bargaining Nash Axiomatic Bargaining 2

The Ultimatum Game The ultimatum game is a simple model of bargaining There are two players: person 1 offers player 2 an amount of money up to c. If 2 accepts this offer then 1 receives the remainder. If 2 rejects the offer then neither person receives any payoff. Each person cares only about the amount of money she receives, and prefers to receive as much as possible. The amount person 1 offers can be any number, not necessarily an integral number of cents. 3

Players: The two people. Terminal histories: The set of sequences (x, Z), where x is a number with 0 ≤ x ≤ c (the amount of money that person 1 offers to person 2) and Z is either Y (“yes, I accept”) or N (“no, I reject”). Player function: P( ∅ ) = 1 and P(x) = 2 for all x. Preferences: Each person’s preferences are represented by payoffs equal to the amounts of money she receives. For the terminal history (x, Y) person 1 receives c − x and person 2 receives x; for the terminal history (x, N) each person receives 0. Formal Model 4

Player 1 chooses first how much to give to player 2. Then player 2 chooses whether Yes or No. 1 x = 0 x = c x 2 YN c - x, x 0, 0 Extensive Form Representation 5

First consider each subgame  x where player 2 either accepts or rejects the offer x by player 1. For every x > 0, player 2’s optimal action is to accept (if she rejects, she gets nothing). For x = 0, person 2 is indifferent between accepting and rejecting. Thus in a subgame perfect equilibrium person 2’s strategy either accepts all offers x (including 0), or accepts all offers x > 0 and rejects the offer x = 0. Backward Induction Solution 6

1 x = 0 x = c x 2 YN c - x, x 0, 0 Y N c, 0 0, 0 N Y 0, c 7

Now consider the whole game. For each of the 2 possible subgame perfect equilibrium strategies of player 2, we find the optimal strategy of player 1. If player 2 accepts all offers x > 0, then player 1’s optimal offer is x = 0 (which yields her the payoff c). If player 2 accepts all offers x > 0, then there is no offer x that is optimal for player 1. No offer x > 0 can be optimal, because x-  is better for player 1, (as long as 0<  <x). 8

The offer x = 0 is not optimal, as player 2 rejects it. The only subgame perfect equilibrium is the strategy pair where player 1 offers x = 0 and player 2 accepts all offers x > 0. In equilibrium, player 1’s payoff is c and player 2’s payoff is zero. 9

The holdup game Before an ultimatum game in which she may accept or reject an offer of person 1, person 2 may make an investment that changes the size of the pie. She may exert little effort, resulting in a small pie, of size c L, or great effort, resulting in a large pie, of size c H. Player 2 dislikes exerting effort: her payoff is x - E if her share of the pie is x, where E = L if she exerts little effort and E = H > L if she exerts great effort. 10

1 x = 0 x = c L x 2 YN 0, -L 1 x = 0 x 2 YN 0, -Hc L -x, x-L 2 x = c H c H -x, x-H L H Extensive Form Representation 11

Each subgame that follows 2’s choice E is an ultimatum game. It has a unique subgame perfect equilibrium, in which 1 offers x = 0 and 2 accepts all offers x > 0. Consider 2’s choice of effort at the start of the game. If she chooses L then her payoff is -L. If she chooses H then her payoff is −H. Backward Induction Solution 12

So, player 1 chooses L at the beginning of the game. Thus the game has a unique subgame perfect equilibrium. In the SPE, player 2 exerts little effort and player 1 obtains all of the resulting small pie. 13

Two Period Alternating Offers Two players bargain over a pie of size 1. In period 1, player 1 makes a split proposal (x, 1-x). If player 2 accepts the proposal, it is implemented. Else, in period 2, player 2 makes proposes (y, 1-y). If player 1 accepts the proposal, it is implemented. Each player i discounts time at rate  i. 14

The subgame starting after player 2 rejects a proposal (x, 1-x) of player 1 is an ultimatum game. It has a unique subgame perfect equilibrium: player 2 proposes (0, 1) and player 1 accepts all proposals. This yields payoffs of 0 for player 1 and  2 for player 2. So, in the subgame after a proposal (x, 1-x) of player 1, if player 2 rejects the proposal, her payoff is  2. Subgame Perfect Equilibrium 15

So, player 2 rejects any proposal (x, 1-x) with 1-x  2. Hence, player 1 initially proposes (1-  2,  2 ). In fact, if proposing any x > 1 –  2, player 1 anticipates that player 2 will reject proposal (x, 1-x), so that player 1’s eventual payoff will be zero. Intuitively, if player 2 is more impatient (i.e.,  2 is smaller), then she gets a lower payoff in the bargain. 16

Rubinstein Bargaining Model Consider the following model in which players may alternate offers indefinitely. Players. The two negotiators: 1 and 2. Terminal histories. Every sequence of the form (x 0, N, x 1, N,..., x t, Y) with t > 0, and every (infinite) sequence of the form (x 0, N, x 1, N,...). To each x r corresponds a split proposal (x r, 1- x r ). N stands for rejection and Y for acceptance. 17

Player Function. P(Ø) = 1, P(x 0, N, x 1, N,..., x t ) = P(x 0, N, x 1, N,..., x t, N) = 1 if t is odd, P(x 0, N, x 1, N,..., x t ) = P(x 0, N, x 1, N,..., x t, N) = 2 if t is even. Preferences. For i = 1, 2, player i’s payoff to the terminal history (x 0, N, x 1, N,..., x t, Y) is  t i x t ; player i’s to the infinite terminal history (x 0, N, x 1, N,...) is zero. 18

Subgame Perfect Equilibrium All subgames starting at odd periods are isomorphic, and so are all subgames starting at even periods. So, we can introduce these stationary bounds: x i H is the largest equilibrium share of player 1 in a subgame where player i makes the initial proposal. x i L is the smallest equilibrium share of player 1 in a subgame where player i makes the initial proposal. 19

In a SPE, player 1 rejects all proposals with a payoff lower than her minimal payoff in her next round. Hence, we obtain that in any SPE, x 2 L >  1 x 1 L. The smallest share of player 1 when 2 makes a proposal is no smaller than the discounted smallest share of player 1, when player 1 makes a proposal. Interchanging players, in any SPE, 1-x 1 H >  2 (1-x 2 H ). 20

Player 2 does not make any proposals with a payoff lower than her minimal payoff in her next round. I.e., player 2 never proposes a share of player 1 larger than player 1’s maximal payoff in the next round. Hence, we obtain that in any SPE, x 2 H <  1 x 1 H. Again, interchanging players, we obtain that in any SPE, 1-x 1 L <  2 (1-x 2 L ). 21

1 -  1    1  2  1 (1 -  2 ) 1 -  1   2 Substitution yields: 1 - x 1 H >  2 (1 -  1 x 1 H ), 1 - x 1 L <  2 (1 -  1 x 1 L ) x 2 L >  1 [1 -  2 (1 - x 2 L )], x 2 H >  1 [1 -  2 (1 - x 2 H )] Further rearranging yields: x 1 L > > x 1 H and x 2 L > > x 2 H So, the unique outcome is x = Player 1’s payoff increases in  1 and decreases in  2. 22

Nash Axiomatic Bargaining The bargaining models seen so far are “positive”: they find solutions of realistic bargaining models. A normative approach to study bargaining is to find solutions that satisfy ethically reasonable requirements. For example, if two identical players bargain over a good, we reasonably require that each gets half. This embodies two principles: Efficiency and Fairness. 23

But what if the players’ preferences are not identical? Denote by X the set of possible agreements, and by D the failure to agree. Let u i be player i’s utility over X ∪ {D}, with d i = u i (D). Define expected utilities Eu i over X ∪ {D}, as usual. Define the payoff set U ={(v 1, v 2 ) : v i = Eu i (L), for some lottery L over X ∪ {D}}. 24

Definition A bargaining problem is a pair (U, d) such that d is a member of U, U is convex, bounded, and closed, for some (v 1, v 2 ) in U we have v 1 > d 1 and v 2 > d 2. Definition A bargaining solution is a function from the set of bargaining problems (U, d) to U. A basic assumption of the model is that the solution depends only on the preferences on lotteries over X ∪ {D}, not on the specific payoff functions u i. 25

We introduce the following requirements (axioms). 1 Invariance to equivalent utility representations. Let (U, d) be a bargaining problem, let a i and b i be numbers with a i > 0 for i = 1, 2. Let U ’={(a 1 v 1 +b 1, a 2 v 2 +b 2 ) : (v 1, v 2 ) is in U}, and let d ’= (a 1 d 1 +b 1, a 2 d 2 +b 2 ). If the solution of (U, d) is (v* 1, v* 2 ), then the solution of (U’, d’) is (a 1 v* 1 +b 1, a 2 v* 2 +b 2 ). 2 Symmetry. Let (U, d) be a bargaining problem for which (v 1, v 2 ) is in U if and only if (v 2, v 1 ) is in U, and d 1 = d 2. If the solution of (U, d) is (v* 1, v* 2 ), then v 1 *= v* 2. 26

3 Pareto efficiency. Let (U, d) be a bargaining problem, and let (v 1, v 2 ) and (v’ 1, v’ 2 ) be members of U. If v 1 > v’ 1 and v 2 > v’ 2, then (v’ 1, v’ 2 ) is not a bargaining solution of (U, d). 4 Independence of irrelevant alternatives. Let (U, d) and (U’, d’) be bargaining problems for which U ’ is a subset of U and d’ = d. If the solution v* of (U, d) is in U’, then bargaining solution of (U’, d’) coincides with v*. 27

Theorem (Nash bargaining solution) A unique bargaining solution satisfies the axioms INV, SYM, IIA, and PAR. This solution associates with the bargaining problem (U, d) the pair of payoffs that solves the problem: max (v 1 - d 1 )(v 2 - d 2 ) (v 1, v 2 ) subject to (v 1, v 2 ) ∈ U and (v 1, v 2 ) > (d 1, d 2 ). The bargaining solution defined by the above Theorem is known as the Nash bargaining solution f N (U, d). 28

The proof or the Theorem is as follows. First note that because U is closed and bounded, the maximization problem defined has a solution. The solution is unique because the level curves of (v 1 - d 1 )(v 2 - d 2 ) are strictly convex, and U is convex. Hence, the Nash bargaining solution f N is well defined. Now we check that f N satisfies the four axioms. 29

Define the function H by H(v 1, v 2 ) = (v 1 - d 1 )(v 2 - d 2 ) for all (v 1, v 2 ). INV: Fix a 1 >0, a 2 > 0, b 1 and b 2. Let U’ be the set of all pairs (a 1 v 1 +b 1, a 2 v 2 +b 2 ) where (v 1, v 2 ) is in U, and let d’=(a 1 d 1 +b 1, a 2 d 2 +b 2 ). Then for every pair (v 1 ’, v 2 ’) in U’ there is a pair (v 1, v 2 ) in U with v i ’=a i v i +b i for i = 1, 2. Thus the maximizer of (v 1 ’ - d 1 ’)(v 2 ’ - d 2 ’) over U’ is (a 1 v 1 *+b 1, a 2 v 2 *+b 2 ), where (v 1 *, v 2 *) is the maximizer of (a 1 v 1 +b 1 - d 1 ’)(a 2 v 2 +b 2 - d 2 ’) over U. 30

But (a 1 v 1 +b 1 - d 1 ’)(a 2 v 2 +b 2 - d 2 ’) = a 1 a 2 H(v 1, v 2 ), so (v 1 *, v 2 *), equals f N (U, d), the Nash solution of (U, d). SYM: If (U, d) is symmetric, the symmetry of the level curves of (v 1 - d 1 )(v 2 - d 2 ) implies that f 1 N (U, d) = f 2 N (U, d). PAR: The function H is increasing in each of its arguments, so v does not maximize H(v) over U if there exists v’ ∈ U with v 1 ’ > v i for i = 1, 2. IIA: If U’ is a subset of U and v* ∈ U’ maximizes H(v) over U, then v* also maximizes H(v) over U’. 31

Finally, I argue that if f is a bargaining solution that satisfies the four axioms, then f = f N. Let (U, d) be an arbitrary problem. I need to show that f(U, d) = f N (U, d). Step 1. Let f N (U, d) = z. Because there exists v ∈ U such that v i > d i for i = 1, 2, we have z i > d i for i = 1, 2. So, let a i =1/[2(z i - d i )] and b i = -d i /[2(z i - d i )], for i=1, 2. 32

Define U’ = {(v 1 ’, v 2 ’)|v i ’ = a i v i + b i for i =1, 2} and d’=(a 1 d 1 +b 1, a 2 v 2 +b 2 ). Note that d’=(0, 0) and that a i z i +b i = 1/2, for i=1, 2. Because the Nash solution satisfies INV, f N (U’, d’) = (a 1 z 1 +b 1, a 2 z 2 +b 2 ) = (1/2, 1/2). By INV, f(U, d) = z if and only if f(U’,d’) = (a 1 z 1 +b 1, a 2 z 2 +b 2 ). Thus it suffices to show that f(U’,d’) = (1/2, 1/2). 33

Step 2. I claim that U’ contains no point (v 1 ’, v 2 ’) for which v 1 ’+v 2 ’ > 1. Suppose to the contrary that it does, and let (t 1 , t 2  ) = (1/2 (1 –  ) +  v 1 ’, 1/2 (1 –  ) +  v 2 ’), for 0 <  < 1. The set U’ is convex, so (t 1 , t 2  ) is in U’ for all . But for small enough values of  we have t 1  t 2  > 1/4, contradicting f N (U’, 0) = (1/2, 1/2). 34

Step 3. The set U’is bounded, so the result of Step 2 ensures that we can find a rectangle T that is symmetric about the 45 ◦ line, that contains U’, and on the boundary of which is (1/2, 1/2). Step 4. By PAR and SYM we have f (T, 0) = (1/2, 1/2). Step 5. By IIA we have f (U’, 0) = f (T, 0), so that f (U’, 0) = (1/2, 1/2), completing the proof. 35

This result is a very deep one within the “axiomatic normative approach” to social sciences. The approach and the result can be described as follows, in the words of John Nash: “One states as axioms several properties that it would seem natural for the solution to have and then one discovers that the axioms actually determine the solution uniquely.” (Nash,1953, pp. 129.) 36

Summary of the Lecture Ultimatum Game and Hold Up Problem Rubinstein Alternating Offer Bargaining Nash Axiomatic Bargaining 37

THE END! Thank you. 38