EC941 - Game Theory Prof. Francesco Squintani Lecture 6 1.

Slides:



Advertisements
Similar presentations
An Introduction to Game Theory Part V: Extensive Games with Perfect Information Bernhard Nebel.
Advertisements

Introduction to Game Theory
EC941 - Game Theory Prof. Francesco Squintani Lecture 4 1.
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 3.1.Dynamic Games of Complete but Imperfect Information Lecture
This Segment: Computational game theory Lecture 1: Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie.
1 EC9A4 Social Choice and Voting Lecture 3 EC9A4 Social Choice and Voting Lecture 3 Prof. Francesco Squintani
Chapter 14 Infinite Horizon 1.Markov Games 2.Markov Solutions 3.Infinite Horizon Repeated Games 4.Trigger Strategy Solutions 5.Investing in Strategic Capital.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
© 2015 McGraw-Hill Education. All rights reserved. Chapter 15 Game Theory.
EC941 - Game Theory Lecture 7 Prof. Francesco Squintani
Game Theory: Inside Oligopoly
Short introduction to game theory 1. 2  Decision Theory = Probability theory + Utility Theory (deals with chance) (deals with outcomes)  Fundamental.
Extensive Games with Imperfect Information
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 3.1.Dynamic Games of Complete but Imperfect Information Lecture
EC941 - Game Theory Prof. Francesco Squintani Lecture 8 1.
1. problem set 13 see last slide Last Slide 3 Extensive form Games with Incomplete Information 111 Information set of player 1 Belief p1p1 p2p2 p3p3.
Adverse Selection Asymmetric information is feature of many markets
EC102: Class 9 Christina Ammon.
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
David Bryce © Adapted from Baye © 2002 Game Theory: The Competitive Dynamics of Strategy MANEC 387 Economics of Strategy MANEC 387 Economics.
More on Extensive Form Games. Histories and subhistories A terminal history is a listing of every play in a possible course of the game, all the way to.
ECON6036 1st semester Format of final exam Same as the mid term
Harsanyi transformation Players have private information Each possibility is called a type. Nature chooses a type for each player. Probability distribution.
Job Market Signaling (Spence model)
Chapter 6 Extensive Games, perfect info
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
Extensive Game with Imperfect Information III. Topic One: Costly Signaling Game.
Extensive Game with Imperfect Information Part I: Strategy and Nash equilibrium.
EC941 - Game Theory Francesco Squintani Lecture 3 1.
© 2009 Institute of Information Management National Chiao Tung University Lecture Notes II-2 Dynamic Games of Complete Information Extensive Form Representation.
Gaming Prediction Markets: Equilibrium Strategies with a Market Maker Yilin Chen, Daniel M. Reeves, David M. Pennock, Robin D. Hanson, Lance Fortnow, Rica.
EC941 - Game Theory Prof. Francesco Squintani Lecture 2 1.
Exam Questions. Fred and Elmer No Price War Price War.
MAKING COMPLEX DEClSlONS
Reading Osborne, Chapters 5, 6, 7.1., 7.2, 7.7 Learning outcomes
Chapter 9 Games with Imperfect Information Bayesian Games.
EC941 - Game Theory Francesco Squintani 1 Lecture 1.
Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie Mellon University.
ECO290E: Game Theory Lecture 12 Static Games of Incomplete Information.
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
EC941 - Game Theory Prof. Francesco Squintani Lecture 5 1.
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 4.1.Dynamic Games of Incomplete Information Lecture
Games with Imperfect Information Bayesian Games. Complete versus Incomplete Information So far we have assumed that players hold the correct belief about.
Dynamic Games & The Extensive Form
Stackelberg –życie i wkład do nauki (teoria gier).
Extensive Games with Imperfect Information
Topic 3 Games in Extensive Form 1. A. Perfect Information Games in Extensive Form. 1 RaiseFold Raise (0,0) (-1,1) Raise (1,-1) (-1,1)(2,-2) 2.
ECO290E: Game Theory Lecture 13 Dynamic Games of Incomplete Information.
제 10 장 게임이론 Game Theory: Inside Oligopoly
Incomplete information: Perfect Bayesian equilibrium
Chapter 6 Extensive Form Games With Perfect Information (Illustrations)
Dynamic games, Stackelburg Cournot and Bertrand
Extensive Form Games With Perfect Information (Illustrations)
Extensive Form (Dynamic) Games With Perfect Information (Theory)
Econ 805 Advanced Micro Theory 1 Dan Quint Fall 2009 Lecture 1 A Quick Review of Game Theory and, in particular, Bayesian Games.
By: Donté Howell Game Theory in Sports. What is Game Theory? It is a tool used to analyze strategic behavior and trying to maximize his/her payoff of.
ECO290E: Game Theory Lecture 10 Examples of Dynamic Games.
Game Theory Georg Groh, WS 08/09 Verteiltes Problemlösen.
Game Theory M.Pajhouh Niya M.Ghotbi
Game Theory: The Competitive Dynamics of Strategy
EC941 - Game Theory Lecture 8 Prof. Francesco Squintani
Econ 805 Advanced Micro Theory 1
Strategic Information Transmission
Game Theory in Wireless and Communication Networks: Theory, Models, and Applications Lecture 2 Bayesian Games Zhu Han, Dusit Niyato, Walid Saad, Tamer.
Learning 6.2 Game Theory.
Games with Imperfect Information Bayesian Games
ECE700.07: Game Theory with Engineering Applications
Molly W. Dahl Georgetown University Econ 101 – Spring 2009
Presentation transcript:

EC941 - Game Theory Prof. Francesco Squintani Lecture 6 1

Structure of the Lecture Extensive-Form Games with Imperfect Information Spence Signalling Game Crawford and Sobel Cheap Talk 2

In games of perfect information, the subgame perfect equilibrium coincides with the backward-induction solution. But subgame-perfect equilibrium is a more general concept, defined also for games without perfect information. 3

Extensive Form Games with Imperfect Information In some strategic interactions, players make decisions without knowing prior decisions of other players. This formulation includes the possibility of simultaneous moves, and the possibility of uncertainty about the opponents’ types. Extensive form games with imperfect information include also strategic form and Bayesian games. 4

Example: Entry Game Consider an entry game in which the entrant may or not be ready for a fight, and this is private information. 1 O R SF 2, 5 3, 3  1 2 SF 4, 3  2 U 5

The two decision subhistory of player 2 are linked, to account for the fact that she does not know player 1’s prior action. 1 O R SF 2, 5 3, 3  1 2 SF 4, 3  2 U 6

Extensive Form Game Definition An extensive game with imperfect information and chance moves consists of a set of players a set of sequences (terminal histories) with the property that no sequence is a proper subhistory of any other sequence a function (the player function) that assigns either a player or “chance” to every sequence that is a proper subhistory of some terminal history a probability distribution (the chance move) over the actions available after any history to which the player function assigns chance. The probability distributions are independent. 7

for each player, a partition (the player’s information partition) of the set of histories assigned to that player by the player function for each player, preferences over the set of terminal histories. Definition A pure strategy of player i in an extensive game is a function that assigns to each of player i’s information sets I i an action in A(I i ) (the set of actions available to player i at the information set I i ). With this definition we can transform any extensive form game into a strategic form game, and find all its Nash Equilibria. 8

For example, in the entry game, we have: The set of players is {1, 2}. The terminal histories are {RF, RS, UF, US, O}. The player function is P( ∅ ) =1, P(R) = 2, P(U) =2. There is no chance move, Player 1’s information partition is { ∅ }, and player 2’s information partition is {{R,U}}. The preferences over the set of terminal histories are u 1 (RF)=1, u 1 (RS)=3, u 1 (UF)=0, u 1 (US)=4, u 1 (O)=2 u 2 (RF)=1, u 2 (RS)=3, u 2 (UF)=2, u 2 (US)=3, u 2 (O)=5 9

The strategic form representation of the entry game is: There are 2 pure strategy Nash Equilibria (U, S) and (O,F). Only (U, S) is reasonable. (O, F) contains a non- credible threat. Both equilibria are subgame perfect, because there are no proper subgames in the extensive form representation. F S R U 1, 1 0, 24, 3 3, 3 O 2, 5 10

Perfect Bayesian Equilibrium To account that only some Subgame Perfect Equilibria are reasonable, we introduce the solution concept of Perfect Bayesian Equilibrium. We separate strategies from beliefs Strategies refer to the choice of a player at any information set A belief is a probability over histories that belong to the same information set. We require beliefs to be `consistent’ with strategies. 11

Definition A behavioral strategy of player i in an extensive game is a function that assigns to each of i’s information sets I i a probability distribution over the actions in A(I i ), the distributions are independent of each other. Definition A belief system in an extensive game is a collection of probability distributions, one for each information set, over the histories in that information set. Definition An assessment is a pair consisting of a profile of behavioral strategies and a belief system. 12

Definition An assessment is a Perfect Bayesian Equilibrium if: Each player’s strategy is optimal whenever she has to move, given her belief and the other players’ strategies Each player’s belief is consistent with the strategy profile, according to the Bayes rule. Consistency requires that the belief probability of different histories in the same information set is determined by the probability that the history is reached according to the players’ strategies. 13

The Nash Equilibrium (U, S) is a Perfect Bayesian Equilibrium, with the belief that assigns probability 1 to the history U at the information set {U, R}. 1 O R SF 2, 5 3, 3  1 2 SF 4, 3  2 U 14

The Nash Equilibrium (O, F) is not a Perfect Bayesian Equilibrium, because the strategy F is not optimal, regardless of 2’s beliefs at the information set {U, R}. 1 O R SF 2, 5 3, 3  1 2 SF 4, 3  2 U 15

Spence Signalling Model There is one student and two firms. There is one student and two firms. The student’s skill is H or L<H, private information. The student’s skill is H or L<H, private information. First, the student chooses her amount e of education. First, the student chooses her amount e of education. Then, the firms observe e, and offer wages w 1 and w 2. Then, the firms observe e, and offer wages w 1 and w 2. Finally, the worker chooses one of the wage offers, w*. Finally, the worker chooses one of the wage offers, w*. 16

17 The firms believe that the student skill is H with probability p. The cost of studying is e/K for a student of skill K. (Studying is less costly for a high skill student). The student’s payoff is w* – e/K. Each firm i’s payoff is K - w i if hiring the student, and zero otherwise.

18 There are many Perfect Bayesian Equilibria. In one PBE, the high skill type chooses a positive amount of education, e*. Consider the following assessment. Student’s strategy. Type H chooses e = e* and type L chooses e = 0. After observing the firms’ wage offers, both types choose one of the highest offer. Perfect Bayesian Equilibrium

19 Firms’ belief. Each firm believes that a student is type H if she chooses e* and type L otherwise. Firms’ strategies. Each firm offers the wage H to a student who chooses e* and the wage L to a student who chooses any other value of e. The firms’ beliefs are consistent with the student’s strategy. (No student chooses an education level e other than e* and 0, so consistency imposes no restriction on the firms’ beliefs after observing any such e.)

20 Now, consider sequential rationality. Student. The strategy of accepting the highest offer at the end of the game is clearly optimal. Now consider the student’s education choice. A type H student obtains the payoff H - e*/H if she follows her strategy, choosing the education level e*, and the payoff L - e/H if deviating to any other level e. So, for the assessment to be a PBE, ones need H - e*/H > L, or e* < H(H - L).

21 A type L student obtains the payoff L, if she follows her strategy and chooses the education level 0. If deviating to any e other than e*, she obtains payoff L - e/L. If deviating to e = e*, then the firms believe her ability to be H, and she obtains the payoff H - e*/L. So, for the assessment to be a PBE, one needs L > H - e*/L, i.e., e* > L(H - L).

22 Each firm’s payoff is 0, given its belief and its strategy. If it raises the wage it offers in response to any value of e, its expected profit is negative, given its belief. If it lowers the wage its expected profit remains zero (its offer is not accepted). In summary, the assessment is a Perfect Bayesian Equilibrium if and only if L (H - L) < e* < H (H - L).

23 There are other Perfect Bayesian Equilibria. For example, consider the following assessment. Student’s strategy. Type H and L chooses e = e’. After observing the firms’ wage offers, both types choose one of the highest offer. Firms’ belief. Each firm believes that a student is type H with probability p if she chooses e = e ’. Otherwise, she believes that the student is of type L.

24 Firms’ strategies. Each firm offers the wage L to a student choosing e = e’, and w = pH+(1-p)L to a student who chooses e = e’. The firms’ beliefs are consistent with the student’s strategies. The student’s wage acceptance strategy is optimal. The type H student’s strategy of choosing e = e’ is also optimal, because it gives her the highest wage, as long as pH+(1-p)L – e’/H > L.

25 The type L student’s strategy of choosing e = e’ is also optimal, because it gives her the highest wage, as long as pH+(1-p)L – e’/L > L. In sum, it is required that e’ < pL(H – L). It can be argued that these “pooling” PBE are less plausible than the “separating” PBE seen before. The pooling PBE is fragile because there are deviations e* = e’, that only high-skill students would choose, if the firms believed that only high-skill students chose e*.

Crawford and Sobel Cheap Talk An expert privately observes a state t in [0, 1]. The expert sends a report r (a real number) to a decision maker. After receiving the report, the decision maker chooses an action y (also, a real number). The DM knows that t is uniformly distributed in [0,1], i.e. the p.d.f. f is such that f(t) = 1 for t in [0, 1]. 26

27 The players’ payoffs are independent of r. (I.e., the report is cheap talk). Both players care that the action matches the state. But the expert is biased relatively to the DM. The expert’s payoff is u E (y, t) = -(y-(t + b)) 2. (Her optimal action given the state t is y = t + b). The DM payoff is u DM (y, t) = -(y-t) 2. (Her optimal action given the state t is y = t ).

Perfect Communication We first show that there cannot be any PBE in which the expert accurately reports the state. (I.e., an invertible strategy  cannot be part of a PBE.) By contradiction, say that  is invertible and PBE. Then, consistency implies that the DM believes (correctly) that the state is t, when the report is r =  (t). 28

29 Hence, upon receiving report r =  (t), the DM chooses the action y = t. Anticipating this, when the state is t, the expert deviates from the strategy . Instead of sending the report r =  (t), she sends the report r’=  (t+b), which induces the action y = t+b. Hence,  is not sequentially rational, and cannot be part of a PBE.

Perfect Bayesian Equilibrium By the above result, every Perfect Bayesian Equilibrium is described by a partition of the state space [0, 1]. Each partition is composed of K intervals, where the admissible set of K depends on the bias level b. The K intervals are [t 0, t 1 ), [t 1, t 2 ), …, [t K-1, t K ], where t 0 =0 and t K =1. 30

31 For any k = 1, …, K-1, all expert types t in [t k-1, t k ) send the same report r k. Hence, upon receiving report r k, the DM knows that t is in [t k-1, t k ), and chooses y so as to maximize t k - (y-t) 2 dt t k-1 t k Taking the first-order condition, 0 = - 2 (y-t) dt = - 2[ y - (t k-1 +t k )/2 ]. t k-1

32 So, upon receiving report r k, the DM chooses the action y = (t k-1 + t k )/2. In a PBE, the expert anticipates that if reporting r = r k, she induces the action y = (t k-1 + t k )/2. For any k = 1, …, K-1, an expert of type t k must be indifferent between sending report r k and r k+1. I.e., - ((t k-1 + t k )/2 -(t k + b)) 2 = - ((t k + t k+1 )/2 -(t k + b)) 2. Or, t k+1 - t k = t k – t k-1 +4b.

33 If these conditions hold, then, for any k = 1, …, K, every type of expert t in [t k-1, t k ) prefers to send report r = r k than any other report. The conditions give a second-order difference equation, solved with boundary conditions t 0 = 0 and t K = 1. The interval [t k-1, t k ) has length t k – t k-1 = t 1 + (k-1)4b. The sum of the intervals [t k-1, t k ), for k = 1, …, K, must be equal to 1: t 1 + (t 1 +4b) + … + [t 1 +(K-1)4b] = 1.

34 Or, Kt 1 + 4b [1+ … + (K-1)b] = 1. I.e., Kt 1 + 2bK(K-1) = 1. So, if b is small enough that 2bK(K-1) < 1, then there is a value of t 1 that satisfies the condition, and hence a PBE with K intervals. The largest is b, the smallest is the maximum number of intervals K* that can be a PBE. For b> 1/4, K* = 1. For 1/4 < b < 1/12, K* =2, etc.

35 We conclude by ranking PBE in ex-ante sense (i.e., before the state t is realized). The sender’s ex-ante equilibrium payoff is: -  Pr{t in [t k-1, t k )} [ (t k-1 +t k )/2 - (t+b)] 2 dt /Pr[t k-1, t k ). The decision maker’s ex-ante equilibrium payoff is: -  Pr{t in [t k-1, t k )} [ (t k-1 +t k )/2 - t] 2 dt /Pr[t k-1, t k ). K t k k=1 t k-1 K t k k=1 t k-1

36 Expanding the sender’s ex-ante equilibrium payoff,    {[(t k-1 +t k )/2 – t] 2 + b 2 – 2b [(t k-1 +t k )/2 – t]}dt = -  [(t k-1 +t k )/2 – t] 2 dt - b 2, because, for any k, [(t k-1 +t k )/2 – t]dt = (t k-1 +t k )/2 - (t k-1 +t k )/2 = 0. K t k k=1 t k-1 tktk t k-1 K t k k=1 t k-1

37 In sum, the sender’s and the decision maker’s ex-ante equilibrium payoff differ only by the constant b 2. The PBE maximizing one, maximizes also the other. It can be shown that, for any b, the PBE maximizing ex-ante payoff is the one with K* intervals. This is because the sum of the loss terms in the ex-ante payoff expression is larger, the coarser is the equilibrium partition.

Summary of the Lecture Extensive-Form Games with Imperfect Information Spence Signalling Game Crawford and Sobel Cheap Talk 38

Preview of the Next Lecture Infinitely Repeated Games Nash and Subgame-Perfect Equilibrium Finitely Repeated Games 39