GAMES IN EEXTENSIVE AND STRATEGIC FORM Topic #7. Review: A Best Reply Given a strategy choice by the other player, your best reply to it is the strategy.

Slides:



Advertisements
Similar presentations
An Introduction to Game Theory Part V: Extensive Games with Perfect Information Bernhard Nebel.
Advertisements

The Basics of Game Theory
5. Combining simultaneous and sequential moves.
Introduction to Game Theory
NON - zero sum games.
GAME THEORY.
Module 4 Game Theory To accompany Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Power Point slides created by Jeff Heyl.
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 3.1.Dynamic Games of Complete but Imperfect Information Lecture
ECON 100 Tutorial: Week 9 office: LUMS C85.
BASICS OF GAME THEORY. Recap Decision Theory vs. Game Theory Rationality Completeness Transitivity What’s in a game? Players Actions Outcomes Preferences.
This Segment: Computational game theory Lecture 1: Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie.
Game Theory S-1.
3. Basic Topics in Game Theory. Strategic Behavior in Business and Econ Outline 3.1 What is a Game ? The elements of a Game The Rules of the.
VARIATIONS ON SIMPLE PAYOFF MATRICES Topic #6. The Payoff Matrix Given any payoff matrix, the standard assumption is – that the players choose their strategies.
Two-Player Zero-Sum Games
Non-Cooperative Game Theory To define a game, you need to know three things: –The set of players –The strategy sets of the players (i.e., the actions they.
Operations Research Assistant Professor Dr. Sana’a Wafa Al-Sayegh 2 nd Semester ITGD4207 University of Palestine.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
An Introduction to... Evolutionary Game Theory
Copyright (c) 2003 Brooks/Cole, a division of Thomson Learning, Inc
Game theory.
Game Theory, Part 1 Game theory applies to more than just games. Corporations use it to influence business decisions, and militaries use it to guide their.
© 2015 McGraw-Hill Education. All rights reserved. Chapter 15 Game Theory.
Short introduction to game theory 1. 2  Decision Theory = Probability theory + Utility Theory (deals with chance) (deals with outcomes)  Fundamental.
Part 3: The Minimax Theorem
M9302 Mathematical Models in Economics Instructor: Georgi Burlakov 3.1.Dynamic Games of Complete but Imperfect Information Lecture
Lecture 2A Strategic form games
SCIT1003 Chapter 2: Sequential games - perfect information extensive form Prof. Tsang.
An Introduction to Game Theory Part I: Strategic Games
5/16/20151 Game Theory Game theory was developed by John Von Neumann and Oscar Morgenstern in Economists! One of the fundamental principles of.
EC102: Class 9 Christina Ammon.
Slide 1 of 13 So... What’s Game Theory? Game theory refers to a branch of applied math that deals with the strategic interactions between various ‘agents’,
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
Basics on Game Theory For Industrial Economics (According to Shy’s Plan)
More on Extensive Form Games. Histories and subhistories A terminal history is a listing of every play in a possible course of the game, all the way to.
Lecture Slides Dixit and Skeath Chapter 4
Lectures in Microeconomics-Charles W. Upton Minimax Strategies.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
QR 38, 2/22/07 Strategic form: dominant strategies I.Strategic form II.Finding Nash equilibria III.Strategic form games in IR.
Finite Mathematics & Its Applications, 10/e by Goldstein/Schneider/SiegelCopyright © 2010 Pearson Education, Inc. 1 of 68 Chapter 9 The Theory of Games.
QR 38, 2/15/07 Extensive form games I.Writing down a game II.Finding the equilibrium III.Adding complexity.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
Minimax Strategies. Everyone who has studied a game like poker knows the importance of mixing strategies. –With a bad hand, you often fold –But you must.
Game Theory Statistics 802. Lecture Agenda Overview of games 2 player games representations 2 player zero-sum games Render/Stair/Hanna text CD QM for.
Game Theory.
GAMES AGAINST NATURE Topic #3. Games Against Nature In game theory, for reasons that will be explained later, the alternatives (e.g., LEFT and RIGHT)
EC941 - Game Theory Prof. Francesco Squintani Lecture 5 1.
Game Theory Part 2: Zero Sum Games. Zero Sum Games The following matrix defines a zero-sum game. Notice the sum of the payoffs to each player, at every.
Dynamic Games & The Extensive Form
THE “CLASSIC” 2 x 2 SIMULTANEOUS CHOICE GAMES Topic #4.
Games. Adversaries Consider the process of reasoning when an adversary is trying to defeat our efforts In game playing situations one searches down the.
3.1.4 Types of Games. Strategic Behavior in Business and Econ Outline 3.1. What is a Game ? The elements of a Game The Rules of the Game:
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
Strategic Behavior in Business and Econ Static Games of complete information: Dominant Strategies and Nash Equilibrium in pure and mixed strategies.
1 Information, Control and Games Shi-Chung Chang EE-II 245, Tel: ext Office.
Zero-sum Games The Essentials of a Game Extensive Game Matrix Game Dominant Strategies Prudent Strategies Solving the Zero-sum Game The Minimax Theorem.
Chapter 16 Oligopoly and Game Theory. “Game theory is the study of how people behave in strategic situations. By ‘strategic’ we mean a situation in which.
Statistics Overview of games 2 player games representations 2 player zero-sum games Render/Stair/Hanna text CD QM for Windows software Modeling.
GAME THEORY Day 5. Minimax and Maximin Step 1. Write down the minimum entry in each row. Which one is the largest? Maximin Step 2. Write down the maximum.
By: Donté Howell Game Theory in Sports. What is Game Theory? It is a tool used to analyze strategic behavior and trying to maximize his/her payoff of.
Mixed Strategies Keep ‘em guessing.
Adversarial Environments/ Game Playing
Introduction to Game Theory
Chapter 15: Game Theory: The Mathematics Lesson Plan of Competition
Introduction to Game Theory
Tools for Decision Analysis: Analysis of Risky Decisions
SCIT1003 Chapter 2: Sequential games - perfect information extensive form Prof. Tsang.
Chapter 6 Game Theory (Module 4) 1.
Game Theory.
Chapter 15: Game Theory: The Mathematics Lesson Plan of Competition
Presentation transcript:

GAMES IN EEXTENSIVE AND STRATEGIC FORM Topic #7

Review: A Best Reply Given a strategy choice by the other player, your best reply to it is the strategy that gives the highest payoff in that contingency. – For Player R (who is maximizing), s1 is his best reply to c1 and s2 is his best reply to c2. – For player C (who is minimizing), c2 is his best reply to s1 and c1 is his best reply to s2. – A dominant strategy is a best reply to every strategy of the other player. – In a Nash equilibrium, each player is making a best reply to the other player’s strategy.

Sequential Non-Strictly Determined Zero-Sum Games This zero-sum payoff matrix is not “strictly determined”: – with respect to pure strategies, maximin ≤ minimax; – there is no pure-strategy Nash equilibium, and – the best strategies for both players are mixed strategies.

Sequential Games However, if the game is played sequentially, it does seem to be “strictly determined” in a practical sense. – If Player R moves first, he can anticipate that Player C, knowing what R has done, will choose his best reply to whatever R has done. – So Player R should choose his maximin pure strategy S1 and Player C should choose his best response to S1, i.e., C2 (which is not C’s minimax strategy in the payoff matrix). – By like reasoning, if Player C moves first, C chooses his minimax strategy C1 and Player R chooses his best response to C1, i.e., S1 (which is R’s maximin strategy).

“Look Ahead and Reason Back” – Put otherwise, the first moving player P1 should – look ahead to figure out what is the second moving player P2’ s best reply to whatever P1 chooses, and then – reason back to figure what should choose, i.e., the strategy that gives P1 the best payoff given the best reply of P2 to that strategy. – This is an example of Dixit and Nalebuf’s (p. 34) First Rule of Strategy: “Look ahead and reason back.” – This First Rule applies to sequential-move games that may be either zero-sum or non-zero-sum. – The “Ex Com” during the Cuban Missile Crisis explicitly followed this rule.

Sequential Games (cont.) So the sequential variant of a non-strictly determined zero-sum is itself “strictly determined” in the practical sense that – both players can readily determine their best strategies, – these best strategies are pure, not mixed strategies, so – a single predictable outcome results. Moreover, in the sequential variant of non-strictly determined zero-sum games there is a clear second-mover advantage. – The first mover gets his (pure strategy) maximin payoff, but – The second mover gets more than his (pure strategy) minimax payoff, i.e., – The maximin vs. minimax payoff gap is closed up in favor of the second mover.

Sequential Games (cont.) If a zero-sum game is strictly determined, sequential choice is no different from simultaneous choice, and – there is no (first or second) mover advantage.

Sequential Chicken Consider the Game of Chicken player sequentially: – The best reply of the second-mover is to do the opposite of whatever the first-mover does. – So the first-mover will choose Straight and “win” the game. – Except that it is not much of a “win,” since sequential play takes the “thrill” out of the game by eliminating the risk of mutual disaster. Sequential Chicken, unlike the sequential version of a non- strictly determined zero-sum game, has a clear first-mover advantage. – The first mover get his maximum payoff while the second mover gets only his maximin payoff. – The second mover has the “last clear chance” to avoid mutual disaster.

Sequential Chicken in Extensive Form (or a Decision/Game Tree)

Strategies A (pure) strategy is a complete plan of action for playing a game, – where choices at any move can be made contingent on whatever information is available to the player at that move. Thus in Sequential Chicken, the first-moving player P1 has just two strategies: SW and ST. But the second-moving player P2, contrary to what the 2x2 payoff matrix suggests, actually has four strategies: – choose SW unconditionally (i.e., whatever P1 has done at the first move) [call this strategy [SW/SW]; – choose ST unconditionally (i.e., whatever P1 has done at the first move) [ST/ST]; – choose SW if P1 has chosen SW and choose ST if P1 has chosen ST [SW/ST] (“do the same as P1”); and – choose ST if P1 has chosen SW and choose SW if P1 has chosen ST [ST/SW] (“do the opposite of P1”).

Strategies (cont.) In principle, rather than actually playing any (parlor) game, each player could write down his complete strategy and turn it in to an umpire, – who would then give each player the payoffs resulting from this strategy pair. In practice, the number of strategies to choose among, and the amount of detail required to specify any strategy, is usually beyond comprehension, – even for a game as simple as three-in-a-row tic-tac-toe*, – let alone poker, chess, etc. *The player making the first move can put his “X” in any one of 9 squares. The player making the second move can put his “0” in any one of the 8 remaining squares, etc. So the extensive form of tic-tac-toe has 9! = 362,880 end points. The number of strategies for each player is far larger.

Sequential Chicken in Normal (or Strategic) Form Thus the expanded payoff matrix for Sequential Chicken, where Row moves first and all of Columns strategies are shown, is the 2x4 matrix above. – This is called the game in normal (or strategic) form, as opposed to extensive form. Notice that in the expanded matrix, Column has a dominant strategy, – i.e., ST/SW (choose the opposite of whatever Row has chosen).

Sequential Chicken in Normal (or Strategic) Form Row’s best reply to Column’s strategy ST/SW is to choose ST, so the game as represented by the expanded payoff matrix can be analyzed in the same manner as a simultaneous choice game. Indeed the players can be viewed as making simultaneous choices of strategies. – Column loses no flexibility by turning in his strategy to an “umpire” in advance. – The flexibility that Column gains by moving second is “built into” his dominant strategy ST/SW (and also his dominated strategy SW/ST).

Normal vs. Extensive Form and Information Sets Simultaneous-move games may also be displayed in extensive form, – by showing “information sets.” Ordinary (non- sequential) Chicken is shown to the right. – Two points in the tree correspond to P2’s move, but – they belong to the same information set.

Games with Perfect Information The extensive form is most useful for specifying games with (effectively) perfect information. – Formally, this means every information set contains only one element, or put otherwise whenever a player makes any choice, he knows exactly where he is in the extensive form. – More practically, this mean all choice are made sequentially and in the open. – Games with perfect information include: tic-tac-toe, checkers, chess, and most board games Roll-call voting. – Games with imperfect information include: Bridge, poker, and most card games Voting by secret ballot.

Backwards Induction Games with perfect information can (in principle) be solved by backwards induction, – which is a generalization of the Dixit and Nalebuf’s “Look Ahead and Reason Back” rule. – Such games are in a meaningful sense “strictly determined”; in particular, no player has reason to choose a mixed strategies. However, even board games as simple as 3x3 tick-tack-toe have enormous extensive forms, – a previously noted. But some political games can be represented and analyzed by manageably small extensive forms.

A Simple Example Suppose Congress can pass a bill either – with an amendment (outcome b+a). – without an amendment (outcome b) or The President can then either – sign the bill (b or b+a, as the case may be) or – veto the bill, so no bill is passed at all (outcome q).

A Simple Example (cont.) The tree diagram show the extensive game form but not actually a game, – because it shows only outcomes, – not the payoffs to the players given by these outcomes. This actually is an advantages because these payoff will vary by circumstances.

A Simple Example (cont.) Suppose the players have these preferences: Congress President b+ab bq q b+a Now suppose: Congress President b+ab b b+a q q

The Powell Amendment In the 1950s, Rep. Adam Clayton Powell (D-NY [Harlem]) proposed a amendment to the Federal Aid to Education Bill prohibiting federal funds from going to segregated schools There were three blocs (each less than a majority) in the House, with these preferences: NDem SDem Rep b+a b q b q b+a q b+q b What will happen? Sincere (non-strategic) voting)? – Don’t look ahead and reason back. Strategic (or “sophisticated’) voting? – Look ahead and reason back.