Mobile Computing Group An Introduction to Game Theory part I Vangelis Angelakis 14 / 10 / 2004.

Slides:



Advertisements
Similar presentations
The Basics of Game Theory
Advertisements

Nash’s Theorem Theorem (Nash, 1951): Every finite game (finite number of players, finite number of pure strategies) has at least one mixed-strategy Nash.
This Segment: Computational game theory Lecture 1: Game representations, solution concepts and complexity Tuomas Sandholm Computer Science Department Carnegie.
Game Theory S-1.
© 2009 Institute of Information Management National Chiao Tung University Game theory The study of multiperson decisions Four types of games Static games.
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Non-Cooperative Game Theory To define a game, you need to know three things: –The set of players –The strategy sets of the players (i.e., the actions they.
Chapter 10 Game Theory and Strategic Behavior
The basics of Game Theory Understanding strategic behaviour.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
Chapter 6 Game Theory © 2006 Thomson Learning/South-Western.
An Introduction to... Evolutionary Game Theory
 1. Introduction to game theory and its solutions.  2. Relate Cryptography with game theory problem by introducing an example.  3. Open questions and.
Game Theory: Inside Oligopoly
Game Theory Eduardo Costa. Contents What is game theory? Representation of games Types of games Applications of game theory Interesting Examples.
Game Theory. Games Oligopolist Play ▫Each oligopolist realizes both that its profit depends on what its competitor does and that its competitor’s profit.
STRATEGIC DECISION MAKING
Economics 202: Intermediate Microeconomic Theory 1.HW #6 on website. Due Thursday. 2.No new reading for Thursday, should be done with Ch 8, up to page.
An Introduction to Game Theory Part I: Strategic Games
GAME THEORY.
Chapter 6 © 2006 Thomson Learning/South-Western Game Theory.
Rational Choice Sociology Lecture 5 Game theory I: the concept and classification of games.
GAME THEORY By Ben Cutting & Rohit Venkat. Game Theory: General Definition  Mathematical decision making tool  Used to analyze a competitive situation.
Eponine Lupo.  Game Theory is a mathematical theory that deals with models of conflict and cooperation.  It is a precise and logical description of.
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
Mobile Computing Group An Introduction to Game Theory part II Vangelis Angelakis 21 / 10 / 2004.
Advanced Microeconomics Instructors: Wojtek Dorabialski & Olga Kiuila Lectures: Mon. & Wed. 9:45 – 11:20 room 201 Office hours: Mon. & Wed. 9:15 – 9:45.
APEC 8205: Applied Game Theory Fall 2007
Game Theory Here we study a method for thinking about oligopoly situations. As we consider some terminology, we will see the simultaneous move, one shot.
Introduction to Game Theory and Behavior Networked Life CIS 112 Spring 2009 Prof. Michael Kearns.
UNIT II: The Basic Theory Zero-sum Games Nonzero-sum Games Nash Equilibrium: Properties and Problems Bargaining Games Bargaining and Negotiation Review.
An introduction to game theory Today: The fundamentals of game theory, including Nash equilibrium.
Strategic Game Theory for Managers. Explain What is the Game Theory Explain the Basic Elements of a Game Explain the Importance of Game Theory Explain.
Game Theory, Strategic Decision Making, and Behavioral Economics 11 Game Theory, Strategic Decision Making, and Behavioral Economics All men can see the.
Introduction: Thinking Like an Economist 1 CHAPTER 2 CHAPTER 12 Game Theory, Strategic Decision Making, and Behavioral Economics All men can see the tactics.
Chapter 12 Choices Involving Strategy Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written.
A Game-Theoretic Approach to Strategic Behavior. Chapter Outline ©2015 McGraw-Hill Education. All Rights Reserved. 2 The Prisoner’s Dilemma: An Introduction.
Dynamic Games of complete information: Backward Induction and Subgame perfection - Repeated Games -
Standard and Extended Form Games A Lesson in Multiagent System Based on Jose Vidal’s book Fundamentals of Multiagent Systems Henry Hexmoor, SIUC.
McGraw-Hill/Irwin Copyright  2008 by The McGraw-Hill Companies, Inc. All rights reserved. GAME THEORY, STRATEGIC DECISION MAKING, AND BEHAVIORAL ECONOMICS.
Chapter 12 - Imperfect Competition: A Game-Theoretic Approach Copyright © 2015 The McGraw-Hill Companies, Inc. All rights reserved.
Lecture 7 Course Summary The tools of strategy provide guiding principles that that should help determine the extent and nature of your professional interactions.
The Science of Networks 6.1 Today’s topics Game Theory Normal-form games Dominating strategies Nash equilibria Acknowledgements Vincent Conitzer, Michael.
Chapter ElevenCopyright 2009 Pearson Education, Inc. Publishing as Prentice Hall. 1 Chapter 11 Game Theory and Asymmetric Information.
Lecture 5 Introduction to Game theory. What is game theory? Game theory studies situations where players have strategic interactions; the payoff that.
1 GAME THEORY AND OLIGOPOLY l Principles of Microeconomic Theory, ECO 284 l John Eastwood l CBA 247 l l address:
1 What is Game Theory About? r Analysis of situations where conflict of interests is present r Goal is to prescribe how conflicts can be resolved 2 2 r.
How to Analyse Social Network? : Part 2 Game Theory Thank you for all referred contexts and figures.
Strategic Game Theory for Managers. Explain What is the Game Theory Explain the Basic Elements of a Game Explain the Importance of Game Theory Explain.
Introduction to Game Theory Presented by 蘇柏穎 2004/12/9 2004/12/9.
Topics to be Discussed Gaming and Strategic Decisions
GAME THEORY and its Application Chapter 06. Outlines... Introduction Prisoner`s dilemma Nash equilibrium Oligopoly price fixing Game Collusion for profit.
Lec 23 Chapter 28 Game Theory.
By: Donté Howell Game Theory in Sports. What is Game Theory? It is a tool used to analyze strategic behavior and trying to maximize his/her payoff of.
Taylor. Na, Amy. Hong, Brian. Sang, Luck Yoon. What is the Game Theory? intelligent rational decision-makers Game theory is "the study of mathematical.
Advanced Subjects in GT Outline of the tutorials Static Games of Complete Information Introduction to games Normal-form (strategic-form) representation.
Now that we have set of pure strategies for each player, we need to find the payoffs to put the game in strategic form. Random payoffs. The actual outcome.
Chapter 12 Game Theory Presented by Nahakpam PhD Student 1Game Theory.
Game Theory By Ben Cutting & Rohit Venkat.
Game theory Chapter 28 and 29
Game theory basics A Game describes situations of strategic interaction, where the payoff for one agent depends on its own actions as well as on the actions.
Rational Choice Sociology
Introduction to Game Theory
Game theory Chapter 28 and 29
GAME THEORY AND APPLICATIONS
Multiagent Systems Game Theory © Manfred Huber 2018.
Learning 6.2 Game Theory.
GAME THEORY AND APPLICATIONS
Game Theory and Strategic Play
EASTERN MEDITERRANEAN UNIVERSITY DEPARTMENT OF INDUSTRIAL ENGINEERING IENG314 OPERATIONS RESEARCH II SAMIR SAMEER ABUYOUSSEF
Presentation transcript:

Mobile Computing Group An Introduction to Game Theory part I Vangelis Angelakis 14 / 10 / 2004

Introduction TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Game theory is the mathematically founded study of conflict and cooperation. Game theoretic concepts apply when the decisions/actions of independent agents affect the interests of others Agents may be individuals, groups, firms, “intelligent” devices Game theory provides them with a methodology for structuring and analyzing problems of strategic choice. By formally modeling a situation as a game requires to enumerate the players, their preferences and their strategic options, The decision maker is given a clearer and broader view of the situation in hand. Game theory is the mathematically founded study of conflict and cooperation. Game theoretic concepts apply when the decisions/actions of independent agents affect the interests of others Agents may be individuals, groups, firms, “intelligent” devices Game theory provides them with a methodology for structuring and analyzing problems of strategic choice. By formally modeling a situation as a game requires to enumerate the players, their preferences and their strategic options, The decision maker is given a clearer and broader view of the situation in hand.

A little history lesson TNL - Mobile Computing Group Angelakis Vangelis 14/10/ :The first formal game theoretic analysis –the study of a duopoly by A. Cournot. 1921:E. Borel suggests a formal theory of games 1928:“Theory of parlour games” by von Neumann 1944:“Theory of Games and Economic behaviour” by von Neumann & O. Morgenstern –basic terminology & problem setup is standardized in this book. 1951:J. Nash proves that finite games always have an equilibrium… 1950’s-60’s:applications to war and (international) politics 1970’s:revolutionalized the economic theory, applications in sociology,psychology, evolutionary biology 1990’s:E/M spectrum auctions design 1994: Nash is awarded the Nobel prize in economics 1838:The first formal game theoretic analysis –the study of a duopoly by A. Cournot. 1921:E. Borel suggests a formal theory of games 1928:“Theory of parlour games” by von Neumann 1944:“Theory of Games and Economic behaviour” by von Neumann & O. Morgenstern –basic terminology & problem setup is standardized in this book. 1951:J. Nash proves that finite games always have an equilibrium… 1950’s-60’s:applications to war and (international) politics 1970’s:revolutionalized the economic theory, applications in sociology,psychology, evolutionary biology 1990’s:E/M spectrum auctions design 1994: Nash is awarded the Nobel prize in economics

Defining Games TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 A Game is a formal model of an interactive situation The formal definition of a game declares: The players Their preferences Their information The strategic actions that are available to them How these actions influence the outcome Games with single players are characterized decision problems Two “schools” of game theory are formed depending on the focus of games and the granularity of the game description A Game is a formal model of an interactive situation The formal definition of a game declares: The players Their preferences Their information The strategic actions that are available to them How these actions influence the outcome Games with single players are characterized decision problems Two “schools” of game theory are formed depending on the focus of games and the granularity of the game description

Cooperative Games TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 A high level description declaring: -payoffs of each potential coalition that can play a game -not the formation process of the coalition Hence, it is not defined as a game in which players actually do cooperate, but as a game in which any cooperation is enforced by an outside party. This outside party involvement and the possible bargaining process that takes place do not belong to the cooperative game description. Cooperative game theory investigates coalitional games with respect to relative power held by the players and how a successful coalition should divide its gains. A high level description declaring: -payoffs of each potential coalition that can play a game -not the formation process of the coalition Hence, it is not defined as a game in which players actually do cooperate, but as a game in which any cooperation is enforced by an outside party. This outside party involvement and the possible bargaining process that takes place do not belong to the cooperative game description. Cooperative game theory investigates coalitional games with respect to relative power held by the players and how a successful coalition should divide its gains.

Non-cooperative Games TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Players make choices of their own interest Order and timing may be crucial to determine the outcome of a game In a non-cooperative game players are unable to make enforceable contracts outside of those specifically modelled in the game. Hence, it is not defined as games in which players do not cooperate, but as games in which any cooperation must be self- enforcing. Cooperation arises, when it is in the best interest of players Players make choices of their own interest Order and timing may be crucial to determine the outcome of a game In a non-cooperative game players are unable to make enforceable contracts outside of those specifically modelled in the game. Hence, it is not defined as games in which players do not cooperate, but as games in which any cooperation must be self- enforcing. Cooperation arises, when it is in the best interest of players

Assumptions TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Strategic Behavior Being aware of your opponents existence and act trying to anticipate/counter their moves is called strategic behavior Rationality rational players always chose actions that give them an outcome they most prefer, given what their opponents will do. Predict how a game will be played or Advice how to best play in a game against rational opponents Rationality is an assumption under common knowledge Some define games as: The interaction among a group of rational agents who behave strategically Strategic Behavior Being aware of your opponents existence and act trying to anticipate/counter their moves is called strategic behavior Rationality rational players always chose actions that give them an outcome they most prefer, given what their opponents will do. Predict how a game will be played or Advice how to best play in a game against rational opponents Rationality is an assumption under common knowledge Some define games as: The interaction among a group of rational agents who behave strategically

Strategic & Extensive Form Games TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Strategic form (normal form) A strategic form game can be a single round of a repeated game Time invariant (no turns) game is played in the blink of an eye List each players strategies List outcomes that result from each possible combination of moves The outcome of a game is the payoff each player gets The Payoff is a numerical value, also called Utility. Extensive form (game tree) The complete description of how a game is played as time goes by + Order of players + Information of players at each point in time More on extensive forms in part II Strategic form (normal form) A strategic form game can be a single round of a repeated game Time invariant (no turns) game is played in the blink of an eye List each players strategies List outcomes that result from each possible combination of moves The outcome of a game is the payoff each player gets The Payoff is a numerical value, also called Utility. Extensive form (game tree) The complete description of how a game is played as time goes by + Order of players + Information of players at each point in time More on extensive forms in part II

Dominance TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Assume a rational player having strategies A and B. If A has a higher utility than B no mater what strategic combination other players make, then strategy A is said to dominate strategy B. Rational players do not play dominated strategies. In some games examining available strategies and eliminating dominated strategies results in only one credible strategy for a rational player. Assume a rational player having strategies A and B. If A has a higher utility than B no mater what strategic combination other players make, then strategy A is said to dominate strategy B. Rational players do not play dominated strategies. In some games examining available strategies and eliminating dominated strategies results in only one credible strategy for a rational player.

Prisoners’ Dilemma TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 A bank is robbed and the robbers escape the police… A pair of suspects are arrested later in the day and are held in separate cells. Each is told that: -if one alone confesses the robbery he will be granted pardon and the other goes in prison for a long time. -if both confess then both go in prison for a short time -if both deny then both go in prison for a very short time (let’s say they will be charged only with arms possession) What action will each prisoner take? A bank is robbed and the robbers escape the police… A pair of suspects are arrested later in the day and are held in separate cells. Each is told that: -if one alone confesses the robbery he will be granted pardon and the other goes in prison for a long time. -if both confess then both go in prison for a short time -if both deny then both go in prison for a very short time (let’s say they will be charged only with arms possession) What action will each prisoner take?

Prisoners’ Dilemma TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I DenyConfess Deny Confess Elimination of dominated strategies

Prisoners’ Dilemma TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 The individually rational outcome is worse for both players… Arms races, environmental pollution, etc are modeled by prisoners’ dilemmas… The solution to a single game is a max-min strategy, a better-play-it-safe strategy In a repeated game patterns for cooperation among the players arise (“suspects” will actually play the “deny-deny” move…) A repeated game allows for a strategy to be dependent on past moves, thus allowing for reputation effects and retribution. In infinitely repeated games, trigger strategies such as tit-for-tat encourage cooperation. The individually rational outcome is worse for both players… Arms races, environmental pollution, etc are modeled by prisoners’ dilemmas… The solution to a single game is a max-min strategy, a better-play-it-safe strategy In a repeated game patterns for cooperation among the players arise (“suspects” will actually play the “deny-deny” move…) A repeated game allows for a strategy to be dependent on past moves, thus allowing for reputation effects and retribution. In infinitely repeated games, trigger strategies such as tit-for-tat encourage cooperation.

Quality Selection TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Customer VoIP Provider BuyDon’t buy High Low

The Nash Equilibrium TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 A set of strategies such that no player has incentive to unilaterally change her action. Players are in equilibrium if a change in strategies by any one of them would lead that player to earn less than if she remained with her current strategy. A set of strategies such that no player has incentive to unilaterally change her action. Players are in equilibrium if a change in strategies by any one of them would lead that player to earn less than if she remained with her current strategy.

Revisiting Quality Selection TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 Customer VoIP Provider BuyDon’t buy High Low No dominant Strategies ! – Two Nash Equilibria

Equilibrium selection TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 In games with multiple Nash equilibria a theory of strategic interaction should guide players to the “most reasonable” equilibrium Large number of papers focused with equilibrium refinements that attempt to derive conditions making an equilibrium more convincing than the another. In games with multiple Nash equilibria a theory of strategic interaction should guide players to the “most reasonable” equilibrium Large number of papers focused with equilibrium refinements that attempt to derive conditions making an equilibrium more convincing than the another. Custome r VoIP Provider BuyDon’t buy High Low For example, in the previous game the “High- buy” equilibrium yields higher utility for both players, so it can easily be argued that they will be self-coordinated to it.

Prisoners’ Dilemma Nash Equilibrium TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I DenyConfess Deny Confess Single Strategy combination rising from the process of dominated strategies elimination is a Nash Equilibrium

Mixed Strategies TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 So far a player chose deterministically among one of her strategies. Such selections are named selections from pure strategies. Randomizing one’s choice, by selecting among her pure strategies with a certain probability is called a mixed strategy. Equilibrium is now defined by a mixed strategy for each player so that none can gain on average by unilaterally deviating. Nash proved (1951) that under mixed strategies any game in strategic-form has an equilibrium Such is therefore the game theorists recommendation in the case when an equilibrium in pure strategies does not exist. So far a player chose deterministically among one of her strategies. Such selections are named selections from pure strategies. Randomizing one’s choice, by selecting among her pure strategies with a certain probability is called a mixed strategy. Equilibrium is now defined by a mixed strategy for each player so that none can gain on average by unilaterally deviating. Nash proved (1951) that under mixed strategies any game in strategic-form has an equilibrium Such is therefore the game theorists recommendation in the case when an equilibrium in pure strategies does not exist.

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect Mixed strategy for I: chose Inspect with a probability. (giving a sufficient change to getting caught should deter II from choosing Cheat) Mixed strategy for I: chose Inspect with a probability. (giving a sufficient change to getting caught should deter II from choosing Cheat) Inspect with p = 0.01 then II receives a utility of: 0 under Comply 0.99 x x (-90) = 9 under Cheat (has incentive to Cheat –inspection not too often) Inspect with p = 0.2 then II receives a utility of: 0 under Comply 0.8 x x (-90) = -10 under Cheat (incentive to always Comply –inspections too often) Inspect with p = 0.01 then II receives a utility of: 0 under Comply 0.99 x x (-90) = 9 under Cheat (has incentive to Cheat –inspection not too often) Inspect with p = 0.2 then II receives a utility of: 0 under Comply 0.8 x x (-90) = -10 under Cheat (incentive to always Comply –inspections too often)

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect So if player I randomizes poorly she leads player II to selecting a pure strategy. Player I must make player II indifferent to achieve equilibrium So if player I randomizes poorly she leads player II to selecting a pure strategy. Player I must make player II indifferent to achieve equilibrium Inspect with p = 0.1 then II receives a utility of: 0 under Comply 0.9 x x (-90) = 0 under Cheat Player II is rational so he knows player I will mix strategies only if I is indifferent too. How can II make I indifferent? Cheat with p = 0.2 then I receives a utility of: 0.8 x x (-10) = -2 under Don’t Inspect 0.8 x (-1) x (-6) = -2 under Inspect Inspect with p = 0.1 then II receives a utility of: 0 under Comply 0.9 x x (-90) = 0 under Cheat Player II is rational so he knows player I will mix strategies only if I is indifferent too. How can II make I indifferent? Cheat with p = 0.2 then I receives a utility of: 0.8 x x (-10) = -2 under Don’t Inspect 0.8 x (-1) x (-6) = -2 under Inspect

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect Equilibrium yields an expected payoff of 0 for player II -2 for player I … Equilibrium yields an expected payoff of 0 for player II -2 for player I … Does randomizing make sense for II ??? “ok, why don’t I just always chose comply since I got nothing to win anyways?” Let’s assume player II always chooses Comply under this rationale, then I needs not randomize, just purely chose Don’t Inspect so player II’s strategy becomes sub-optimal (irrational). With no incentive to select one strategy over the other a player can mix strategies and only thus is the equilibrium reached Does randomizing make sense for II ??? “ok, why don’t I just always chose comply since I got nothing to win anyways?” Let’s assume player II always chooses Comply under this rationale, then I needs not randomize, just purely chose Don’t Inspect so player II’s strategy becomes sub-optimal (irrational). With no incentive to select one strategy over the other a player can mix strategies and only thus is the equilibrium reached

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect We saw that the probabilities for mixing one’s strategies depend on opponent's payoffs… It could be reasoned by I that : “We just have the penalty for Cheating disgustingly high and II will be deterred to select Cheat” We saw that II’s payoffs determine the probabilities that will make I be indifferent… It could be reasoned by I that : “We just have the penalty for Cheating disgustingly high and II will be deterred to select Cheat” We saw that II’s payoffs determine the probabilities that will make I be indifferent…

Compliance Inspections TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003 II I ComplyCheat Don’t Inspect Inspect One could see this game as an evolutionary game: It is the interaction between an organization who chooses Don’t Inspect and Inspect for certain fractions of a large number of people. One could see this game as an evolutionary game: It is the interaction between an organization who chooses Don’t Inspect and Inspect for certain fractions of a large number of people. Player II’s actions Comply and Cheat are each chosen by a certain fraction of people involved in these interactions. If these fractions would deviate from the equilibrium probabilities, the group whose strategies do better would increase. For example: if player I chooses Inspect too often (relative to the penalty for a cheater who is caught), the fraction of cheaters will decrease, which in turn makes Don’t Inspect a better strategy In this dynamic process, the long-term averages of the fractions approximate the equilibrium probabilities Player II’s actions Comply and Cheat are each chosen by a certain fraction of people involved in these interactions. If these fractions would deviate from the equilibrium probabilities, the group whose strategies do better would increase. For example: if player I chooses Inspect too often (relative to the penalty for a cheater who is caught), the fraction of cheaters will decrease, which in turn makes Don’t Inspect a better strategy In this dynamic process, the long-term averages of the fractions approximate the equilibrium probabilities

TNL - Mobile Computing Group Angelakis Vangelis 14/10/2003