Games of imperfect recall

Slides:



Advertisements
Similar presentations
Cross Sectional Designs
Advertisements

Decision Making Under Uncertainty CSE 495 Resources: –Russell and Norwick’s book.
Introduction to Philosophy Lecture 6 Pascal’s wager
MIT and James Orlin © Game Theory 2-person 0-sum (or constant sum) game theory 2-person game theory (e.g., prisoner’s dilemma)
Beaten by: Suzanne Weyn Power Point By: Lily Borders.
Multiplication Rules for Probability Independent Events Two events are independent if the fact that A occurs does not affect the probability of B occuring.
3.6: Probabilities Through Simulations Objective: To simulate probabilities using random number tables and random number generators CHS Statistics.
Section 16.1: Basic Principles of Probability
Adverse Selection Asymmetric information is feature of many markets
Lec 18 Nov 12 Probability – definitions and simulation.
Games, Logic, and Math Kristy and Dan. GAMES Game Theory Applies to social science Applies to social science Explains how people make all sorts of decisions.
1 Many people debate basic questions of chance in games such as lotteries. The Monty Hall problem is a fun brain teaser that Marilyn vos Savant addressed.
BEE3049 Behaviour, Decisions and Markets Miguel A. Fonseca.
PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2005 Normative Decision Theory A prescriptive theory for how decisions should be made.
Judy Benjamin is a Sleeping Beauty, modulo Monty Hall Luc Bovens Progic Conference September 2009.
COMP14112: Artificial Intelligence Fundamentals L ecture 3 - Foundations of Probabilistic Reasoning Lecturer: Xiao-Jun Zeng
1 9/8/2015 MATH 224 – Discrete Mathematics Basic finite probability is given by the formula, where |E| is the number of events and |S| is the total number.
Decision Analysis (cont)
Bell Work. Have you ever watched someone win a game again and again? Do you think that person just has good luck? In many cases, winners have strategies.
1 9/23/2015 MATH 224 – Discrete Mathematics Basic finite probability is given by the formula, where |E| is the number of events and |S| is the total number.
CPS 570: Artificial Intelligence Introduction to probability Instructor: Vincent Conitzer.
1 What is probability? Horse Racing. 2 Relative Frequency Probability is defined as relative frequency When tossing a coin, the probability of getting.
Introduction to Philosophy Lecture 6 Pascal’s wager By David Kelsey.
Critical Analysis Key ideas to remember. What's the Point? Here are some questions you can ask yourself to help you analyze: So what? How is this significant?
Game Theory, Part 2 Consider again the game that Sol and Tina were playing, but with a different payoff matrix: H T Tina H T Sol.
Natural Language Processing Giuseppe Attardi Introduction to Probability IP notice: some slides from: Dan Jurafsky, Jim Martin, Sandiway Fong, Dan Klein.
1 Discrete Random Variables – Outline 1.Two kinds of random variables – Discrete – Continuous 2. Describing a DRV 3. Expected value of a DRV 4. Variance.
Reasoning with Probs How does evidence lead to conclusions in situations of uncertainty? Bayes Theorem Data fusion, use of techniques that combine data.
The Monty Hall Simulation
1 Binomial Random Variables Lecture 5  Many experiments are like tossing a coin a fixed number of times and recording the up-face.  The two possible.
Bell Work Please write the fraction, decimal AND percent. 1)Convert 4/5 to a decimal and a percent. 1)Convert.675 to a fraction and a Percent. 1)Convert.
 Understanding the way scientists talk when they make a claim  Looking at parts of a scientific argument during a game ◦ Each game is broken up into.
Monty Hall This is a old problem, but it illustrates the concept of conditional probability beautifully. References to this problem have been made in much.
Chance We will base on the frequency theory to study chances (or probability).
Uncertainty and Games (Ch. 15). Uncertainty If a game outcome is certain can it achieve meaningful play? –Example of such a game? Two kinds of uncertainty:
Money and Banking Lecture 10. Review of the Previous Lecture Application of Present Value Concept Compound Annual Rate Interest Rates vs Discount Rate.
1 COMP2121 Discrete Mathematics Principle of Inclusion and Exclusion Probability Hubert Chan (Chapters 7.4, 7.5, 6) [O1 Abstract Concepts] [O3 Basic Analysis.
Adding Probabilities 12-5
Section 4-4 Multiplication Rule: Basics.
Decisions under uncertainty and risk
Dealing with Random Phenomena
4-4 The Multiplication Rules and Conditional Probability
Introduction to Probability Distributions
Lecture 6.
Probability Distributions; Expected Value
Recognizing Verb Forms
Critical Thinking Lecture 14 Pascal’s wager
Monty Hall This is a old problem, but it illustrates the concept of conditional probability beautifully. References to this problem have been made in much.
WARM - UP The American Red Cross says that about 45% of the US Population has Type O blood, 40% Type A, 11% Type B, and the rest Type AB. a.) Selecting.
The Binomial and Geometric Distributions
Probabilities and Proportions
Expected Value.
Introduction to Philosophy Lecture 6 Pascal’s wager
Instructor: Vincent Conitzer
Philosophical Chairs.
CPS 570: Artificial Intelligence Introduction to probability
Value Based Reasoning and the Actions of Others
Artificial Intelligence Introduction to probability
12.5 Independent and Dependent Events
From Randomness to Probability
Expected Value.
Probability Rules.
How do secularists think about decisions?
Statistics and Probability-Part 5
From Randomness to Probability
Section 5.2 The Addition Rule and the Rule of Complements
The Addition Rule and the Rule of Complements
The Pigeonhole Principle
Thursday 05/16 Warm Up 200 people were surveyed about ice cream preferences. 78 people said they prefer chocolate. 65 people said they prefer strawberry.
Presentation transcript:

Games of imperfect recall Instructor: Vincent Conitzer

image taken from http://en.wikipedia.org/wiki/Monty_Hall_problem Monty Hall problem image taken from http://en.wikipedia.org/wiki/Monty_Hall_problem Game show participants can choose one of three doors One door has a car, two have a goat Assumption: car is preferred to goat Participant chooses door, but not opened yet At least one of the other doors contains a goat; the (knowing) host will open one such door (flips coin to decide if both have goats) Participant is asked whether she wants to switch doors (to the other closed door) – should she?

Sleeping Beauty problem There is a participant in a study (call her Sleeping Beauty) On Sunday, she is given drugs to fall asleep A coin is tossed (H or T) If H, she is awoken on Monday, then made to sleep again If T, she is awoken Monday, made to sleep again, then again awoken on Tuesday Due to drugs she cannot remember what day it is or whether she has already been awoken once, but she remembers all the rules You’re SB and you’ve just been awoken. What is your (subjective) probability that the coin came up H? Sunday Monday Tuesday H T

Information structure Nature Heads Tails Monday player 1 Tuesday

Dutch book against Halfer [Hitchcock’04] A Dutch book is a set of bets that someone with a particular belief system would each accept, but that in combination lead to a sure loss Offer Beauty the following bet whenever she awakens: If the coin landed Heads, Beauty receives 11 If it landed Tails, Beauty pays 10 Argument: Halfer will accept, Thirder won’t Also offer Beauty on Sunday: If the coin lands Heads, Beauty will pay 12 If the coin lands Tails, Beauty will receive 13 Argument: everyone will accept this one If it’s Heads, Halfer Beauty will get -12 + 11 = -1 If it’s Tails, Halfer Beauty will get 13 - 10 - 10 = -7 Guaranteed loss! Sunday Monday Tuesday H T Same bet twice!

The betting game (ignoring the Sunday bet) Nature Heads Tails Left=accept, Right= decline Monday player 1 Tuesday 11 -20 -10 -10

Evidential decision theory Idea: when considering how to make a decision, should consider what it would tell you about the world if you made that decision EDT Halfer: “With prob. ½, it’s Heads; if I accept, I will end up with 11. With prob. ½, it’s Tails; if I accept, then I expect to accept the other day as well and end up with -20. I shouldn’t accept.” As opposed to more traditional causal decision theory (CDT) CDT Halfer: “With prob. ½, it’s Heads; if I accept, it will pay off 11. With prob. ½, it’s Tails; if I accept, it will pay off -10. Whatever I do on the other day I can’t affect right now. I should accept.” EDT Thirder can also be Dutch booked CDT Thirder and EDT Halfer cannot [Draper & Pust’08, Briggs’10] EDTers arguably can in more general setting [Conitzer’15] Sunday Monday Tuesday H T

Philosophy of “being present” somewhere, sometime simulated light (no direct correspondence to light in our world) 1: world with creatures simulated on a computer 2: displayed perspective of one of the creatures See also: [Hare 2007- 2010, Valberg 2007, Hellie 2013, Merlo 2016, …] To get from 1 to 2, need additional code to: A. determine in which real-world colors to display perception B. which agent’s perspective to display Is 2 more like our own experience than 1? If so, are there further facts about presence, perhaps beyond physics as we currently understand it?