Uncertainty and Hyperbolic Discounting P. Dasgupta E. Maskin.

Slides:



Advertisements
Similar presentations
Introductory Mathematics & Statistics for Business
Advertisements

14.127BehavioralEconomics. Lecture 9 Xavier Gabaix April8, 2004.
Completeness and Expressiveness
An Example of Quant’s Task in Croatian Banking Industry
Dating and Setting Limits
Chapter 7 Hypothesis Testing
L5: Dynamic Portfolio Management1 Lecture 5: Dynamic Portfolio Management The following topics will be covered: Will risks be washed out over time? Solve.
Chapter 36 Public Goods Suppose there are two nonsmokers and one smoker. Even if nonsmokers are entitled to clean air, they first have to agree among themselves.
Statistics.  Statistically significant– When the P-value falls below the alpha level, we say that the tests is “statistically significant” at the alpha.
Lock-Based Concurrency Control
Evolution and Repeated Games D. Fudenberg (Harvard) E. Maskin (IAS, Princeton)
Regret & decision making What is regret? It’s –a negative emotion –Stems from a comparison of outcomes there is a choice that we did not take. had we decided.
Dividend Policy 05/30/07 Ch. 21. Dividend Process Declaration Date – Board declares the dividend and it becomes a liability of the firm Ex-dividend Date.
Investment Science D.G. Luenberger
Three-way choice Option Price Option Value Real Options Calls & Puts Endogenous/Exogenous Option Price Option Value Real Options Calls & Puts Endogenous/Exogenous.
Models with Discrete Dependent Variables
Certainty Equivalent and Stochastic Preferences June 2006 FUR 2006, Rome Pavlo Blavatskyy Wolfgang Köhler IEW, University of Zürich.
Should Decision-Makers Embrace “Non- Constant” Discounting? Mike Paulden Samprita Chakraborty Valentina Galvani Christopher McCabe.
ES INC: Economic and discounted cash flow techniques: a comparison with respect to the Requirements of the Management Control System.
Last Day Utility Analysis. Today Utility Analysis (cont’d) International Diversification.
Finance, Financial Markets, and NPV
1 Information Markets & Decision Makers Yiling Chen Anthony Kwasnica Tracy Mullen Penn State University This research was supported by the Defense Advanced.
L9: Consumption, Saving, and Investments 1 Lecture 9: Consumption, Saving, and Investments The following topics will be covered: –Consumption and Saving.
September 5, 2009Section 3 Midterm Review1 Section 3: Midterm Review EWMBA 201A Eva Vivalt.
Extensive Game with Imperfect Information Part I: Strategy and Nash equilibrium.
Two Papers on Intertemporal Choice and Self Control SS200 - Meghana Bhatt.
Issues in monetary and fiscal policy In this lecture we will use our economic models to study some important issues in the use of monetary and fiscal policy.
L9: Consumption, Saving, and Investments 1 Lecture 9: Consumption, Saving, and Investments The following topics will be covered: –Consumption and Saving.
Expectations and Macroeconomics Chapter Introduction We have put together a complete model of aggregate demand, supply and wage adjustment.
The Marriage Problem Finding an Optimal Stopping Procedure.
The Characteristics of an Experimental Hypothesis
Hypothesis Testing A hypothesis is a conjecture about a population. Typically, these hypotheses will be stated in terms of a parameter such as  (mean)
Statistical Techniques I
Multiproduct Monopoly, Commodity Bundling, and Correlation of Values Authors: R. Preston McAfee 1, John McMillan 2, Michael D. Whinston 3 1 Source: The.
Auction Seminar Optimal Mechanism Presentation by: Alon Resler Supervised by: Amos Fiat.
RMTD 404 Lecture 8. 2 Power Recall what you learned about statistical errors in Chapter 4: Type I Error: Finding a difference when there is no true difference.
Chapter 13: Weighted Voting Banzhaf Power Index Shapley-Shubik Power Index Equivalent Systems Examples.
Programming with Alice Computing Institute for K-12 Teachers Summer 2011 Workshop.
Why Do We Procrastinate?: An Evolutionary Perspective based on “Uncertainty and Hyperbolic Discounting” P. Dasgupta (Cambridge) E. Maskin (I.A.S.)
Chapter 10 Hypothesis Testing
KAREN PHELPS Spontaneous Sponsoring. Your Home Presentations “A Valuable Source for Recruits”
Introduction to inference Use and abuse of tests; power and decision IPS chapters 6.3 and 6.4 © 2006 W.H. Freeman and Company.
Extending the Definition of Exponents © Math As A Second Language All Rights Reserved next #10 Taking the Fear out of Math 2 -8.
Introduction to Matching Theory E. Maskin Jerusalem Summer School in Economic Theory June 2014.
Networks of Queues Plan for today (lecture 6): Last time / Questions? Product form preserving blocking Interpretation traffic equations Kelly / Whittle.
Biostatistics Class 6 Hypothesis Testing: One-Sample Inference 2/29/2000.
VIII Lecture Time Preferences. Wrap up of the previous lecture Problem of distinguishing between biasing and shaping effect. Evidence for shaping effect.
Ellsberg’s paradoxes: Problems for rank- dependent utility explanations Cherng-Horng Lan & Nigel Harvey Department of Psychology University College London.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
Chapter 8 Delving Into The Use of Inference 8.1 Estimating with Confidence 8.2 Use and Abuse of Tests.
Uncertainty Management in Rule-based Expert Systems
Copyright © Zeph Grunschlag, Induction Zeph Grunschlag.
1 Consumer Choice and Demand CHAPTER 6 © 2003 South-Western/Thomson Learning.
CONDITIONAL SENTENCES
Decision Making by Individuals and Firms Chapter 9.
1 Chapter 4 Prof. Dr. Mohamed I. Migdad Professor in Economics 2015.
Multiplication of Common Fractions © Math As A Second Language All Rights Reserved next #6 Taking the Fear out of Math 1 3 ×1 3 Applying.
Intermediate Microeconomics
The Base Model. Objectives of the chapter Describe the basic elements of the Basic Principal-Agent model Study the contracts that will emerge when information.
EC941 - Game Theory Prof. Francesco Squintani Lecture 6 1.
How Should Presidents Be Elected? E. Maskin Institute for Advanced Study.
The expected value The value of a variable one would “expect” to get. It is also called the (mathematical) expectation, or the mean.
Fundamentals of Data Analysis Lecture 4 Testing of statistical hypotheses pt.1.
 This will explain how consumers allocate their income over many goods.  This looks at individual’s decision making when faced with limited income and.
Production and Costs Ch. 19, R.A. Arnold, Economics 9 th Ed.
Unit 5: Hypothesis Testing
microeconomics spring 2016 the analytics of
Significance Tests: The Basics
Significance Tests: The Basics
Behavioral Finance Economics 437.
Presentation transcript:

Uncertainty and Hyperbolic Discounting P. Dasgupta E. Maskin

2 Strong evidence in behavioral ecology and economics that animals and humans place less weight on future than current payoffs, i.e., they discount the future more intriguingly: considerable evidence that discount rates increase as time to payoffs shrinks (experimental evidence better for birds— pigeons and starlings— than for humans)

3 Strotz (1956) People attempt to lay aside money for Christmas early in the year But later on, spend this money on summer vacations or back-to-school clothes They have become more “impatient.”

4 O’Donoghue and Rabin (1999) If offered choice in February between –painful 5-hour task on April 1 –painful 8-hour task on April 15 people choose April 1. As April 1 approaches, people apt to postpone to April 15 That is, they discount later pain more as time grows short

5 Both examples accord with hyperbolic discounting (discount rates increase as payoffs approach, so more distant payoffs are discounted at lower per-period rate) has attracted attention in economics literature because sheds light on important economic phenomena (e.g., saving behavior)

6 Offer evolutionary explanation for hyperbolic discounting Based on hypothesis that human or animal preferences—as manifested in cravings, urges, or instincts—selected to induce animal to make “right” choice in typical situation it faces “right” = survival-maximizing Will show: if typical situation entails uncertainty about when payoffs are realized, get preference reversals consistent with hyperbolic discounting

7 Rough intuition: suppose DM offered choice between: prospect P - - small payoff, relatively early realization and prospect - - large payoff, relatively late realization small but positive probability of early realization assume DM initially chooses –bigger payoff –might be realized early with time, chance of early realization of declines –true of P too, but pays off early anyway so DM may switch to P - - à la hyperbolic discounting

8 Although preference reversal here looks like hyperbolic discounting, actually dynamically consistent –optimal for DM to switch from to P But suppose DM faces atypical choice problem –urge to switch may lead her astray If problem recurs, DM may learn how to overcome impatience

9 Why discount at all? Conventional answer: future payoffs may disappear or depreciate For example, blackbird waits for fruit on raspberry bush to ripen –crows may devour raspberries before ripe –blackbird should discount the payoff of getting fruit –discount rate = hazard rate (probability that crows arrive

10 Apparently cheap explanation for hyperbolic discounting: hazard rate declining in time But no particular reason why this should be so (if crow-arrival time is Poisson, hazard rate and hence discount rate is constant— i.e., discounting is “exponential”) Doesn’t explain preference reversals: if over P at time 0, will do so at time t

11 Another reason for discounting: waiting costs –waiting entails using up energy (physiological cost) –waiting entails passing up other prospects (opportunity cost) Waiting costs immediately explain another empirical regularity: large payoffs discounted less

12 Two prospects: Suppose Evidence suggest that, for k >1 big enough,

13 Phenomenon follows immediately from waiting costs Let c be waiting cost per unit time, Suppose (earlier prospect preferred) Then (later prospect preferred when payoffs increased). Both hazard-rate and waiting-cost stories important in practice Henceforth, stick with hazard rates

14 Introduce uncertainty about realization time Blackbird may be pretty sure raspberries will ripen by tomorrow morning But some chance they will ripen earlier (or later)

15 Prospect of raspberries V = calories in ripe raspberries T = likely ripening (realization) time, say, tomorrow morning

16 At any time t < T, there is probability that V will be realized in q = probability density of “early realization” r = hazard rate (rate of crow arrival) expected payoff =

17 Suppose there is another prospect (blackberry bush) bird can monitor only one bush at a time (must choose ) (more calories/volume in blackberries) (blackberries likely to ripen later) Some chance of early ripening (density q )

18 Proposition 1: Assume that there exists such that decision maker (DM) indifferent between with and probability density q of early arrival. Then DM prefers Implies “hyperbolic discounting”: when much time remains DM willing to wait for bigger reward. But when horizon short becomes impatient.

19 Proof : Expected payoffs from (1) and (2) Time derivatives: and

20 (1) and (2) Can rewrite derivatives as (3) and (4) At sums of first two terms in bracketed expressions are equal Because (3) bigger than (4) Hence, (1) bigger than (2) for (2) bigger than (1) for

21 Idea: passage of time has 2 marginal effects on expected payoff from prospect (i)brings nearer time at which payoff likely to be realized (ii)reduces probability of early realization effect (i) is proportional to expected payoff - - so same for effect (ii) (negative) is proportional to V for P and to so single-crossing property holds: P’s expected payoff increases faster than that of whenever expected payoffs equal.

22 2 ways to interpret preference reversal: (i) once-and-for-all choice of at time 0, and then an unexpected opportunity to choose again at time (in which case the choice will be P) (ii) DM can switch at any time, in which case will choose and switch to

23 Proposition 1 pertains to positive payoffs, but tax story entails negative payoffs Proposition 1*: Maintain hypotheses of Proposition 1 except assume Then if DM indifferent between prefers

24 Propositions assumed (i)all early realization times equally likely (ii)probability density of early realization same for both prospects (iii)no probability of late arrival –Can relax these assumptions –However, cannot dispense with all assumptions about uncertainty

25 Example –Consider –In interval has zero probability of early realization but P has positive probability –Then at ’s chances for early realization are the same as before, but P’s chances are dimmer –So is more attractive (by comparison with P) than before, contradicting hyperbolic discounting

26 Suppose Then is density of P being realized at conditional on t being reached with no previous realization

27 Similarly is conditional density for Assume (5) and (6) Condition (6) is MLRP condition Condition (7) rules out above example

28 Proposition 2: Under (5) and (6), if there exists such that DM is indifferent between Then DM prefers

29 Example Suppose and Then (5) and (6) hold for sufficiently small

30 –But still one important ingredient to hyperbolic discounting not yet accounted for –Propositions show that preference reversals consistent with hyperbolic discounting follow from uncertainty about realization times –However, choices are dynamically consistent –The DM at would not choose to tie her hands to prevent herself from switching at

31 Yet Strotz notes people learn to save for Christmas by putting money in illiquid low-interest savings accounts: “Christmas accounts” In experiments, pigeons learn to commit themselves not to switch from “patient” to “impatient” choices must show how this arises naturally in a evolutionary model

32 Can explain dynamic inconsistency and self-commitment as follows: –Suppose that, over evolutionary time, species faced prospects of type discussed: ( V, T, q ) –Suppose, in any given choice problem between P = (V,T, q ) and individual DM from species can observe (V, T ) and –Then best DM can do is to choose between –Evolution should endow her with urges and inclinations that induce right choice. –If satisfy (5) and (6), then may get preference reversal from

33 –Important that uncertainty unobservable, otherwise evolutionarily desirable to make discount rates depend on uncertainty from problem to problem –Now suppose DM in a situation where uncertainty differs significantly from “typical.” Specifically, suppose –Given inherited preferences, she will switch from - - but this is dynamically inconsistent

34 But (thanks to evolution) many species can learn from experience Suppose, DM faces choice between (V,T, 0 ) and recurrently –each round, DM chooses a behavior probabilistically –successful behaviors more likely to be chosen provided DM does not have urge to behave otherwise

35 How does this model apply to experiments with pigeons? large literature starting with Rachlin (1972) and Ainslee (1974) stylized protocol: –At pigeon makes choice (by pecking key) between (V, T, 0) and – later at pigeon can switch choices –Third key available at - - if pecked, disables switching option at

36 Stylized findings: (i)pigeon makes same choice in most rounds (ii) if chose P at unlikely to choose more likely to switch if chose (iii)unlikely to peck disabling key in early rounds (iv)if peck disabling key in later rounds, more likely to have chosen (v) if switch from in early rounds, more likely to peck disabling key in later rounds

37 finding (i) –stable preferences –consistent with bird maximizing something (e.g., discounted calories) finding (ii) –switch from is consistent with model, but from is not finding (iii) –takes experience to discover that uncertainty is atypical findings (iv) and (v) –birds that switch from are the ones that gain from disabling switch option

38 Know something about pigeons, starlings, and humans –all have preference reversals consistent with hyperbolic discounting Perhaps other species don’t exhibit preference reversals –if so, can try to correlate reversals with nature of uncertainty they face

39