David Laibson Harvard University Department of Economics Mannheim Lectures July 13, 2009 Lecture 2: Neuroeconomics and the multiple systems hypothesis.

Slides:



Advertisements
Similar presentations
EXPERIMENTAL DESIGN STATEMENT OF PROBLEM Not a yes or no answered question Problem should be clearly testable and specific to your investigation.
Advertisements

Outline 1. Definition of Complex Designs 2. Some important terms 3. Advantages of complex designs Testing theories Resolving contradictions Establishing.
Development of a Non-pharmacological Model of Cognitive Impairment for the Evaluation of Putative Pro-cognitive Agents – Potential Relevance for Age-Related.
Emotional Intelligence predicts individual differences in social exchange reasoning D. Reis, M. Brackett, N. Shamosh, K. Kiehl, P. Salovey & J. Gray.
Detecting Conflict-Related Changes in the ACC Judy Savitskaya 1, Jack Grinband 1,3, Tor Wager 2, Vincent P. Ferrera 3, Joy Hirsch 1,3 1.Program for Imaging.
Orbitofrontal Cortex and Its Contribution to Decision-Making Group 2.
Neural Basis of Cognition Lecture 6 Learning and Memory, Part II.
Pre-frontal cortex and Executive Function Squire et al Ch 52.
Behavioral Finance David Laibson Robert I. Goldman Professor of Economics Harvard College Professor Harvard University National Bureau of Economic Research.
Behavioral Economics and Aging David Laibson Harvard University and NBER July 8, 2009 RAND.
Can We Control Our Selves? David Laibson Robert I. Goldman Professor of Economics Harvard University March 27, 2013.
M. Bhatt & C. Camerer Games and Economic Behavior, 2005.
[week 1 Introduction] How we understand ‘human mind’ from the brain? Jaeseung Jeong, Ph.D Department of Bio and Brain Engineering, KAIST.
Outline 1. Definition of Complex Designs 2. Some important terms
December 1, 2009Introduction to Cognitive Science Lecture 22: Neural Models of Mental Processes 1 Some YouTube movies: The Neocognitron Part I:
Participants: 21 smokers (13M, ages 18-45) and 21 age-, gender-, race-, and education-matched controls. Procedure: Stimuli were 100 photographs: 50 food.
Dr. Bruce J. West Chief Scientist Mathematical & Information Science Directorate Army Research Office UNCLASSIFIED.
Serotonin and Impulsivity Yufeng Zhang. Serotonin Originate from the median and dorsal raphe nuclei. Serotonin has been implicated in a variety of motor,
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
C2004 Alcohol Medical Scholars Program1 Craving Karen Drexler, M.D. Emory University School of Medicine.
David Laibson July 3, 2014 This deck contains “hidden slides” that were not presented. View in “slideshow” mode to avoid these hidden slides. Biosocial.
Course Behavioral Economics Alessandro InnocentiAlessandro Innocenti Academic year Lecture 12 Intertemporal choice LECTURE 12 INTERTEMPORAL CHOICE.
The Economics and Neuroeconomics of Instant Gratification Canadian Economic Association “State of the Art Lecture” David Laibson Harvard University and.
Waiting for the Right Wave: The Delay of Gratification Georgann Zachary Willis, Ph.D. Assistant Professor of Psychology Umpqua Community College.
Neural circuits for bias and sensitivity in decision-making Jan Lauwereyns Associate Professor, Victoria University of Wellington, New Zealand Long-term.
David Laibson January 2010 AEA This deck contains “hidden slides” that were not presented in course. View in “slideshow” mode to avoid these hidden slides.
By Peter Dang and Kyle Dennison.  Ability to acquire language is a unique and essential human trait  Chomsky’s Universal Grammar The human brain contains.
Priming the ant or the grasshopper in people’s mind: How regulatory mode affects inter- temporal choices Lucia Mannetti*, Susanne Leder**, Libera Insalata*,
Angie Mangiantini. ARE WE DOING ENOUGH? 2 adm
Prediction in Human Presented by: Rezvan Kianifar January 2009.
Neural systems supporting the preparatory control of emotional responses Tor D. Wager, Brent L. Hughes, Matthew L. Davidson, Melissa Brandon, and Kevin.
Evolution of Control-Related Mental Models Crystal A. Brandon.
Social Cognitive View Integrates Social Learning and Cognitive Theories Reciprocal determinism Self-regulation Expectancy values & self-efficacy.
Coricelli and Nagel (2008) Introduction Methods Results Conclusion.
Chapter 50 The Prefrontal Cortex and Executive Brain Functions Copyright © 2014 Elsevier Inc. All rights reserved.
The Economics of Instant Gratification NIH Behavior Change Conference David Laibson Harvard University and NBER June 15-16, 2009 Bethesda, Maryland.
Lecture 8. Crossroads of economics and cognitive science Xavier Gabaix April 1, 2004.
Metacognition as Kludge Peter Carruthers with thanks to Logan Fletcher Maryland Metacognition Seminar, 12/9/11.
“The Role of the Human Prefrontal Cortex in Social Cognition and Moral Judgment” Group 3: Kindra Akridge, Antoinette Sellers, Hannah Stolarczyk, Tawni.
Metacognition Neil H. Schwartz Psych 605. Three Terms: Organizing the Concept Exogenous Constructivism Endogenous Constructivism Spence Piaget Dialectical.
The Role of the Pre Frontal Cortex in Social Cognition Group 5 Alicia Iafonaro Alyona Koneva Barbara Kim Isaac Del Rio.
Neural Correlates of Conscious Emotional Experience Group 3 Week 8 Youngjin Kang Alyssa Nolde Antoinette Sellers Zhiheng Zhou.
Neuromarketing Laurent Hermoye, PhD. Marketing Research Understanding, explaining, predicting individual, group, organisational behaviour relevant to.
KUHL, B.A., JOHNSON, M.K., AND CHUN, M.M. (2013). DISSOCIABLE NEURAL MECHANISMS FOR GOAL-DIRECTED VERSUS INCIDENTAL MEMORY REACTIVATION. THE JOURNAL OF.
Neural correlates of risk sensitivity An fMRI study of instrumental choice behavior Yael Niv, Jeffrey A. Edlund, Peter Dayan, and John O’Doherty Cohen.
An ERP investigation of response inhibition in adults with DCD Elisabeth Hill Duncan Brown José van Velzen.
Does the brain compute confidence estimates about decisions?
Biosocial Science David Laibson April 27, 2016.
Revolutionizing Global Leadership
Biosocial Science David Laibson April 11, 2017.
Chapter 7 Psychology: Memory.
Choice Behavior Two.
Lecture 8 Intertemporal Choice
Acute Stress Impairs Self-Control in Goal-Directed Choice by Altering Multiple Functional Connections within the Brain’s Decision Circuits  Silvia U.
The Neurobiology of Decision: Consensus and Controversy
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Sang Wan Lee, Shinsuke Shimojo, John P. O’Doherty  Neuron 
Volume 85, Issue 2, Pages (January 2015)
Volume 93, Issue 2, Pages (January 2017)
Modeling Madness in Mice: One Piece at a Time
The Neurobiology of Decision: Consensus and Controversy
A Neurocomputational Model of Altruistic Choice and Its Implications
Moral Judgments Recruit Domain-General Valuation Mechanisms to Integrate Representations of Probability and Magnitude  Amitai Shenhav, Joshua D. Greene 
The Future of Memory: Remembering, Imagining, and the Brain
Wallis, JD Helen Wills Neuroscience Institute UC, Berkeley
Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum  John P. O'Doherty, Tony W.
Volume 62, Issue 4, Pages (May 2009)
Acute Stress Impairs Self-Control in Goal-Directed Choice by Altering Multiple Functional Connections within the Brain’s Decision Circuits  Silvia U.
Volume 50, Issue 4, Pages (May 2006)
Volume 90, Issue 5, Pages (June 2016)
Presentation transcript:

David Laibson Harvard University Department of Economics Mannheim Lectures July 13, 2009 Lecture 2: Neuroeconomics and the multiple systems hypothesis

Lecture 2 Outline Neuroeconomics: definition Multiple Systems Hypothesis

Neuroeconomics: definition. Definition: Neuroeconomics is the study of the biological microfoundations of economic cognition. Biological microfoundations are neurochemical mechanisms and pathways, like brain systems, neurons, genes, and neurotransmitters. Economic cognition is cognitive activity that is associated with economic perceptions, beliefs and decisions, including mental representations, emotions, expectations, learning, memory, preferences, decision-making, and behavior.

An example: The Multiple Systems Hypothesis Statement of Hypothesis Variations on a theme Caveats Illustrative predictions –Cognitive load manipulations –Willpower manipulations –Affect vs. analytic manipulations –Cognitive Function –Development –Neuroimaging Directions for future research

Statement of Multiple Systems Hypothesis (MSH) The brain makes decisions (e.g. constructs value) by integrating signals from multiple systems These multiple systems process information in qualitatively different ways and in some cases differentially weight attributes of rewards (e.g., time delay)

An (oversimplified) multiple systems model System 1 System 2 Integration Behavior

An uninteresting example Addition Division Integration Behavior What is 6 divided by 3?

A more interesting example Abstract goal: diet Visceral reward: pleasure Integration Behavior Would you like a piece of chocolate?

A more interesting example Abstract goal: diet Visceral reward: pleasure Integration Behavior Would you like a piece of chocolate?

Variations on a theme Interests vs passions (Smith) Superego vs Ego vs Id (Freud) Controlled vs Automatic (Schneider & Shiffrin, 1977; Benhabib & Bisin, 2004) Cold vs Hot (Metcalfe and Mischel, 1979) System 2 vs System 1 (Frederick and Kahneman, 2002) Deliberative vs Impulsive (Frederick, 2002) Conscious vs Unconscious (Damasio, Bem) Effortful vs Effortless (Baumeister) Planner vs Doer (Shefrin and Thaler, 1981) Patient vs Myopic (Fudenburg and Levine, 2006) Abstract vs Visceral (Loewenstein & O’Donoghue 2006; Bernheim & Rangel, 2003) PFC & parietal cortex vs Mesolimbic dopamine (McClure et al, 2004)

Commonalities between classification schemes Affective system fast unconscious reflexive myopic effortless Analytic system slow conscious reflective forward-looking (but still prone to error: heuristics may be analytic) self-regulatory effortful and exhaustible

Mesolimbic dopamine reward system Frontal cortex Parietal cortex Affective vs. Analytic Cognition mPFC mOFC vmPFC

Hypothesize that the fronto-parietal system is patient Hypothesize that mesolimbic system is impatient. Then integrated preferences are quasi-hyperbolic Relationship to quasi-hyperbolic model nowt+1t+2t+3 PFC1111… Mesolimbic1000… Total2111… Total normed11/2 …

nowt+1t+2 PFC1δδ2δ2 … Mesolimbicx00… Total1+xδδ2δ2 … Total normed1 β δβ δ β δ2β δ2 … where β = (1+x) -1. Generalized relationship to quasi-hyperbolic model

Hypothesize that mesolimbic dopamine system is impatient. Hypothesize that the fronto-parietal system is patient Here’s one implementation of this idea: U t = u t +  u t+1   u t+2   u t+3  (1/  )U t = (1/  )u t +  u t+1   u t+2   u t+3  (1/  )U t =(1/  )u t + [   u t +   u t+1   u t+2   u t+3   limbic fronto-parietal cortex

Caveats N ≥ 2 The systems do not have well-defined boundaries (they are densely interconnected) Maybe we should not say “system,” but should instead say “multiple processes” Some systems may not have a value/utility representation –Making my diet salient is not the same as assigning utils/value to a Devil Dog If you look downstream enough, you’ll find what looks like an integrated system

Predictions Cognitive Load Manipulations –Shiv and Fedorikhin (1999), Hinson, Jameson, and Whitney (2003) Willpower manipulations –Baumeister and Vohs (2003) Affect vs. analytic manipulations –Rodriguez, Mischel and Shoda (1989) Cognitive Function –Benjamin, Brown, and Shapiro (2006), Shamosh and Gray (forth.) Developmental Dynamics –Green, Fry, and Myerson (1994), Krietler and Zigler (1990) Neuroimaging Studies –Tanaka et al (2004), McClure et al (2004), Hariri et al (2006), McClure et al (2007), Kabel and Glimcher (2007), Hare, Camerer, and Rangel (2009)

Cognitive Load Should Decrease Self-regulation Shiv and Fedorikhin (1999) Load manipulated by having people keep either a 2-digit or 7-digit number in mind during experiment Subjects choose between cake or fruit- salad Processing burden% choosing cake Low (remember only 2 digits)41% High (remember 7 digits)63%

Cognitive Load Should Increase Discounting Hinson, Jameson, and Whitney (2003) Task: Subjects choose one reward from a set of two or more time-dated rewards. Some subjects are under cognitive load: hold 5-digit string in memory One month discount rate * Control (2 items): 26.3% Treatment (2 items + load): 49.8% Treatment (3 items): 48.4% *Discount rate for 1 month is ln(1+k), where discount function is 1/(1+kt).

Willpower should be a domain general and exhaustable resource Muraven, Tice and Baumeister (1998) All subjects watch upsetting video clip –Treatment subjects are asked to control emotions and moods –Control subjects are not asked to regulate emotions All subjects then try to squeeze a handgrip as long as possible Treatment group gives up sooner on the grip task Interpretation: executive control is a scarce resource that is depleted by use Many confounds and many variations on this theme

Affect Augmentation/Reduction Should Predictably Change Patience Rodriguez, Mischel and Shoda (1989) Task: Children try to wait 15 minutes, to exchange a smaller immediate reward for a larger delayed reward. Manipulations: –Control –Affect Augmentation: exposure to rewards –Affect Reduction: represent the delayed reward abstractly (pretzels are logs, marshmallows are clouds) Results: –Ability to wait goes down after affect augmentation –Ability to wait goes up after affect reduction

Delay of Gratification Paradigm

Individuals with greater analytic intelligence should be more patient Shamosh and Gray (2008) Meta-analysis of the relationship between delay discounting and analytic intelligence –e.g. g, IQ, math ability In 24 studies, nearly all found a negative relationship Quantitative synthesis across 26 effect sizes produce a correlation of See also Benjamin, Brown, and Shapiro (2006): a standard deviation increase in a subject’s math test score is associated with a 9.3% increase in the subject’s likelihood of choosing patiently See also Rustichini et al. (2008)

Shamosh and Gray (forthcoming) “Delay discounting paradigms appear to require some of the specific abilities related to both working memory and intelligence, namely the active maintenance of goal-relevant information in the face of potentially distracting information, as well as the integration of complex or abstract information.” 1.Manage affect: “controlling one’s excitement over the prospect of receiving an immediate reward” –Shift attention away from affective properties of rewards –Transform reward representation to make them more abstract 2.Deploy strategies 3.Recall past rewards and speculate about future rewards

Individuals with greater analytic intelligence should be more patient Benjamin, Brown, and Shapiro (2006) Choice task: “500 pesos today vs. 550 pesos in a week” One standard deviation increase in a subject’s math test score is associated with a 9.3% increase in the subject’s likelihood of choosing patiently

Patience should track PFC development PFC undergoes development more slowly than other brain regions Changes in patience track timing of PFC development –Green, Fry, and Myerson (1994) –Krietler and Zigler (1990) –Galvan (2008) Cross-species evidence is also supportive –Monkeys have a 50% discount for juice rewards delayed 10 seconds (Livingstone data)

Neural activity in frontoparietal regions should be differentiated from neural activity in mesolimbic dopamine regions Not clear. At least five studies of classical delay discounting: –McClure et al (2004) – supportive –McClure et al (2007) – supportive –Kable and Glimcher (2007) – critical –Hariri et al (2007) – supportive –Hare, Camerer, and Rangel (2009) – supportive (integration) And one other study that is related (and supportive): –Tanaka et al (2004): different behavioral task

McClure, Laibson, Loewenstein, Cohen (2004) Intertemporal choice with time-dated Amazon gift certificates. Subjects make binary choices: $20 now or $30 in two weeks $20 in two weeks or $30 in four weeks $20 in four weeks or $30 in six weeks

$20 $30 Fronto-parietal cortex Meso-limbic dopamine

y = 8mmx = -4mmz = -4mm 0 7 T1T1 Delay to earliest reward = Today Delay to earliest reward = 2 weeks Delay to earliest reward = 1 month 0.2% VStr MOFCMPFC PCC  areas respond “only” to immediate rewards BOLD Signal 2 sec Time

XYZMax Tn Medial OFC Ventral striatum L Posterior hippocampus Medial PFC Posterior cingulate cortex All voxels significant at p <  Analysis Summary of Significant Voxels

x = 44mm x = 0mm 0 15 T1T1 VCtx 0.4% 2s PMARPar DLPFCVLPFCLOFC  Areas respond equally to all rewards Delay to earliest reward = Today Delay to earliest reward = 2 weeks Delay to earliest reward = 1 month

XYZMax Tn Visual cortex PMA SMA R Posterior parietal cortex L Posterior parietal cortex R DLPFC R VLPFC R Lateral OFC  Analysis: Summary of Significant Voxels All voxels significant at p < 0.001

0% 25% 50% 75% 100% 1-3%5-25% 35-50% P(choose early) Difficult Easy 0.4% 2s VCtxRPar DLPFCVLPFC LOFC PMA Difficult Easy Effect of Difficulty Response Time (sec) (R’-R)/R 1-3% 35-50% 5-25% Sec BOLD Signal

Choose Immediate Reward Choose Delayed Reward DRS Fronto- parietal cortex Brain Activity Brain activity in the frontoparietal system and mesolimbic dopamine reward system predict behavior (Data for choices with an immediate option.)

McClure, Ericson, Laibson, Loewenstein, Cohen (2007) Subjects water deprived for 3hr prior to experiment (a subject scheduled for 6:00)

Free (10s max.)2sFree (1.5s Max) Variable Duration 15s (i) Decision Period(ii) Choice Made(iii) Pause(iv) Reward Delivery 15s10s5s iv. Juice/Water squirt (1s ) … Time iiiiii A B Figure 1

d d'-d (R, R')  { This minute, 10 minutes, 20 minutes }  { 1 minute, 5 minutes }  {(1,2), (1,3), (2,3)} Experiment Design d = This minute d'-d = 5 minutes (R, R') = (2,3)

This Minute10 Minutes20 Minutes P(choose early) d = delay to early reward Behavioral evidence

Now10 Minutes20 Minutes P(choose early) Now10 Minutes20 Minutes d’-d = 5 min d’-d = 1 min d = delay to early reward Behavioral evidence

Discount functions fit to behavioral data MesolimbicCortical β = 0.53 (se = 0.041) δ = 0.98 (se = 0.014)  = 0.47 (se = 0.101)  = 1.02 (se = 0.018) Evidence for two-system model Can reject exponential restriction with t-stat > 5 Double exponential generalization fits data best

y = 12mm VStr SMA Ins 0 11 T 2s 0.2% JuiceWater Juice and Water treated equally (both behavioral and neurally) Time (2 second increments)

Figure 4 x = -12mmx = -2mmx = -8mm z = -10mm NAcc MOFC/SGC ACCPCu PCC NAcc ACC SGC PCu x = 0mm x = 40mmx = -48mm PCC SMA/PMA Vis Ctx PPar BA10 Ant Ins BA9/44 BA T A B  areas: respond only to immediate rewards  areas: respond to all rewards Neuroimaging data estimated with general linear model.

Figure 5 x = 0mmx = -48mm x = 0mmy = 8mm Primary only Money only Both areas (p<0.001) areas (p<0.001) Relationship to Amazon experiment:

Figure 5 Primary only Money only Both x = 0mmx = -48mm x = -4mmy = 12mm areas (p<0.01) areas (p<0.01) Relationship to Amazon experiment:

AntInsL0.9908(0.007) AntInsR0.9871(0.006) BA10L1.0047(0.011) BA10R0.9953(0.010) BA (0.008) BA (0.006) PCC0.9926(0.006) PParL0.9970(0.005) PParR0.9959(0.005) SMAPMA0.9870(0.006) VisCtx0.9939(0.005) Fitting discount functions using neuroimaging data. Discount factorStdErr ACC0.1099(0.132) MPFC0.0000NA NAc0.9592(0.014) PCC0.9437(0.014) PCu0.9547(0.011) β = (0.004) = 0.39 δ= (0.003) = 0.78 N(t) = β d R + β d' R' + X(t)·θ + ε(t) N(t) = δ d R + δ d' R' + X(t)·θ + ε(t) β systems  systems

Measuring discount functions using neuroimaging data Impatient voxels are in the emotional (mesolimbic) reward system Patient voxels are in the analytic (prefrontal and parietal) cortex Average (exponential) discount rate in the impatient regions is 4% per minute. Average (exponential) discount rate in the patient regions is 1% per minute.

What determines immediacy? Is mesolimbic DRS activation associated with relatively “early” (or earliest) options? or Do juice and money have different discount functions? or Does thirst invoke more intense discounting?

Our working hypotheses. One system associated with midbrain dopamine neurons (mesolimbic DRS) shows high sensitivity to time delay. Second system associated with lateral prefrontal and posterior parietal cortex shows less sensitivity to time delay. Combined function of these two systems explains decision making across choice domains.

Hare, Camerer, and Rangel (2009) + 4s food item presentation ?-?s fixation Rate Health + Rate Taste + Decide Health SessionTaste SessionDecision Session

Rating Details Taste and health ratings made on five point scale: -2,-1,0,1,2 Decisions also reported on a five point scale: SN,N,0,Y,SY “strong no” to “strong yes”

Subjects SC (self-control) group = 19 dieting subjects who showed self-control during the decision phase NSC (no self-control) group = 18 comparison subjects who did not exhibit self-control during the decision phase

Who is classified as a self-controller: SC? (must meet all criteria below) 1)Use self-control on > %50 of trials in which self-control is required (decline Liked- Unhealthy items or choose Disliked-Healthy ones) 2)Decision =  1 HR +  2 LR +   1 >  2 3)R 2 for HR > R 2 for LR

Examples of individual behavioral fits Self-controller Non- self-controller

Disliked Healthy Disliked Unhealthy Liked Unhealthy Liked Healthy Percent Yes Result: NSC group chose based on taste

** Disliked Healthy Disliked Unhealthy Liked Unhealthy Liked Healthy Percent Yes Result: SC group chose based on taste and health

** Disliked Healthy Disliked Unhealthy Liked Unhealthy Liked Healthy Percent Yes SC group versus NSC group

Question: Is there evidence for a single valuation system? Neuroimaging Results

Activity in vmPFC is correlated with a behavioral measure of decision value (regardless of SC) L  p <.001  p <.005

* * * Taste RatingHealth Rating Beta vmPFC BOLD signal reflects both taste and health ratings

BOLD Health Rating BetaDecision Health Rating Beta The effect of HR in the vmPFC is correlated with its effect on behavior Robust reg Coef =.847

Neuroimaging Results Question: Does self-control involve DLPFC modulation of the vmPFC valuation network?

What is self control? Rejecting good tasting foods that are unhealthy? Accepting bad tasting foods that are healthy?

More activity in DLPFC in successful SC trials than in failed SC trials L  p <.001  p <.005

Future work: 1.Are multiple system models a useful way of generating new hypotheses and models? 2.Are these systems localized? If so, where? 3.How do the systems communicate? 4.How are the inputs integrated? 5.When are the systems cooperative and when conflictual? 6.When they are in conflict, are they strategic? 7.What manipulations enhance or weaken the signals coming from these systems? 8.Can we influence individual systems in the lab? 9.Can we influence individual systems in the field? 10.Can we produce useful formalizations of their operation?