The Neurobiology of Decision: Consensus and Controversy

Slides:



Advertisements
Similar presentations
The Neurobiology of Decision: Consensus and Controversy Joseph W. Kable, Paul W. Glimcher Neuron Volume 63, Issue 6, Pages (September 2009) DOI:
Advertisements

Soyoun Kim, Jaewon Hwang, Daeyeol Lee  Neuron 
Heterogeneous Coding of Temporally Discounted Values in the Dorsal and Ventral Striatum during Intertemporal Choice  Xinying Cai, Soyoun Kim, Daeyeol.
Volume 53, Issue 1, Pages 9-16 (January 2007)
Grid Cells for Conceptual Spaces?
Elizabeth V. Goldfarb, Marvin M. Chun, Elizabeth A. Phelps  Neuron 
Heather L. Dean, Maureen A. Hagan, Bijan Pesaran  Neuron 
Monitoring and Control of Action by the Frontal Lobes
A Source for Feature-Based Attention in the Prefrontal Cortex
The Neurobiology of Decision: Consensus and Controversy
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
Ranulfo Romo, Adrián Hernández, Antonio Zainos  Neuron 
Volume 64, Issue 3, Pages (November 2009)
Volume 72, Issue 5, Pages (December 2011)
Frontal Cortex and the Discovery of Abstract Action Rules
Value Representations in the Primate Striatum during Matching Behavior
Volume 62, Issue 5, Pages (June 2009)
Heather L. Dean, Maureen A. Hagan, Bijan Pesaran  Neuron 
Martin O'Neill, Wolfram Schultz  Neuron 
Exploiting Exploration: Past Outcomes and Future Actions
Braden A. Purcell, Roozbeh Kiani  Neuron 
Learning to Simulate Others' Decisions
Volume 87, Issue 1, Pages (July 2015)
Volume 85, Issue 2, Pages (January 2015)
Alteration of Visual Perception prior to Microsaccades
Volume 81, Issue 6, Pages (March 2014)
Probabilistic Population Codes for Bayesian Decision Making
Volume 79, Issue 1, Pages (July 2013)
Roman F. Loonis, Scott L. Brincat, Evan G. Antzoulatos, Earl K. Miller 
Hannah M. Bayer, Paul W. Glimcher  Neuron 
Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action  Michael C. Dorris, Paul W. Glimcher  Neuron 
Neurocognitive Architecture of Working Memory
Volume 19, Issue 18, Pages (September 2009)
A Role for the Superior Colliculus in Decision Criteria
Volume 65, Issue 6, Pages (March 2010)
Dynamic Coding for Cognitive Control in Prefrontal Cortex
Torben Ott, Simon Nikolas Jacob, Andreas Nieder  Neuron 
Pieter R. Roelfsema, Henk Spekreijse  Neuron 
Multiple Timescales of Memory in Lateral Habenula and Dopamine Neurons
Differences between Neural Activity in Prefrontal Cortex and Striatum during Learning of Novel Abstract Categories  Evan G. Antzoulatos, Earl K. Miller 
Independent Category and Spatial Encoding in Parietal Cortex
Volume 74, Issue 4, Pages (May 2012)
Caleb E. Strait, Tommy C. Blanchard, Benjamin Y. Hayden  Neuron 
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Kerstin Preuschoff, Peter Bossaerts, Steven R. Quartz  Neuron 
Dopamine: Burning the Candle at Both Ends
Volume 75, Issue 5, Pages (September 2012)
Dynamics of Eye-Position Signals in the Dorsal Visual System
Neuronal Origins of Choice Variability in Economic Decisions
Value-Based Modulations in Human Visual Cortex
Contributions of Orbitofrontal and Lateral Prefrontal Cortices to Economic Choice and the Good-to-Action Transformation  Xinying Cai, Camillo Padoa-Schioppa 
Social Signals in Primate Orbitofrontal Cortex
Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity  Tommy C. Blanchard, Benjamin Y. Hayden,
Volume 76, Issue 4, Pages (November 2012)
Sarah R. Heilbronner, Michael L. Platt  Neuron 
Posterior Parietal Cortex Encodes Autonomously Selected Motor Plans
Monitoring and Control of Action by the Frontal Lobes
Learning to Simulate Others' Decisions
Jude F. Mitchell, Kristy A. Sundberg, John H. Reynolds  Neuron 
Antagonistic but Not Symmetric Regulation of Primary Motor Cortex by Basal Ganglia Direct and Indirect Pathways  Ian A. Oldenburg, Bernardo L. Sabatini 
Cortical Signals for Rewarded Actions and Strategic Exploration
Social Attention and the Brain
Social Information Signaling by Neurons in Primate Striatum
Volume 75, Issue 5, Pages (September 2012)
Orbitofrontal Cortex as a Cognitive Map of Task Space
Richard A. Andersen, He Cui  Neuron 
Matthew R. Roesch, Adam R. Taylor, Geoffrey Schoenbaum  Neuron 
Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity  Tommy C. Blanchard, Benjamin Y. Hayden,
Contributions of Orbitofrontal and Lateral Prefrontal Cortices to Economic Choice and the Good-to-Action Transformation  Xinying Cai, Camillo Padoa-Schioppa 
Volume 72, Issue 5, Pages (December 2011)
Presentation transcript:

The Neurobiology of Decision: Consensus and Controversy Joseph W. Kable, Paul W. Glimcher  Neuron  Volume 63, Issue 6, Pages 733-745 (September 2009) DOI: 10.1016/j.neuron.2009.09.003 Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 1 Valuation Circuitry Diagram of a macaque brain, highlighting in black the regions discussed as playing role in valuation. Other regions are labeled in gray. Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 2 An Example Orbitofrontal Neuron that Encodes Offer Value, in a Menu-Invariant and Therefore Transitive Manner (A) In red is the firing rate of the neuron (±SEM), as a function of the magnitude of the two juices offered, for three different choice pairs. In black is the percentage of time the monkey chose the first offer. (B) Replots firing rates as a function of the offer value of juice C, demonstrating that this neuron encodes this value in a common currency in a manner that is independent of the other reward offered. The different symbols and colors refer to data from the three different juice pairs, and each symbol represents one trial type. Reprinted with permission from Padoa-Schioppa and Assad (2008). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 3 Two Example Striatal Neurons that Encode Action Value (A) Caudate neuron that fires more when a contralateral saccade is more valuable (blue) compared to less valuable (yellow), independently of which saccade the animal eventually chooses. c denotes the average onset of the saccade cue, and the thin lines represent ±1 SEM. Reprinted with permission from Lau and Glimcher (2008). (B) Putamen neuron that encodes the value of a rightward arm movement (QR), independent of the value of a leftward arm movement (QL). Reprinted with permission from Samejima et al. (2005). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 4 Orbitofrontal Cortex Encodes the Subjective Value of Food Rewards in Humans (A) Hungry subjects bid on snack foods, which were the only items they could eat for 30 min after the experiment. At the time of the decision, medial orbitofrontal cortex (B) tracked the subjective value that subjects placed on each food item. Activity here increased as the subjects' willingness to pay for the item increased (C). Error bars denote standard errors. Reprinted with permission from Plassmann et al. (2007). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 5 Match between Psychometric and Neurometric Estimates of Subjective Value during Intertemporal Choice (A) Regions of interest are shown for one subject, in striatum, medial prefrontal cortex, and posterior cingulate cortex. (B) Activity in these ROIs (black) decreases as the delay to a reward increases, in a similar manner to the way that subjective value estimated behaviorally (red) decreases as a function of delay. This decline in value can be captured by estimating a discount rate (k). Error bars represent standard errors. (C) Comparison between discount rates estimated separately from the behavioral and neural data across all subjects, showing that on average there is a psychometric-neurometric match. Reprinted with permission from Kable and Glimcher (2007). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 6 Dopaminergic Responses in Monkeys and Humans (A) An example dopamine neuron recorded in a monkey, which responds more when the reward received was better than expected. (B) Firing rates of dopaminergic neurons track positive reward prediction errors. (C) Population average of dopaminergic responses (n = 15) recorded in humans during deep-brain stimulation (DBS) surgery for Parkinson's disease, showing increased firing in response to unexpected gains. The red line indicates feedback onset. (D) Firing rates of dopaminergic neurons depend on the size and valence of the difference between the received and expected reward. All error bars represent standard errors. Panels (A) and (B) reprinted with permission from Bayer and Glimcher (2005), and panels (C) and (D) reprinted with permission from Zaghloul et al. (2009). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 7 Choice Circuitry for Saccadic Decision Making Diagram of a macaque brain, highlighting in black the regions discussed as playing a role in choice. Other regions are labeled in gray. Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 8 Relative Value Responses in LIP LIP firing rates are greater when the larger magnitude reward is in the response field (n = 30) (A) but are not affected when the magnitude of all rewards are doubled (n = 22) (B). Adapted with permission from Dorris and Glimcher (2004). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 9 Theoretical and Computational Models of the Choice Process Schematic of the symmetric random walk (A) and race models (B) of choice and reaction time. (C) Schematic neural architecture and simulations of the computational model that replicates activation dynamics in LIP and superior colliculus during choice. Panels (A) and (B) reprinted with permission from Gold and Shadlen (2007). Panel (C) adapted with permission from Lo and Wang (2006). Neuron 2009 63, 733-745DOI: (10.1016/j.neuron.2009.09.003) Copyright © 2009 Elsevier Inc. Terms and Conditions