Economic Choice as an Untangling of Options into Actions

Slides:



Advertisements
Similar presentations
One-Dimensional Dynamics of Attention and Decision Making in LIP
Advertisements

Volume 92, Issue 5, Pages (December 2016)
To Detect and Correct: Norm Violations and Their Enforcement
Effective Connectivity between Hippocampus and Ventromedial Prefrontal Cortex Controls Preferential Choices from Memory  Sebastian Gluth, Tobias Sommer,
Signal, Noise, and Variation in Neural and Sensory-Motor Latency
Ranulfo Romo, Adrián Hernández, Antonio Zainos  Neuron 
Choosing Goals, Not Rules: Deciding among Rule-Based Action Plans
Volume 72, Issue 4, Pages (November 2011)
Frontal Cortex and the Discovery of Abstract Action Rules
Jung Hoon Sul, Hoseok Kim, Namjung Huh, Daeyeol Lee, Min Whan Jung 
Caspar M. Schwiedrzik, Winrich A. Freiwald  Neuron 
Alan N. Hampton, Ralph Adolphs, J. Michael Tyszka, John P. O'Doherty 
Volume 39, Issue 5, Pages (August 2003)
Neural Mechanisms of Hierarchical Planning in a Virtual Subway Network
Perceptual Learning and Decision-Making in Human Medial Frontal Cortex
The Psychology and Neuroscience of Curiosity
An Optimal Decision Population Code that Accounts for Correlated Variability Unambiguously Predicts a Subject’s Choice  Federico Carnevale, Victor de Lafuente,
Volume 62, Issue 5, Pages (June 2009)
Following Directions from the Retina to the Brain
Computational Mechanisms of Sensorimotor Control
Feature- and Order-Based Timing Representations in the Frontal Cortex
Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action  Michael C. Dorris, Paul W. Glimcher  Neuron 
Making Choices between Rules or between Actions
Hedging Your Bets by Learning Reward Correlations in the Human Brain
Caspar M. Schwiedrzik, Winrich A. Freiwald  Neuron 
Intrinsic and Task-Evoked Network Architectures of the Human Brain
Neural Correlates of Visual Working Memory
The Prefrontal Cortex—An Update
Volume 87, Issue 5, Pages (September 2015)
Volume 65, Issue 6, Pages (March 2010)
Hyoung F. Kim, Hidetoshi Amita, Okihide Hikosaka  Neuron 
Jack Grinband, Joy Hirsch, Vincent P. Ferrera  Neuron 
Nicholas J. Priebe, David Ferster  Neuron 
A Neurocomputational Model of Altruistic Choice and Its Implications
Volume 45, Issue 4, Pages (February 2005)
Interplay of Hippocampus and Prefrontal Cortex in Memory
Ralf M. Haefner, Pietro Berkes, József Fiser  Neuron 
Human Orbitofrontal Cortex Represents a Cognitive Map of State Space
Moral Judgments Recruit Domain-General Valuation Mechanisms to Integrate Representations of Probability and Magnitude  Amitai Shenhav, Joshua D. Greene 
The Functional Neuroanatomy of Object Agnosia: A Case Study
A. Saez, M. Rigotti, S. Ostojic, S. Fusi, C.D. Salzman  Neuron 
Mechanisms of Connectome Development
Caleb E. Strait, Tommy C. Blanchard, Benjamin Y. Hayden  Neuron 
Wallis, JD Helen Wills Neuroscience Institute UC, Berkeley
Orbitofrontal Cortex: A Neural Circuit for Economic Decisions
Kerstin Preuschoff, Peter Bossaerts, Steven R. Quartz  Neuron 
Fast Sequences of Non-spatial State Representations in Humans
Redmond G. O’Connell, Michael N. Shadlen, KongFatt Wong-Lin, Simon P
Neural Mechanisms Underlying Human Consensus Decision-Making
Neuronal Origins of Choice Variability in Economic Decisions
Computational Models of Grid Cells
Volume 87, Issue 5, Pages (September 2015)
Timing, Timing, Timing: Fast Decoding of Object Information from Intracranial Field Potentials in Human Visual Cortex  Hesheng Liu, Yigal Agam, Joseph.
Monica W. Chu, Wankun L. Li, Takaki Komiyama  Neuron 
Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity  Tommy C. Blanchard, Benjamin Y. Hayden,
Volume 97, Issue 1, Pages e3 (January 2018)
Volume 76, Issue 4, Pages (November 2012)
Neural Signatures of Economic Preferences for Risk and Ambiguity
Neural and Computational Mechanisms of Action Processing: Interaction between Visual and Motor Representations  Martin A. Giese, Giacomo Rizzolatti  Neuron 
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
Volume 39, Issue 5, Pages (August 2003)
Volume 62, Issue 4, Pages (May 2009)
Social Attention and the Brain
Looking for cognition in the structure within the noise
Volume 27, Issue 2, Pages (August 2000)
Orbitofrontal Cortex as a Cognitive Map of Task Space
Richard A. Andersen, He Cui  Neuron 
Matthew R. Roesch, Adam R. Taylor, Geoffrey Schoenbaum  Neuron 
Orbitofrontal Cortex Uses Distinct Codes for Different Choice Attributes in Decisions Motivated by Curiosity  Tommy C. Blanchard, Benjamin Y. Hayden,
Farshad A. Mansouri, Tobias Egner, Mark J. Buckley 
Presentation transcript:

Economic Choice as an Untangling of Options into Actions Seng Bum Michael Yoo, Benjamin Yost Hayden  Neuron  Volume 99, Issue 3, Pages 434-447 (August 2018) DOI: 10.1016/j.neuron.2018.06.038 Copyright © 2018 Terms and Conditions

Figure 1 Some of the Brain Regions Associated with Economic Decision Making Figure from Neuroscience (6th edition) by Purves et al. (2017). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 2 Cartoon of the Form Vision Pathway Input from the retina and lateral geniculate nucleus proceeds to the primary visual cortex (V1) and then continues rostrally toward the rostral temporal pole. Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 3 Conceptual Description of Untangling the Input in the Neural Population Vector Space Visual input in early visual areas still contains object identity manifold but it is highly non-linear. Consequently, a hyperplane cannot cleanly cut it into accepted and rejected options. As with the visual system, information in the reward system becomes untangled as it moves toward the motor system. Figure is based on DiCarlo et al. (2012). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 4 Description of Possible Information Propagation Method when Viewing Cupcake with Specific Size, Position, or Orientation First hypothesis, the abstraction occurs unidirectionally and primitive variables are dropped. Thus, primitive variables are most decodable in primary visual cortex (V1). Second hypothesis, modularized abstraction makes primitive variable most decodable in different brain regions. For example, color is most decodable in V4 and orientation in V1. Finally, there is case that coarse coding governs information propagation. In that case, primitive variables are strengthened on ventral stream. In all cases, object identity is most linearly decodable in inferotemporal (IT) cortex. Gray box was the result summarizing Hong et al. (2016). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 5 Choice-Orthogonal Information in Early Reward Region of the Brain (A) Subjects performed a 3AFC set shifting task, where reward was contingent on the rule (color or shape of object) not the position of the object. The rule changed every 15 correct trials, and consecutive rule was randomly selected. Three offers were initially shown asynchronously (offer period) and shown simultaneously in choice period. (B) Position of the offer is encoded in three core reward regions at offer period (OFC, blue; VS, orange; DS, green). Analysis is done only for the offers with same identity (incorrect/non-rewarding). (C) Position of the upcoming choice is encoded in the same regions throughout the trial. Although any positional information is orthogonal to choice in current task, core reward regions encode this choice-orthogonal information. Figure modified from Yoo et al. (2018). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 6 A Few Possible Architectures of Decision Making (A) In good-based model, decision is made based on competition between represented values. Once winner of the value competition is decided, movement is generated to acquire the preferred option. (B) In action-based model, values representations never compete between each other. Instead, both representations are sent downstream and those influence a competition between possible action representation. (C) Sequential architecture proposed by Chen and Stuphorn (2015). In this architecture, the competition occurs in both goods and action space. However, without reciprocal connection, the influence is unidirectional from goods to action space. (D) Distributed consensus architecture proposed by Cisek (2012). The distributed consensus model assumes reciprocal interactions between the value and the action representation. Competition between action representations will influence value competition via reciprocal connection. The selection of the chosen good and action proceeds therefore in parallel. Figure modified from Chen and Stuphorn (2015). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 7 Baseball Fielding Positions (A) The regular fielding position with nine players. (B) If we could “lesion” a center fielder, the other players would adjust positions slightly to cover the field efficiently. The flexible roles of each player allow for flexibly responding to unexpected changes in play and lead lesions to have minimal effects. Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions

Figure 8 Lack of Pre- and Post-decisional Signal in Reward Regions of the Brain The subject performed two sequential asynchronous tasks that varied reward amount and probability. Initially, the neural response was regressed against values of accepted and rejected first offers. Then the correlation between the regression coefficients was investigated. If there is any positive correlation, it indicates that these neurons signal the value independent of whether the option will later be chosen to some degree. Figure is from Azab and Hayden (2017). Neuron 2018 99, 434-447DOI: (10.1016/j.neuron.2018.06.038) Copyright © 2018 Terms and Conditions