Reinforcement Learning Signal Predicts Social Conformity

Slides:



Advertisements
Similar presentations
Is it an error to be ‘too different’!? Neurobiology of social conformity Ale Smidts a Co-authors: Vasily Klucharev ab Kaisa Hytönen ab, Mark Rijpkema b.
Advertisements

Ale Smidtsa Co-authors: Vasily Klucharevab Kaisa Hytönenab,
Building Better Models of Visual Cortical Receptive Fields
Acute Stress Impairs Self-Control in Goal-Directed Choice by Altering Multiple Functional Connections within the Brain’s Decision Circuits  Silvia U.
Risk-Responsive Orbitofrontal Neurons Track Acquired Salience
Elizabeth V. Goldfarb, Marvin M. Chun, Elizabeth A. Phelps  Neuron 
A Source for Feature-Based Attention in the Prefrontal Cortex
Volume 63, Issue 6, Pages (September 2009)
Luke Clark, Andrew J. Lawrence, Frances Astley-Jones, Nicola Gray 
Volume 64, Issue 3, Pages (November 2009)
Volume 63, Issue 2, Pages (July 2009)
The Neural Basis of Body Form and Body Action Agnosia
Volume 76, Issue 5, Pages (December 2012)
Daphna Shohamy, Anthony D. Wagner  Neuron 
Volume 92, Issue 5, Pages (December 2016)
Matthias J. Gruber, Bernard D. Gelman, Charan Ranganath  Neuron 
A Code for Cross-Modal Working Memory
Learning to Simulate Others' Decisions
Predicting Value of Pain and Analgesia: Nucleus Accumbens Response to Noxious Stimuli Changes in the Presence of Chronic Pain  Marwan N. Baliki, Paul.
Volume 73, Issue 1, Pages 1-3 (January 2012)
Sheng Li, Stephen D. Mayhew, Zoe Kourtzi  Neuron 
Perceptual Learning and Decision-Making in Human Medial Frontal Cortex
Volume 80, Issue 2, Pages (October 2013)
Volume 93, Issue 2, Pages (January 2017)
Volume 53, Issue 6, Pages (March 2007)
Nucleus Accumbens Neurons Are Innately Tuned for Rewarding and Aversive Taste Stimuli, Encode Their Predictors, and Are Linked to Motor Output  Mitchell.
Volume 62, Issue 5, Pages (June 2009)
Volume 65, Issue 1, Pages (January 2010)
Vincent B. McGinty, Antonio Rangel, William T. Newsome  Neuron 
Statistical Challenges in “Big Data” Human Neuroimaging
Hedging Your Bets by Learning Reward Correlations in the Human Brain
Selective Entrainment of Theta Oscillations in the Dorsal Stream Causally Enhances Auditory Working Memory Performance  Philippe Albouy, Aurélien Weiss,
Volume 74, Issue 3, Pages (May 2012)
A Neurocomputational Model of Altruistic Choice and Its Implications
Dharshan Kumaran, Hans Ludwig Melo, Emrah Duzel  Neuron 
Volume 45, Issue 4, Pages (February 2005)
Human Orbitofrontal Cortex Represents a Cognitive Map of State Space
Peter Kok, Janneke F.M. Jehee, Floris P. de Lange  Neuron 
Dharshan Kumaran, Eleanor A. Maguire  Neuron 
Resolving Emotional Conflict: A Role for the Rostral Anterior Cingulate Cortex in Modulating Activity in the Amygdala  Amit Etkin, Tobias Egner, Daniel.
Franco Pestilli, Marisa Carrasco, David J. Heeger, Justin L. Gardner 
Volume 74, Issue 4, Pages (May 2012)
Caleb E. Strait, Tommy C. Blanchard, Benjamin Y. Hayden  Neuron 
Volume 68, Issue 1, Pages (October 2010)
Absolute Coding of Stimulus Novelty in the Human Substantia Nigra/VTA
Processing of Social and Monetary Rewards in the Human Striatum
Subliminal Instrumental Conditioning Demonstrated in the Human Brain
Neural Predictors of Purchases
Volume 92, Issue 5, Pages (December 2016)
Franco Pestilli, Marisa Carrasco, David J. Heeger, Justin L. Gardner 
Volume 68, Issue 1, Pages (October 2010)
Daniel E. Winkowski, Eric I. Knudsen  Neuron 
Learning to Simulate Others' Decisions
Michael J. Frank, Brion S. Woroch, Tim Curran  Neuron 
Megan E. Speer, Jamil P. Bhanji, Mauricio R. Delgado  Neuron 
Predictive Neural Coding of Reward Preference Involves Dissociable Responses in Human Ventral Midbrain and Ventral Striatum  John P. O'Doherty, Tony W.
Arielle Tambini, Nicholas Ketz, Lila Davachi  Neuron 
Laurie S. Glezer, Xiong Jiang, Maximilian Riesenhuber  Neuron 
Perceptual Classification in a Rapidly Changing Environment
Volume 76, Issue 5, Pages (December 2012)
Caroline A. Montojo, Susan M. Courtney  Neuron 
An Upside to Reward Sensitivity: The Hippocampus Supports Enhanced Reinforcement Learning in Adolescence  Juliet Y. Davidow, Karin Foerde, Adriana Galván,
Predicting Value of Pain and Analgesia: Nucleus Accumbens Response to Noxious Stimuli Changes in the Presence of Chronic Pain  Marwan N. Baliki, Paul.
Acute Stress Impairs Self-Control in Goal-Directed Choice by Altering Multiple Functional Connections within the Brain’s Decision Circuits  Silvia U.
Similarity Breeds Proximity: Pattern Similarity within and across Contexts Is Related to Later Mnemonic Judgments of Temporal Proximity  Youssef Ezzyat,
Volume 63, Issue 2, Pages (July 2009)
Striatal Activity Underlies Novelty-Based Choice in Humans
Eric A. Finkel, Daniel H. O’Connor  Neuron 
David Hubel and Torsten Wiesel
Volume 63, Issue 6, Pages (September 2009)
Presentation transcript:

Reinforcement Learning Signal Predicts Social Conformity Vasily Klucharev, Kaisa Hytönen, Mark Rijpkema, Ale Smidts, Guillén Fernández  Neuron  Volume 61, Issue 1, Pages 140-151 (January 2009) DOI: 10.1016/j.neuron.2008.11.027 Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 1 The Task (fMRI Session) Evoking a Conflict with Group Ratings Followed by the Behavioral Session The sequence of the events within a trial is shown. During the fMRI session (Experiment N1), subjects rated the attractiveness of female faces and were subsequently presented with the group ratings that could be similar (no conflict with group ratings), below or above (as is shown in the figure) subjects' rating (conflict with group ratings). Thirty minutes after the fMRI session subjects rated again the same faces during the Behavioral session in order to identify the subsequent conformity effects. The control experiment (Experiment N2) had the same trial structure, but a different cover story. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 2 Mean Behavioral Conformity Effects On average the attractiveness ratings changed in line with the group ratings. The picture illustrates the change of the faces' attractiveness measured during the behavioral session as compared to the initial ratings during the fMRI session. Bars indicate the standard error of the mean. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 3 Social Conflict Effects: Neural Response to Group Ratings in Conflict versus No-Conflict Trials Left: z-maps of activations (A) and deactivations (B) induced by a conflict with group ratings. Right: the signal change of the hemodynamic response for conflict and no conflict trials. RCZ, rostral cingulate zone. N.Ac., nucleus accumbens. R, right hemisphere. All maps are thresholded at p < 0.001; the clusters are significant at p < 0.05 (FDR corrected). Bars indicate standard error of the mean. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 4 Conformity Effects: The Social Conflicts Followed by the Subsequent Change of Facial Attractiveness in Line with Group Ratings (i.e., Conformity) versus the Normative Conflicts that Were Not Followed by Changes in Attractiveness Ratings (i.e., No Conformity) Left: z-maps of activations (A) and deactivations (B) predicting the conformity with group ratings. Right: the signal change of the hemodynamic response for trials followed by conformity and by no conformity. RCZ, rostral cingulate zone. N.Ac., nucleus accumbens. All maps are thresholded at p < 0.001. Bars indicate standard error of the mean. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 5 Results of the Conjunction Analysis of Social Conflict and Conformity Effects Both the conflict with group ratings and the subsequent conformity activated RCZ (left part of the figure: local maxima at x = 6, y = 16, z = 46) and deactivated the NAc (right part of the figure: local maxima at x = 6, y = 6, z = −2). Maps are thresholded at p < 0.001; clusters are significant at p < 0.05 (FDR corrected). Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 6 Nucleus Accumbens (NAc) Recruitment during a Conflict with Group Opinion Predicts Individual Differences in Conformity (A) Conformists (subjects easily conforming to group ratings) showed the stronger conflict-related deactivation of the nucleus accumbens. Error bars indicate standard error of the mean. Grey rectangular area indicates a putative threshold of conformity. (B) Significant correlation of the neural conformity effect with the individual level of conformity. Due to a higher probability of any conflict to trigger conformity, conformists showed a smaller difference (conformity effect) between neural responses to the conflicts with group ratings followed by conformity and those that were not followed by conformity. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions

Figure 7 Comparison of Social and Nonsocial (Control) fMRI Studies (A) Conflict × social task interaction. White circles indicate RCZ (local maxima at x = 3, y = 16, z = 43) and NAc (local maxima at x = 12, y = 16, z = −2). (B) Conformity × social task interaction. White circles indicate RCZ (local maxima at x = 10, y = 22, z = 43) and NAc (local maxima at x = 8, y = 6, z = −3). The maps are thresholded at p < 0.001. Neuron 2009 61, 140-151DOI: (10.1016/j.neuron.2008.11.027) Copyright © 2009 Elsevier Inc. Terms and Conditions