Friedemann Pulvermüller  Trends in Cognitive Sciences 

Slides:



Advertisements
Similar presentations
Figure Three-dimensional reconstruction of the left hemisphere of the human brain showing increased activity in ventrolateral area 45 during verbal.
Advertisements

Grasping ideas with the motor system: Semantic somatotopy in idiom comprehension Véronique Boulenger MRC Cognitive and Brain Sciences Unit, Cambridge (UK)
Words in the brain Slide #1 김 민 경 Chap 4. Words in the brain.
September 2, 2009 Kamini Krishnan Tandra Toon. Article Focus Review of literature that combines use of functional or structural MRI and microelectrode.
Two views of brain function Marcus E. Raichle Trends in Cognitive Sciences Volume 14, Issue 4, Pages (April 2010) DOI: /j.tics
Dyscalculia and the Calculating Brain
Uri Hasson, Ifat Levy, Marlene Behrmann, Talma Hendler, Rafael Malach 
Segregated Systems of Human Brain Networks
Disrupted Neural Synchronization in Toddlers with Autism
Volume 60, Issue 4, Pages (November 2008)
Volume 73, Issue 6, Pages (March 2012)
Who is That? Brain Networks and Mechanisms for Identifying Individuals
Volume 47, Issue 6, Pages (September 2005)
Lior Shmuelof, Ehud Zohary  Neuron 
Volume 87, Issue 4, Pages (August 2015)
Attila Andics, Márta Gácsi, Tamás Faragó, Anna Kis, Ádám Miklósi 
Araceli Ramirez-Cardenas, Maria Moskaleva, Andreas Nieder 
Neural network imaging to characterize brain injury in cardiac procedures: the emerging utility of connectomics  B. Indja, J.P. Fanning, J.J. Maller,
Volume 26, Issue 13, Pages (July 2016)
Analysis of the Neuronal Selectivity Underlying Low fMRI Signals
Genetic Influences on Cortical Regionalization in the Human Brain
Volume 41, Issue 5, Pages (March 2004)
Coding of the Reach Vector in Parietal Area 5d
Michael Ewers, Reisa A. Sperling, William E. Klunk, Michael W
Disruption of Large-Scale Brain Systems in Advanced Aging
Brain Networks and Cognitive Architectures
Volume 27, Issue 2, Pages (January 2017)
Genetic Influences on Cortical Regionalization in the Human Brain
Towards a neural basis of auditory sentence processing
Network hubs in the human brain
Volume 53, Issue 6, Pages (March 2007)
Nikolaus Kriegeskorte, Rogier A. Kievit  Trends in Cognitive Sciences 
Liping Wang, Lynn Uhrig, Bechir Jarraya, Stanislas Dehaene 
Volume 80, Issue 3, Pages (October 2013)
Volume 74, Issue 4, Pages (May 2012)
Data-Driven Methods to Diversify Knowledge of Human Psychology
Decoding Cognitive Processes from Neural Ensembles
Neural Correlates of Visual Working Memory
The Prefrontal Cortex—An Update
The Generality of Parietal Involvement in Visual Attention
Volume 26, Issue 7, Pages (April 2016)
Parallel Interdigitated Distributed Networks within the Individual Estimated by Intrinsic Functional Connectivity  Rodrigo M. Braga, Randy L. Buckner 
Integration of Touch and Sound in Auditory Cortex
Silent Reading: Does the Brain ‘Hear’ Both Speech and Voices?
Volume 73, Issue 6, Pages (March 2012)
Distributed Neural Systems for the Generation of Visual Images
The Functional Neuroanatomy of Object Agnosia: A Case Study
Audiovisual Integration of Letters in the Human Brain
Lior Shmuelof, Ehud Zohary  Neuron 
Volume 62, Issue 6, Pages (June 2009)
Segregated Systems of Human Brain Networks
Volume 26, Issue 13, Pages (July 2016)
Memory aging and brain maintenance
Cortical Motion Deafness
Volume 38, Issue 3, Pages (May 2003)
René Marois, Hoi-Chung Leung, John C. Gore  Neuron 
Cerebral Responses to Change in Spatial Location of Unattended Sounds
Facial-Expression and Gaze-Selective Responses in the Monkey Amygdala
Volume 50, Issue 4, Pages (May 2006)
Social Attention and the Brain
Christian J. Fiebach, Jesse Rissman, Mark D'Esposito  Neuron 
Connectivity Fingerprints: From Areal Descriptions to Abstract Spaces
Clinical Concepts Emerging from fMRI Functional Connectomics
Looking for cognition in the structure within the noise
Conserved Sequence Processing in Primate Frontal Cortex
Memory Control: A Fundamental Mechanism of Emotion Regulation
Common Prefrontal Regions Coactivate with Dissociable Posterior Regions during Controlled Semantic and Phonological Tasks  Brian T Gold, Randy L Buckner 
Human Posterior Parietal Cortex Flexibly Determines Reference Frames for Reaching Based on Sensory Context  Pierre-Michel Bernier, Scott T. Grafton  Neuron 
César F. Lima, Saloni Krishnan, Sophie K. Scott 
Volume 81, Issue 3, Pages (February 2014)
Presentation transcript:

How neurons make meaning: brain mechanisms for embodied and abstract-symbolic semantics  Friedemann Pulvermüller  Trends in Cognitive Sciences  Volume 17, Issue 9, Pages 458-470 (September 2013) DOI: 10.1016/j.tics.2013.06.004 Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure 1 Semantic brain mechanisms: hubs, category specificity, and semantic circuits. Top left: Left cortical hemisphere with Brodmann area numbers indicated; the left-perisylvian language areas are highlighted (adapted from [55]). Top middle: Areas of particular importance for general semantic processing as proposed in the literature. Top right: Cortical areas for which semantic category-specific effects have been reported in the literature. Middle panels: Model of general lexico–semantic circuits (leftmost graph) and referential–semantic circuits for four different semantic word types (as indicated). Bottom panels: Results of functional magnetic resonance imaging (fMRI) cluster analysis (views from left and from top) revealing activation clusters common to all word types tested (leftmost graph) and category-specific activation to four different semantic word types. Cluster analysis contrasts activation patterns elicited by individual word categories (each tested against a control condition of matched meaningless symbol strings) with each other and with those activations shared by combinations of semantic categories (adapted from [79]). Category-specific semantic circuits are distributed over different areas of both hemispheres and lexico–semantic circuits shared by all words are localized in left perisylvian areas. Note the rich category-specific activations, which confirm some of the model predictions, but also call for model extensions. Abbreviations: iFC, inferior frontal cortex; iPC, inferior parietal cortex; sTC, superior temporal cortex; m/iTC, middle/inferior temporal cortex; aTC, anterior temporal cortex; TP, temporal pole. Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure 2 Cortico–cortical connectivity, word form circuit formation, and combinatorial semantic learning. Top left: Long-range cortico–cortical connections within the perisylvian language cortex and adjacent areas. Abbreviations: IFS, inferior frontal sulcus; PrCS, precentral sulcus; CS, central sulcus; IPS, intraparietal sulcus; STS, superior temporal sulcus. Numbers indicate Brodmann areas (reproduced, with permission, from [54]). Top right: Neuroanatomical subdivision of inferior frontal and superior temporal cortex into six areas: M1, primary motor; PM, premotor; PF, prefrontal; A1, primary auditory; AB, auditory belt; and PB, auditory parabelt areas (adapted from [61]). Middle: Schematic connection structure of the six areas highlighted in the top right panel. Correlated activation in M1 and A1 during articulations leads to spreading activation in the network and distributed circuit formation for syllables and words. Their richer connectivity determines that PF and PB develop memory-active circuit cores [67], by means of which word-form circuits become linked to each other in combinatorial learning. Bottom: Combinatorial learning of noun–verb co-occurrences in an auto-associative neuronal network model. Word pair co-occurrence data are shown in the table on the left (verbs in top row, nouns in left column; numbers denote co-occurrences in the British National Corpus). The bottom right panel shows neuronal elements for the same words and connections between neural elements detecting individual pair sequences. Black lines show learnt connections between sequences including semantically similar nouns and verbs. The formation of ad hoc semantic categories (yellow circles, e.g. nouns for humans vs flying objects and human-specific actions/mental activities vs flying actions) results from mapping of word–word correlations (adapted from [66]). Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure 3 Semantic embodiment of abstract emotion words. Brain activation (event-related functional magnetic resonance imaging) to face-related action words (in green), arm-related action words (in blue), and abstract emotion words (in red), each contrasted with activation for matched meaningless strings of repeated familiar symbols. Note that the inferior motor and premotor cortex sparked by face and arm words is also active for abstract emotion words. In addition, there is activation of the anterior insula and a range of other limbic structures. Reproduced, with permission, from [73]. Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure 4 Brain activation for idiomatic and literal sentences recorded using functional magnetic resonance imaging (top) and magnetoencephalography (bottom). Top left: comparison of brain activation elicited during idiomatic and literal sentence processing (white, idiomatic>literal; black, literal>idiomatic; reproduced, with permission, from [78]). Top right: activation for literal and idiomatic sentences that include arm- (red bars) and leg-related words (blue bars); the red and blue areas indicate where finger and foot movements elicited activity (reproduced, with permission, from [75]). Bottom left: activation time course for idiomatic and literal action sentences (arm and leg sentences collapsed). Bottom right: activation time course for arm and leg sentences (idiomatic and literal collapsed). Note that constructional idiomaticity and compositional action-relatedness effects were present simultaneously early on (150–200ms), suggesting that action-embodied compositional and disembodied constructional semantic processes emerge instantaneously at the same time (reproduced, with permission, from [101]). Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure I Semantic somatotopy in the motor system. Activity foci observed in studies of action word and sentence processing semantically related to actions preferentially performed with the face/mouth (symbols in green), arms/hands (red) and legs/feet (blue). Note that neural indices of semantic body-part relationships are present in central and precentral frontal, but not in postcentral parietal areas. Adapted, with permission, from [81]. The data displayed are from [75,79–81,92–100]. Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure I Grammatically driven flexibility of semantic activation in the motor system and anterior temporal cortex. Simple action sentences (her/they grasp; top left panels) produce stronger semantic activations in precentral and anterior temporal cortex than similar sentences that include additional grammatical materials (with inflectional affixes on the nouns and verbs, e.g., she/their grasps; top right). Such grammatical modulation occurs in extrasylvian areas that index semantic processing (bottom, blue bars) but not in perisylvian language areas (red bars; reproduced, with permission, from [115]). Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions

Figure I Sketch of putative neurobiological mechanisms for concrete and abstract meaning processing. Trends in Cognitive Sciences 2013 17, 458-470DOI: (10.1016/j.tics.2013.06.004) Copyright © 2013 Elsevier Ltd Terms and Conditions