Ago, ergo Cogito Language comprehension warps the mirror neuron system Arthur M. Glenberg Arizona State University University of Wisconsin - Madison September, 2013 Embodied Language, II Christs College, Cambridge
Ago, ergo Cogito Does action play a constituative role in linguistic meaning? If so, can that role be traced to a mirror neuron system? The plan: Determine if adaptation produced by repeated action affects language comprehension; determine if adaptation produced by repeated language affects perception of action. Todays talk
Ago, ergo Cogito Some possibilities for the relation between language and action Modularity: Language and action are separate systems with little interaction. Associative: Language and action are associated in that some words strongly prime actions and some actions strongly prime words. Causal: Language understanding causally depends on action systems so that modifying action systems will modify language understanding. Constituative: Activity in action systems constitutes, that is, IS part of the meaning that arises when understanding language.
Ago, ergo Cogito Glenberg & Gallese, 2012 Action-based language (& Wolperts HMOSAIC) bi-directional assoc. of speech and action control over serial order in action & speech grounding of meaning-- constituative gesture eyesextend Predictions Gain Social Environment Physical Environment Bodily Actions & Perceptions drink/drink predictorcontroller Integrate efference copy sensory feedback /k/ /dr/ speech basic motor repertoire in motor cortex canonical neurons mirror neurons
Ago, ergo Cogito mirror neurons purpose action recognition intent/theory of mind enhance perception communication? Human data fMRI, TMS, behavior, single-cell recoding Brocas & hand canonical neurons From, Rizzolatti & Arbib, 1998
Ago, ergo Cogito Bean task Glenberg, Sato, & Cattaneo (2008) eyesarm /g/ Predictions Gain Social Environment Physical Environment Bodily Actions & Perceptions give/ give predictor controller Integrate efference copy sensory feedback speech The logic: Mirror neurons are multi-modal and contribute to both action and cognition (e.g., language), so… …using repeated motor movements to adapt action control ought to also adapt cognition.
Adapting the motor system causally affects language comprehension.
Ago, ergo Cogito Suppose beans adapt a MNS that is constituative of language understanding, that is, action as the adapting stimulus affects language… …can we use language as the adapting stimulus and affect action systems? The plan: Repeat language of a particular kind, such as transfer away or transfer toward, and measure effects on … use of the MNS in action recognition/prediction Flanagan & Johansson, 2003 …and, what if the adapting sentences are about transfer by leg?
Ago, ergo Cogito
Conclusions 1. Causal (yes!): Language understanding causally depends on action systems in that modifying action systems modifies language understanding. 3. Constituative (likely): The bi-directional adaptation is consistent with a constituative claim. Nonetheless, the data do not logically compel this conclusion. 2. Mirror neuron system (Probably): Adapting language causally affects prediction in a visual perception task. Depends on biological effectors. Thank you!