Multisensory perception: Beyond modularity and convergence

Slides:



Advertisements
Similar presentations
Multimodal Perception
Advertisements

Journal of Vision. 2017;17(6):18. doi: / Figure Legend:
By Cathy J. Price and Joseph T. Devlin
Building Better Models of Visual Cortical Receptive Fields
Visual Perception: Shaping What We See
Volume 51, Issue 5, Pages (September 2006)
The Geometry of Visual Cortical Maps
Multisensory Integration: What You See Is Where You Hear
Brain States: Top-Down Influences in Sensory Processing
Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments  Jon Driver, Toemme Noesselt 
Stereopsis: How the brain sees depth
Volume 60, Issue 5, Pages (December 2008)
Jean-Paul Noel, Mark Wallace, Randolph Blake  Current Biology 
Crossmodal Spatial Influences of Touch on Extrastriate Visual Areas Take Current Gaze Direction into Account  E Macaluso, C.D Frith, J Driver  Neuron 
Congenital Amusia: All the Songs Sound the Same
Natalia Zaretskaya, Andreas Bartels  Current Biology 
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Shape representation in the inferior temporal cortex of monkeys
Vision: In the Brain of the Beholder
Multisensory Integration: What You See Is Where You Hear
John-Dylan Haynes, Jon Driver, Geraint Rees  Neuron 
A Code for Cross-Modal Working Memory
Volume 87, Issue 1, Pages (July 2015)
Multisensory flavour perception
Auditory Neuroscience: How to Encode Microsecond Differences
Volume 26, Issue 3, Pages (February 2016)
Dynamic Shape Integration in Extrastriate Cortex
FMRI Activation in Response to Illusory Contours and Salient Regions in the Human Lateral Occipital Complex  Damian A. Stanley, Nava Rubin  Neuron  Volume.
Multisensory integration: perceptual grouping by eye and ear
Integration of Touch and Sound in Auditory Cortex
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Motion Processing: How Low Can You Go?
Patrick Haggard, Gian Domenico Iannetti, Matthew R. Longo 
Contextual Feedback to Superficial Layers of V1
Brain States: Top-Down Influences in Sensory Processing
Sense of agency Current Biology
Motion vision: Are ‘speed lines’ used in human visual motion?
Structure and function of the cerebral cortex
Cortical cartography: what's in a map?
Volume 27, Issue 13, Pages R631-R636 (July 2017)
Volume 68, Issue 1, Pages (October 2010)
Stephen G. Lomber, Blake E. Butler  Current Biology 
Neuroimaging: Perception at the Brain's Core
Martijn Barendregt, Ben M. Harvey, Bas Rokers, Serge O. Dumoulin 
Vahe Poghosyan, Andreas A. Ioannides  Neuron 
Sébastien Marti, Jean-Rémi King, Stanislas Dehaene  Neuron 
Auditory-Visual Crossmodal Integration in Perception of Face Gender
Supervised Calibration Relies on the Multisensory Percept
Vision: Modular analysis – or not?
Silvia Convento, Md. Shoaibur Rahman, Jeffrey M. Yau  Current Biology 
Volume 7, Issue 6, Pages R147-R151 (June 2000)
Multisensory Integration: Maintaining the Perception of Synchrony
Volume 18, Issue 19, Pages (October 2008)
When Correlation Implies Causation in Multisensory Integration
Top-Down Modulation of Lateral Interactions in Early Vision
Volume 19, Issue 9, Pages R373-R375 (May 2009)
Qualia Current Biology Volume 22, Issue 10, Pages R392-R396 (May 2012)
Volume 19, Issue 9, Pages R353-R355 (May 2009)
Sung Jun Joo, Geoffrey M. Boynton, Scott O. Murray  Current Biology 
Multisensory Integration: Space, Time and Superadditivity
Visual development: Making maps in the dark
Christian J. Fiebach, Jesse Rissman, Mark D'Esposito  Neuron 
Perceptual Learning: Is V1 up to the Task?
Recurrent neuronal circuits in the neocortex
The superior colliculus
Taosheng Liu, Franco Pestilli, Marisa Carrasco  Neuron 
Christophe Micheyl, Biao Tian, Robert P. Carlyon, Josef P. Rauschecker 
Vision: Attending the Invisible
Li Zhaoping, Nathalie Guyader  Current Biology 
A Supramodal Number Representation in Human Intraparietal Cortex
Presentation transcript:

Multisensory perception: Beyond modularity and convergence Jon Driver, Charles Spence  Current Biology  Volume 10, Issue 20, Pages R731-R735 (October 2000) DOI: 10.1016/S0960-9822(00)00740-5

Fig. 1 Illustrative results from the fMRI study of Macaluso et al. [1(a) Schematic illustration of the conventional notion of feedforward convergence of information from different sensory modalities; here, auditory (Ax) and visual (Vx) information about the same external property (x) is combined to generate the multimodal representation Mx. (b) Schematic illustration of the idea that multimodal levels of representation may feedback to influence levels traditionally considered as ‘unimodal’. Furthermore, by means of this ‘vertical’ feedback, combined with ‘horizontal’ connections between the coding of different properties within one modality, crossmodal interactions concerning one stimulus property (x) could affect unimodal coding of a different property (y or z). Current Biology 2000 10, R731-R735DOI: (10.1016/S0960-9822(00)00740-5)

Fig. 2 Schematic illustration of a representative sequence of events in the experiments of Vroomen and De Gelder [9]. A rapid series of visual events is presented, each visual event concurrent with an auditory event (illustrated here with the ‘musical’ notation). The task was to detect (and report the location of) a diamond-shaped visual target (present in frame 4 of the illustration). This was performed better when the visual target coincided with a unique sound in the auditory stream. Current Biology 2000 10, R731-R735DOI: (10.1016/S0960-9822(00)00740-5)

Fig. 3 The left lingual gyrus (activation shown in red) is traditionally considered a unimodal region of retinotopic visual cortex. Unsurprisingly, it responded more strongly to a contralateral (right) visual stimulus than to an equivalent stimulus in the ipsilateral (left) visual field (see leftmost two bars in histogram). The novel crossmodal observation was that the visual response to a light in the right visual field was enhanced by concurrent touch at the same right location (rightmost bar), even though the lingual gyrus did not respond to touch per se (see second bar from right). Current Biology 2000 10, R731-R735DOI: (10.1016/S0960-9822(00)00740-5)