Multisensory convergence Traditionally, represented by inputs from more than one sensory modality, each of which can independently activate the target.

Slides:

Advertisements

Similar presentations

Chapter 4: The Visual Cortex and Beyond

Advertisements

Smooth pursuit.

Are We Paying Attention Yet? A review of the relation between attention and saccades By Travis McKinney.

The Visual System: Feature Detection Model Lesson 17.

Visual speech speeds up the neural processing of auditory speech van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) Proceedings of the National Academy.

Chapter 3: Neural Processing and Perception. Lateral Inhibition and Perception Experiments with eye of Limulus –Ommatidia allow recordings from a single.

The cerebral cortex has four lobes, each is specialized for different activities. The lobes and some of their functions: –Occipital lobe- initial processing.

Somatosensory Cortex Dr. Zahoor Ali Shaikh. Somatosensory Areas Somatosensory Area I – S I. (Brodmann area 1,2,3) – post central gyrus parietal lobe.

Copyright © 2006 Pearson Education, Inc., publishing as Benjamin Cummings Central Nervous System (CNS)  CNS = Brain + spinal cord  Surface anatomy includes.

The Human Brain.

Electrophysiology. Neurons are Electrical Remember that Neurons have electrically charged membranes they also rapidly discharge and recharge those membranes.

Attention Controlling how information flows through the brain.

Read this article for Friday next week [1]Chelazzi L, Miller EK, Duncan J, Desimone R. A neural basis for visual search in inferior temporal cortex. Nature.

Read this article for Friday [1]Chelazzi L, Miller EK, Duncan J, Desimone R. A neural basis for visual search in inferior temporal cortex. Nature 1993;

Attention as Information Selection. Early Selection Early Selection model postulated that attention acted as a strict gate at the lowest levels of sensory.

Interactions between Stimulus- Specific Adaptation and Visual Auditory Integration in the Forebrain of the Barn Owl Amit Reches, Shai Netser, and Yoram.

A synaptic memory trace for cortical receptive field plasticity Robert Froemke, Michael Merzenich & Christoph Schreiner Andrew Lysaght HST.723 April 22,

Meet the Profs event Thursday Sept. 23 at 4:30 in AH117.

Color vision Different cone photo- receptors have opsin molecules which are differentially sensitive to certain wavelengths of light – these are the physical.

1 The Neural Basis of Temporal Processing Michael D. Mauk Department of Neurobiology and Anatomy University of Texas Houston Medical School Slideshow by.

Auditory cortex spatial sensitivity sharpens during task performance Chen-Chung Lee 1,2 & John C Middlebrooks 2 Nature Neuroscience 12 December 2010; 1.

Audiovisual Multisensory Facilitation: A Fresh Look at Neural Coactivation and Inverse Effectiveness. Lynnette Leone North Dakota State University.

Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?

Consequences of Attentional Selection Single unit recordings.

The role of auditory-visual integration in object recognition Clara Suied 1, Nicolas Bonneel 2 and Isabelle Viaud-Delmon 1 1 CNRS – UPMC UMR 7593 Hôpital.

Stein, B., Meredith, M., The merging of the senses, Cambridge, Mass., MIT Press, 1993 Part III, IV.

Cell Types and Physiology in the CANS. Major Components of the Central Auditory Nervous System (CANS) VIIIth cranial nerve Cochlear Nucleus Superior Olivary.

Adaptive, behaviorally gated, persistent encoding of task-relevant auditory information in ferret frontal cortex.

Central Nervous System (CNS) CNS –brain –spinal cord.

THE VISUAL SYSTEM: EYE TO CORTEX Outline 1. The Eyes a. Structure b. Accommodation c. Binocular Disparity 2. The Retina a. Structure b. Completion c. Cone.

A human parietal face area contains aligned head-centered visual and tactile maps Sereno & Huang (2006)

Biomedical Sciences BI20B2 Sensory Systems Human Physiology - The basis of medicine Pocock & Richards,Chapter 8 Human Physiology - An integrated approach.

Basic Pattern of the Central Nervous System Spinal Cord – ______________________________ surrounded by a _ – Gray matter is surrounded by _ myelinated.

Neural dynamics of in vitro cortical networks reflects experienced temporal patterns Hope A Johnson, Anubhuthi Goel & Dean V Buonomano NATURE NEUROSCIENCE,

Sensory Physiology. Concepts To Understand Receptor Potential Amplitude Coding Frequency Coding Activation/Inactivation Neural Adaptation Synaptic Depression.

Dan D. Stettler and Richard Axel REPRESENTATIONS OF ODOR IN THE PIRIFORM CORTEX Neuron 63, p (2009)

Sensory Systems Lesson 14. Sensory Information n Detection of changes in environment l external or internal n 4 main functions l perception l control.

Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.

A new theoretical framework for multisensory integration Michael W. Hadley and Elaine R. Reynolds Neuroscience Program, Lafayette College, Easton PA

Human Anatomy & Physiology, Sixth Edition Elaine N. Marieb 12 The Central Nervous System Part A.

Voluntary Movement I. Psychophysical principles & Neural control of reaching and grasping Claude Ghez, M.D.

Spatial Organization of Neuronal Population Responses in Layer 2/3 of Rat Barrel Cortex Jason N. D. Kerr, Christiaan P. J. de Kock, David S. Greenberg,

PERCEPTUAL LEARNING AND CORTICAL SELF-ORGANIZATION Mike Kilgard University of Texas Dallas.

Chapter 22 Fundamentals of Sensory Systems

Biological Modeling of Neural Networks: Week 10 – Neuronal Populations Wulfram Gerstner EPFL, Lausanne, Switzerland 10.1 Cortical Populations - columns.

1 Perception and VR MONT 104S, Spring 2008 Lecture 3 Central Visual Pathways.

PRINCIPLES OF SENSORY TRANSDUCTION

End of Chapter 46.

Mind, Brain & Behavior Monday February 10, Sensory Systems  Sensory modalities: Vision, hearing, touch, taste, smell  Submodalities – building.

Modulatory Influence of Auditory Cortex on the Activity of Medial Geniculate Body Neurons in Rat R. Moucha1, J. Poeplar2, D. Suta2, M.P. Kilgard1, J.

Oregon Health & Science University

Multisensory perception: Beyond modularity and convergence

Multisensory Integration: What You See Is Where You Hear

Volume 60, Issue 4, Pages (November 2008)

Who is That? Brain Networks and Mechanisms for Identifying Individuals

Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin

Learning without Training

Orientation tuning: strongest response to one orientation

Anterolateral Pathway Sensory Pathway Ist. Order N. from receptors to the Laminae I IV, V &VI on the same side.

Mapping Behavioral Repertoire onto the Cortex

Sensory Systems Lecture 12.

Multisensory integration: perceptual grouping by eye and ear

The Visual System: Feature Detection Model

Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin

Patrick Haggard, Gian Domenico Iannetti, Matthew R. Longo

Vahe Poghosyan, Andreas A. Ioannides Neuron

Christoph Kayser, Nikos K. Logothetis, Stefano Panzeri Current Biology

The superior colliculus

Associational cortex introduction

Natasha Mhatre, Daniel Robert Current Biology

Presentation transcript:

Multisensory convergence Traditionally, represented by inputs from more than one sensory modality, each of which can independently activate the target neuron. (50 yr) Recently, multisensory neuron excited to suprathreshold levels by only one sensory modality, yet inputs from a second modality can significantly modulate these responses through facilitation or suppression (25 yr) Subthreshold multisensory effects may be a general feature

Cat Auditory Cortex and FAES

Auditory field of the anterior ectosylvian sulcus (FAES) Prefer complex sounds /c multiple frequencies & sensitivity to sound location Reversible deactivation of leads to deficits in sound localization Bimodal neurons identified largely along shared borders Nonbimodal forms of multisensory processing in visual and somatosensory cortices. Allman 2007 Courtesy of Stein 2008 Somatosensory: SIV Visual: anterior ectosylvian visual (AEV)

Hypothesis Subthreshold-processing patterns might be ubiquitous to multisensory systems Multisensory processing is subserved by not just bimodal neurons, but by a range of multisensory convergence patterns.

Methods Craniotomy to expose auditory cortex (deep anesth.  pentobarbital) a glass-insulated tungsten electrode was inserted vertically and advanced into the FAES (shallow anesth. with ketamine + acepromazine, still some reflex kept) Visual cues: moving light or dark bars projected onto a translucent hemisphere Auditory cues: clicks, claps, whistles, & hisses Somatosensory stimuli: air puffs, brushes, taps to the body surface, as well as compression of deep tissues and joint rotation.

FAES & the sensory responses Auditory neurons: 70% (135/193) Visual: 13.5% (26/193) ventrally (AEV) A+V (bimodal): 14.5% (28/193) 2% unresponsive No other sensory convergence (v+s) FAES+AEVBimodal: neurons response independently to separate visual and auditory stimulation Subthreshold multisensory neurons: response to only one modality but influenced by other modality

Response of FAES neurons to auditory, visual, and combined auditory–visual stimulation 16.5% of all neurons Within FAES

Multisensory influences on auditory processing in FAES MS: multisensory, bimodal & subthreshold

Conclusion Neurons in auditory FAES exhibit both bimodal and subthreshold forms of multisensory convergence and processing. Subthreshold multisensory neurons produce response levels intermediate to those elicited in bimodal (multisensory convergence) or in unimodal neurons (no convergence).