Neural Basis of the Ventriloquist Illusion Bonath, Noesselt, Martinez, Mishra, Schwiecker, Heinze, and Hillyard.

Slides:



Advertisements
Similar presentations
PS4529/30 Applications of Cognitive Neuroscience.
Advertisements

Early studies of the development of recognition memory in infants demonstrated a negative component over central leads (Nc) with greater amplitude in event-related.
The Event-Related Potential (ERP) Embedded in the EEG signal is the small electrical response due to specific events such as stimulus or task onsets, motor.
Neuroimaging for Cognitive Research
Electrophysiology of Visual Attention. Does Visual Attention Modulate Visual Evoked Potentials? The theory is that Visual Attention modulates visual information.
Human (ERP and imaging) and monkey (cell recording) data together 1. Modality specific extrastriate cortex is modulated by attention (V4, IT, MT). 2. V1.
Electrophysiology. Electroencephalography Electrical potential is usually measured at many sites on the head surface More is sometimes better.
Attention - Overview Definition Theories of Attention Neural Correlates of Attention Human neurophysiology and neuroimaging Change Blindness Deficits of.
Read this article for next week: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Electrophysiology.
Principles of NMR Protons are like little magnets
Read this article for Wednesday: A Neural Basis for Visual Search in Inferior Temporal Cortex Leonardo Chelazzi et al. (1993) Nature.
Opportunity to Participate
Subdural Grid Intracranial electrodes typically cannot be used in human studies It is possible to record from the cortical surface Subdural grid on surface.
Experimental Design in fMRI
Electroencephalography The field generated by a patch of cortex can be modeled as a single equivalent dipolar current source with some orientation (assumed.
Electroencephalography and the Event-Related Potential
Opportunity to Participate
The Event-Related Potential (ERP) Embedded in the EEG signal is the small electrical response due to specific events such as stimulus or task onsets, motor.
Electroencephalography Electrical potential is usually measured at many sites on the head surface.
Opportunity to Participate EEG study of auditory attention – takes about 2 hours Sign up on sheet or
Structural and Functional Imaging Functional images tend to be lower resolution and fail to convey spatial information Pixels.
FMRI - What Is It? Then: Example of fMRI in Face Processing Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/06 /2015: Lecture 02-1 This.
Electrophysiology of Visual Attention. Does Visual Attention Modulate Visual Evoked Potentials? The theory is that Visual Attention modulates visual information.
Four Main Approaches Experimental cognitive psychology Cognitive neuropsychology Computational cognitive science Cognitive neuroscience.
Mind, Brain & Behavior Wednesday February 5, 2003.
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
Principles of MRI Some terms: – Nuclear Magnetic Resonance (NMR) quantum property of protons energy absorbed when precession frequency.
Mind, Brain & Behavior Friday February 7, From Nerve Cells to Cognition (Cont.) Chapter 18.
Neural mechanisms of feature- based attention Taosheng Liu.
Measuring Blood Oxygenation in the Brain. Functional Imaging Functional Imaging must provide a spatial depiction of some process that is at least indirectly.
Methods of Studying the Brain Mrs. Joseph AP Psychology Solon High School.
HELSINKI UNIVERSITY OF TECHNOLOGY LABORATORY OF COMPUTER AND INFORMATION SCIENCE NEURAL NETWORKS RESEACH CENTRE Variability of Independent Components.
Closed and Open Electrical Fields
Memory and Cognition PSY 324 Chapter 2: Cognition and the Brain Part II: Localization of Function Dr. Ellen Campana Arizona State University.
Attention Modulates Responses in the Human Lateral Geniculate Nucleus Nature Neuroscience, 2002, 5(11): Presented by Juan Mo.
Recording of electrical activity / electrical stimulation of brain tissue Spike trains Spikes.
Attention Loads program into working memory (more about that later) Vast amount of perceptual information available at one Moment How much can be retained.
Some notes Room Change (as of Thursday) Geological Sciences Stores Rd Course website New course outline (corrected.
Basic Pattern of the Central Nervous System Spinal Cord – ______________________________ surrounded by a _ – Gray matter is surrounded by _ myelinated.
Chapter 8: Perceiving Motion
Cognition, Brain and Consciousness: An Introduction to Cognitive Neuroscience Edited by Bernard J. Baars and Nicole M. Gage 2007 Academic Press Chapter.
Foundations (cont.) Complexity Testing explanations in psychology Cognitive Neuroscience.
Functional MRI David Card. fMRI So what exactly are we measuring in fMRI? Our goal is to “see” neural activity We are actually seeing changes in blood.
Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,
Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.
1 Psychology 304: Brain and Behaviour Lecture 2. 2 Research Methods 1.What techniques do biological psychologists use to assess the structure and function.
Cerebral Mechanisms of word masking and unconscious repetition priming Stanislas Dehaene, Lionel Naccache, Laurent Cohen, Denis Le Bihan, Jean- Francois.
Chapter 4: Cortical Organization
Methodology in the Biological Level of Analysis Learning Objectives: 1.Discuss how and why particular research methods are used at the biological level.
12 Attention and Consciousness The breath of the mind is attention – Joseph Joubert.
Chapter 2 Cognitive Neuroscience. Some Questions to Consider What is cognitive neuroscience, and why is it necessary? How is information transmitted from.
Electrophysiology. Neurons are Electrical Remember that Neurons have electrically charged membranes they also rapidly discharge and recharge those membranes.
Methods used for studying brain development
Melanie Boysen & Gwendolyn Walton
Ways of investigating the brain
Evoked Response Potential (ERP) and Face Stimuli N170: negative-going potential at 170 ms Largest over the right parietal lobe,
CAT Scan MRI Scan.
Volume 60, Issue 4, Pages (November 2008)
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Delayed Striate Cortical Activation during Spatial Attention
Visual Processing in Fingerprint Experts and Novices
Direct Recordings of Pitch Responses from Human Auditory Cortex
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Negative BOLD Differentiates Visual Imagery and Perception
Negative BOLD Differentiates Visual Imagery and Perception
Integration of Local Features into Global Shapes
Cerebral Responses to Change in Spatial Location of Unattended Sounds
Neural Basis of the Ventriloquist Illusion
The neural bases of attention
Presentation transcript:

Neural Basis of the Ventriloquist Illusion Bonath, Noesselt, Martinez, Mishra, Schwiecker, Heinze, and Hillyard

Investigating the Ventriloquist Illusion Behavioral responses EEG fMRI

ElectroEncephaloGraphy (EEG) Neurons use electrical potentials to communicate Multiple, aligned, synchronously-firing neurons produce enough voltage change to be read by electrodes on the scalp.

ElectroEncephaloGraphy (EEG) Neurons use electrical potentials to communicate Multiple, aligned, synchronously-firing neurons produce enough voltage change to be read by electrodes on the scalp.

ElectroEncephaloGraphy (EEG) Neurons use electrical potentials to communicate Multiple, aligned, synchronously-firing neurons produce enough voltage change to be read by electrodes on the scalp.

Good and bad about EEG Temporal resolution is great! Spatial resolution is not so great (scalp maps can be misleading), but methods exist for estimating sources

Event Related Potentials Image from: Sirigu, Daprati, Ciancia, Giraux, Nighoghossian, Posada, & Haggard EEG = Signal + trial-independent noise

fMRI - what is it? Angelo Mosso's 19th century balancing experiment Late 19th century: blood flow in dog brain Blood flow related to brain activity in 1948 (Kety and Schmidt). Hemodynamic response

How does fMRI measure bloodflow? Giant magnet creates magnetic field in and around head Hemoglobin is diamagnetic when oxygenated, paramagnetic when not Measuring this difference is called Blood-Oxygen Level Dependent (BOLD) imaging

Good and bad about fMRI Bad temporal resolution (response + imaging) Good spatial resolution

Questions about the tools? EEG Bad spatial resolution Good temporal resolution fMRI Good spatial resolution Bad temporal resolution

What is the Ventriloquist Illusion? Spurious perception of sound source at a visual event's location Narins, Grabul, Soma, Gaucher, Hodl (2004)

How does this illusion arise? Knowing where and when the illusion arises can tell us about how the visual and auditory signals are integrated for localization. Look at EEG and fMRI to find the origins

Experimental Set-up Ignore visual stimuli, report location of sound Also included blank condition

Behavioral Results

Revealing Multimodal Interaction (ERP) Difference waveform o (AcVr + blank) - (Ac + Vr) Blank added to account for prestimulus common response Multimodal waveforms separated by behavioral response o (AcVr)illusion and (AcVr)no-illusion

Difference Waveform Components P Symmetrical in all conditions N Lateralized in illusion trials, not in no-illusion trials

Lateralization Contralateral activation same for illusion trials as for when sound actually came from the illusory location Response found in Planum Temporale o What is the Planum Temporale?

Planum Temporale Responsible for acoustic spatial representation Leon Y. Deouell, Aaron S. Heller, Rafael Malach, Mark D'Esposito and Robert T. Knight

N 260 Previously noticed in audio-visual interaction, but not associated with localization Latency suggests feedback from higher multisensory areas o Retinotopic activity in extrastriate occipital cortex ms o Location-specific audio-visual interactions ms in occipito-temporal and parietal regions o Superior temporal cortex around 200ms

Attention? Probably not Lateralization may be due to attentional orientation to perceived sound location No differential BOLD response in attentional areas (anterior cingulate, posterior parietal cortex) between illusion/no- illusion trials Other behavioral results suggest visual attention has little influence on illusion

Response bias? Probably not Maybe audio perceived the same, but response drawn to visual location However, significant increase of responses to C when visual and audio presented on opposite sides Also, observed hemispheric differences in auditory cortex imply difference in perception

Behavioral Results Again (no response bias?)

Neural Basis of Ventriloquist Illusion Illusion accompanied by contralateral response in auditory cortex Similar to response when sound actually comes from illusory location Response occurs between ms after stimulus onset Therefore: Auditory information is present very early, but localization itself may depend on longer time scales o example of early information: MMN present for illusory shift of sound source