Multisensory Perception and Biological Motion

Slides:

Advertisements

Similar presentations

FMRI Methods Lecture 10 – Using natural stimuli. Reductionism Reducing complex things into simpler components Explaining the whole as a sum of its parts.

Advertisements

Investigating motor-related sounds in the brain Zarinah Agnew, Carolyn McGettigan, Sophie Scott UCL Institute of Cognitive Neuroscience.

Delayed auditory feedback: a study into vocal motor patterns UCL Institute of Cognitive Neuroscience Dr Zarinah Agnew Dr Carolyn McGettigan Briony Banks.

Visual speech speeds up the neural processing of auditory speech van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) Proceedings of the National Academy.

1st Level Analysis Contrasts and Inferences Nico Bunzeck Katya Woollett.

Detecting Conflict-Related Changes in the ACC Judy Savitskaya 1, Jack Grinband 1,3, Tor Wager 2, Vincent P. Ferrera 3, Joy Hirsch 1,3 1.Program for Imaging.

Experimental Psychology PSY 433 Chapter 7 Perception (Cont.)

Designing a behavioral experiment

Effects of Sound and Visual Congruency on Product Selection and Preference Brock Bass Felipe Fernandez Drew Link Andrew Schmitz.

1Neural Networks B 2009 Neural Networks B Lecture 1 Wolfgang Maass

Cognitive Processes PSY 334 Chapter 3 – Attention July 8, 2003.

I. Face Perception II. Visual Imagery. Is Face Recognition Special? Arguments have been made for both functional and neuroanatomical specialization for.

Visual Imagery One of the greatest problems confronting psychology is the nature of mental representation. Part of this debate is the nature of representations.

The ‘when’ pathway of the right parietal lobe L. Battelli A. Pascual - LeoneP. Cavanagh.

The History and Methods of Cognitive Psychology. What is Cognitive Psychology? The branch of psychology that studies how we perceive, attend, recognize,

Experimental Design Tali Sharot & Christian Kaul With slides taken from presentations by: Tor Wager Christian Ruff.

Efficiency – practical Get better fMRI results Dummy-in-chief Joel Winston Design matrix and.

Perception-Based Engineering: Integrating Human Response Into Product Design A collaboration between psychologists and engineers. Mission: To integrate.

The role of auditory-visual integration in object recognition Clara Suied 1, Nicolas Bonneel 2 and Isabelle Viaud-Delmon 1 1 CNRS – UPMC UMR 7593 Hôpital.

Percevoir l'imperceptible par l'action : l'exemple du mouvement biologique Christel Ildéi-Bidet, Alan Chauvin & Yann Coello Université Charles De Gaulle,

Human perception and recognition of metric changes of part-based dynamic novel objects Quoc C. Vuong, Johannes Schultz, & Lewis Chuang Max Planck Institute.

Chapter 5: Perceiving Objects and Scenes. The Puzzle of Object and Scene Perception The stimulus on the receptors is ambiguous. –Inverse projection problem:

Chapter 8: Perceiving Motion

BASIC PROCESSES The Team: Philip Abrami Denis Cousineau Roberto de Almeida Zohra Mimouni Norm Segalowitz Michael von Grünau Concordia University Psychology.

Integration of behavioral and physiological data with imaging data James Voyvodic, Ph.D. Brain Imaging and Analysis Center Duke University June 30, 2008.

Pattern Classification of Attentional Control States S. G. Robison, D. N. Osherson, K. A. Norman, & J. D. Cohen Dept. of Psychology, Princeton University,

Thinking part I Mental Representations and Visual Imagery Mind Reading

Intentional binding with a robotic hand To what extent agency is modulated by embodiment? Emilie CASPAR, Patrick HAGGARD & Axel CLEEREMANS 1- CO3-Consciousness,

Introduction  Conway 1 proposes there are two types of autobiographical event memories (AMs):  Unique, specific events  Repeated, general events  These.

Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,

Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.

Chapter 2: Intelligences, Personality Types and Learning Styles.

Thinking part I Mental Representations and Visual Imagery Mind Reading.

Connecting Sound with the Mind’s Eye: Multisensory Interactions in Music Conductors W. David Hairston, Ph.D Advanced Neuroscience Imaging Research Lab.

Perception & Pattern Recognition 1 Perception Pattern Recognition Theories of Pattern Recognition Bottom-up vs. Top-Down Processing & Pattern Recognition.

Neural representation and decoding of the meanings of words

fMRI and neural encoding models: Voxel receptive fields

Non-Speech Audio Area Overview Four Areas Will it be heard ?

Exploring Spatial Frequency Channels in Stereopsis

Development of Audiovisual Integration in Central and Peripheral Vision Yi-Chuan Chen, Terri L. Lewis, David I. Shore, and Daphne Maurer Department.

FMRI experimental design and data processing

Sibylle C. Herholz, Robert J. Zatorre Neuron

Cross-cultural differences on object perception

Welcome to our speech perception experiment!

Classification of fMRI activation patterns in affective neuroscience

fMRI: What Does It Measure?

The Development of Emotional Interactions Across the Senses:

Cognitive Processes PSY 334

Cognitive Brain Dynamics Lab

Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments Jon Driver, Toemme Noesselt

Experimental Psychology PSY 433

The Nose Smells What the Eye Sees

Experimental Design in Functional Neuroimaging

Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin

Detection of Human Simultaneity Thresholds Using Cross-Modal Stimuli

Dynamic Causal Modelling

Learning by analogy: cerebral bases

Movement Perception.

Multisensory integration: perceptual grouping by eye and ear

Adaptive multi-voxel representation of stimuli, rules and responses

Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin

Learning Letters in Adulthood

A Comparison of Cues for Auditory Motion Judgments

Perception and Pattern Recognition

Multisensory Integration and Attention in Developmental Dyslexia

Multisensory Integration: Maintaining the Perception of Synchrony

Sound Facilitates Visual Learning

The neural bases of attention

Christoph Kayser, Nikos K. Logothetis, Stefano Panzeri Current Biology

Perception & Pattern Recognition

Presentation transcript:

Multisensory Perception and Biological Motion Ayse Pinar Saygin, Margarita Sarri, Jon Driver Institute of Cognitive Neuroscience BUCNI Project Presentation Nov 29 2007

Background Recent interest in audio-visual multisensory interplay (e.g. Noesselt/Driver, 2007, J Neurosci; STS for matching temporal patterns with flashes and beeps) Little known about multisensory processing for more complex or ecological stimuli (other than speech)

Background Recent interest in audio-visual multisensory interplay (e.g. Noesselt/Driver, 2007, J Neurosci; STS for matching temporal patterns with flashes and beeps) Little known about multisensory processing for more complex or ecological stimuli (other than speech) Biological motion - activates STS Seen movements often accompanied by sounds We recently showed behavioural effects of heard ‘footsteps’ during dot-walker perception (Saygin, Driver & de Sa, Psychological Science, in press) Single cells in the STS that are responsive to biological motion show increased activity when corresponding sounds are present

Design fMRI of audio-visual interplay in biological motion Visual Stimuli: dot-jogger or same dots scrambled Auditory Stimuli: “footstep” sounds in or out of synch with ‘foot’ dots Visual noise: Principle of inverse effectiveness Demo.

Proposal N=16 subjects, 6 runs of ~ 8 minutes Event related, whole brain coverage, TR=2200 ms. To be analyzed with SPM Conditions Biological/Scrambled (plus noise dots) Matching/Mismatching sound Task: Decide whether jogger is present Unisensory (Biological, Scrambled, Just Sound, Fixation) Predictions: Expected in the STS, possibly IFG, unisensory areas AV_Congruent > AV_Incongruent AV > A, V with Congruent sound Possibly AV < A, V with Incongruent sound Interaction with Visual Stimulus type: Multisensory effect greater for Biological compared with Scrambled