Contact Introduction Viewing a talking person’s face and mouth may enhance speech understanding.

Slides:



Advertisements
Similar presentations
Visual speech speeds up the neural processing of auditory speech van Wassenhove, V., Grant, K. W., & Poeppel, D. (2005) Proceedings of the National Academy.
Advertisements

Hearing relative phases for two harmonic components D. Timothy Ives 1, H. Martin Reimann 2, Ralph van Dinther 1 and Roy D. Patterson 1 1. Introduction.
Detecting Conflict-Related Changes in the ACC Judy Savitskaya 1, Jack Grinband 1,3, Tor Wager 2, Vincent P. Ferrera 3, Joy Hirsch 1,3 1.Program for Imaging.
Karen Iler Kirk PhD, Hearing Science, The University of Iowa –Speech perception & cochlear implants Professor, Dept. of Speech, Language and Hearing Sciences.
INTRODUCTION Assessing the size of objects rapidly and accurately clearly has survival value. Thus, a central multi-sensory module for magnitude assessment.
School of Electrical and Computer Engineering Weldon School of Biomedical Engineering Thomas M. Talavage, PhD Associate Professor, Electrical and Computer.
The Neuroscience of Language. What is language? What is it for? Rapid efficient communication – (as such, other kinds of communication might be called.
Charles Spence Department of Experimental Psychology, Oxford University New Perspectives from the Human Sciences Consumer Focus Workshop (November, 2001)
Vocal Emotion Recognition with Cochlear Implants Xin Luo, Qian-Jie Fu, John J. Galvin III Presentation By Archie Archibong.
Stroop Performance in Normal Control Subjects: An fMRI Study S.A. Gruber, J. Rogowska, P. Holcomb, S. Soraci, and D. Yurgelun-Todd.
The auditory cortex mediates the perceptual effects of acoustic temporal expectation Santiago Jaramillo & Anthony M Zador Cold Spring Harbor Laboratory,
Audiovisual Multisensory Facilitation: A Fresh Look at Neural Coactivation and Inverse Effectiveness. Lynnette Leone North Dakota State University.
Altering cognitive and brain states through cortical entrainment: A pilot study of binaural beats in visual target detection using dense-array EEG Nicholas.
What is a Cochlear Implant?
The Brain.
Measuring the brain’s response to temporally modulated sound stimuli Chloe Rose Institute of Digital Healthcare, WMG, University of Warwick, INTRODUCTION.
Longitudinal fNIRS Stroop Study of Adult Traumatic Brain Injured Patients in Post-Acute Treatment Matthew Cloud, BS 1,2 ; Jana Downum, MA, BCB, CBIS 1.
Ruth Litovsky University of Wisconsin Madison, WI USA Brain Plasticity and Development in Children and Adults with Cochlear Implants
-- 1 Voltage-Sensitive Dye Optical Imaging Vassiliy Tsytsarev Department of Anatomy and Neurobiology.
Sounds in a reverberant room can interfere with the direct sound source. The normal hearing (NH) auditory system has a mechanism by which the echoes, or.
COSC 3461: Module 9 A Principle of UI Design (revisited)
Modelling, Analysis and Visualization of Brain Connectivity
The effects of working memory load on negative priming in an N-back task Ewald Neumann Brain-Inspired Cognitive Systems (BICS) July, 2010.
Binding problems and feature integration theory. Feature detectors Neurons that fire to specific features of a stimulus Pathway away from retina shows.
Zhuanghua Shi Dragan Rangelov Psychophysics. Course lecturers and tutors.
Näätänen et al. (1997) Language-specific phoneme representations revealed by electric and magnetic brain responses. Presented by Viktor Kharlamov September.
Acknowledgement Work supported by NINDS (grant NS39845), NIMH (grants MH42900 and 19116) and the Human Frontier Science Program Methods Fullhead.
Orienting Attention to Semantic Categories T Cristescu, JT Devlin, AC Nobre Dept. Experimental Psychology and FMRIB Centre, University of Oxford, Oxford,
Introduction Ruth Adam & Uta Noppeney Max Planck Institute for Biological Cybernetics, Tübingen Scientific Aim Experimental.
1 Psychology 304: Brain and Behaviour Lecture 2. 2 Research Methods 1.What techniques do biological psychologists use to assess the structure and function.
ANT Z=52 R ACUE - PASSIVE VCUE - PASSIVE 1300 msVoltageCSD.31uV.03uV/cm 2 AIM We investigate the mechanisms of this hypothesized switch-ERP.
Interaction between chronic and acute pain: down- regulation of motivational value for relief from acute pain 589 OHBM 2009 INTRODUCTION Our recent fMRI.
Date of download: 5/28/2016 Copyright © 2016 American Medical Association. All rights reserved. From: Organization of Cognitive Control Within the Lateral.
2 spontaneous ongoing pain rating stimulus ongoing pain rating (affected area) stimulus ongoing pain rating (control area) mechanical stimulus Mechanical.
What can we expect of cochlear implants for listening to speech in noisy environments? Andrew Faulkner: UCL Speech Hearing and Phonetic Sciences.
UROP Undergraduate Research Opportunities Programme This project was supported through the University of Reading UROP (Undergraduate Research Opportunities.
Date of download: 6/23/2016 Copyright © 2016 SPIE. All rights reserved. (a) This image shows the fNIRS sources (dark blue filled circles), detectors (light.
Date of download: 6/28/2016 Copyright © 2016 SPIE. All rights reserved. Photography of the experimental setup: (1) Subject wearing an EEG cap with functional.
Audio-spinal reflex response in human limb muscles
Figure 1 The pattern reversal stimuli
The Eye Processing in Brain Color
Cognitive Brain Dynamics Lab
The Eye Processing in Brain Color
Jean-Paul Noel, Mark Wallace, Randolph Blake  Current Biology 
Volume 87, Issue 4, Pages (August 2015)
Guangying K. Wu, Pingyang Li, Huizhong W. Tao, Li I. Zhang  Neuron 
Volume 30, Issue 3, Pages (May 2001)
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Volume 19, Issue 6, Pages (March 2009)
Clément Moutard, Stanislas Dehaene, Rafael Malach  Neuron 
A Neural Signature of Divisive Normalization at the Level of Multisensory Integration in Primate Cortex  Tomokazu Ohshiro, Dora E. Angelaki, Gregory C.
Effects of Arousal on Mouse Sensory Cortex Depend on Modality
Selective Entrainment of Theta Oscillations in the Dorsal Stream Causally Enhances Auditory Working Memory Performance  Philippe Albouy, Aurélien Weiss,
The Prefrontal Cortex—An Update
Medial Prefrontal and Subcortical Mechanisms Underlying the Acquisition of Motor and Cognitive Action Sequences in Humans  Etienne Koechlin, Adrian Danek,
A.3 Perception of Stimuli
Michael S Beauchamp, Kathryn E Lee, Brenna D Argall, Alex Martin 
Distributed Neural Systems for the Generation of Visual Images
Learning Letters in Adulthood
James M. Jeanne, Tatyana O. Sharpee, Timothy Q. Gentner  Neuron 
Christian Büchel, Jond Morris, Raymond J Dolan, Karl J Friston  Neuron 
Stefano Panzeri, Jakob H. Macke, Joachim Gross, Christoph Kayser 
Vahe Poghosyan, Andreas A. Ioannides  Neuron 
Neural Basis of the Ventriloquist Illusion
Beth L. Parkin, Hamed Ekhtiari, Vincent F. Walsh  Neuron 
Tomokazu Sato, Mikhail G. Shapiro, Doris Y. Tsao  Neuron 
Volume 34, Issue 4, Pages (May 2002)
Multisensory Integration in the Mouse Striatum
Christoph Daube, Robin A.A. Ince, Joachim Gross  Current Biology 
A Supramodal Number Representation in Human Intraparietal Cortex
Presentation transcript:

Contact Introduction Viewing a talking person’s face and mouth may enhance speech understanding in noisy environments (Helfer et al, 1997). This is regarded as a form of multisensory integration, in which unisensory signals from multiple modalities are merged to form a coherent and enhanced percept (Stein & Meredith, 1993). When it comes to study this in cochlear implant (CI) patients most techniques (e.g. fMRI, EEG) are not feasible. Here, we characterize multisensory integration in speech processing by an alternative, non-invasive method of recording neural activity: functional near-infrared spectroscopy (fNIRS). Objective To test whether multisensory integration in human auditory cortex can be demonstrated with fNIRS in normal-hearing subjects and post-lingually deaf CI-users. Methods Subjects. 33 normal-hearing adults; 15 female (pure tone air conduction thresholds <= 15 dB HL, years). 5 post-lingually deaf CI-users; 5 female (> 5 years use of cochlear implant). Task. Subjects were instructed to view and listen to the segments of a story, and were afterwards asked whether they understood the gist of the storyline (‘passive listening’). Paradigm. The segments were played in chronological order, followed by a silent, dark period from 25-40s. The segments were divided in three blocks of 12. For every block, the 12 segments were pseudo-randomnly assigned to an experimental sensory-modality condition. Recordings. Data was collected with a pulsed continuous-wave NIRS- instrument (Oxymon MK III, Artinis Medical Systems BV). Normal-hearing subjects: measured bilaterally CI-users: measured contralateral to the implant Figure 1. (A) Schematic layout of optical sources (open circles) and photodetectors (filled circles) on the left hemisphere. (B) Schematic top view of probe layout. Results Figure 2. Grand average responses of normal-hearing subjects (A/C) and CI-users (B/D). Lines denote colors are red (visual), blue (auditory), green (audiovisual) and grey (additive model). Figure 3. Pooled β-regression coefficients for normal-hearing subjects (open circles) and CI-users (filled squares). Kdfg Adsfasdfasdf Discussion These data indicate that the fNIRS is suitable in normal-hearing subjects and CI-users. It demonstrates that cortical responses can be measured. Results show evoked responses of auditory cortex to all stimulus modalities: visual-only condition elicited smallest response, as expected auditory and audiovisual stimuli showed clear responses. Conclusion This study indicates a preliminary attempt to determine if the novel neuroimaging modality fNIRS could be useful in assessing auditory function in subjects using CIs. Auditory cortex activation to audiovisual speech in normal-hearing subjects and CI-users measured with functional near-infrared spectroscopy L.P.H. van de Rijt 1,2, E.A.M. Mylanus 1, A.J. van Opstal 2, A.F.M. Snik 1, M.M. van Wanrooij 2 ¹Department of Otorhinolaryngology, Head and Neck Surgery, Radboudumc ²Department of Biophysics, Donders Institute for Brain, Cognition and Behaviour, Radboud University