A B C D VIS AUD V azi ele stim resp gaze shift error Figure 12-1.

Slides:



Advertisements
Similar presentations
Figures for Chapter 7 Advanced signal processing Dillon (2001) Hearing Aids.
Advertisements

Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
HEARING CONSERVATION Protecting Employees From Noise Hazards.
3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.
Hearing Detection Loudness Localization Scene Analysis Music Speech.
3-D Sound and Spatial Audio MUS_TECH 348. Wightman & Kistler (1989) Headphone simulation of free-field listening I. Stimulus synthesis II. Psychophysical.
Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
Development of sound localization
Saccades: Rapid rotation of the eyes to reorient gaze to a new object or region. Reflex saccades Attentional saccades Shifting Gaze - Saccades.
Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.
Plasticity in sensory systems Jan Schnupp on the monocycle.
Visual Adaptation And Spatial Auditory Processing Peter Lokša, Norbert Kopčo Collaborators: Jenni Groh, Barb Shinn-Cunningham, I-Fan Lin.
Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.
Audio for Telepresence and Virtual Reality Colin S. Harrison.
Week 6: (March 15, 2011) Auditory Maps and orienting: need for Coordinate Transformations.
3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.
Spatial and Spectral Properties of the Dummy-Head During Measurements in the Head-Shadow Area based on HRTF Evaluation Wersényi György SZÉCHENYI ISTVÁN.
Human Detection and Localization of Sounds in Complex Environments W.M. Hartmann Physics - Astronomy Michigan State University QRTV, UN/ECE/WP-29 Washington,
Auditory Neuroscience 1 Spatial Hearing Systems Biology Doctoral Training Program Physiology course Prof. Jan Schnupp HowYourBrainWorks.net.
Visually-induced auditory spatial adaptation in monkeys and humans Norbert Kopčo, I-Fan Lin, Barbara Shinn-Cunningham, Jennifer Groh Center for Cognitive.
Modeling human localization in multiple sound-source scenarios Jonas Braasch Jens Blauert Institut für Kommunikationsakustik Ruhr-Universität Bochum
On the improvement of virtual localization in vertical directions using HRTF synthesis and additional filtering Wersényi György SZÉCHENYI ISTVÁN UNIVERSITY,
Hearing in Distance Or Where is that sound? Today: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.
3-D Sound and Spatial Audio MUS_TECH 348. Are IID and ITD sufficient for localization? No, consider the “Cone of Confusion”
Energy, Stereoscopic Depth, and Correlations. Molecules Levels of Information Processing in the Nervous System 0.01  m Synapses 1m1m Neurons 100 
On the manifolds of spatial hearing
$ studying barn owls in the laboratory $ sound intensity cues $ sound timing cues $ neural pathways for sound location $ auditory space $ interaural time.
Figure 14-1 Small pinna Large pinna A B Weight (a.u.) Frequency (kHz)
Fletcher’s band-widening experiment (1940)
Figure 8-1. Figure 8-2 Correct Rejection Miss FA Hit ‘YES’ ‘NO’ β.
Figure Figure up down rostral caudal V A’ up down rostral caudal A V A H 0 20 AVAV H 0.
The owl Ecology and behavior
SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.
3-D Sound and Spatial Audio MUS_TECH 348. What do these terms mean? Both terms are very general. “3-D sound” usually implies the perception of point sources.
T F d O ε α E Φ R R cos(Φ) R sin(Φ) α=f(E, Φ) ε=g(E, Φ) Figure 7-1.
Sound Localization and Binaural Hearing
Auditory Localization in Rooms: Acoustic Analysis and Behavior
Hearing and other senses.
An auditory system modeling in sound localization
From: Cross-modal attention influences auditory contrast sensitivity: Decreasing visual load improves auditory thresholds for amplitude- and frequency-modulated.
3) determine motion and sound perceptions.
1.
Invest. Ophthalmol. Vis. Sci ;46(4): doi: /iovs Figure Legend:
From: Visual sensitivity is a stronger determinant of illusory processes than auditory cue parameters in the sound-induced flash illusion Journal of Vision.
Volume 62, Issue 1, Pages (April 2009)
Visually-induced auditory spatial adaptation in monkeys and humans
Dorita H.F. Chang, Carmel Mevorach, Zoe Kourtzi, Andrew E. Welchman 
Volume 20, Issue 6, Pages R282-R284 (March 2010)
Listening for the Right Sounds
Volume 66, Issue 6, Pages (June 2010)
Minami Ito, Gerald Westheimer, Charles D Gilbert  Neuron 
Volume 62, Issue 1, Pages (April 2009)
Localizing Sounds.
Low-Intensity Focused Ultrasound Modulates Monkey Visuomotor Behavior
Variability in Inter-cue Timing Slows Implicit Motor Sequence Learning
Volume 27, Issue 3, Pages (February 2017)
Volume 93, Issue 1, Pages (January 2017)
Daniel E. Winkowski, Eric I. Knudsen  Neuron 
Training Attentional Control in Infancy
Encoding of Stimulus Probability in Macaque Inferior Temporal Cortex
3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.
Volume 35, Issue 4, Pages (August 2002)
Jenni Deveau, Daniel J. Ozer, Aaron R. Seitz  Current Biology 
Localization behavior in ITD-alone condition and head turn analysis.
Power spectra of EMG during the pre- and post-feedback sessions.
Week 13: Neurobiology of Hearing Part 2
Lecture 4. Human Factors : Psychological and Cognitive Issues (II)
Responsibility Assignment in Redundant Systems
Volume 27, Issue 2, Pages (January 2017)
Presentation transcript:

A B C D VIS AUD V azi ele stim resp gaze shift error Figure 12-1

HUMAN/MAMMAL BARN OWL elevation azimuth Figure 12-2 HRTF ITD ILD earflaps facial ruff Figure 12-2

A B C Figure 12-3 Owl 1 Plug left Normal vision Owl 5 Plug right Prisms Owl 3 Eyes occluded A B C Figure 12-3

E Sound level (dBA) Target Azimuth (deg) Figure 12-4 JV CONTROL 35 45 55 Mean Absolute Azimuth Error (deg) E JV RK CONTROL PLUG Figure 12-4

A B Sound Level (dBA) Azimuth Bias (deg) Azimuth Gain Figure 12-5

AZPERC ELPERC attenuated ear normal hearing ear Figure 12-6

Percent Correct Experimental Session 100 80 60 40 20 Pre-plug Plug: 1 Block-trained Daily-trained: all tasks Daily-trained: only flat noise Daily-trained: random spectra 100 80 60 40 20 Pre-plug Plug: 1 Plug: final Post-plug Experimental Session Percent Correct Figure 12-7

Target Azimuth (deg) MAE (deg) PRE-ADAPTATION POST-ADAPTATION RK -50 -25 0 +25 +50 -50 -25 0 +25 +50 35 45 55 30 60 40 20 50 0 5 10 15 20 Target Azimuth (deg) MAE (deg) PRE-ADAPTATION POST-ADAPTATION Sound Intensity (dBA) Azimuth Gain Session 0 5 10 Elevation Gain 0.2 0.5 0.9 0.7 Figure 12-8

A B C - Figure 12-9 Control: no mold Ear with pinna mold without mold with mold - Transfer (dB) Elevation (deg) Frequency (kHz) Control: no mold Acute mold Azimuth (deg) -30 0 30 -30 30 A B C Figure 12-9

Figure 12-10 Day 1 Day 0 Day 2 Day 3 Day 4 Day 5 Day 7 Day 15 Day 9

Figure 12-11

εPERC εVIS @εVIS Figure 12-12 X(ω) Y(ω; εTAR) initial HRTF map (random entries) new HRTF map after 104 trials Sensorimotor feedback Learn HRTF maps δ-rule εPERC εVIS @εVIS New HRTFs Original HRTFs Max(Corr) εTAR HRTF(ω; εTAR) X(ω) @ εTAR Y(ω; εTAR) Figure 12-12

A B Response (deg) Azimuth Elevation Stimulus (deg) Normalized Gain Correlation A B Figure 12-13

Targets and Field of View Elevation (deg) Azimuth (deg) Adaptation Aftereffect -0.5 Local Spatial Gain Change +0.5 -20 20 40 FOV VOR Gain Targets and Field of View Vestibular-Ocular Reflex A B C D E Figure 12-14

A D B E C Population Response Response Change Gain Change Azimuth ILD sensitivities Azimuth Population Response Response Change Gain Change A B C D E Figure 12-15