From sound to hearing Nisheeth 26th February 2019.

Slides:

Advertisements

Similar presentations

Auditory Localisation

Advertisements

Revised estimates of human cochlear tuning from otoacoustic and behavioral measurements Christopher A. Shera, John J. Guinan, Jr., and Andrew J. Oxenham.

Chapter 12: Speech and Music Perception

Psychoacoustics Perception of Direction AUD202 Audio and Acoustics Theory.

Binaural Hearing Or now hear this! Upcoming Talk: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.

3-D Sound and Spatial Audio MUS_TECH 348. Psychology of Spatial Hearing There are acoustic events that take place in the environment. These can give rise.

Hearing Detection Loudness Localization Scene Analysis Music Speech.

Sensation and Perception - audition.ppt © 2001 Laura Snodgrass, Ph.D.1 Audition Anatomy –outer ear –middle ear –inner ear Ascending auditory pathway –tonotopic.

Reflections Diffraction Diffusion Sound Observations Report AUD202 Audio and Acoustics Theory.

Localizing Sounds. When we perceive a sound, we often simultaneously perceive the location of that sound. Even new born infants orient their eyes toward.

Sensation- Day 2 Review Questions: 1.Define sensation and perception, and discriminate between the two. 2.What is the retina, and what happens there? 3.Describe.

Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.

cells in cochlear nucleus

A.Diederich– International University Bremen – Sensation and Perception – Fall Frequency Analysis in the Cochlea and Auditory Nerve cont'd The Perception.

There are several clues you could use: 1.arrival time 2.phase lag (waves are out of sync) 3.sound shadow (intensity difference)- sound is louder at ear.

The Auditory System. Audition (Hearing)  Transduction of physical sound waves into brain activity via the ear. Sound is perceptual and subjective. 

Hearing & Deafness (3) Auditory Localisation

AUDITORY PERCEPTION Pitch Perception Localization Auditory Scene Analysis.

Spectral centroid 6 harmonics: f0 = 100Hz E.g. 1: Amplitudes: 6; 5.75; 4; 3.2; 2; 1 [(100*6)+(200*5.75)+(300*4)+(400*3.2)+(500*2 )+(600*1)] / = 265.6Hz.

What are harmonics? Superposition of two (or more) frequencies yields a complex wave with a fundamental frequency.

Sound involves the compression and rarefaction of a medium like air.

Frequency Coding And Auditory Space Perception. Three primary dimensions of sensations associated with sounds with periodic waveforms Pitch, loudness.

Puzzler 1 Imagine that you have three boxes, one containing two black marbles, one containing two white marbles, and the third, one black marble and one.

The Auditory System Dr. Kline FSU. What is the physical stimulus for audition? Sound- vibrations of the molecules in a medium like air. The hearing spectrum.

Hearing: auditory coding mechanisms. Harmonics/ Fundamentals ● Recall: most tones are complex tones, consisting of multiple pure tones ● The lowest frequency.

 Space… the sonic frontier. Perception of Direction  Spatial/Binaural Localization  Capability of the two ears to localize a sound source within an.

Sensation- Day 2 Review Questions: 1.Define sensation and perception, and discriminate between the two. 2.What is the retina, and what happens there? 3.Describe.

Audio Systems Survey of Methods for Modelling Sound Propagation in Interactive Virtual Environments Ben Tagger Andriana Machaira.

Learning Goal Three: Understand how the auditory system registers sounds and how it connects with the brain to perceive it.

How Can You Localize Sound? Ponder this: –Imagine digging two trenches in the sand beside a lake so that water can flow into them. Now imagine hanging.

3-D Sound and Spatial Audio MUS_TECH 348. Physical Modeling Problem: Can we model the physical acoustics of the directional hearing system and thereby.

AUDITION Functions: Adequate stimuli: Class # 12&13: Audition, p. 1.

Pitch Perception Or, what happens to the sound from the air outside your head to your brain….

Fundamentals of Sensation and Perception THE AUDITORY BRAIN AND PERCEIVING AUDITORY SCENE ERIK CHEVRIER OCTOBER 13 TH, 2015.

Hearing in Distance Or Where is that sound? Today: Isabelle Peretz Musical & Non-musical Brains Nov. 12 noon + Lunch Rm 2068B South Building.

Evolution of the Vestibular and Auditory End Organs

PSYC Auditory Science Spatial Hearing Chris Plack.

Fletcher’s band-widening experiment (1940)

Auditory Computation Overview: I. Physiological Foundations II. Elements of Auditory Computation.

 Sounds are longitudinal mechanical waves.  They are created by a disturbance and must travel through a medium, usually air, but sound can travel through.

Physics Acoustics for Musicians selected slides, March 5, 2002 Loudness at different frequencies Critical band Masking The ear Neurological response.

SPATIAL HEARING Ability to locate the direction of a sound. Ability to locate the direction of a sound. Localization: In free field Localization: In free.

Fundamentals of Sensation and Perception

Perception and Attention Advanced Cognitive Psychology PSY 421, Fall 2004.

PSYCHOACOUSTICS: SOUND PERCEPTION PHYSICS OF MUSIC, SPRING 2016.

Sound Localization and Binaural Hearing

Hearing Module 14.

Mrs. Trotter’s Science Class Chapter 4 Waves, Light, sound

Auditory Localization in Rooms: Acoustic Analysis and Behavior

PSYCHOACOUSTICS A branch of psychophysics

Review: Hearing.

The barn owl (Tyto alba)

Hearing Aka: Audition.

Sound localization in the owl: representation and control

Sensation Notes 5-3 (obj 11-16)

Christine V. Portfors, Henrique von Gersdorff Neuron

Vibrations Sound waves are compression waves. They are made of atoms being pushed, or compressed, by other atoms. Why wouldn’t sound waves carry in.

Hearing Aka: Audition.

Sound, language, thought and sense integration

Localizing Sounds.

Multisensory integration: perceptual grouping by eye and ear

Vibrations Sound waves are compression waves. They are made of atoms being pushed, or compressed, by other atoms. Why wouldn’t sound waves carry in.

Evolution of sound localisation in land vertebrates

Topic: Language perception

Vibrations Sound waves are compression waves. They are made of atoms being pushed, or compressed, by other atoms. Why wouldn’t sound waves carry in.

3 primary cues for auditory localization: Interaural time difference (ITD) Interaural intensity difference Directional transfer function.

RHYTHM, RHYME AND RAP MUSIC

Week 13: Neurobiology of Hearing Part 2

Presentation transcript:

From sound to hearing Nisheeth 26th February 2019

Sound localization

Localization Accuracy vs. Frequency Signature of a dual-mechanism process?

Localization Accuracy vs Localization Accuracy vs. Frequency: Low Freq – Interaural Time Difference High Freq – Interaural Intensity Difference ΔI ΔT

Sound Shadowing (Interaural Intensity Difference –IID) High-frequency sound waves are “blocked” by the human head and cast a “shadow” at the far ear (Strong IID cue) Low-frequency sound waves wrap easily around the head and cast little or no sound shadow (Weak IID Cue) ΔI

Characteristic parameter: head size Heads are 0.3 meters around Sound frequencies higher than ~3000 Hz wrap around the head

IID = f(Location, Frequency) Straight Ahead Straight Behind Right Ear (Perpendicular)

ITD versus Location ΔT Straight Ahead Straight Behind Right Ear (Perpendicular)

Delay Line Theory (How to Build a Cell tuned to delta-T Signals) Delta-T = 200 microsec

“Active” Localization (Continuous Sound Sources)

Straight Ahead vs. Straight Behind Relatively good localization performance despite same IID and ITD levels (i.e., zeros) Differential sound distortion (“coloration”) introduced by interaction with pinna Modifying shape of pinna causes immediate reduction in localization accuracy (Hoffman, et al., 1998) Listening through the ears of another yields “ahead” vs. “behind” confusion (chance performance)

Building blocks of the world of sound Auditory cognition

Auditory cognitive concepts Speech-related Phonemes, visemes and their relationship Music-related Rhythm perception and motor entrainment

Phoneme-viseme mapping Visemes are mouth configurations associated with sound Fundamental to learning to speak And also to hear (McGurk & McDonald, 1976)

Several possible clusterings

Rhythm Strongly dependent on periodicity Motor periodicity: repetition of motor actions Heartbeat Circadian rhythm Chewing Walking Auditory periodicity is beat detection Inference of a periodic pulse from a complex sound stimulus Entrainment Synchronizing motor actions to inferred beats

The musical hierarchy

Automated beat extraction Pop music has concentrated energy at the beat frequency Easy to extract algorithmically Classical music and jazz have syncopated rhythms Silent events matter significantly in beat inference Very poorly understood Homework: try picking out a jazz beat before the bass kicks in, or a Hindustani piece’s rhythm during alaaps where the tabla is quiet

The anatomy of entrainment Rhythm perception involves brain regions also associated with motor output and production Cerebellum Basal ganglia SMA Can explain simple tapping Not more complex aspects of musicality Still terra incognita

Animal music cognition Simple motor entrainment is shared by humans with at least parrots and pinnipeds But (apparently) not with other mammal species, e.g. dogs, cats Maturational feature in humans > 2 years Massive social influence is also an important research area (Kotz, Ravignani & Fitch, 2018)