Implications of rate pitch on musical perception and auditory object formation in cochlear implants Bomjun Kwon, Trevor Perry Gallaudet University Dept.

Slides:

Advertisements

Similar presentations

Creative Development. 1: Explores different media and responds to a variety of sensory experiences. Engages in representational play. Scale points 1 –

Advertisements

For those who have never played an instrument

Music Introduction to Humanities. Music chapter 9 Music is one of the most powerful of the arts partly because sounds – more than any other sensory stimulus.

Unit 3 Ear Training Basics.

Auditory scene analysis 2

Periodicity and Pitch Importance of fine structure representation in hearing.

Physics 1251 The Science and Technology of Musical Sound Unit 1 Session 8 Harmonic Series Unit 1 Session 8 Harmonic Series.

Synthesis. What is synthesis? Broad definition: the combining of separate elements or substances to form a coherent whole. (

Cochlear Implants The cochlear implant is the most significant technical advance in the treatment of hearing impairment since the development of the hearing.

A.Diederich– International University Bremen – USC – MMM – Spring Auditory scene.

Pitch Perception.

A.Diederich – International University Bremen – USC – MMM – Spring 2005 Development of music perception Dowling, W.J. (1999). Development of music perception.

Colouring in the Violin: A graphically-mediated approach to the reconstruction of heard melodies.

Experiencing Music Chapter 3 Section 1. Quote “If a man does not keep pace with his companions, perhaps it is because he hears a different drummer.” -

Vocal Emotion Recognition with Cochlear Implants Xin Luo, Qian-Jie Fu, John J. Galvin III Presentation By Archie Archibong.

A.Diederich – International University Bremen – USC – MMM – Spring 2005 Scales Roederer, Chapter 5, pp. 171 – 181 Cook, Chapter 14, pp. 177 – 185 Cook,

A.Diederich– International University Bremen – USC – MMM – Spring 5 1 The Perception of Frequency cont'd.

A brief message from your TAs Tine Gulbrandsen Wahab Hanif.

Timbre (pronounced like: Tamber) pure tones are very rare a single note on a musical instrument is a superposition (i.e. several things one on top of.

PERCEPTION OF MUSIC BY PATIENTS WITH COCHLEAR IMPLANTS Jaan Ross (Tartu and Tallinn) Inna V. Koroleva and Jelena A. Ogorodnikova (St. Petersburg)

Relationship between perception of spectral ripple and speech recognition in cochlear implant and vocoder listeners L.M. Litvak, A.J. Spahr, A.A. Saoji,

What are harmonics? Superposition of two (or more) frequencies yields a complex wave with a fundamental frequency.

The Mathematics of Music By: Phil Boyer, Mark Forman, Brian Glenn, and Arvind Kanna.

Tuning Basics INART 50 Science of Music. Three Fundamental Facts Frequency ≠ Pitch (middle A is often 440 Hz, but not necessarily) Any pitch class can.

PERCEPTION OF MUSIC BY PATIENTS WITH COCHLEAR IMPLANTS Jaan Ross (University of Tartu and Estonian Academy of Music and Theatre, Tallinn) Inna V. Koroleva.

Beats and Tuning Pitch recognition Physics of Music PHY103.

Audio Scene Analysis and Music Cognitive Elements of Music Listening

Exam 1 February 6 – 7 – 8 – 9 Moodle testing centre.

INTONATION: The control of overall pitch level and individual pitches in relation to other relevant pitches.

Throckley Primary, ( Jenny Cross) Reading, Writing and Music.

Ruth Litovsky University of Wisconsin Madison, WI USA Brain Plasticity and Development in Children and Adults with Cochlear Implants

Music Intelligence. What it is It is ability to think in pattern, rhythms and sound It is ability to appreciate the music It is ability to compose different.

Perception: Attention – Module 11 General Psych 1 March 1, 2005 Class #11.

Intervals – the building blocks of harmony

One of the most pleasurable AURAL – or hearing related – experiences is listening to music.

Chapter 3 Experiencing Music. Listening to Music One of most pleasurable aural experiences is music Levels of Listening Different levels of attentiveness.

Figuring out Songs Happy Birthday. Figuring Out Happy Birthday For any song the key is to have a process and then follow that process. I always first.

Chapter 5 Pitch: The Simplest Musical Implication of Characteristic Oscillations.

Musical Tools For Music Teachers. Professionals need tools Professionals need tools  Effectiveness  Efficiency.

Geniekids Learning Resources P Ltd Go around and interview others and find out how they used to study during school / college. What were.

Melody The Basics.

Texture. Texture describes how much is going on in the music at any one time It is about the different ways instruments and voices are combined in a piece.

What’s that scale?? 1 Note Grades should be available on some computer somewhere. The numbers are based on the total number of correct answers, so 100%

About Directions Start Tutorial. How to use this tutorial The modules are designed to be completed sequentially. Each module has a brief review of concepts.

Pitch Perception Or, what happens to the sound from the air outside your head to your brain….

DO NOW: 1.State whether you agree or disagree with this statement-and tell me WHY- “Everyone learns the same way.” Be prepared to justify your answer.

Things to Consider When Writing Melodies Vital Elements  Two most vital elements - rhythm and melody.  Harmonic structure of your composition will.

Oscillation of a system to a preferential frequency causing the system to achieve a greater amplitude then its oscillation. Oscillation of a system to.

Unison- same note, same octave Minor 2 nd - “Jaws” theme Major 2 nd - Happy Birthday, Do-Re Minor 3 rd - sing Do-Re-Mi in your head, and hear how the.

Discovering the Arts  Elements of Music  Elements of Art.

Introduction to psycho-acoustics: Some basic auditory attributes For audio demonstrations, click on any loudspeaker icons you see....

Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003.

Pitch What is pitch? Pitch (as well as loudness) is a subjective characteristic of sound Some listeners even assign pitch differently depending upon whether.

A framework for answering aural questions using the 6 concepts of music.

INTERVALS Distance in pitch between 2 notes. What are the intervals? 1 – 1 = prime intervals = unisons 1 – 2 = 2 nd 1 – 3 = 3 rd 1 – 4 = 4 th 1 – 5 =

Lecture 06 Part II a little more history of science October 1, 2004.

12-3 Harmonics.

Audio Scene Analysis and Music Cognitive Elements of Music Listening Kevin D. Donohue Databeam Professor Electrical and Computer Engineering University.

MATHS IN MUSIC.

What can we expect of cochlear implants for listening to speech in noisy environments? Andrew Faulkner: UCL Speech Hearing and Phonetic Sciences.

1 Reading within Year 1 How to support your child 1.

Tippett - Concerto for Double String Orchestra movement I (Harmony) By Luke Everard.

Introduction to Music scales

SPATIAL SPREAD MEASUREMENTS

New York University Adjunct Instructor Scott Burton

More than a Melody.

RESULTS: Individual Data

Lesson 8: Intervals.

Sound, language, thought and sense integration

Nobody Knows You When You’re Down And Out

Presentation transcript:

Implications of rate pitch on musical perception and auditory object formation in cochlear implants Bomjun Kwon, Trevor Perry Gallaudet University Dept of Hearing, Speech and Language Washington DC The study was supported by NIDCD (R03 DC009061)

Music in cochlear implants Image source: FDA.gov

Bold statement regarding CI users music appreciation They can recognize familiar tunes in carefully prepared conditions. – Not many voices, not much harmony – Dominated by rhythmic components The process of music listening involves pattern-matching (highly top-down) – More effortful than enjoyable

Fundamental problem Perception is based only on place pitch and does not punctuate the pitch accurately necessary for musical events  Harmonicity is absent

Temporal pitch as an alternative Can temporal pitch work? – Limited to ~ 300 Hz – Not as salient as place+temporal (Burns & Viemeister, 1983) – Maybe can be used to represent low pitch notes? – At least the pitch can be accurately represented – Less top-down pattern matching task

Demonstration of temporal pitch Pijl & Schwarz (JASA, 1995; HR, 1995) Pijl (EH 1997) – CI users can recognize melodies from temporal pitch sequences presented on single channel – Their musical interval judgment can be as good as NH. But…. So what?

Temporal harmonics (Rate harmonics) Idea: Deliver rate pitch melody on multiple channels with harmonic ally related rates EL pps pps pps130.8 pps EL pps pps pps130.8 pps Why are we trying this? To facilitate grouping stimulation on two channels

Experiment 1: Conditions Minor 2nd Major 3rd Perf 5th Major 7th Perf 8th Unison H: Stimulation on two channels are more easily grouped if their rates are harmonically related

Procedure 4 Nucleus users with substantial musical experience 5 familiar tunes All temporal (rate) pitch lower note on apical El Higher note on basal El Happy Birthday Frère Jacques Mary had a little lamb Do-re-mi song When the saints go marching in

Procedure For each melody, 6 buttons are given on screen, corresponding to 6 conditions 6 were randomly arranged in each time. Subjects click the button to play Repeats are allowed Once done, they type consonance rating for each button—1: complete cacophony, 10: perfect harmony (almost one sound) Each melody was repeated 3 times.

Results

Octave (harmonic) Hypothesis supported!

Punchline Electrical stimulation on two channels can be perceptually grouped when stimulation rates are harmonically related. Findings from Experiment 2 are even cooler but don’t have time today. – Please stay tuned until next time I give a talk. Conclusion Rate pitch has potentially important implications in auditory grouping with CIs. Temporal harmonics… maybe future

Observations / more stories Rate pitch percept is not immediate. – Takes a little “warm-up” time. Different range of rates for each subj – Some prefer higher rate (>200 pps) Rates 400~500 pps do enrich sound quality when used as a harmonic rate even though they alone cannot elicit pitch percept. In terms of sound quality, rates and electrode position do not appear to be independent. – They definitely prefer some choice than others.