Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003.

Slides:



Advertisements
Similar presentations
Teaching Pronunciation
Advertisements

Hearing relative phases for two harmonic components D. Timothy Ives 1, H. Martin Reimann 2, Ralph van Dinther 1 and Roy D. Patterson 1 1. Introduction.
Customer Support Center Measurement Business Headquarters YOKOGAWA
Periodicity and Pitch Importance of fine structure representation in hearing.
CS 551/651: Structure of Spoken Language Lecture 11: Overview of Sound Perception, Part II John-Paul Hosom Fall 2010.
SPEECH PERCEPTION 2 DAY 17 – OCT 4, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Pitch Perception.
1 The Effect of Pitch Span on the Alignment of Intonational Peaks and Plateaux Rachael-Anne Knight University of Cambridge.
Properties of Sound EQ: How does intensity, loudness, frequency and pitch affect sound waves?
INTRODUCTION TO HEARING. WHAT IS SOUND? amplitude Intensity measured in decibels.
Sound Chapter What is Sound? I can explain how sound waves are produced. I can describe how sound waves are transmitted. I can compare the phases.
Sensation and Perception - audition.ppt © 2001 Laura Snodgrass, Ph.D.1 Audition Anatomy –outer ear –middle ear –inner ear Ascending auditory pathway –tonotopic.
Reflections Diffraction Diffusion Sound Observations Report AUD202 Audio and Acoustics Theory.
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Prosodic Signalling of (Un)Expected Information in South Swedish Gilbert Ambrazaitis Linguistics and Phonetics Centre for Languages and Literature.
Connecting Acoustics to Linguistics in Chinese Intonation Greg Kochanski (Oxford Phonetics) Chilin Shih (University of Illinois) Tan Lee (CUHK) with Hongyan.
Source Localization in Complex Listening Situations: Selection of Binaural Cues Based on Interaural Coherence Christof Faller Mobile Terminals Division,
A.Diederich– International University Bremen – Sensation and Perception – Fall Frequency Analysis in the Cochlea and Auditory Nerve cont'd The Perception.
A.Diederich– International University Bremen – USC – MMM – Spring 5 1 The Perception of Frequency cont'd.
A.Diederich – International University Bremen – USC – MMM – Spring 2005 Rhythm and timing  Clarke, E.F. Rhythm and timing in music. In Deutsch, D. Chapter.
Sensory Systems: Auditory. What do we hear? Sound is a compression wave: When speaker is stationary, the air is uniformly dense Speaker Air Molecules.
Hearing & Deafness (4) Pitch Perception 1. Pitch of pure tones 2. Pitch of complex tones.
Speech Perception Richard Wright Linguistics 453.
The Auditory System. Audition (Hearing)  Transduction of physical sound waves into brain activity via the ear. Sound is perceptual and subjective. 
Structure and function
Frequency representation Part 2 Development of mechanisms involved in frequency representation.
Intonation September 18, 2014 The Plan for Today Also: I have posted a couple of readings on TOBI (an intonation transcription system) to the course.
Chapter 6: The Human Ear and Voice
Sound Sound is a wave that carries vibrations. It is mechanical, longitudinal, and a pressure wave.
Perceived prominence and nuclear accent shape Rachael-Anne Knight LAGB 5 th September 2003.
The Auditory System Dr. Kline FSU. What is the physical stimulus for audition? Sound- vibrations of the molecules in a medium like air. The hearing spectrum.
The Auditory Process. Stimulus  Distal Stimulus- in our environment produces a proximal stimulus  Proximal Stimulus- form of sound waves reaching the.
Hearing: auditory coding mechanisms. Harmonics/ Fundamentals ● Recall: most tones are complex tones, consisting of multiple pure tones ● The lowest frequency.
Hearing & Aging Or age brings wisdom and other bad news.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
HEARING MUSICAL ACOUSTICS Science of Sound Chapter 5 Further reading: “Physiological Acoustics” Chap. 12 in Springer Handbook of Acoustics, ed. T. Rossing.
Chapter 11: Hearing.
The Effect of Pitch Span on Intonational Plateaux Rachael-Anne Knight University of Cambridge Speech Prosody 2002.
1 Investigating Intonational Plateaux Rachael-Anne Knight, University of Cambridge What are Intonational Plateaux? Targets appear as flat.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
SOUND PRESSURE, POWER AND LOUDNESS MUSICAL ACOUSTICS Science of Sound Chapter 6.
Perception: Hearing Sound: Amplitude – loudness (decibels)
TOBI Basics April 13, 2010.
Fundamentals of Sensation and Perception
Syllables and Stress October 21, 2015.
Introduction to psycho-acoustics: Some basic auditory attributes For audio demonstrations, click on any loudspeaker icons you see....
You better be listening… Auditory Senses Sound Waves Amplitude  Height of wave  Determines how loud Wavelength  Determines pitch  Peak to peak High.
Language and Speech, 2000, 43 (2), THE BEHAVIOUR OF H* AND L* UNDER VARIATIONS IN PITCH RANGE IN DUTCH RISING CONTOURS Carlos Gussenhoven and Toni.
Control of prosodic features under perturbation in collaboration with Frank Guenther Dept. of Cognitive and Neural Systems, BU Carrie Niziolek [carrien]
Applied Psychoacoustics Lecture 4: Pitch & Timbre Perception Jonas Braasch.
Hearing. Anatomy of the Ear How the Ear Works The outer ear The pinna, which is the external part of the ear, collects sounds and funnels them through.
SOUND PRESSURE, POWER AND LOUDNESS
Pitch Tracking + Prosody January 19, 2012 Homework! For Tuesday: introductory course project report Background information on your consultant and the.
HEARING MUSICAL ACOUSTICS Science of Sound Chapter 5 Further reading: “Physiological Acoustics” Chap. 12 in Springer Handbook of Acoustics, ed. T. Rossing.
Physics Acoustics for Musicians selected slides, March 5, 2002 Loudness at different frequencies Critical band Masking The ear Neurological response.
Auditory Perception 1 Streaming 400 vs. 504 Hz 400 vs. 566 Hz 400 vs. 635 Hz 400 vs. 713 Hz A 400-Hz tone (tone A) is alternated with a tone of a higher.
Precedence-based speech segregation in a virtual auditory environment
Meanings of Intonational Contours
C-15 Sound Physics 1.
Psychoacoustics: Sound Perception
The Special Senses: Part D
The Auditory Sense: Hearing
The Auditory Sense: Hearing
Patricia Keating, Marco Baroni, Sven Mattys, Rebecca Scarborough,
Fundamentals of Sensation and Perception
Fundamentals of Sensation and Perception
Speech Perception (acoustic cues)
Sound 12.1 Sound is one type of wave. 12.2
Properties of Sound EQ: How does intensity, loudness, frequency and pitch affect sound waves?
Properties of Sound EQ: How does intensity, loudness, frequency and pitch affect sound waves?
Presentation transcript:

Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003

Outline  Factors affecting perception of pitch  Contour shape  Experiment  Design  Results  Theoretical and psychoacoustic explanations  Conclusions and implications

The Perception of Pitch  The perception of the pitch of a complex sound is related to the fundamental frequency  Sounds that have a higher fundamental frequency sound higher in pitch  And in speech are associated with greater prominence

Syllable Position  In an utterance the position of a syllable also affects the perception of pitch  If two syllables have identical F0, the one later in the utterance will sound higher in pitch  Explained as the listener ‘normalising for declination’ Frequency Time

Contour Shape  Real contours are not stylised peaks and troughs  The majority of falling nuclear accents are realised as more of a flat stretch of contour Peak Plateau

Definition of the Plateau  Plateaux are defined as being 4% down from any absolute peak in F0  4% is the range of perceptual equality Peak 4% range Plateau

Segmental and Prosodic Effects on the Production of the Plateau  Plateaux take up more of syllables that have sonorant onsets and codas  Plateaux are aligned later in the syllable in polysyllabic than monosyllabic feet  Some speakers align the end of the plateau earlier in the syllable before a word boundary

The End of the Plateau  The end of the plateau is stably aligned within the syllable regardless of pitch span  More errors made with incorrect EP alignment in a true/false judgment task  The end of the plateau seems to be the real target (rather than the peak)

Experiment  How does a plateau affect the perception of pitch?  3 possible hypotheses  No effect  A longer plateau makes a syllable sound higher in pitch  A longer plateau makes a syllable sound lower in pitch

Stimuli  Test sentence  “…came with Manny” taken from “Anna came with Manny”  Resynthesised nuclear accent (12 versions)  Frequency of contour o 160, 180, 200, 210 Hz  Shape of contour o Peak, 50ms or 100 ms plateau

Examples of Different Contours AnnaManny

Procedure  7 subjects heard pairs of sentences  ‘Manny’ differed only in shape never in pitch  Question: “In which version is ‘Manny’ higher in pitch?”  Responded by pressing 1 or 2 on a keyboard 160 Hz plateau, peak210 Hz peak, plateau

Results  Percentage of times the longer stretch of contour sounds higher in pitch than the shorter stretch  Overall  50ms vs. peak  100ms vs. peak  100ms vs. 50ms  By frequency  160Hz  180Hz  200Hz  210Hz  By Position  Longer stretch in utt. 1  Longer stretch in utt. 2  By shape 1  50ms vs. peak  100ms vs. peak  By shape 2  100ms vs. 50ms

Results Overall  The shape of the contour does affect the perception of pitch  73% of responses were for “longer stretch of contour sounds higher”

Results by Frequency  The significant result holds at each of the 4 frequencies  160 Hz 67%  180 Hz 72%  200 Hz83%  210 Hz67%

Results by Position  The result is not significant when the plateau occurs in the first token  The result is significant when the plateau occurs in the second position

Results by Shape 1  Both lengths of plateau are perceived as longer when compared to a peak  50ms 77%  100ms 77%

Results by Shape 2  There is no significant difference between the two lengths of plateau

Results Summary  Overall plateaux are perceived as higher in pitch than peaks  Regardless of the frequency  This result is only significant when the plateau is in second position  Suggesting an interaction with position  There is no significant difference between the perception of the 2 plateau lengths  Suggesting a categorical rather than gradient difference

Possible Explanations  There are two possible explanations for why longer stretches of contour may sound higher in pitch  Integration  Temporal Smoothing

Integration  The listener may be integrating the area under the curve  There is a larger area under the curve of a plateau

Smoothing  The listener may be smoothing the curve  So peaks will sound lower than they actually are

Predictions  Integration  As the plateau gets longer pitch will be perceived as increasingly higher  Smoothing  There will be a cut-off point at which a longer plateau no longer sounds higher in pitch

Psychoacoustic Explanation  “Stability-sensitive weighting”  In pitch perception less weight is given to portions of the signal where frequency is changing rapidly  Due to the sluggishness of the auditory system

Pitch Perception  There are 2 mechanisms for extracting pitch from a signal  Place mechanism  Perceived pitch corresponds to the place of maximum excitation on the basilar membrane  Temporal mechanism  Pitch is derived from the frequency of nerve firings  Phase Locking

The Inner Ear

The Cochlea

Cochlea Cross Section

The Organ of Corti

Phase Locking  Neural firings firings occur at the same phase of the waveform each time  The intervals between firings will be integral multiples of the period of the wave

Sluggishness  If the pitch is changing too rapidly  The auditory system does not have enough time to phase lock  Pitch may not be perceived accurately

Conclusions  The shape of the contour does affect perceptions of pitch  Longer stretches of pitch sound higher than single turning points  There is a categorical difference between peaks and plateau  Suggesting an explanation based on smoothing  This effect can be explained as the sluggishness of the phase locking mechanism

Implications  My PhD  Plateaux may occur to enhance the prominence of the nucleus  Models of pitch span  May need to take account of contour shape  Intonational phonology  The situation is more complicated than peaks and troughs in the contour  A more perceptual approach is necessary