Chapter 12: Speech and Music Perception

Slides:



Advertisements
Similar presentations
Two hemispheres with different specializations
Advertisements

English Phonetics and Phonology Presented by Sergio A. Rojas.
Chapter 12 Speech Perception. Animals use sound to communicate in many ways Bird calls Bird calls Whale calls Whale calls Baboons shrieks Baboons shrieks.
The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
The Neuroscience of Language. What is language? What is it for? Rapid efficient communication – (as such, other kinds of communication might be called.
SOUND Chapter Twenty-Four: Sound  24.1 Properties of Sound  24.2 Sound Waves  24.3 Sound Perception and Music.
PHONETICS AND PHONOLOGY
General Problems  Foreign language speakers of a target language cause a great difficulty to native speakers because the sounds they produce seems very.
Basic Spectrogram Lab 8. Spectrograms §Spectrograph: Produces visible patterns of acoustic energy called spectrograms §Spectrographic Analysis: l Acoustic.
The Human Voice. I. Speech production 1. The vocal organs
Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.
The Human Voice Chapters 15 and 17. Main Vocal Organs Lungs Reservoir and energy source Larynx Vocal folds Cavities: pharynx, nasal, oral Air exits through.
PH 105 Dr. Cecilia Vogel Lecture 14. OUTLINE  consonants  vowels  vocal folds as sound source  formants  speech spectrograms  singing.
Structure of Human Speech Chris Darwin Vocal Tract.
PHYS 103 lecture 29 voice acoustics. Vocal anatomy Air flow through vocal folds produces “buzzing” (like lips) Frequency is determined by thickness (mass)
English 306A; Harris Everything has meaning. Everything.
English 306A; Harris Language 1. Humans’ accommodations for language 2. Some characteristics of language.
Speech perception Relating features of hearing to the perception of speech.
Chapter 1 (Hall) The Nature of Sound Dr. Jie Zou PHY 1071.
SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?
What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.
Language Comprehension Speech Perception Naming Deficits.
Language Humankind’s greatest achievement. Language Defined  Any set of symbols  Ex: sounds, pictures, music  Arranged according to rules  Ex: grammar,
Linguistics I Chapter 4 The Sounds of Language.
The Description of Speech
Sound Sound is a wave that carries vibrations. It is mechanical, longitudinal, and a pressure wave.
Chapter 13: Speech Perception
Phonetics and Phonology
Speech Perception. Phoneme - a basic unit of a speech sound that distinguishes one word from another Phonemes do not have meaning on their own but they.
SOMAYEH SHAHSAVARANI 90/1/29 Speech Production. Language SpeechSigningWritingPainting.
Lecture 6 The Intonation Phonology Suprasegmental phonology Intonation
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Speech Science Fall 2009 Nov 2, Outline Suprasegmental features of speech Stress Intonation Duration and Juncture Role of feedback in speech production.
Chapter Twenty-Four: Sound  24.1 Properties of Sound  24.2 Sound Waves  24.3 Sound Perception and Music.
Speech Perception 4/4/00.
Sensation & Perception
Speech Science VI Resonances WS Resonances Reading: Borden, Harris & Raphael, p Kentp Pompino-Marschallp Reetzp
Chapter 24 –Sound 24.3 –Sound, Perception and Music pp
Sounds and speech perception Productivity of language Speech sounds Speech perception Integration of information.
PHYSIOLOGY OF SPEECH Prof. Sultan Ayoub Meo
Chapter 13: Speech Perception. The Acoustic Signal Produced by air that is pushed up from the lungs through the vocal cords and into the vocal tract Vowels.
Language I: Structure Defining language: symbolic, rule-based system of communication shared by a community Linguistics: study of language Psycholinguistics:
Speech Perception.
Language Perception.
Intonation Lecture 11.
Sounds in different patterns How do language organize sounds to distinguish different words? How do languages restrict, constrain of sounds? How are sounds.
The two different parts of speech Speech Production Speech Perception.
PROPERTIES OF SOUND CHAPTER 2, SECTION 2. Loudness describes your ___PERCEPTION__ of the energy of a sound. The loudness of sound depends on 2 factors:
Properties of Sound. Loudness Loudness describes your perception of the energy of sound – It describes what you hear The closer you are to the sound,
Branches of Linguistics
Biology of Communication Respiratory System Thorax: the region of the body’s truck from below the neck to just above the diaphragm Diaphragm: the muscular-tendenous.
Cerebrum Chapter 12 and 13 p Cerebrum – surrounded by a thin layer of gray matter called cerebral cortex (rind or bark)  Consists of six layers.
Acoustic phonetics: Concerned with describing the acoustics of speech. Also called speech acoustics. Big questions: (1) What are the relationships between.
PHONETICS AND PHONOLOGY
1 Cerebrum November 6, 2013 Chapter 13: Dr. Diane M. Jaworski Frontal Temporal Occipita l Parietal.
Chapter 3: The Speech Process
The Human Voice. 1. The vocal organs
SOUND 24.3.
THE HUMAN BRAIN.
Chapter Twenty-Four: Sound
Chapter 3: The Speech Process
The Human Voice. 1. The vocal organs
What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.
Speech Perception.
Chapter 2 Phonology.
24.3 –Sound , Perception and Music pp
The Vocal Process How the Voice Works.
Evolution of human vocal production
Topic: Language perception
PHONETICS AND PHONOLOGY
Presentation transcript:

Chapter 12: Speech and Music Perception Vocal anatomy: Vocal folds (vocal cords) are located with larynx). Air is vibrated as it passes through then “shaped’ by vocal tract (throat, tongue, teeth and lips) as it is expelled. Note also, human larynx “descended” compared to other apes, allows for articulation of linguistic sounds

Studying the speech signal: Sound spectrograms Visually depicts energy levels at different frequencies for speech sounds. Darker areas indicate greater energy. Note: widespread energy across 1-5K Hz for “I”; low frequency energy for “miii”, hissing “sss” more widespread energy, then high frequency energy for “y” which then drops to lower “ooouuu” Neurogram: sound spectrogram could also be understood as depicting activity along BM over time moving from base (hi freq) to apex (lo freq).

Invariance Problem with phonemic signals Phonemes are basic units of sound in language (/b/; /d/; /ch/ etc). However, their acoustic signal is not invariant, so how do we identify them? To answer first must review brain regions active in speech perception.

Brain areas involved in speech processing PAC does not respond preferentially to speech sound, but WA (left hemisphere) does. Damage to WA produce receptive aphasia (inability to understand speech). Damage to BA produces production aphasia, inability to produce speech. Motor areas of brain also activated in speech perception. Analogous structures in RH process emotional content of speech; identify speaker from cadence, intonation patterns, etc.; not so much meaning of speech. Damage to right WA can produce phonagnosia – inability to indentify speaker but still can understand speech.

Auditory pathways from PAC Similar to “what” and “where” pathways in visual system, two pathways extend from PAC. Red, ventral pathway deals more with extracting meaning from sounds, including phonemic sounds. Blue, dorsal pathway deals more with processing rhythm and intonation patterns. Note: RH shown in image, similar arrangement also found in LH

Back to identifying phonemes How can we identify phonemes if they are not associated with consistent acoustic signal? Two Contextual factors: Motor information: We use motor information (movements of face and mouth, to disambiguate) phoneme -- recall that motor cortex is active in speech perception -- McGurk effect: motor information affects perception

Back to identifying phonemes 2nd contextual factor: Semantic context, what makes sense? EX: phonemic restoration effect. If a sound is removed from a sentence, people still claim to have heard a sound consistent with the meaning of the sentence.  The *eel was on the axel (wh)/ shoe (h) /orange (p)/ table (m)

Music Perception Melody: the central aspect of music. Structured organization of pitches that create an identifiable pattern. Composed of absolute intervals, relative intervals, and pitch contour. Absolute intervals: distance between pitches which in the leftmost example (in Hungarian!) is one whole note Relative intervals: relationship among intervals in a group of notes. In distortion one (middle example) absolute intervals have been doubled (two whole notes now separate each note, but relative intervals remain constant – remains 1:1 across all notes, all notes separated by 2 whole notes). Pitch contour: pattern of rising and falling pitches in a group of notes. In example below pitch contour is always, 1<2<3. Note in distortion 3 (rightmost example), pitch contour is preserved but absolute and relative intervals have been distorted. Results: Most could still indentify melody in distortion one (relative intervals and pitch contour present) and distortion 3 (only pitch contour present). When none present most could not identify melody.

Absolute (“perfect”) pitch Ability to correctly identify any note played. Ability seems to be more present in younger aged kids then tends to diminish. One hypo is that it might be detrimental to language development. Language perception requires ignoring “absolute” tonal qualities for relative or contextual ones.

Brain areas associated with music perception Areas both anterior and posterior to PAC important for music perception. RH anterior superior temporal sensitive to pitch variation and pitch chroma (similarity between same pitches at different octaves – middle vs. high C). Superior posterior temporal more sensitive to pitch height (difference between high vs. middle C). Left anterior temporal: especially sensitive to rhythmic qualities of melody

Factors affecting emotional quality of music Increasing and decreasing tempo and intensity tend to have greatest effects on emotional content. Cross-cultural constancy