SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?

Slides:



Advertisements
Similar presentations
Tom Lentz (slides Ivana Brasileiro)
Advertisements

Chapter 12: Speech and Music Perception
Sounds that “move” Diphthongs, glides and liquids.
SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.
Acoustic Characteristics of Consonants
Speech Perception Dynamics of Speech
Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)
Coarticulation Analysis of Dysarthric Speech Xiaochuan Niu, advised by Jan van Santen.
Chapter 12 Speech Perception. Animals use sound to communicate in many ways Bird calls Bird calls Whale calls Whale calls Baboons shrieks Baboons shrieks.
The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
Language Comprehension Speech Perception Semantic Processing & Naming Deficits.
Cognition, 8e by Margaret W. MatlinChapter 2 Cognition, 8e Chapter 2 Perceptual Processes I: Visual and Auditory Recognition.
The Neuroscience of Language. What is language? What is it for? Rapid efficient communication – (as such, other kinds of communication might be called.
Speech perception 2 Perceptual organization of speech.
The Perception of Speech. Speech is for rapid communication Speech is composed of units of sound called phonemes –examples of phonemes: /ba/ in bat, /pa/
PHONETICS AND PHONOLOGY
Speech Perception Overview of Questions Can computers perceive speech as well as humans? Does each word that we hear have a unique pattern associated.
Introduction to Acoustics Words contain sequences of sounds Each sound (phone) is produced by sending signals from the brain to the vocal articulators.
Structure of Human Speech Chris Darwin Vocal Tract.
SPEECH PSYC 330: PERCEPTION. SOME BASICS Methods of Manipulation PHONATION (air pushed across vocal cords) Airflow Mass and “tuning” of cords Harmonics.
Speech perception Relating features of hearing to the perception of speech.
Exam 1 Monday, Tuesday, Wednesday next week WebCT testing centre Covers everything up to and including hearing (i.e. this lecture)
DESCRIBING THE TWENTY-FOUR CONSONANT SOUNDS
Cognitive Processes PSY 334 Chapter 2 – Perception April 9, 2003.
PSY 369: Psycholinguistics
PSY 369: Psycholinguistics Language Comprehension: Introduction & Perception of language.
Introduction to Speech Production Lecture 1. Phonetics and Phonology Phonetics: The physical manifestation of language in sound waves. –How sounds are.
What is Phonetics? Short answer: The study of speech sounds in all their aspects. Phonetics is about describing speech. (Note: phonetics ¹ phonics) Phonetic.
Language Comprehension Speech Perception Naming Deficits.
The Perception of Speech
Cognitive Processes PSY 334 Chapter 2 – Perception.
Chapter 13: Speech Perception
Speech Perception. Phoneme - a basic unit of a speech sound that distinguishes one word from another Phonemes do not have meaning on their own but they.
CSD 5400 REHABILITATION PROCEDURES FOR THE HARD OF HEARING Auditory Perception of Speech and the Consequences of Hearing Loss.
Phonetics: the generation of speech Phonemes “The shortest segment of speech that, if changed, would change the meaning of a word.” hog fog log *Phonemes.
Speech Perception 4/6/00 Acoustic-Perceptual Invariance in Speech Perceptual Constancy or Perceptual Invariance: –Perpetual constancy is necessary, however,
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Speech Perception1 Fricatives and Affricates We will be looking at acoustic cues in terms of … –Manner –Place –voicing.
PERCEPTION AND PATTERN RECOGNITION Making sense of sensation –Local vs. Global scope –Data-driven (sensory, bottom-up) vs. Concept-driven (knowledge, “top-down”)
Speech Or can you hear me now?. Linguistic Parts of Speech Phone Phone Basic unit of speech sound Basic unit of speech sound Phoneme Phoneme Phone to.
CSD 2230 HUMAN COMMUNICATION DISORDERS Topic 6 Language Disorders Adult Disorders Aphasia and Right Hemisphere Injury.
Glides, Place and Perception March 18, 2010 News The hard drive on the computer has been fixed! A couple of new readings have been posted to the course.
SPEECH PERCEPTION DAY 16 – OCT 2, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Sensation & Perception
Phonetic Context Effects Major Theories of Speech Perception Motor Theory: Specialized module (later version) represents speech sounds in terms of intended.
Sounds and speech perception Productivity of language Speech sounds Speech perception Integration of information.
Stops Stops include / p, b, t, d, k, g/ (and glottal stop)
CSD 2230 INTRODUCTION TO HUMAN COMMUNICATION DISORDERS Normal Sound Perception, Speech Perception, and Auditory Characteristics at the Boundaries of the.
Chapter II phonology II. Classification of English speech sounds Vowels and Consonants The basic difference between these two classes is that in the production.
Chapter 13: Speech Perception. The Acoustic Signal Produced by air that is pushed up from the lungs through the vocal cords and into the vocal tract Vowels.
Phonetics Definition Speech Organs Consonants vs. Vowels
Fundamentals of Sensation and Perception SPEECH & MUSIC ERIK CHEVRIER NOVEMBER 3RD, 2015.
CSE 551/651: Structure of Spoken Language Lecture 13: Theories of Human Speech Perception; Formant Based Speech Synthesis; Automatic Speech Recognition.
Language I: Structure Defining language: symbolic, rule-based system of communication shared by a community Linguistics: study of language Psycholinguistics:
Speech Perception.
Language Perception.
WebCT You will find a link to WebCT under the “Current Students” heading on It is your responsibility to know how to work WebCT!
THE SOUNDS OF LANGUAGE the study of inventory and structure of the sounds of language.  Human can produce any number of sounds including those we never.
Transitions + Perception March 25, 2010 Tidbits Mystery spectrogram #3 is now up and ready for review! Final project ideas.
AUDITORY CORTEX 1 SEPT 11, 2015 – DAY 8 Brain & Language LING NSCI Fall 2015.
Speech Perception Chris Plack
PHONETICS AND PHONOLOGY
Phonetics Unit 1.
Linguistics: Phonetics
Cognitive Processes PSY 334
Speech Perception.
DESCRIBING THE TWENTY-FOUR CONSONANTS
Speech Perception (acoustic cues)
Fundamentals of Sensation and Perception
Topic: Language perception
Presentation transcript:

SPEECH PERCEPTION The Speech Stimulus Perceiving Phonemes Top-Down Processing Is Speech Special?

The Speech Stimulus Spoken words are composed of phonemes phoneme: smallest unit of speech that affects the meaning of a word

The Speech Stimulus: Articulation vocal tract open or closed: vowels are produced with the vocal tract open voicing: vibrating of vocal cords place of articulation: point at which airstream is blocked manner of articulation: degree to which airstream is blocked

Analyzing The Speech Stimulus sound spectrogram - graph showing intensities of various frequencies over time formants - bands of high intensity frequencies in vowel sounds formant transitions - shifts preceding or following formants; carry information about consonants

Perceiving Phonemes variability problem: acoustic properties of phonemes change depending on – context (coarticulation) – speech rate – speaker – loudness

Perceiving Phonemes segmentation problem: there is often no clear separation between one phoneme and another

Perceiving Phonemes categorical perception: phonemes are perceived as categories; many different sounds can be perceived as within the same phonemic category

Top-Down Processing of Speech phonemic restoration effect: listeners perceive a phoneme even when it is deleted and replaced by noise demonstrates effect of context on speech perception

Top-Down Processing of Speech McGurk Effect: phoneme perception is affected by visual cues about lip movements demonstrates effect of visual information on speech perception

Top-Down Processing of Speech The problems for speech perception are general perceptual problems, such as constancy Similar top-down processing strategies might be used (e.g., Gestalt heuristics)

Top-Down Processing of Speech indexical characteristics - characteristics of a person’s voice that carry information about – Age – Gender – Emotion – Region – Intent

Is Speech Special? According to the “Speech is Special” hypothesis, we have a speech module: specialized abilities for perceiving speech Motor theory: the speech module contains knowledge of how phonemes are produced; we use this knowledge for speech perception

Is Speech Special? Left hemisphere specialized for language – Broca’s area - damage causes Broca’s Aphasia – Wernicke’s area - damage causes Wernicke’s aphasia Categorical perception of phonemes

Is Speech Special? Although locations in the left hemisphere are important for speech, specific brain areas are important for other perceptual abilities as well Categorical perception of phonemes does not require a speech module because: – Infants show categorical perception of phonemes – Quail and chinchillas also show it – Non-speech sounds can be perceived categorically