Conclusions  Constriction Type does influence AV speech perception when it is visibly distinct Constriction is more effective than Articulator in this.

Slides:

Advertisements

Similar presentations

Place of Articulation, continued

Advertisements

Normal Aspects of Articulation. Definitions Phonetics Phonology Articulatory phonetics Acoustic phonetics Speech perception Phonemic transcription Phonetic.

Sounds that “move” Diphthongs, glides and liquids.

SPPA 403 Speech Science1 Unit 3 outline The Vocal Tract (VT) Source-Filter Theory of Speech Production Capturing Speech Dynamics The Vowels The Diphthongs.

Plasticity, exemplars, and the perceptual equivalence of ‘defective’ and non-defective /r/ realisations Rachael-Anne Knight & Mark J. Jones.

Glides (/w/, /j/) & Liquids (/l/, /r/) Degree of Constriction Greater than vowels – P oral slightly greater than P atmos Less than fricatives – P oral.

Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)

Hello, Everyone! Review questions  Give examples to show the following features that make human language different from animal communication system:

Phonetic variability of the Greek rhotic sound Mary Baltazani University of Ioannina, Greece  Rhotics exhibit considerable phonetic variety cross-linguistically.

Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.

Speech Science XII Speech Perception (acoustic cues) Version

“Speech and the Hearing-Impaired Child: Theory and Practice” Ch. 13 Vowels and Diphthongs –Vowels are formed when sound produced at the glottal source.

Digital Systems: Hardware Organization and Design

Narrow phonetic transcription

Place of Articulation January 29, 2014 The Agenda Due at 5 pm tonight: backwards name exercise! For Friday, there will be a transcription exercise on.

Part Two Distinctive features and Natural classes Phonology: The study of the sound system - i.e. how sounds relate to and interact with each other in.

Phonetics (Part 1) Dr. Ansa Hameed.

Profile of Phoneme Auditory Perception Ability in Children with Hearing Impairment and Phonological Disorders By Manal Mohamed El-Banna (MD) Unit of Phoniatrics,

Optical Phonetics and Visual Perception of Lexical and Phrasal Stress in English Patricia Keating, Marco Baroni, Sven Mattys, Rebecca Scarborough, Abeer.

Chapter 6 Features PHONOLOGY (Lane 335).

PSY 369: Psycholinguistics

Recap: Vowels & Consonants V – central “sound” of the syllable C – outer “shell” of the syllable (C) V (C) (C)(C)(C)V(C)(C)(C)

The auditory and the visual percept evoked by the same audiovisual stimuli Hartmut Traunmüller Niklas Öhrström Dept. of Linguistics, University of Stockholm.

Phonetics III: Dimensions of Articulation October 15, 2012.

Phonetics = sounds of language

Linguistics I Chapter 4 The Sounds of Language.

Phonetics HSSP Week 5.

PHONETICS & PHONOLOGY COURSE WINTER TERM 2014/2015.

Phonetics and Phonology

Chapter 2 Speech Sounds Phonetics and Phonology

An Introduction to Linguistics

SPEECH ORGANS & ARTICULATION

Speech Science Fall 2009 Oct 28, Outline Acoustical characteristics of Nasal Speech Sounds Stop Consonants Fricatives Affricates.

5aSC5. The Correlation between Perceiving and Producing English Obstruents across Korean Learners Kenneth de Jong & Yen-chen Hao Department of Linguistics.

Phonetics: Dimensions of Articulation October 13, 2010.

Phonetics 2. Phonology 2.1 The phonic medium of language Sounds which are meaningful in human communication constitute the phonic medium of language.

From subtle to gross variation: an Ultrasound Tongue Imaging study of Dutch and Scottish English /r/ James M Scobbie Koen Sebregts Jane Stuart-Smith.

Sensation & Perception

Phonetic Context Effects Major Theories of Speech Perception Motor Theory: Specialized module (later version) represents speech sounds in terms of intended.

Sounds and speech perception Productivity of language Speech sounds Speech perception Integration of information.

Chapter II phonology II. Classification of English speech sounds Vowels and Consonants The basic difference between these two classes is that in the production.

Introduction to Language Phonetics 1. Explore the relationship between sound and spelling Become familiar with International Phonetic Alphabet (IPA )

Tongue movement kinematics in speech: Task specific control of movement speed Anders Löfqvist Haskins Laboratories New Haven, CT.

ACE TESOL Diploma Program – London Language Institute OBJECTIVES You will understand: 1. How each of the phonemes in English is articulated 2. The differences.

Stop Acoustics and Glides December 2, 2013 Where Do We Go From Here? The Final Exam has been scheduled! Wednesday, December 18 th 8-10 am (!) Kinesiology.

Language Perception.

Stop + Approximant Acoustics

Motor Theory + Signal Detection Theory

Phonetics Overview/review Transcription Describing Phones Drills Overview/review Transcription Describing Phones Drills.

Ch4 – Features Features are partly acoustic partly articulatory aspects of sounds but they are used for phonology so sometimes they are created to distinguish.

Speech Production “Problems” Key problems that science must address How is speech coded? How is speech coded? What is the size of the “basic units” of.

Acoustic Phonetics 3/14/00.

Motor Theory of Perception March 29, 2012 Tidbits First: Guidelines for the final project report So far, I have two people who want to present their.

Stop Acoustics + Glides December 2, 2015 Down The Stretch They Come Today: Stop and Glide Acoustics Friday: Sonorant Acoustics + USRI evaluations We’ll.

Gestural Timing and Magnitude of English /r/: An Ultrasound-OptoTrak Study Fiona Campbell, Bryan Gick, Ian Wilson, and Eric Vatikiotis-Bateson Ultrafest.

Phonological Features And Natural Classes. So, remember features?  Remember how it used to be so simple?  Three little descriptors…  Place  Manner.

Speechreading Based on Tye-Murray (1998) pp

An Articulatory Analysis of Phonological Transfer Using Real-Time MRI Joseph Tepperman, Erik Bresch, Yoon-Chul Kim, Sungbok Lee, Louis Goldstein, and Shrikanth.

Vowels and Consonant Serikova Aigerim.

Université du Québec à Montréal

Overview/review Transcription Describing Consonants

Spoken language phonetics: Transcription, articulation, consonants

Patricia Keating, Marco Baroni, Sven Mattys, Rebecca Scarborough,

Phonetics: The Sounds of Language

Speech Perception (acoustic cues)

Review for Test 2.

A Japanese trilogy: Segment duration, articulatory kinematics, and interarticulator programming Anders Löfqvist Haskins Laboratories New Haven, CT.

PHONETICS AND PHONOLOGY

Presentation transcript:

Conclusions  Constriction Type does influence AV speech perception when it is visibly distinct Constriction is more effective than Articulator in this stimulus context critical constriction degree (fricatives) shows the strongest visual influence  Active Articulator had little visual effect labials did not have greater effect than linguals However, passive articulator differences may account for the strong /v/-/D/ effects  Articulatory Phonology implications for AV speech perception/production research gestural parameters may offer better (or additional) guidance than phonetic features Précis In audio-visual (AV) speech perception the two modalities convey largely complementary information (V: Place, A: Manner). But place can be low visibility, and manner visible. Articulatory Phonology and ecological/direct realist views imply that examining visible vs. audible gestural structure may offer novel insights.Perceptual effects of active articulator vs. constriction degree were examined in a McGurk task using anterior consonants that differ visibly on both dimensions. Visual impact was greatest for incongruent A-V signals that used different articulators but same constriction type, stronger for fricatives than stops/glides, yet failed to yield an articulator effect. Thus, constriction affects AV perception, more so than active articulator, in identification of visually distinct anterior consonants. Background Audio-visual (AV) speech perception shows modality-specific contributions (MacDonald & McGurk, 1978; VPAM : Summerfield, 1987):  Audio provides primarily manner information  Visual provides place of articulation information Yet, some qualifications re: those assumptions:  place and manner imperfectly related to visibility: place (POA) visibility varies labials vs. non-labials also some visibility for some coronals face dynamics re: other POA info (below) manner also varies: stops - fricatives - glides unclear how narrowly to define POA, e.g. /b v/ SAME: labial ( broad transcripttion) DIFFERENT: labiodental vs. bilabial (narrow transcription)  dynamic visual speech information is distributed across the talking face/head (Yehia et al., 1998) correlates with tongue as well as lip and jaw movements this info can guide intelligible audio synthesis Articulatory Phonology (Browman & Goldstein, 1992, 2000) suggests an alternative: A-V perception re: articulatory gestures (cf Fowler & Dekle, 1991)  Active articulator: lower lip vs. tongue tip/blade  Constriction degree: closed - critical - narrow Results: Experiment 1 Ê Gestural Incongruity Type main effect, p <.0001  Visual influence was strongest when A and V tokens differed in Articulator but shared the same Constriction degree Ë Gestural Incongruity x Articulator, p =.0084  The preceding effect was more pronounced when the video token used lips than tongue tip Results cont’d: Experiment 1 ÊConstriction Type main effect, p =.0001  Visual influence on perception was greater for fricatives than stops Ì Gestural Incongruity x Constriction, p <.0001  /v/-/D/ pairs showed the strongest visual effect, followed by video stop paired with opposite- articulator fricative Í Articulator x Constriction, p <.017  Both fricatives had strong visual effects, but labial stop > lingual stop Experiment 2 ÊGestural Incongruity Type main effect, p <.0001  Replicated that of Experiment 1 Î Constriction Type main effect, p =.0001  Again, fricatives had a larger visual effect than stops; in Exp. 2 they also superceded glides Results cont’d: Experiment 2 Ï Gestural Incongruity x Articulator, p <.053  marginal: largest visual effects for /v/-/D/; /b/-/d/ pairs and video fricative + audio stop/glide yielded next largest visual effect Ð Gestural Incongruity x Constriction, p <.0001  Replication/extension of Exp. 1 interaction effect. /v/-/D/ showed strongest effect by far. Video glides with opposite-articulator stop/fricative was next-strongest. AVSP’05 Influences of Visible Place Versus Manner Distinctions on Perception of Audio-Visual English CV Syllables Catherine T. Best & Daniel Lazarek Research Question: How do visible distinctions in active articulator and constriction degree contribute to AV speech perception? Method Stimuli anterior Cs (USA English) that differ visibly re: u Active Articulator lower lip tongue tip/blade u Constriction: closed (stop) critical (fricative) narrow (glide) (included only in Exp. 2) Subjects English (USA) : Exp 1 (n =14), Exp 2 (n =12) Task report C heard: AV-congruent & AV-incongruent Data Visual Speech Index (VSI), calculated on proportion correct audio identifications VSI = [AVcongruent - AVincongruent]