Yao LSA 2010-1-7 Separating speaker- and listener- oriented forces in speech – Evidence from phonological neighborhood density.

Slides:



Advertisements
Similar presentations
Accessing spoken words: the importance of word onsets
Advertisements

Turning an L1 three-way contrast into an L2 two-way contrast Paola Escudero University of Utrecht and McGill University Paul Boersma University of Amsterdam.
Tone perception and production by Cantonese-speaking and English- speaking L2 learners of Mandarin Chinese Yen-Chen Hao Indiana University.
Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)
Coarticulation Analysis of Dysarthric Speech Xiaochuan Niu, advised by Jan van Santen.
The perception of dialect Julia Fischer-Weppler HS Speaker Characteristics Venice International University
18 and 24-month-olds use syntactic knowledge of functional categories for determining meaning and reference Yarden Kedar Marianella Casasola Barbara Lust.
Language and Cognition Colombo, June 2011 Day 8 Aphasia: disorders of comprehension.
Language Comprehension Speech Perception Semantic Processing & Naming Deficits.
Phonological Priming in Spontaneous Speech Production Katrina Housel H uman L anguage P rocessing L ab.
Speech and speaker normalization (in vowel normalization)
Evidence of a Production Basis for Front/Back Vowel Harmony Jennifer Cole, Gary Dell, Alina Khasanova University of Illinois at Urbana-Champaign Is there.
AN ACOUSTIC PROFILE OF SPEECH EFFICIENCY R.J.J.H. van Son, Barbertje M. Streefkerk, and Louis C.W. Pols Institute of Phonetic Sciences / ACLC University.
Experiment 2: MEG Study Materials and Methods: 11 right-handed subjects with 20:20 vision were run. 3 subjects’ data was discarded because of poor performance.
Analysis II: Bayesian Analysis of Individual Data Bayesian analysis allows for principled 'null' results. 1) Transform the correlation coefficients to.
Phonetic Similarity Effects in Masked Priming Marja-Liisa Mailend 1, Edwin Maas 1, & Kenneth I. Forster 2 1 Department of Speech, Language, and Hearing.
Development of coarticulatory patterns in spontaneous speech Melinda Fricke Keith Johnson University of California, Berkeley.
Profile of Phoneme Auditory Perception Ability in Children with Hearing Impairment and Phonological Disorders By Manal Mohamed El-Banna (MD) Unit of Phoniatrics,
Psycholinguistic methodology Psycholinguistics: Questions and methods.
TEMPLATE DESIGN © Listener’s variation in phoneme category boundary as a source of sound change: a case of /u/-fronting.
Recognition of Voice Onset Time for Use in Detecting Pronunciation Variation ● Project Description ● What is Voice Onset Time (VOT)? – Physical Realization.
To learn or not to learn: The growing paths of children’s phonological neighborhoods Yao LSA Annual Meeting 2009.
Distributional Cues to Word Boundaries: Context Is Important Sharon Goldwater Stanford University Tom Griffiths UC Berkeley Mark Johnson Microsoft Research/
High Frequency Word Entrainment in Spoken Dialogue ACL, June Columbus, OH Department of Computer and Information Science University of Pennsylvania.
Sound and Speech. The vocal tract Figures from Graddol et al.
Morphological information and acoustic salience in Dutch compounds Victor Kuperman, IWTS Radboud University Nijmegen.
Language Comprehension Speech Perception Naming Deficits.
-- A corpus study using logistic regression Yao 1 Vowel alternation in the pronunciation of THE in American English.
Phonetics Linguistics for ELT B Ed TESL 2005 Cohort 2.
Acoustic and Linguistic Characterization of Spontaneous Speech Masanobu Nakamura, Koji Iwano, and Sadaoki Furui Department of Computer Science Tokyo Institute.
Introduction To know how perceptual and attentional processes and properties of words guide the eyes through a sentence, the following issues are particularly.
Present Experiment Introduction Coarticulatory Timing and Lexical Effects on Vowel Nasalization in English: an Aerodynamic Study Jason Bishop University.
SPOKEN LANGUAGE COMPREHENSION Anne Cutler Addendum: How to study issues in spoken language comprehension.
Sebastián-Gallés, N. & Bosch, L. (2009) Developmental shift in the discrimination of vowel contrasts in bilingual infants: is the distributional account.
Auditory cortical monitoring prevents speech errors before they happen Caroline A. Niziolek UCSF Depts. of Radiology and Otolaryngology – Head and Neck.
Speech Perception 4/6/00 Acoustic-Perceptual Invariance in Speech Perceptual Constancy or Perceptual Invariance: –Perpetual constancy is necessary, however,
Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS and NSF BCS to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented.
1 Introducing The Buckeye Speech Corpus Kyuchul Yoon English Division, Kyungnam University March 21, 2008 School of English,
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Jiwon Hwang Department of Linguistics, Stony Brook University Factors inducing cross-linguistic perception of illusory vowels BACKGROUND.
Speech Perception 4/4/00.
Results Tone study: Accuracy and error rates (percentage lower than 10% is omitted) Consonant study: Accuracy and error rates 3aSCb5. The categorical nature.
Epenthetic vowels in Japanese: a perceptual illusion? Emmanual Dupoux, et al (1999) By Carl O’Toole.
YAO UC BERKELEY JULY 25, 2008 An Exemplar-based Approach to Automatic Burst Detection in Voiceless.
The long-term retention of fine- grained phonetic details: evidence from a second language voice identification training task Steve Winters CAA Presentation.
1 Cross-language evidence for three factors in speech perception Sandra Anacleto uOttawa.
The Edinburgh Disfluency Group Researching disfluency from a psycholinguistic perspective: Language.
Phonological Priming and Lexical Access in Spoken Word Recognition Christine P. Malone Minnesota State University Moorhead.
Exemplar Theory, part 2 April 15, 2013.
0 / 27 John-Paul Hosom 1 Alexander Kain Brian O. Bush Towards the Recovery of Targets from Coarticulated Speech for Automatic Speech Recognition Center.
1 Applying Principles To Reading Presented By Anne Davidson Michelle Diamond.
ASSESSING SEARCH TERM STRENGTH IN SPOKEN TERM DETECTION Amir Harati and Joseph Picone Institute for Signal and Information Processing, Temple University.
Welcome to All S. Course Code: EL 120 Course Name English Phonetics and Linguistics Lecture 1 Introducing the Course (p.2-8) Unit 1: Introducing Phonetics.
Introduction Method Experiment 2 In spoken word recognition, phonological and indexical properties (i.e., characteristics of the speaker’s voice) of a.
Of Words, Birds, Worms, and Weeds: Infant Word Learning and Lexical Neighborhoods.
VISUAL WORD RECOGNITION. What is Word Recognition? Features, letters & word interactions Interactive Activation Model Lexical and Sublexical Approach.
LISTENING: QUESTIONS OF LEVEL FRANCISCO FUENTES NICOLAS VALENZUELA.
The 157th Meeting of Acoustical Society of America in Portland, Oregon, May 21, pSW35. Confusion Direction Differences in Second Language Production.
Precedence-based speech segregation in a virtual auditory environment
Cognitive Processes in SLL and Bilinguals:
Phonological Priming and Lexical Access in Spoken Word Recognition
Nonsense Syllable Confusions in Children with Reading Disabilities
Effect of Word Frequency on Tonal Variation Yuan Zhao, Dan Jurafsky Stanford University ABSTRACT We show that lexical frequency is an important source.
Verb Activation through Priming at the Syntax-Semantics Interface
Abstraction versus exemplars
Understanding Variation of VOT in spontaneous speech
Vannesa Mueller, Ph.D., CCC-SLP Speech-Language Pathology Program
عمادة التعلم الإلكتروني والتعليم عن بعد
Phonological Priming and Lexical Access in Spoken Word Recognition
How acoustic distinctiveness affects spoken word recognition:
Presentation transcript:

Yao LSA Separating speaker- and listener- oriented forces in speech – Evidence from phonological neighborhood density

phonetic variation Introduction | Methodology | Linear mixed-effects model | Discussion Widely exists in spontaneous speech – Duration – Segmental realization – Pitch Why? 2

explaining variation Listener-oriented Response to different models of listener’s needs Result of ease or difficulty of comprehension (modeled by the speaker) Examples –F–Foreigner- and child-directed speech –S–Speech under noise –S–Shortening and reduction in High-frequency or high- predictability forms Talker-oriented Result of ease or difficulty of production Examples –S–Shortening and reduction in High-frequency or high- predictability forms “articulatory routinization” (Bybee, 2001) Many word properties have the same predictions for comprehension and production… Introduction | Methodology | Linear mixed-effects model | Discussion 3

general research question – Is it possible to tease apart talker- and listener- oriented forces in variation at the word level? Any word property with different predictions for comprehension and production? Yes! Introduction | Methodology | Linear mixed-effects model | Discussion 4

phonological neighborhood density High-density words are hard for perception but easy for production (Dell & Gordon, 2003) Introduction | Methodology | Linear mixed-effects model | Discussion 5

phonological neighborhood Concept – Similar-sounding words are connected to each other and form phonological neighborhoods – Neighborhood density: number of phonological neighbors each word has One-phoneme difference rule (Luce & Pisoni 1998, etc) Introduction | Methodology | Linear mixed-effects model | Discussion Additional factors: neighborhood freq. fat fad fightkite cap add cat coat 6

phonological neighbors and word perception Inhibition – Similar-sounding primes inhibit auditory word recognition (Goldinger & Pisoni 1989) – Slower (and less accurate) responses for words from dense neighborhoods in perceptual tasks (Luce & Pisoni 1998) Perceptual identification, lexical decision and word naming tasks Introduction | Methodology | Linear mixed-effects model | Discussion 7

Facilitation – Words from dense neighborhoods induce fewer speech errors and have shorter latency times in picture naming tasks (Vitevitch 2002) Introduction | Methodology | Linear mixed-effects model | Discussion phonological neighbors and word production 8

phonological neighbors and phonetic variation Phonological neighbors – Both compete with and bring more activation to the target word – Either impede or facilitate the processing of the target word How does neighborhood density tease apart the two accounts of variation? Introduction | Methodology | Linear mixed-effects model | Discussion perception production 9

predictions Talker-oriented – High-density words are easy to produce  shortening and reduction Listener-oriented – High-density words are hard to perceive  lengthening and vowel dispersion High-density words have more expanded vowel space (Wright 1997, Munson & Solomon 2004) and more nasalized vowels (Scarborough 2004) Introduction | Methodology | Linear mixed-effects model | Discussion 10

keywords of current study Spontaneous speech Aspects of production –W–Word duration –V–Vowel production High-density words are shorter  talker- oriented Introduction | Methodology | Linear mixed-effects model | Discussion 11

data Buckeye corpus (Pitt et al 2007) 40 speakers, ~300,000 words Target words – CVC – Monomorphemic – Content words 414 word types / 13,858 tokens Introduction | Methodology | Linear mixed-effects model | Discussion 12

neighborhood measures Two separate variables (from Hoosier Mental Lexicon; Nusbaum et al, 1984) – Neighborhood density (i.e. # of neighbors) Using the 1-phoneme difference rule – Average neighbor frequency Introduction | Methodology | Linear mixed-effects model | Discussion 13

coding variables Outcome variable – Word token duration Control variables – Baseline duration – Speaker characteristics sex, age – Other lexical properties word freq, length (in letters), familiarity, imageability, POS, phonotactic probability – Contextual factors pre/fw predictability, pre/fw speech rate, disfluency, pre mentions Introduction | Methodology | Linear mixed-effects model | Discussion 14

linear mixed-effects model Fixed effects – All predictors Neighborhood measures Control variables Random effects – Speaker – Word Introduction | Methodology | Linear mixed-effects model | Discussion 15

modeling results Neighborhood density – A significant negative effect – More neighbors  shorter duration – Facilitation Neighbor frequency – Insignificant Introduction | Methodology | Linear mixed-effects model | Discussion 16

partial effect of neighborhood density Introduction | Methodology | Linear mixed-effects model | Discussion Effect confirmed by model evaluation. 17

confounding factor? Phonotactic probability – The frequency with which a phonological segment, […] and a sequence of phonological segments, […] occur in a given position in a word (Jusczyk et al, 1994) – Correlated with neighborhood density (r = 0.46) – Phonotactic probability is never significant in the model, with or without neighborhood measures The facilitative effect is at the lexical level, not the sublexical level Introduction | Methodology | Linear mixed-effects model | Discussion 18

implications Evidence for talker-oriented account – Talker-oriented: High-density words are easy to produce  shortening and reduction – Listener-oriented: High density words are hard to perceive  lengthening and vowel dispersion Fast lexical access? Ease of articulation? Not really… Probably… 19 Introduction | Methodology | Linear mixed-effects model | Discussion Synchrony between planning and articulation (Bell et al, 2009)

looking back… Conflict with previous experimental results? – Wright (1997) and Munson & Solomon (2004): Vowel dispersion in high-density words – Shorter but more expanded vowels? – Differences in the type of speech? – Maybe it’s not density, but neighbor frequency… Preliminary results in the current dataset: NO effect of density, but words with high-frequency neighbors have more expanded vowel space Previous results can also be explained by neighbor frequency Introduction | Methodology | Linear mixed-effects model | Discussion 20

conclusion Facilitative effect of neighorhood density on word duration Unambiguous evidence for the talker-oriented account of phonetic variation Ongoing work: effect of phonological neighborhoods on vowel production Introduction | Methodology | Linear mixed-effects model | Discussion 21

The end… Introduction | Methodology | Linear mixed-effects model | Discussion 22

selected references Dell & Gordon(2003). Neighbors in the lexicon: Friends or foes? In N.O. Schiller and A.S. Meyer (eds.), Phonetics and phonology in language comprehension and production: Differences and similarities. New York: Mouton. Luce & Pisoni (1998) Recognizing spoken words: the Neighborhood Activation Model. Ear & Hearing, 19, Munson & Solomon (2004) The effect of phonological neighborhood on vowel articulation. JSLHR, 47, Pitt et al (2007Buckeye Corpus of Conversational Speech (2nd release) [ Columbus, OH: Department of Psychology, Ohio State University (Distributor). Scarborough (2004). Lexical confusability and degree of coarticulation. Proceedings of the 29th Annual Meeting of the Berkeley Linguistics Society. Vitevitch (2002) The influence of phonological similarity neighborhoods on speech production. J. of Experimental Psychology: Learning, Memory and Cognition, 28, Wright (1997) Lexical competition and reduction in speech: A preliminary report.. Research on Spoken Language Processing Progress Report. 21, Indiana University 23

Thanks to… Prof. Susanne Gahl and Prof. Keith Johnson for helpful discussion Anonymous subjects in Buckeye Buckeye corpus developers 24

Perception & Production fat fad fightkite cap add cat coat ProductionPerception Dell & Gordon (2003) 25 Introduction | Methodology | Linear mixed-effects model | Discussion

model evaluation Confirms the robustness of the results – Testing t-values – Model comparison – Cross-validation Introduction | Methodology | Linear mixed-effects model | Discussion 26

Individual differences Introduction | Methodology | Linear mixed-effects model | Discussion 27 Having one more neighbor decreases duration by 0.4%

Distribution of neighborhood density and neighbor frequency Introduction | Methodology | Linear mixed-effects model | Discussion 28