Using disfluency to understand, um, sentences... with PP-attachment ambiguities Jennifer E. Arnold and Kellen Carpenter, UNC Chapel Hill Background 1)

Slides:



Advertisements
Similar presentations
Prosody and Verb Placement Research question: Do Explicit Prosody and Verb Placement modulate listeners PP-attachment preferences in the processing of.
Advertisements

Chapter 9 - Fluency Assessment
4. Prediction The FT/FA (Schwartz & Sprouse 1996) suggest that the initial state for L2 acquisition is the end state L1 grammar, and all L1 properties.
“Effect of Genre, Speaker, and Word Class on the Realization of Given and New Information” Julia Agustín Gravano & Julia Hirschberg {agus,
Function words are often reduced or even deleted in casual conversation (Fig. 1). Pairs may neutralize: he’s/he was, we’re/we were What sources of information.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 6: EFFECTS OF DISFLUENCY ON REFERENCE COMPREHENSION.
TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: BRANIGAN ET AL.: PRIMING.
The Interaction of Lexical and Syntactic Ambiguity by Maryellen C. MacDonald presented by Joshua Johanson.
Prosody Modeling (in Speech) by Julia Hirschberg Presented by Elaine Chew QMUL: ELE021/ELED021/ELEM March 2012.
Sentence Processing 1: Encapsulation 4/7/04 BCS 261.
Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Phonological Priming in Spontaneous Speech Production Katrina Housel H uman L anguage P rocessing L ab.
Watching the eyes when talking about size: An investigation of message formulation and utterance planning Sarah Brown-Schmidt, Michael K. Tanenhaus Presentation.
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Results ISI Variance in STP Corpus ISI Variance in BU Corpus * p
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
Speakers Reduce Because of Their Own Internal Representations Jason Kahn Jennifer Arnold UNC – Chapel Hill.
Towards a model of speech production: Cognitive modeling and computational applications Michelle L. Gregory SNeRG 2003.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Dianne Bradley & Eva Fern á ndez Graduate Center & Queens College CUNY Eliciting and Documenting Default Prosody ABRALIN23-FEB-05.
Language, Mind, and Brain by Ewa Dabrowska Chapter 2: Language processing: speed and flexibility.
Eva Fernández & Dianne Bradley Queens College & Graduate Center CUNY in collaboration with José Manuel Igoa & Celia Teira Universidad Autónoma de Madrid.
Dianne Bradley, Eva Fernández & Dianne Taylor Graduate Center & Queens College CUNY 16th Annual CUNY Conference on Human Sentence.
Interactions between Language and Stuttering NU/SFA Workshop for Fluency Specialists July, 1996 J. Scott Yaruss, Ph.D., CCC-SLP University of Pittsburgh.
Prosody and NLP Seminar by Nikhil: Adith: Prachur: 06D05011 We have a presentation this Friday ?
14: THE TEACHING OF GRAMMAR  Should grammar be taught?  When? How? Why?  Grammar teaching: Any strategies conducted in order to help learners understand,
Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS and NSF BCS to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented.
Ferreira and Henderson (1990)
Comprehension of Grammatical and Emotional Prosody is Impaired in Alzheimer’s Disease Vanessa Taler, Shari Baum, Howard Chertkow, Daniel Saumier and Reported.
Acoustic Properties of Taiwanese High School Students ’ Stress in English Intonation Advisor: Dr. Raung-Fu Chung Student: Hong-Yao Chen.
10/13/10Psyc / Ling / Comm 525 Fall 10 Kim & Osterhout (2005) JML The independence of combinatory semantic processing: Evidence from event-related potentials.
Breathing and speech planning in turn-taking Francisco Torreira Sara Bögels Stephen Levinson Max Planck Institute for Psycholinguistics Nijmegen, The Netherlands.
Avoiding the Garden Path: Eye Movements in Context
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Results of Eyetracking & Self-Paced Moving Window Studies DO-Bias Verbs: The referees warned the spectators would probably get too rowdy. The referees.
How Speakers' Eye Movements Reflect Spoken Language Generation Zenzi M. Griffin Department of Psychology Intro to Cognitive Science University of Texas.
Dec 11, Human Parsing Do people use probabilities for parsing?! Sentence processing Study of Human Parsing.
Parafoveal Preview in Reading Burgess (1991) - Self-paced moving window reading time study - Varied window size from single to several words - Found an.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
Suprasegmental Properties of Speech Robert A. Prosek, Ph.D. CSD 301 Robert A. Prosek, Ph.D. CSD 301.
Intersensory Redundancy Facilitates Infants’ Perception of Meaning in Speech Passages Irina Castellanos, Melissa Shuman, and Lorraine E. Bahrick Florida.
Acoustic Cues to Emotional Speech Julia Hirschberg (joint work with Jennifer Venditti and Jackson Liscombe) Columbia University 26 June 2003.
48 Item Sets (Only the results for the relative clause versions are reported here.) The professor (who was) confronted by the student was not ready for.
Suprasegmental features and Prosody Lect 6A&B LING1005/6105.
On the role of context and prosody in the interpretation of ‘okay’ Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Héctor Chávez, and Lauren Wilcox.
Assessing Listening (Listening comprehension has not always drawn the attention of educators. Human beings have a natural tendency.
NADYA RUTHERFORD. Building AWARENESS and CONCERN about pronunciation.
Predictability affects pronoun production only for some verb types
Thematic Role Predictability and Planning affect Word Duration
Jason Kahn & Jennifer E. Arnold UNC – Chapel Hill Amlap
Meanings of Intonational Contours
Studying Intonation Julia Hirschberg CS /21/2018.
Intonational and Its Meanings
Intonational and Its Meanings
The American School and ToBI
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Information Structure and Prosody
Meanings of Intonational Contours
Turn-taking and Disfluencies
Representing Intonational Variation
Agustín Gravano & Julia Hirschberg {agus,
Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997
Recognizing Structure: Dialogue Acts and Segmentation
Presentation transcript:

Using disfluency to understand, um, sentences... with PP-attachment ambiguities Jennifer E. Arnold and Kellen Carpenter, UNC Chapel Hill Background 1) Prosody (e.g., pausing, acoustic prominence) marks some aspect of the speaker’s intended message: syntactic structure (e.g., Snedeker & Trueswell, 2003) discourse status (e.g., Brown, 1983; Watson & Arnold, 2005) contrast (Terken & Hirschberg, 1994) focus structure (Selkirk, 1996) 2) Pausing, word duration, and acoustic prominence also reflect processing constraints on production: Disfluency correlates with longer words (Bell et al., 2003) Difficult reference induces longer words and higher pitch (Christodoulou & Arnold, 2008) Predictability and givenness correlate with prominence, and also can facilitate production (e.g., Bell et al., 2009; Kahn & Arnold, CUNY 2010 poster; Watson et al., 2008)  Prosodic cues are ambiguous (cf. Ferreira, 2007; Clifton et al., 2006). E.g., how do listeners know whether a pause signals processing or a syntactic break? Funded by NSF grant BCS References Bell, A., et al. (2003). Effects of disfluencies, predictability, and utterance position on word form variation in English conversation. JASA, 113, Bell, A., et al. (2009). Predictability effects on durations of content and function words in conversational English. JML, 60, Christodoulou, A., & Arnold, J. E. (2008). Acoustic prominence as a result of production difficulty. Prosody Poster; Ithaca, NY. Clifton, C., Carlson, K., & Frazier, L. (2006). Tracking the what and why of speakers choices: Prosodic boundaries and the length of constituents PBR, 13, Ferreira, F. (2007). Prosody and performance. LCP, 22, Kahn, J., & Arnold, J. E. (2010). When Predictability is Not Enough: The Additional Contribution of Givenness to Durational Reduction. CUNY Poster; New York City, NY. Snedeker, J., & Trueswell, J. C. (2003). Using Prosody to Avoid Ambiguity: Effects of Speaker Awareness and Referential Context. JML, 48, Snedeker, J., & Trueswell, J. C. (2004). The developing constraints on parsing decisions…. Cog.Psych, 49, Selkirk, E. O. (1996). Sentence prosody: Intonation, stress and phrasing. In J. A. Goldsmith (Ed.), The handbook of phonological theory. Cambridge, Mass., USA: Blackwell. Terken, J., & Hirschberg, J. (1994). Deaccentuation of words representing given information…. Language and Speech, 37, Watson, D. & Gibson, E. (2004). The relationship between intonational phrasing and syntactic structure in language production. LCP, 19, Watson, D., Arnold, J.E., & Tanenhaus, M. K. (2008). Tic tac TOE: Effects of predictability and importance on acoustic prominence…. Cognition, 106, Watson, D., & Arnold, J. E. (2005). Not just given and new: The effects of discourse and task-based constraints on acoustic prominence. CUNY Poster; Tuscon, AZ. Research Question When listeners think that a pause might result from production difficulty, are they less likely to use it as a cue to syntactic structure? FLUENT: Tickle the meerkat [pause] with the feather. DISFLUENT: Tickle theee uh… meerkat [pause] with the feather. A pause usually signals VP-attachment In the presence of disfluency, is the NP attachment interpretation more available? Model: multilevel logistic regression (SAS proc glimmix) Cross-classified; subjects and items random effects Dependent variable: Instrument vs. Modifier interpretation Predictors:Control variables (all n.s.) Fluency (n.s.) Verb bias Pause (n.s.) Instrument picture on left side Fluency x Pause (Est=.89; p =.04) List forwards/ backwards Results: % Instrumental chosen FLUENT / PAUSE: Bunny looked at the table [pause] with the magnifying glass FLUENT / NO PAUSE: Bunny looked at the table with the magnifying glass DISFLUENT / PAUSE: Bunny looked at thee uh table [pause] with the magnifying glass DISFLUENT / NO PAUSE: Bunny looked at thee uh table with the magnifying glass 69% 79% 66% 65% EXPERIMENT 1: Which picture best matches the sentence? Kitty scratched the puppy with the paper Bunny looked at the table with the magnifying glass. Doggy threw the flower with the cup Birdy sang to the owl with the funnel. Sentences based on Snedeker & Trueswell (2004), normed for verb bias EXPERIMENT 2: Eyetracking (in progress) Fluent/no pause/destination: Put the meerkat on the circle on the left. Fluent/no pause/modifier: Put the meerkat on the circle [pause] on the triangle. Fluent/pause/destination: Put the meerkat [pause] on the circle on the left. Fluent/pause/modifier:Put the meerkat [pause] on the circle [pause] on the triangle. Disfluent/pause/destination: Put thee uh meerkat [pause] on the circle on the left. Disfluent/pause/modifier:Put thee uh meerkat [pause] on the circle [pause] on the triangle. Task: Get all the animals to their “home” on one of the shapes Predict: More looks to the empty circle during fluent/pause than either of the other conditions Faster responses to the destination interpretation conditions for the fluent/no pause and disfluent/pause conditions; faster modifier responses in the fluent/pause condition This pause is manipulated This pause is part of the modifier disambiguation Conclusions For fluent items: Pause promotes instrument (VP-attachment) interpretations This effect disappears for disfluent items The interaction suggests disfluency affects the interpretation of the pause If disfluency just created a bias toward the modified-NP structure (in which the NP is relatively more complex), we would expect a main effect of disfluency and no interaction Listeners may attribute the pause to difficulty, which reduces the informativeness of the pause for syntactic structure Materials FLUENT / PAUSE: Bunny looked at the table [pause] with … FLUENT / NO PAUSE: Bunny looked at the table with … DISFLUENT / PAUSE: Bunny looked at thee uh table [pause] with… DISFLUENT / NO PAUSE: Bunny looked at thee uh table with … Disfluent items: The effect of the pause should be diminished or eliminated Fluent items: Predict more VP-attach for pause than no-pause condition *stimuli are fully cross-spliced