Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS-0318456 and NSF BCS-0318456 to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented.

Slides:



Advertisements
Similar presentations
Information structuring in English dialogue class 4
Advertisements

Phonetics as a scientific study of speech
Teaching Pronunciation
The Role of F0 in the Perceived Accentedness of L2 Speech Mary Grantham O’Brien Stephen Winters GLAC-15, Banff, Alberta May 1, 2009.
4. Prediction The FT/FA (Schwartz & Sprouse 1996) suggest that the initial state for L2 acquisition is the end state L1 grammar, and all L1 properties.
“Effect of Genre, Speaker, and Word Class on the Realization of Given and New Information” Julia Agustín Gravano & Julia Hirschberg {agus,
The perception of dialect Julia Fischer-Weppler HS Speaker Characteristics Venice International University
Language and Cognition Colombo, June 2011 Day 8 Aphasia: disorders of comprehension.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
ERP Investigation of Prosodic and Semantic Focus Shawn Johnson Charles Clifton, Jr. Mara Breen Andrea Eileen Martin Joanna Morris Florack.
Using disfluency to understand, um, sentences... with PP-attachment ambiguities Jennifer E. Arnold and Kellen Carpenter, UNC Chapel Hill Background 1)
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Nigerian English prosody Sociolinguistics: Varieties of English Class 8.
Connecting Acoustics to Linguistics in Chinese Intonation Greg Kochanski (Oxford Phonetics) Chilin Shih (University of Illinois) Tan Lee (CUHK) with Hongyan.
A Processing-based Account of Acoustic Reduction (or: Reduction Comes From Facilitation of Levels of Language Production) Jason M. Kahn & Jennifer E. Arnold.
Speakers Reduce Because of Their Own Internal Representations Jason Kahn Jennifer Arnold UNC – Chapel Hill.
Towards a model of speech production: Cognitive modeling and computational applications Michelle L. Gregory SNeRG 2003.
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Prosodic Cues to Discourse Segment Boundaries in Human-Computer Dialogue SIGDial 2004 Gina-Anne Levow April 30, 2004.
Yao LSA Separating speaker- and listener- oriented forces in speech – Evidence from phonological neighborhood density.
1 Phonetics Study of the sounds of Speech Articulatory Acoustic Experimental.
Introduction General Questions: What is the main cause of language change? Is it due to human laziness, the drive to conserve energy? Is it an automatization.
Sound and Speech. The vocal tract Figures from Graddol et al.
Primary Stress and Intelligibility: Research to Motivate the Teaching of Suprasegmentals By Laura D. Hahn Afra MA Carolyn MA Josh MA
STUDY OF ENGLISH STRESS AND INTONATION
14: THE TEACHING OF GRAMMAR  Should grammar be taught?  When? How? Why?  Grammar teaching: Any strategies conducted in order to help learners understand,
Stages of Second Language Acquisition
Schizophrenia and Depression – Evidence in Speech Prosody Student: Yonatan Vaizman Advisor: Prof. Daphna Weinshall Joint work with Roie Kliper and Dr.
Jelena Mirković and Maryellen C. MacDonald Language and Cognitive Neuroscience Lab, University of Wisconsin-Madison Introduction How to Study Subject-Verb.
Perceived prominence and nuclear accent shape Rachael-Anne Knight LAGB 5 th September 2003.
Una Y. Chow Stephen J. Winters Alberta Conference on Linguistics November 1, 2014.
Assessing Speaking. Basic Types of Speaking (1) Imitative  Focus on pronunciation  Not concerned about comprehension or expression of meaning e.g. Repeat.
Suprasegmentals Segmental Segmental refers to phonemes and allophones and their attributes refers to phonemes and allophones and their attributes Supra-
Is phonetic variation represented in memory for pitch accents ? Amelia E. Kimball Jennifer Cole Gary Dell Stefanie Shattuck-Hufnagel ETAP 3 May 28, 2015.
Results Tone study: Accuracy and error rates (percentage lower than 10% is omitted) Consonant study: Accuracy and error rates 3aSCb5. The categorical nature.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
Language. Phonetics is the study of how elements of language are physically produced.
Annotating the HKCSE Pragmatically Martin Weisser Visiting Professor School of English and Education Guangdong University of Foreign Studies mail:
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
Introduction to Computational Linguistics
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Lecture 1 Lec. Maha Alwasidi. Branches of Linguistics There are two main branches: Theoretical linguistics and applied linguistics Theoretical linguistics.
Intonational Meaning in Discourse Jennifer J. Venditti Tutorial for the IRCS 5 th Annual Undergraduate Summer Workshop in Cognitive Science 18 June 2002.
Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003.
Control of prosodic features under perturbation in collaboration with Frank Guenther Dept. of Cognitive and Neural Systems, BU Carrie Niziolek [carrien]
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
Suprasegmental Properties of Speech Robert A. Prosek, Ph.D. CSD 301 Robert A. Prosek, Ph.D. CSD 301.
Intersensory Redundancy Facilitates Infants’ Perception of Meaning in Speech Passages Irina Castellanos, Melissa Shuman, and Lorraine E. Bahrick Florida.
Speech in the DHH Classroom A new perspective. Speech in the DHH Bilingual Classroom Important to look beyond the traditional view of speech Think of.
On the role of context and prosody in the interpretation of ‘okay’ Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Héctor Chávez, and Lauren Wilcox.
LISTENING: QUESTIONS OF LEVEL FRANCISCO FUENTES NICOLAS VALENZUELA.
The 157th Meeting of Acoustical Society of America in Portland, Oregon, May 21, pSW35. Confusion Direction Differences in Second Language Production.
Linguistic knowledge for Speech recognition
Predictability affects pronoun production only for some verb types
Thematic Role Predictability and Planning affect Word Duration
4AOD Malinnikova Ekaterina
Teaching Oral Communication
Jason Kahn & Jennifer E. Arnold UNC – Chapel Hill Amlap
Why Study Spoken Language?
Studying Intonation Julia Hirschberg CS /21/2018.
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Information Structure and Prosody
Why Study Spoken Language?
Turn-taking and Disfluencies
Representing Intonational Variation
Fadi Biadsy. , Andrew Rosenberg. , Rolf Carlson†, Julia Hirschberg
Agustín Gravano & Julia Hirschberg {agus,
Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997
SECOND LANGUAGE LISTENING Comprehension: Process and Pedagogy
Towards Automatic Fluency Assessment
Presentation transcript:

Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS and NSF BCS to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented explanation: Acoustic prominence (duration, pitch movement, high pitch, intensity) communicates something to the listener the referent is discourse-new / not-salient (Brown, 1983) contrast (Terken & Hirschberg, 1994) informativeness (Bolinger, 1986) accent signals the focus structure (Selkirk, 1996) provides additional information in the case of low predictability words duration shorter when predictable (Jurafsky et al., 2001; Gahl & Garnsey 2004) words less intelligible when predictable (Fowler & Housum, 1987, Bard & Aylett, 2004) Speaker-internal effort also increases acoustic prominence: Speaker disfluency correlates with characteristics of acoustic prominence longer duration (Bell et al., 2003) higher pitch (Christodoulou & Arnold, Prosody08 poster) Bard & Aylett (2004): intelligibility loss for repeated words occurs even with a new addressee Higher pitch, longer duration, more pauses for unpredictable game moves (Watson, Arnold, & Tanenhaus, 2008) Research Question Does nonlinguistic, task-unrelated effort also increase acoustic prominence? Test case: Memory Load Story-telling experiment 1.Subject sees panel 1 and hears sentence 2.Subject sees panel 2, repeats sentence 1 and adds a line to the story Concurrent Digit load How acoustically prominent is the reference to the main character? The main character (Here Mickey) is larger / more interesting  start of response Only names included (pronouns excluded) Only two-character conditions included (“single char” condition yielded pronouns) Results: Longer Duration Under Memory Load Multilevel model (SAS proc mixed) of log duration: significant effects: not significant effects in model ( = marginal): load (0, 2, or 3 digits) p <.02)condition target word (p <.05)digit span utterance length (p <.05)number digits remembered continuation (p <.05)disfluency control variables (List, load order, block, list order) Load also decreased frequency of pronoun use Mickey first: Mickey did some tricks with Daisy at the Western theme park. OR Mickey second: Daisy did some tricks with Mickey at the Western theme park. Mickey did some tricks with Daisy at the Western theme park..... Mickey was good with the rope. References Babwah, L. (2008). Distraction and Reference in Discourse. Honors Thesis, UNC Chapel Hill. Bard, E. G., & Aylett, M. P. (2004). Referential form, word duration, and modeling the listener in spoken dialogue. In J. C. Trueswell & M. K. Tanenhaus (Eds.), Approaches to studying world- situated language use: Bridging the language-as-product and language-as-action traditions (pp ). Cambridge, MA: MIT Press. Bell, A., Jurafsky, D., et al.. (2003). Effects of disfluencies, predictability, and utterance position on word form variation in English conversation. JASA, 113(2), Bolinger, D. (1986). Intonation and its parts melody in spoken English. Stanford, CA: Stanford University Press. Brown, G. (1983). Prosodic structure and the given/new distinction. In A. Cutler & D. R. Ladd (Eds.), Prosody, models, and measurements. New York: Springer-Verlag. Christodoulou, A., & Arnold, J. E. (2008). Effects of production difficulty on prosody. Poster; Prosody08. Fowler, C. A., & Housum, J. (1987). Talkers’ signaling of ‘‘new’’ and ‘‘old’’ words in speech and listeners’ perception and use of the distinction. JML, 26, 489–504. Gahl, S. & Garnsey, S. M. (2004). Knowledge of grammar, knowledge of usage: Syntactic probabilities affect pronunciation variation. Language, 80, Jurafsky, D., Bell, A., Gregory, M., & Raymond, W. (2001). Probabilistic relations between words... In J. Bybee & P. Hopper (Eds.), Frequency and the emergence of linguistic structure (pp ). Amsterdam: John Benjamins. Selkirk, E. O. (1996). Sentence prosody: Intonation, stress and phrasing. In J. A. Goldsmith (Ed.), The handbook of phonological theory (pp. 550–569). Cambridge, Mass, USA: Blackwell. Terken, J., & Hirschberg, J. (1994). Deaccentuation of words representing ‘given’ information…. Language and Speech, 37, Watson, D., Arnold, J.E., & Tanenhaus, M. K. (2008). Tic tac TOE: Effects of predictability and importance on acoustic prominence in language production. Cognition, 106, Conclusions Nonlinguistic task demands increase acoustic prominence Memory task: effort affects duration Distraction task: effort affects pitch Production-internal load decreases both acoustic and lexical attenuation The semantic/ pragmatic functions of acoustic prominence may partly reflect associated speaker-internal cognitive demands No load Converging Evidence: Babwah (2008) Instructions to given or new entities Secondary, nonlinguistic task (responding to beeps) can distract speaker Distraction also decreased pronoun use Click on the cow. (beep! beep!) Now move the carrot to the circle. Cognitive Effort Influences Acoustic Prominence: The Impact of Memory Resources Jennifer E. Arnold and Zenzi M. Griffin UNC Chapel Hill Georgia Tech