Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997

Slides:



Advertisements
Similar presentations
October 10–11, 2014 (UMass-Amherst) Reconsidering Spanish pitch accent distribution: H+L* in Bogotá Spanish 1ST SYMPOSIUM ON INTONATION & TONE IN THE.
Advertisements

Using prosody and intonation to identify accents: The role of peak and valley alignment in the Spanish of Córdoba, Argentina Jennifer Lang-Rigal James.
Prosody Modeling (in Speech) by Julia Hirschberg Presented by Elaine Chew QMUL: ELE021/ELED021/ELEM March 2012.
Prosodic facilitation and interference in the resolution of temporary syntactic closure ambiguity Kjelgaard & Speer 1999 Kent Lee Ψ 526b 16 March 2006.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Two Types of Listeners? Marie Nilsenov á (Tilburg University) 1. Background When you and I listen to the same utterance, we may not perceive the linguistic.
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
Nigerian English prosody Sociolinguistics: Varieties of English Class 8.
Niebuhr, D‘Imperio, Gili Fivela, Cangemi 1 Are there “Shapers” and “Aligners” ? Individual differences in signalling pitch accent category.
Prosodic analysis: theoretical value and practical difficulties Anne Wichmann Nicole Dehé.
SYNTAX 1 DAY 30 – NOV 6, 2013 Brain & Language LING NSCI Harry Howard Tulane University.
Language Use and Understanding BCS 261 LIN 241 PSY 261 CLASS 12: SNEDEKER ET AL.: PROSODY.
Introduction to Intonation Jennifer J. Venditti Cognitive Science March 2001.
CS 4705 Lecture 22 Intonation and Discourse What does prosody convey? In general, information about: –What the speaker is trying to convey Is this a.
Context in Multilingual Tone and Pitch Accent Recognition Gina-Anne Levow University of Chicago September 7, 2005.
On the Correlation between Energy and Pitch Accent in Read English Speech Andrew Rosenberg Weekly Speech Lab Talk 6/27/06.
1 Phonetics Study of the sounds of Speech Articulatory Acoustic Experimental.
Sound and Speech. The vocal tract Figures from Graddol et al.
Eva Fernández & Dianne Bradley Queens College & Graduate Center CUNY in collaboration with José Manuel Igoa & Celia Teira Universidad Autónoma de Madrid.
Anchoring effects in Spanish Pilar Prieto and Francisco Torreira (ICREA-UAB & ULB) 2004 TIE Workshop Santorini, September 11-13, 2004.
Intonation September 18, 2014 The Plan for Today Also: I have posted a couple of readings on TOBI (an intonation transcription system) to the course.
Schizophrenia and Depression – Evidence in Speech Prosody Student: Yonatan Vaizman Advisor: Prof. Daphna Weinshall Joint work with Roie Kliper and Dr.
Semantics 3rd class Chapter 5.
Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS and NSF BCS to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
Intonation in Communication Skill: Recent Research Discourse, both in theoretical linguistics and in foreign language pedagogy,has focused on describing.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
The Effect of Pitch Span on Intonational Plateaux Rachael-Anne Knight University of Cambridge Speech Prosody 2002.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
TOBI Basics April 13, 2010.
Phonetics, part III: Suprasegmentals October 19, 2012.
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
TOBI, continued January 29, 2008 The Outlook 1.Return course project reports. 2.New course schedule. 3.Today: Continue the discussion of English Intonation.
Acoustic Cues to Emotional Speech Julia Hirschberg (joint work with Jennifer Venditti and Jackson Liscombe) Columbia University 26 June 2003.
Pitch Tracking + Prosody January 19, 2012 Homework! For Tuesday: introductory course project report Background information on your consultant and the.
INTONATION And IT’S FUNCTIONS
Lecture Overview Prosodic features (suprasegmentals)
English Intonation (introductory lecture)
Investigating Pitch Accent Recognition in Non-native Speech
Statistical NLP: Lecture 3
4AOD Malinnikova Ekaterina
Sentence stress and intro to intonation
SUPRASEGMENTAL PHONEME
Intonation and Speaking Styles
What are suprasegmentals?
Tone in Sherpa (Sino-Tibetan) Joyce McDonough1, Rebecca Baier2 and
Recognizing Structure: Dialogue Acts and Segmentation
Studying Intonation Julia Hirschberg CS /21/2018.
Meanings of Intonational Contours
Representing Intonational Variation
Studying Intonation Julia Hirschberg CS /21/2018.
…It’s how you say it Julia Hirschberg CS /21/2018.
INTONATION. What is intonation? Intonation is a term used to refer to the distinctive use of different patterns of pitch that carry meaningful information.
Intonational and Its Meanings
Intonational and Its Meanings
The American School and ToBI
Meaningful Intonational Variation
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Meanings of Intonational Contours
Representing Intonational Variation
Representing Intonational Variation
Advanced NLP: Speech Research and Technologies
Discourse Structure in Generation
Intonational and Its Meanings
Agustín Gravano1 · Stefan Benus2 · Julia Hirschberg1
Patricia Keating, Marco Baroni, Sven Mattys, Rebecca Scarborough,
Recognizing Structure: Dialogue Acts and Segmentation
Discourse & Dialogue CMSC October 28, 2004
Intonation.
Presentation transcript:

Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997 Production studies comparing English, Italian and Spanish speakers (4 per language) and then English and Italian Potentially ambiguous utterances embedded in contexts to disambiguate: 12/8/2018

English I know William very well. Since his girlfriend left him, he’s done nothing but drink. It’s been such a long time since his separation, that he’s used to living alone. Now, William doesn’t drink because he’s unhappy. He drinks because he’s an alcoholic. There’s something about William that puzzles me. When he’s happy, he has a good time with his friends, and certainly he doesn’t dislike drinking. I think I understand what’s wrong. William doesn’t drink because he’s unhappy. 12/8/2018

Spanish Conozco a Guillermo muy bien. Desde que su novia le dejo, no ha hecho nada mas que beber. Despues de tanto tiempo de su separacion, se ha acostumbrado a vivir solo. Ahora, Guillermo no bebe porque esta triste. Simplement, porque es un alcoholico. Ha algo de Guillermo que no me convence. Cuando le veo feliz, se que se lo pasa, bien con sus amigos, y que no le desagrada beber. Creo que se lo que le pasa. Guillermo no bebe porque esta triste. 12/8/2018

Analysis Target utterances excised and labeled for Intonational contour Relative prominence of pitch accents Different ambiguity contexts compared within languages to find common patterns Common patterns compared across languages 12/8/2018

Results Scope of negation similarly disambiguated between wide and narrow readings by variation of intonational phrasing (one phrase vs. two) Spanish and Italian speakers also varied nuclear stress placement (on verb for wide) English speakers also used continuation rise for wide, falling for narrow Bill doesn’t drink because he’s unhappy. •    PP-attachment disambiguated by phrasing variation (for Italian speakers) 12/8/2018

Association with focus: only consistently disambiguated by all three Quantifier scope disambiguated by varying nuclear stress placement and phrases (for Italian, Spanish, 2 English subjects) Association with focus: only consistently disambiguated by all three 12/8/2018

How do other languages use intonation to convey information? Syntactic ambiguity Semantic ambiguity Discourse phenomena ‘Paralinguistic’ information 12/8/2018

Sag & Liberman on Intonation and Indirect Speech Acts ‘75 Direct vs. Indirect Speech Acts Illocutionary force (e.g. asking) Perlocutionary effect (e.g…..) Can you open that window? Wh-questions ‘Real’: “tilde contour” – why? “hat pattern” 12/8/2018

Negative-implicating rhetorical: Hat pattern (if second accent highest) Evidence? Surprise/redundancy: The blackboard’s painted orange! How do we conclude that any intonation contour “means” X? YNQs: ‘Real’: rising or falling Indirect request: plateau or falling 12/8/2018

Production studies: recorded read skits Tilde  real wh-q Neg-implicating wh: second accent more prominent than first Perception studies: match recording to context Tilde  real wh-q and not other Late peak  either Terminal rise  real ynq 12/8/2018

Conclusion: some contours can ‘freeze’ a pragmatic interpretation? 12/8/2018

Hirschberg & Ward ’92: Rise/fall/rise (L*+H L-H%) The question: why does one contour have different meanings? Uncertainty/incredulity or lack of speaker commitment to some scalar value When will it mean one over the other? Hypothesis: variation in F0, amplitude, duration, voice quality Experiment: 12/8/2018

Record same sentence with each interpretation (pretest) Analyze each token to extract acoustic and prosodic features of hypothesis Resynthesize tokens exchanging all possible combinations of F0, RMS, duration and spectral features of ‘uncertainty’ tokens with ‘incredulity’ tokens 12/8/2018

Forced choice task: uncertainty or incredulity? Results: F0 and spectral features influence uncertainty/incredulity distinction although amplitude and duration also differ 12/8/2018