Lexical, Prosodic, and Syntactics Cues for Dialog Acts.

Slides:



Advertisements
Similar presentations
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Advertisements

Detecting Certainness in Spoken Tutorial Dialogues Liscombe, Hirschberg & Venditti Using System and User Performance Features to Improve Emotion Detection.
Using prosody to avoid ambiguity: Effects of speaker awareness and referential context Snedeker and Trueswell (2003) Psych 526 Eun-Kyung Lee.
Rhee Dong Gun. Chapter The speaking process The differences between spoken and written language Speaking skills Speaking in the classroom Feedback.
Automatic Prosodic Event Detection Using Acoustic, Lexical, and Syntactic Evidence Sankaranarayanan Ananthakrishnan, Shrikanth S. Narayanan IEEE 2007 Min-Hsuan.
Results ISI Variance in STP Corpus ISI Variance in BU Corpus * p
Agustín Gravano 1 · Stefan Benus 2 · Julia Hirschberg 1 Elisa Sneed German 3 · Gregory Ward 3 1 Columbia University 2 Univerzity Konštantína Filozofa.
1) Introduction to research topic. Thesis: There is a difference between the prosodic properties of: a) contrastive Focus and b) presentational Focus.
Outline Project markers and backchanneling – statistics and functions of new tokens secondary functionality of certain tokens as project markers Nonconventional.
Towards a model of speech production: Cognitive modeling and computational applications Michelle L. Gregory SNeRG 2003.
Extracting Social Meaning Identifying Interactional Style in Spoken Conversation Jurafsky et al ‘09 Presented by Laura Willson.
Dianne Bradley & Eva Fern á ndez Graduate Center & Queens College CUNY Eliciting and Documenting Default Prosody ABRALIN23-FEB-05.
High Frequency Word Entrainment in Spoken Dialogue ACL, June Columbus, OH Department of Computer and Information Science University of Pennsylvania.
Classification of Discourse Functions of Affirmative Words in Spoken Dialogue Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Shira Mitchell, Ilia.
EE225D Final Project Text-Constrained Speaker Recognition Using Hidden Markov Models Kofi A. Boakye EE225D Final Project.
STUDY OF ENGLISH STRESS AND INTONATION
1. Introduction Which rules to describe Form and Function Type versus Token 2 Discourse Grammar Appreciation.
Lecture 1, 7/21/2005Natural Language Processing1 CS60057 Speech &Natural Language Processing Autumn 2005 Lecture 1 21 July 2005.
McEnery, T., Xiao, R. and Y.Tono Corpus-based language studies. Routledge. Unit A 2. Representativeness, balance and sampling (pp13-21)
Theories of Discourse and Dialogue. Discourse Any set of connected sentences This set of sentences gives context to the discourse Some language phenomena.
A Study in Cross-Cultural Interpretations of Back-Channeling Behavior Yaffa Al Bayyari Nigel Ward The University of Texas at El Paso Department of Computer.
1 Speech Perception 3/30/00. 2 Speech Perception How do we perceive speech? –Multifaceted process –Not fully understood –Models & theories attempt to.
FUNCTIONS OF INTONATION
Information Technology – Dialogue Systems Ulm University (Germany) Speech Data Corpus for Verbal Intelligence Estimation.
Turn-taking Discourse and Dialogue CS 359 November 6, 2001.
VIII Language and society V. Language and society  1.Language exchange information  maintain social relationship 2 ** The kind of language one chooses.
Background: Speakers use prosody to distinguish between the meanings of ambiguous syntactic structures (Snedeker & Trueswell, 2004). Discourse also has.
Creating User Interfaces Directed Speech. XML. VoiceXML Classwork/Homework: Sign up to be Voxeo developer. Do tutorials.
Automatic Cue-Based Dialogue Act Tagging Discourse & Dialogue CMSC November 3, 2006.
Discourse Analysis ENGL4339
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Pitch Ladefoged, p. 23) Pitch refers to the rate of vibration of the vocal cords. The higher the vibration, the higher the pitch. Thus sounds are said.
Dialogue Act Tagging Discourse and Dialogue CMSC November 4, 2004.
Lecture 7 Intonation 2 Lec. Maha Alwasidi.
Turn-taking and Backchannels Ryan Lish. Turn-taking We all learned it in preschool, right? Also an essential part of conversation Basic phenomenon of.
1/17/20161 Emotion in Meetings: Business and Personal Julia Hirschberg CS 4995/6998.
Natural conversation “When we investigate how dialogues actually work, as found in recordings of natural speech, we are often in for a surprise. We are.
TOPIC MANAGEMENT AND TURN-TAKING Discourse Strategies used by speakers and how cooperation is achieved.
Adapting Dialogue Models Discourse & Dialogue CMSC November 19, 2006.
INTONATION Islam M. Abu Khater.
Pitch Tracking + Prosody January 19, 2012 Homework! For Tuesday: introductory course project report Background information on your consultant and the.
Objectives of session By the end of today’s session you should be able to: Define and explain pragmatics and prosody Draw links between teaching strategies.
On the role of context and prosody in the interpretation of ‘okay’ Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Héctor Chávez, and Lauren Wilcox.
IELTS Reading Test GENERAL PRESENTATION
INTONATION And IT’S FUNCTIONS
Sentence-Utterance-Proposition
The Functions of Intonation Shane Lee Ward. THE GRAMMATICAL FUNCTION OF INTONATION 0 Can mark “grammatical contrasts, such as chunking into clauses and.
Lecture Overview Prosodic features (suprasegmentals)
Analysis of spontaneous speech
English Intonation (introductory lecture)
Sentence stress and intro to intonation
TEACHING LANGUAGE SKILLS: TEACHING SPEAKING
期中考试 Quarter’s Final Oct. 11th – Listening / Reading / Writing (60)
Lexical, Prosodic, and Syntactic Cues for Dialog Acts
Why Study Spoken Language?
Recognizing Structure: Dialogue Acts and Segmentation
Studying Intonation Julia Hirschberg CS /21/2018.
Intonational and Its Meanings
The American School and ToBI
THE NATURE OF SPEAKING Joko Nurkamto UNS Solo.
Dialogue Acts Julia Hirschberg CS /18/2018.
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Information Structure and Prosody
Why Study Spoken Language?
Studying Spoken Language Text 17, 18 and 19
Recognizing Structure: Sentence, Speaker, andTopic Segmentation
Dialogue Acts Julia Hirschberg LSA /29/2018.
Recognizing Structure: Dialogue Acts and Segmentation
Chapter 8 Communicative competence
Sentence-Utterance-Proposition
Presentation transcript:

Lexical, Prosodic, and Syntactics Cues for Dialog Acts

Purpose Investigating the particular class of dialogue acts called backchannels (aka "acknowledgement tokens"). Those give feedback to the speaker. Continuers – an utterance indicating that the other speaker should go on speaking. incipient speakership agreements – marks the degree to which a user accepts the speakers opinion, statement, etc. yes-answers Assessments – ascriptive sentences: expression of a certain property ("good," "bad").

Questions Does it have any importance as cue- phrases for the structure? Does prosodic knowledge have any importance? Is there any difference in syntactic realization of certain dialog acts, compared to others?

Who Cares? Part of a project to "automate discourse structure for speech recognition and understanding tasks" Create models of speakers and dialog.

Materials and Methods -SWBD-DAMSL dialog tagset: * an adaptation of DAMSL tag-set * ~60 labels that could be combined in different dimensions. -7 CU-Boulder linguistics grad students labeling switchboard conversations of human-to-human interaction

Results 220 unique tags for 205,000 utterances, where each utterance received exactly one tag. Good agreement rate between labelers (84%), but too many tags for statistical analysis  everything was condensed into 42 final tags

On the lexical level, do words like "yeah" have any importance as cue-phrases for the structure?" Hirschberg & Litman: "now" and "well." Here: words with overlap meanings Jurafsky’s Findings: utterances may be ambiguous, BUT through the lexical form, we could find the word's true "identity."

"Yeah" Vs. "uh-huh": “Yeah" (and variations): ambiguous ("agreements" at 36%, at "incipient speaker" at 59%", and 86% at "yes- answers") "uh-huh" (with its variations): a "continuer" (45% vs. "yeah" at 27%).

Next Question: "Does prosodic knowledge have any importance in determining DA's meaning?" Hirschberg and Litman: intonational phrasing and pitch accent disambiguates cue phrases and help determine discourse structure. Jurafsky: agrees. –Runs experiment: Text transcription vs. complete speech:

MATERIALS AND METHODS: 44 random, but previously labeled conversations. Conversations were put in full context as well as fully transcribed AND the original labeling was also available. RESULTS: 98% agreement!

2% The shifts: 38% of the 2%: continuers  agreements 19% of the 2%: opinions  statements 15% of the 2% statements  opinions Etc.

Why the Shifts? –due to cascading changes (continuer  agreement, preceding statement = opinion). –Nature of labeling instruction: ambiguous cases were labeled as continuers –Identical lexical form: some speakers distinguished agreement from continuer based on prosody, while others used lexical form.

Take Home Message Continuers are, in most cases (vs. agreements): –shorter in duration –less intonationally marked –long pauses before speaking

3 rd Question:Is there any difference in syntactic realization of certain dialog acts, compared to others? Goodwin and Goodwin: Pro Term + Copula + (Intensifier) + Assessment Adjective Formula happens frequently, where: –pro term mostly equals: "that" –intensifiers are rare, and are usually "really," and "pretty" –assessment adjective has small range of adjectives: great, good, nice, wonderful, etc.

Syntactic Conclusion "micro-syntax" – restricted grammatical production than would have thought. That is, certain dialog acts have their own syntactic patterning.