10/10/20051 Acoustic/Prosodic and Lexical Correlates of Charismatic Speech Andrew Rosenberg & Julia Hirschberg Columbia University 10/10/05 - IBM.

Slides:



Advertisements
Similar presentations
2014/2015 English Course Offerings for Incoming Grade 11 Students Challenge Yourself!
Advertisements

Spiros Papageorgiou University of Michigan
“Effect of Genre, Speaker, and Word Class on the Realization of Given and New Information” Julia Agustín Gravano & Julia Hirschberg {agus,
IELTS (International English Language Testing System) Why do we need to know about it? Why do we need to know about it? What does it look like? What does.
® Towards Using Structural Events To Assess Non-Native Speech Lei Chen, Joel Tetreault, Xiaoming Xi Educational Testing Service (ETS) The 5th Workshop.
1 The Effect of Pitch Span on the Alignment of Intonational Peaks and Plateaux Rachael-Anne Knight University of Cambridge.
Nuclear Accent Shape and the Perception of Prominence Rachael-Anne Knight Prosody and Pragmatics 15 th November 2003.
AN ACOUSTIC PROFILE OF SPEECH EFFICIENCY R.J.J.H. van Son, Barbertje M. Streefkerk, and Louis C.W. Pols Institute of Phonetic Sciences / ACLC University.
Introduction to Linguistics for lawyers
Confidential and Proprietary. Copyright © 2010 Educational Testing Service. All rights reserved. Catherine Trapani Educational Testing Service ECOLT: October.
Charismatic Speech Andrew Rosenberg Spoken Language Processing 4/24/06.
Emotion in Meetings: Hot Spots and Laughter. Corpus used ICSI Meeting Corpus – 75 unscripted, naturally occurring meetings on scientific topics – 71 hours.
Polling. Interpreting a poll Who conducted the poll? How was it conducted? When was it conducted? How many people were sampled? Is the margin of error.
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Seminar /workshop on cognitive attainment ppt Dr Charles C. Chan 28 Sept 2001 Dr Charles C. Chan 28 Sept 2001 Assessing APSS Students Learning.
Spoken Language Processing Lab Who we are: Julia Hirschberg, Stefan Benus, Fadi Biadsy, Frank Enos, Agus Gravano, Jackson Liscombe, Sameer Maskey, Andrew.
Ability to attract and retain followers by virtue of personal characteristics - not traditional or political office (Weber ‘47) What makes an individual.
Automatic Prosody Labeling Final Presentation Andrew Rosenberg ELEN Speech and Audio Processing and Recognition 4/27/05.
Modeling Other Speaker State COMS 4995/6998 Julia Hirschberg Thanks to William Wang.
Extracting Social Meaning Identifying Interactional Style in Spoken Conversation Jurafsky et al ‘09 Presented by Laura Willson.
On the Correlation between Energy and Pitch Accent in Read English Speech Andrew Rosenberg, Julia Hirschberg Columbia University Interspeech /14/06.
On the Correlation between Energy and Pitch Accent in Read English Speech Andrew Rosenberg Weekly Speech Lab Talk 6/27/06.
William Y. Wang CS 6998 Emotional Speech, Dept. of Computer Science, Columbia University, Dec Modeling Other Speaker State: Sarcasm, Charisma,
9/5/20051 Acoustic/Prosodic and Lexical Correlates of Charismatic Speech Andrew Rosenberg & Julia Hirschberg Columbia University Interspeech Lisbon.
Charisma in English and Arabic Political Speech Julia Hirschberg Columbia University Joint work with Andrew Rosenberg and Fadi Biadsy Stony Brook University,
Varying Input Segmentation for Story Boundary Detection Julia Hirschberg GALE PI Meeting March 23, 2007.
TAYLOR HOWARD The Employment Interview: A Review of Current Studies and Directions for Future Research.
Charisma Perception from Text and Speech Andrew Rosenberg NLP Group Meeting 11/03/05.
Perceived prominence and nuclear accent shape Rachael-Anne Knight LAGB 5 th September 2003.
ONLINE VS. FACE-TO-FACE: EDUCATOR OPINIONS ON PROFESSIONAL DEVELOPMENT DELIVERY METHODS BY TERESA SCRUGGS THOMAS Tamar AvineriEMS 792x.
Advanced Supplementary Level. You learn how to: 4 write grammatical English 4 speak in English (for communication) 4 read English for general understanding.
Suprasegmentals Segmental Segmental refers to phonemes and allophones and their attributes refers to phonemes and allophones and their attributes Supra-
CSD 5100 Introduction to Research Methods in CSD Observation and Data Collection in CSD Research Strategies Measurement Issues.
On Speaker-Specific Prosodic Models for Automatic Dialog Act Segmentation of Multi-Party Meetings Jáchym Kolář 1,2 Elizabeth Shriberg 1,3 Yang Liu 1,4.
Yun-Nung (Vivian) Chen, Yu Huang, Sheng-Yi Kong, Lin-Shan Lee National Taiwan University, Taiwan.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
Predicting Student Emotions in Computer-Human Tutoring Dialogues Diane J. Litman&Kate Forbes-Riley University of Pittsburgh Department of Computer Science.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
National Taiwan University, Taiwan
Computational Linguistics Analysis of Charismatic Speech: Cross-Cultural and Political Perspectives Andrew Rosenberg NLP & Psychology 11/12/2015.
2004 PRESIDENTIAL CANDIDATES The filing period…...
1/17/20161 Emotion in Meetings: Business and Personal Julia Hirschberg CS 4995/6998.
Chapter 14: Affective Assessment
Explain the meaning of the quote: "I do not agree with a word you say, but I will defend to the death your right to say it.... -Voltaire “What I heard.
Nuclear Accent Shape and the Perception of Syllable Pitch Rachael-Anne Knight LAGB 16 April 2003.
TOEFL EXAM By: Alexandra Alfonso Code: TOEFL The Test of English as a Foreign Language (TOEFL) measures the ability of nonnative speakers of English.
Debate-Public Speaking 7 th Grade Communication Arts.
Acoustic Cues to Emotional Speech Julia Hirschberg (joint work with Jennifer Venditti and Jackson Liscombe) Columbia University 26 June 2003.
On the role of context and prosody in the interpretation of ‘okay’ Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Héctor Chávez, and Lauren Wilcox.
To my presentation about:  IELTS, meaning and it’s band scores.  The tests of the IELTS  Listening test.  Listening common challenges.  Reading.
The Math Studies Project for Internal Assessment   Personal research   Relate to student’s own interest   Use mathematical tools from the syllabus.
Answering 12 Mark questions
Investigating Pitch Accent Recognition in Non-native Speech
Intonation and Computation: Charisma
August 15, 2008, presented by Rio Akasaka
Copyright © American Speech-Language-Hearing Association
Ma Rui Tianjin Normal University
Studying Intonation Julia Hirschberg CS /21/2018.
Meanings of Intonational Contours
Studying Intonation Julia Hirschberg CS /21/2018.
Explain the meaning of the quote:
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Meanings of Intonational Contours
Fadi Biadsy. , Andrew Rosenberg. , Rolf Carlson†, Julia Hirschberg
Agustín Gravano & Julia Hirschberg {agus,
(Presidential) Party Nominations
Emotional Speech Julia Hirschberg CS /16/2019.
Acoustic-Prosodic and Lexical Entrainment in Deceptive Dialogue
Charismatic Speech and Vocal Attractiveness
Automatic Prosodic Event Detection
Presentation transcript:

10/10/20051 Acoustic/Prosodic and Lexical Correlates of Charismatic Speech Andrew Rosenberg & Julia Hirschberg Columbia University 10/10/05 - IBM

10/10/20052 Why study charismatic speech? Construction of a feedback system for public speakers, (politicians, academic instructors, etc.) Identification of potential charismatic leaders Automatic generation of “charismatic- like” speech

10/10/20053 What is charisma? Not face-to-face, one-on-one charisma. Rather, public (political, religious,etc.) charisma –The ability to attract, and retain followers by virtue of personality as opposed to tradition or laws. (Weber ‘47) E.g. Ghandi, Hitler, Castro. Charismatic speech: Speech that leads listeners to perceive the speaker as “charismatic”.

10/10/20054 Goals of this study Do people agree on what kind of speech is charismatic? Is there a common, functional definition of charisma? What acoustic/prosodic and lexical properties of speech communicate charisma?

10/10/20055 Study Description Format: web survey Subjects: 8, solicited via , no monetary incentive Dependent variables: 5-point Likert scale ratings of agreement on 26 statements about the speaker. Duration: avg. 1.5 hrs, min 45m, max ~3hrs

10/10/20056 Study Description Materials: 45 short (2-30s) tokens of American political speech from late ’03 and early ‘04 Speakers: 9 Candidates for Democratic Party’s nomination for President –Wesley Clark, Howard Dean, John Edwards, Dick Gephardt, John Kerry, Dennis Kucinich, Joseph Lieberman, Carol Moseley Braun, Al Sharpton Topics: Postwar Iraq, Healthcare, Bush’s Tax plan, Reason for Running, Content-Neutral

10/10/20057 How much do subjects agree with one another? Using the weighted kappa statistic with quadratic weighting, mean  = –Do subjects agree about what is charismatic?  = (8 th ) Inter-subject agreement by token –No significant differences across all tokens Inter-subject agreement by statement –The individual statements demonstrate significantly different agreements

10/10/20058 What do subjects mean by “charismatic”? Which pairs of statements were most closely correlated with the charismatic statement, determined by kappa. The speaker is enthusiastic0.606 The speaker is charming0.602 The speaker is persuasive0.561 The speaker is boring The speaker is passionate0.512 The speaker is convincing0.503

10/10/20059 Does the identity of the speaker affect judgments of charisma? There is a significant difference between speakers (p=1.75e-2) Most charismatic –Rep. Edwards (3.73) –Rev. Sharpton (3.40) –Gov. Dean (3.32) Least charismatic –Sen. Lieberman (2.38) –Rep. Kucinich (2.73) –Rep. Gephardt (2.77)

10/10/ Does recognizing a speaker affect judgments of charisma? Subjects were asked to identify which, if any, speakers they recognized at the end of the study. Subjects rated recognized speakers (3.28) significantly more charismatic than those they did not (2.99).

10/10/ Does the genre or topic of speech affect judgments of charisma? The tokens were taken from debates, interviews, stump speeches, and a campaign ad –Stump speeches were the most charismatic. (3.28) –Interviews the least. (2.90) Topic does not affect ratings of charisma.

10/10/ What makes speech charismatic? Acoustic/Prosodic and Lexical Properties Examined Duration (secs) Min, max, mean, stdev F0 –Raw and normalized by speaker Min, max, mean, stdev intensity Speaking rate (syls/sec) Length (words, syls) 1 st, 2 nd, 3 rd person pronoun density Function to content word ratio Mean syllables/word Mean words per intermediate and intonational phrase Number of intonational, intermediate, and internal phrases Mean and stdev of normalized F0 and intensity across phrases Require manual labeling of phrase boundaries

10/10/ What makes speech charismatic? Properties showing positive correlation with charisma More Content –Length in secs, words, syllables, and phrases Higher and more dynamic raw F0 –Min, max, mean, std. dev. of F0 over male speakers Greater intensity –Mean intensity Higher in a speaker’s pitch range –Mean normalized F0

10/10/ What makes speech charismatic? Properties showing positive correlation with charisma Faster speaking rate –Syllables per second Greater variation of F0 and intensity across phrases –Std. dev. of normalized phrase F0 and intensity The use of more first person pronouns –First person pronoun density The use of polysyllabic words –Lexical complexity (mean syllables per word)

10/10/ Conclusions There are substantial individual differences in subject perception of charisma. Subjects seem to agree on a common, functional definition of charisma. –“A charismatic speaker is enthusiastic, charming, convincing, persuasive, powerful and not boring” Broadly, dynamic speech – loud, high in the pitch range – using first person pronouns is associated with charisma.

10/10/ Future Research Isolate the lexical component of speech to determine the relative influences of what is said and how it is said. Modify acoustic/prosodic features to resynthesize more/less charismatic speech Study communication of charisma in other languages, specifically Palestinian Arabic.