Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,

Slides:



Advertisements
Similar presentations
Human Speech Recognition Julia Hirschberg CS4706 (thanks to John-Paul Hosum for some slides)
Advertisements

“Effect of Genre, Speaker, and Word Class on the Realization of Given and New Information” Julia Agustín Gravano & Julia Hirschberg {agus,
Segmenting Nonsense Sanders, Newport & Neville (2002) Ricardo TaboneLIN 7912.
Automatic Prosodic Event Detection Using Acoustic, Lexical, and Syntactic Evidence Sankaranarayanan Ananthakrishnan, Shrikanth S. Narayanan IEEE 2007 Min-Hsuan.
Vocal Emotion Recognition with Cochlear Implants Xin Luo, Qian-Jie Fu, John J. Galvin III Presentation By Archie Archibong.
Charismatic Speech Andrew Rosenberg Spoken Language Processing 4/24/06.
Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg,
Presented by Ravi Kiran. Julia Hirschberg Stefan Benus Jason M. Brenier Frank Enos Sarah Friedman Sarah Gilman Cynthia Girand Martin Graciarena Andreas.
Spoken Language Processing Lab Who we are: Julia Hirschberg, Stefan Benus, Fadi Biadsy, Frank Enos, Agus Gravano, Jackson Liscombe, Sameer Maskey, Andrew.
Ability to attract and retain followers by virtue of personal characteristics - not traditional or political office (Weber ‘47) What makes an individual.
Automatic Prosody Labeling Final Presentation Andrew Rosenberg ELEN Speech and Audio Processing and Recognition 4/27/05.
Modeling Other Speaker State COMS 4995/6998 Julia Hirschberg Thanks to William Wang.
On the Correlation between Energy and Pitch Accent in Read English Speech Andrew Rosenberg, Julia Hirschberg Columbia University Interspeech /14/06.
On the Correlation between Energy and Pitch Accent in Read English Speech Andrew Rosenberg Weekly Speech Lab Talk 6/27/06.
William Y. Wang CS 6998 Emotional Speech, Dept. of Computer Science, Columbia University, Dec Modeling Other Speaker State: Sarcasm, Charisma,
Classification of Discourse Functions of Affirmative Words in Spoken Dialogue Julia Agustín Gravano, Stefan Benus, Julia Hirschberg Shira Mitchell, Ilia.
9/5/20051 Acoustic/Prosodic and Lexical Correlates of Charismatic Speech Andrew Rosenberg & Julia Hirschberg Columbia University Interspeech Lisbon.
Charisma in English and Arabic Political Speech Julia Hirschberg Columbia University Joint work with Andrew Rosenberg and Fadi Biadsy Stony Brook University,
10/10/20051 Acoustic/Prosodic and Lexical Correlates of Charismatic Speech Andrew Rosenberg & Julia Hirschberg Columbia University 10/10/05 - IBM.
Varying Input Segmentation for Story Boundary Detection Julia Hirschberg GALE PI Meeting March 23, 2007.
Charisma Perception from Text and Speech Andrew Rosenberg NLP Group Meeting 11/03/05.
Funded by NIH grant RO1 HD-4152 to J. Arnold NSF BCS and NSF BCS to Z. Griffin Why do speakers modulate acoustic prominence? Listener-oriented.
Tone sensitivity & the Identification of Consonant Laryngeal Features by KFL learners 15 th AATK Annual Conference Hye-Sook Lee -Presented by Hi-Sun Kim-
CSD 5100 Introduction to Research Methods in CSD Observation and Data Collection in CSD Research Strategies Measurement Issues.
Speech Perception 4/4/00.
Evaluating prosody prediction in synthesis with respect to Modern Greek prenuclear accents Elisabeth Chorianopoulou MSc in Speech and Language Processing.
Schneider: Discourse1 CHAPTER 12: DISCOURSE READ 656 Dr. Schneider.
Predicting Student Emotions in Computer-Human Tutoring Dialogues Diane J. Litman&Kate Forbes-Riley University of Pittsburgh Department of Computer Science.
Recognizing Discourse Structure: Speech Discourse & Dialogue CMSC October 11, 2006.
Hello, Who is Calling? Can Words Reveal the Social Nature of Conversations?
Computational Linguistics Analysis of Charismatic Speech: Cross-Cultural and Political Perspectives Andrew Rosenberg NLP & Psychology 11/12/2015.
1/17/20161 Emotion in Meetings: Business and Personal Julia Hirschberg CS 4995/6998.
Lexical, Prosodic, and Syntactics Cues for Dialog Acts.
Phone-Level Pronunciation Scoring and Assessment for Interactive Language Learning Speech Communication, 2000 Authors: S. M. Witt, S. J. Young Presenter:
Acoustic Cues to Emotional Speech Julia Hirschberg (joint work with Jennifer Venditti and Jackson Liscombe) Columbia University 26 June 2003.
1 Variation in English Grammar Linda Thomas U210A Chapter 6.
A Text-free Approach to Assessing Nonnative Intonation Joseph Tepperman, Abe Kazemzadeh, and Shrikanth Narayanan Signal Analysis and Interpretation Laboratory,
L INGUISTIC AND SOCIAL INEQUALITY Linguistic inequality One of the most solid achievements of linguistics in 20 TH century has been to eliminate.
Teaching Listening Why teach listening?
Effects of Reading on Word Learning
Chapter 7 Verbal Intercultural Communication
Investigating Pitch Accent Recognition in Non-native Speech
Intonation and Computation: Charisma
National 4 English – Listening
Spoken language A guide to the key terms.
Why Study Spoken Language?
Studying Intonation Julia Hirschberg CS /21/2018.
Meanings of Intonational Contours
Studying Intonation Julia Hirschberg CS /21/2018.
AICE AS English Language (9093)
Automatic Fluency Assessment
Intonational and Its Meanings
Intonational and Its Meanings
The American School and ToBI
Detecting Prosody Improvement in Oral Rereading
Job Google Job Title: Linguistic Project Manager
Linguistic Predictors of Cultural Identification in Bilinguals
Why Study Spoken Language?
Meanings of Intonational Contours
Recognizing Structure: Sentence, Speaker, andTopic Segmentation
Fadi Biadsy. , Andrew Rosenberg. , Rolf Carlson†, Julia Hirschberg
Agustín Gravano & Julia Hirschberg {agus,
Discourse Structure in Generation
Comparative Studies Avesani et al 1995; Hirschberg&Avesani 1997
Emotional Speech Julia Hirschberg CS /16/2019.
Noriko Hoshino Department of Psychology
Explore attitudes to the spoken language of young people.
Acoustic-Prosodic and Lexical Entrainment in Deceptive Dialogue
Charismatic Speech and Vocal Attractiveness
Automatic Prosodic Event Detection
Presentation transcript:

Comparing American and Palestinian Perceptions of Charisma Using Acoustic-Prosodic and Lexical Analysis Fadi Biadsy, Julia Hirschberg, Andrew Rosenberg, and Wisam Dakka The Department of Computer Science, Columbia University, New York, USA Abstract Why study Charismatic Speech? Inter-Subject Agreement Acoustic/Prosodic Analysis Lexical Analysis Charisma, the ability to lead by virtue of personality alone, is difficult to define but relatively easy to identify. However, cultural factors clearly affect perceptions of charisma. In this paper we compare results from parallel perception studies investigating charismatic speech in Palestinian Arabic and American English. We examine acoustic/prosodic and lexical correlates of charisma ratings to determine how the two cultures differ with respect to their views of charismatic speech. It is an intriguing phenomenon To identify potential charismatic leaders To provide a feedback system for individuals who want to improve their speaking style – politicians, professors, students… To create a charismatic Text-to-Speech system, when compelling speech is needed (e.g., Intelligent tutoring system) Duration Token duration: positive correlate with charisma in both studies Pause: number of pauses to number of words in the token gives a positive correlate only in Arabic Sdev of length of pauses: negative correlate in English but positive in Arabic Speaking Rate Speaking Rate: positive correlate in English and approaching negative correlate in Arabic Speaking rate of fastest intonational phrase: positive correlation in both Pitch Mean F0: positive correlate in both studies Min F0: positive correlate in English but negative in Arabic Max and Sdev F0: positive correlate in Arabic only HiF0 max and Sdev: positive correlate in Arabic only Mean HiF0: positive correlate in both Normalized Pitch Max F0: approaching significance with negative correlation in English Mean HiF0: positive correlate in both Max and Sdev HiF0: positive correlate in Arabic only Intensity Mean and Sdev of rms of IPs: positive correlate in both Sdev Intensity: positive correlate in Arabic only ToBI Labels Ratio of H* pitch accents: negative correlate in English only Ratio of !H* and L+H* pitch accents: positive correlate in both Ratio of L* pitch accent: negatively correlates with charisma in both languages Ratio of H- phrase accent: phrase accent approaches positive significance in English only L% boundary tone: positively correlate with charisma in Arabic only H% boundary tone: negatively correlate with charisma in Arabic only Number of words: positively correlated with charisma in both studies Disfluency: rate of disfluencies (repetitions, repairs, and filled pauses) negatively correlated with charisma in both The filler “yaEony” (يعني): negatively correlate with charisma in Arabic Ratio of repeated words: positive correlate in both The use of Arabic regional dialect: negative correlation with charisma Prominalization First person plural pronoun: positive correlate in English only Third person singular pronouns: negative correlate in Arabic but positive in English Third person plural pronouns: negative correlate in English but positive in Arabic Part of Speech Ratio of adverbs, prepositions, and nouns: negative correlate in Arabic Ratio of adverbs and adjectives: negative correlate in English Our Approach ‘Functional’ Definition of Charisma What is Charisma? Collect tokens of charismatic and non-charismatic speech from a small set of speakers on a small set of topics Ask listeners to rate the ‘The speaker is charismatic’ plus statements about other 25 attributes (e.g., The speaker is boring, charming, persuasive,…) Correlate listener ratings with lexico-syntactic and acoustic-prosodic features of the tokens to identify potential cues to perception of charisma Ability to attract and retain followers by virtue of personal characteristics – not traditional or political office (Weber ‘47) What makes an individual charismatic? Their message? Their personality? Their speaking style? Charisma arising from the faith of a leader’s listener-followers (Marcus, 1967) It as a combination of a ‘gift of grace’, an inspiring message and an important crisis (Boss, 1976) Tannen (1984) identifies a number of pragmatic dimensions that vary cross-culturally including when to talk, formulacity, and degree of indirectness, cohesion and coherence. American and Palestinian Perception Studies H-H% Conclusions and Future Work Influence of Speaker and Topic on Charisma Ratings What is Charismatic Speech? While American and Palestinian speakers share some notion of a ‘functional’ definite of charisma — both find speakers who are persuasive, charming, enthusiastic and not boring to be charismatic — American speakers also find passionate and convincing speakers to be charismatic, while Palestinians associate the qualities of toughness and powerfulness with charisma Arabic subjects tended to be more homogenous in their judgments than were English subjects When we examine the acoustic/prosodic and lexical correlates of charisma in each study, we again find some broad similarities and some major differences Future Work Machine learning experiments to predict degree of charisma for a given speech token based on our features Perception experiments: Palestinian and Swedish subjects rate English American subjects rate Arabic Speech that leads listeners to perceive the speaker as charismatic What aspects of speech might contribute to the perception of a speaker as charismatic? Content of message? Lexico-syntactic features? Acoustic-prosodic features? Identity of speaker of a segment: significantly influences subjects’ ratings of charisma in both studies. Subject’s Recognition of speaker: positively influences perceptions of charisma in English. Topic (in English): approaching statistical significance on subjects’ ratings of charisma. Healthcare (mean rating 3.31), postwar Iraq (3.29), reasons for running (3.28), content-neutral (3.07), and taxes (2.97). Topic (in Arabic): influences charisma ratings. The Israeli separation wall (3.96), the assassination of the Hamas leader (3.37), the debate among the Palestinian groups (3.23), the Palestinian Authority and calls for reforms (3.21), and the Intifada and resistance (3.17) Subjects for English experiment: 12 native American English speakers (6 f, 6 m) They were presented with 45 speech segments of 2–28 seconds duration, 5 each from 9 candidates for Democratic nomination for U.S. president in 2004 Topics: greeting, reasons for running, tax cuts, postwar Iraq, healthcare. Is Charisma a Culture-Dependent Phenomenon? Subjects for Arabic experiment: 12 native Palestinian Arabic speakers (6 f, 6 m) Presented with 44 speech tokens of 3–28 seconds, 2 each from Palestinian politicians and authors Tokens extracted from Aljazeera talk shows, topics: the assassination, of the Hamas leader, the debate among the Palestinian, groups, The Intifada and resistance, the Israeli separation wall, the Palestinian Authority and calls for reforms Do people of different languages and cultures perceive charisma differently? Do they perceive charismatic speech differently? Do Arabic listeners respond to American politicians the same way Americans do? Do Americans hear Swedish professors the same way Swedish students do? Recent results: Prediction of Charisma (actual vs. predicted charisma score) Arabic English