1. Multimedia Concepts and Applications Multimedia Concepts and Applications Differentiated Semantic Analysis in Lexical Affect Sensing Alexander Osherenko, Elisabeth André University of Augsburg

2. Multimedia Concepts and Applications Multimedia Concepts and Applications Examples What is the emotional meaning (I am very happy vs. I am happy)?I am very happyI am happy What is the emotional meaning (I am very sad even if everybody is happy!)?I am very sad even if everybody is happy!

3. Multimedia Concepts and Applications Multimedia Concepts and Applications Research questions Differentiated analysis Significant elements

4. Multimedia Concepts and Applications Multimedia Concepts and Applications Differentiated linking Rules that consider affective and grammatical information Different granularities of analysis, e.g. majority Different strategies of analysis, e.g. first phrase

5. Multimedia Concepts and Applications Multimedia Concepts and Applications Information sources Affective sources – Emotion words (GI, WordNet-Affect, Levin) – Movie glossary Grammatical sources – Means from linguistic literature (negations, intensifiers, superordinate/subordinate clauses) – Means from own corpus studies (interdependencies)

6. Multimedia Concepts and Applications Multimedia Concepts and Applications Corpora FWF (759 sentences - 3 classes) – Statistical: 37.2% BMRC-S (1010 sentences - 3-, 5-classes) – Statistical: 52.34% - 3 classes; 30.81% - 5 classes

7. Multimedia Concepts and Applications Multimedia Concepts and Applications System Relies on deep parsing in the Stanford parser and matching in the SPIN parser 4,527 rules for emotion words 74 rules for primitive grammatical elements 154 empirical grammatical rules

8. Multimedia Concepts and Applications Multimedia Concepts and Applications Results 47.64% classwise recall value (FWF) – 37.2% statistical 54.65% classwise recall value (3-classes BMRC-S) or 32.79% classwise recall value (5- classes BMRC-S) - 52.34% vs. 30.81% statistical

9. Multimedia Concepts and Applications Multimedia Concepts and Applications Discussion Semantic vs. statistical Majority, First phrase

10. Multimedia Concepts and Applications Multimedia Concepts and Applications Future work Generalization Emotional phrases/idioms Quantifiers (Few people were happy, Many people were happy) Context (dynamically changing)