Modeling Emotion Frameworks Useful In Computation and Speech Frank Enos

Overview General Questions Approaches to Describing Emotion Theoretical Models of Emotion Some Computational Frameworks

General Questions What makes E. relevant to Computation? What makes E. relevant to the study of speech? How can a subjective process be understood in computational terms? How do we operationalize our model? Caveat: emotions vs. linguistic labels

Describing Emotions Taxonomic descriptions* (Izzard) Discreet descriptions*  “Basic” emotions (Frijda, Plutchick) Dimensional (continuous) descriptions (Arnold, Schlosberg) Raw “empirical” observations, anecdotal reports Evidence  Langugage, self reports, behavioral, physiological *not an exhaustive list

Theoretical Frameworks (Cornelius) Evolutionary (Darwin)  Behavioral – physiological  Expression Jamesian  Physiological – behavioral  Experience Cognitive (Arnold)  Thought and emotion inseparable  Appraisal Social Constructivist (Averill)  E. fully understood only on social level of analysis

Appraisal Theory (Arnold) Describes mechanism that elicits the appropriate emotion in circumstances in which the functions of that emotion are called for. (Smith) Meaning based and evaluative  Individuals react differently Continuous process (not necessarily conscious) Produces action tendency / action readiness Highly differentiated Conducive to computational modeling

Beyond Appraisal Theory Emotion as Information (Clore)  Conceptual Priming vs. Feelings as Information  Judgement (Damasio) Intentionality, Agency and Emotion (Ableson)  Goal  Action  Causal Inst.  Outcome  Alternative construals of events So what’s a good definition, anyway?

Some Definitions “A felt tendency toward anything intuitively appraised as good (beneficial), or away from anything intuitively appraised as bad” (Arnold) “Valenced reactions to events, agents or objects, with their particular nature being determined by the way in which the eliciting situation is construed.” (Clore/Ortnoy) “Reaction to significant stimulus events that impinge on organismic equilibruim or that change the organism-environment relationship.” (Scherer)

A Few Computational Approaches Must specify: (Scherer)  Appraisal Criteria (Input vector)  Parameters (theoretical appraisal vectors)  Predicted Affective Response (vocal, action)  Computational Model (Implementation) Situated Cognizers (Petta) Modeling Emotional Agents (Wehrle) Predicting Emotion (Enos)

Classifying Emotion Using Appraisal Criteria ISEAR Database (Scherer) Subjects surveyed about remembered emotional episodes (N=7659) JOY, FEAR, ANGER, SADNESS, DISGUST, SHAME, GUILT Survey elicited variables for antecedents and reactions to the episode, as well as name of emotion Maximum likelihood to determine optimal directed graphical model of dependencies.

Digraph of Variable Dependencies

Classification Accuracy

Implications for Speech Understanding of Context Appraisal CriteriaEmotionSpeech Action Context Appraisal CriteriaEmotionSpeech

Implications for Speech Understanding of Context Appraisal CriteriaEmotionSpeech Action Context Appraisal CriteriaEmotionSpeech