1. Emotional Speech
Julia Hirschberg
CS 6998
12/8/2018

2. Today Defining emotional speech Emotional categories
Eliciting judgments
Producing emotional speech
Detecting emotional speech
12/8/2018

3. Cowie ‘00
Is there a good theoretical or practical definition of emotional speech?
“Full-blown” emotion vs. emotional state
Cause and effect descriptions
Primary and secondary (second order)
Everyday descriptions
Representations
Biological
12/8/2018

4. Dimensions in continuous space, e.g.
Valence: positive or negative
Activation level: how disposed to take action
Structural models: different ways of appraising situation that evokes emotion
e.g. positive or negative? Does situation help agent to achieve his/her goals?
Timing as a key variable
sadness vs. grief vs. depression vs. gloominess
12/8/2018

5. How are emotions expressed? Display rules? In speech? Mixing
Simulation
12/8/2018

6. Schroeder ‘01: Emotion in Synthesis
How is a given emotion expressed in speech?
What are the properties of the emotion to be expressed? How are they related to those of other emotions?
What kind of synthesizer works best?
Formant
Diphone
Unit selection
12/8/2018

7. Prosody rules: what to modify? How do we evaluate the results?
Forced choice
Free response
Recognition rate
Perceived naturalness
12/8/2018

8. Ten Bosch ‘00: Emotion Recognition
How hard is the problem?
Is ‘standard’ ASR technology well-suited to it?
Acoustic and language models target short local events
Feature extraction normlizes/excludes e.g. pitch, rate, amplitude -- why?
Interaction: emotional speech and ASR performance
Synthesis needs one good example but...
12/8/2018

9. 12/8/2018