Application of Emotion Recognition Methods in Automotive Research Matthias Wimmer, Christian Peter, Jörg Voskamp, Martin A. Tischler Institut für Informatik.

Slides:

Advertisements

Similar presentations

ARTIFICIAL PASSENGER.

Advertisements

Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science TU München, Germany A Person and Context.

Model-based Image Interpretation with Application to Facial Expression Recognition Matthias Wimmer

COGNITIVE SCIENCE 17 Why Emotions Are Necessary Jaime A. Pineda, Ph.D.

Myers’ PSYCHOLOGY (6th Ed) ‏ Chapter 13 Emotion James A. McCubbin, PhD Clemson University Worth Publishers.

R & D Continental in Púchov Radoslav Fujerik Continental Technology Center Púchov, SK 8. November 2011, Zlín.

1 Introduction to Software Engineering Lecture 41 – Communication Skills.

On the road to the creation of situation-adaptive dialogue managers Ajay Juneja Dialog Seminar.

general psychology Firouz meroei milan Emotion 1.

Emotion, p A response of the whole organism, involving Physiological arousal by the autonomic nervous system Expressive behaviors Conscious experience.

Joemon M Jose (with Ioannis Arapakis & Ioannis Konstas) Department of Computing Science.

User-System Interaction a challenge for the present and the future Prof. dr. Matthias Rauterberg IPO Center for User-System Interaction Eindhoven University.

Presented By: Karan Parikh Towards the Automated Social Analysis of Situated Speech Data Watt, Chaudhary, Bilmes, Kitts CS546 Intelligent.

Based on a fine paper byPhilippe Zimmermann

User-Centered Design Prof. dr. Matthias Rauterberg IPO Center for User-System Interaction TU/e Eindhoven University of Technology.

Emotional Intelligence and Agents – Survey and Possible Applications Mirjana Ivanovic, Milos Radovanovic, Zoran Budimac, Dejan Mitrovic, Vladimir Kurbalija,

Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science Technische Universität München Adaptive.

Measuring Empathy Presentation at VICTEC technical workshop , IVA, Kloster Irrsee Dipl.-Psych. Carsten Zoll Institut für Theoretische Psychologie.

Older drivers fail in intersections: speed discrepancies between older and younger male drivers 學生：董瑩蟬.

10 ways to find a liar. An excerpt from the magazine «TUPOKAYF» and the book of Irvin Yalom "Liar on the couch“.

Children’s Books.

C H A P T E R 4 4 Arousal, Stress, and Anxiety. Is Arousal the Same as Anxiety? Relationship Between Trait and State Anxiety Session Outline Defining.

Technology to support psychosocial self-management Kurt L. Johnson, Ph.D. Henry Kautz, Ph.D.

Chapter 8: Motivation and Emotion

Seeing is believing: Using systematic observations in user experience research. March 11 th, 2011 Bram van Mil Sales consultant.

Effects of practice, age, and task demands, on interference from a phone task while driving Author: David Shinar, Noam Tractinsky, Richard Compton Accident.

How necessary is it to use and interpret it?. Non-verbal Communication  Nonverbal communications is the process of communication through sending and.

Subjective Sound Quality Assessment of Mobile Phones for Production Support Thorsten Drascher, Martin Schultes Workshop on Wideband Speech Quality in Terminals.

Perceptual Computing Kevin Homaizad. Background Control of a device with: Voice Recognition Facial Recognition Precise Muscle Movement Recognition* No.

Chapter 13 The Subjective and Physiological Nature of Emotions.

Chapter 3: The Measurement of Behavior Continued Validity: the extent to which a measure actually measures what it is intended to measure The truthfulness.

Empathy Measurement Sibylle Enz. Psychological Empathy Measures Self-Description  Questionnaires Empathy as an ability  Face Recognition  Picture Stories.

Tips for Parents of Teenage Drivers BALANCING LIFE’S ISSUES.

A comparison of two license plate acquiring methods Ubiquitous computing David Filipovic.

EMOTIONS. Emotions Emotions are our affective responses to changing relationships between ourselves and our environment.

MIT Artificial Intelligence Laboratory — Research Directions The Next Generation of Robots? Rodney Brooks.

Chapter 7 Affective Computing. Structure IntroductionEmotions Emotions & Computers Applications.

© 2011 The McGraw-Hill Companies, Inc. Instructor name Class Title, Term/Semester, Year Institution Introductory Psychology Concepts Emotions.

Emotion Comprised of: – Physiological arousal – Expressive behaviors – Conscious experience Thoughts Feelings Controversies: – Physiological response v.

RESEARCH MOTHODOLOGY SZRZ6014 Dr. Farzana Kabir Ahmad Taqiyah Khadijah Ghazali (814537) SENTIMENT ANALYSIS FOR VOICE OF THE CUSTOMER.

Cell Phones and Driving

FINGERTEC FACE ID FACE RECOGNITION Technology Overview.

Motivation and Emotion

Physiological response:

Testimonial Builder The simplest way to arm your sales team to BE your grassroots operation.

Derek McColl Alexander Hong Naoaki Hatakeyama Goldie Nejat

Automated Detection of Human Emotion

Human-Operator Monitoring System

Communication and Social Style

Starter: Prepare a dance routine to the following music, some of you will be asked to perform this back to the class.

3 COMPONENTS OF EMOTION Physiological Arousal Expressive Behaviors

Effective Communication in the Workplace

Presentation by Sasha Beltinova

When You’re Done… Take the “Blobs” sheet and circle four blobs:

Survey of Affective Computing for Digital Home

Lecture 2: Data Collecting and Sampling

Multi-Sensor Soft-Computing System for Driver Drowsiness Detection

What is blue eyes ? aims on creating computational machines that have perceptual and sensory ability like those of human beings. interactive computer.

Interaction in Urban Traffic – Insights into an Observation of Pedestrian-Vehicle Encounters André Dietrich, Chair of Ergonomics, TUM

Exploring Naturalistic Gestures for Digital Tabletops

WORKING WITH COLLEGUES AND CUSTOMERS

Emotion notes 13-2 (Objectives 2-7)

6 Important Gestures 護二甲詹怡琪

Experimental Evaluation

Learning Targets I can define emotion

Automated Detection of Human Emotion

Peeping into the Human World

Presentation transcript:

Application of Emotion Recognition Methods in Automotive Research Matthias Wimmer, Christian Peter, Jörg Voskamp, Martin A. Tischler Institut für Informatik 2nd Workshop “Emotion and Computing”, , Osnabrück

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"2 Theoretical Background of Driving Pleasure Driver‘s Objective: Optimal Activation Task Demands Driveability Sportiveness Comfort Capability Task Difficulty Resources und Restrictions Vehicle Environment Emotional estimation Transfer of Driver‘s Request Jordan (2000): “Four Pleasures”  Physio-pleasure  Psycho-pleasure  Socio-pleasure  Ideo-pleasure based on Fuller (2005)

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"3 Measurement of Emotions in Vehicles EMOTION Subjective component Verbal report Expressive component Video/Audio- recording Behavioral component Driving dynamics Physiological component Measurement Cognitive component Verbal report  Facial expressions  Gestures  Changes in voice ECG, EMG, EDA Questioning during driving Driving style and operator control action Cognitive appraisal of the vehicle and the situation

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"4 Pilot Study „Driving Pleasure W204“ 2007 C220 CDI (W204) E (W201)

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"5 Cooperation

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"6 Subjects: 8 non professional drivers (age: 33-53)

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"7 Task: Drive on three courses Bosch Proofing Ground Boxberg (near Heilbronn) Autobahn Country road Handling course

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"8 Technical Setup driving dynamics meter EREC glove video camera microphone cell phone handsfree set EREC recording unit

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"9 The Methods in Detail Physiological measurement system EREC (skin resistance, heart rate, temperature) Interviews and questionnaires after driving each car Video and audio recorder on the back seat Drivers were asked to “think aloud”

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"10 Subjective Driving Experience 1,03,05,07,0 subjective control no worries about safety drove too risky vehicle is predictable vehicle met my desires MB 190E MB C220 strongly agreestrongly disagree N=8, Method: questionnaire

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"11 Facial Expression Recognition Institut für Informatik Mercedes-Benz 190E Mean expression of happiness: 4,2% Peak value: 15,0% Mercedes-Benz C-Class 220 Mean expression of happiness: 5,5% Peak value: 19,8% 0% = neutral face 100% = maximum expression

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing" A C H A H C MB 190E MB C-Class 220 A Autobahn C Country road H Handling Valence Activation Speech Analysis Most important parameters changes of pitch intensity energy changes over frequency bands Average confidence for valence for arousal

Tischler, Peter, Wimmer & Voskamp, Application of Emotion Recognition Methods in Automotive Research, 2nd Workshop "Emotion and Computing"13 Conclusions Methods show corresponding results Speech analysis Easy to apply, but speech is not a natural product while driving Facial expression recognition Challenge in fitting the face model and classifying the facial expression Problems: changing light and background, non emotional-related head movements, driver is talking Advantages of tested methods Non disturbing Continuous data collection Useful completion to psychological methods