Interactive Emotional Content Communications System using Portable Wireless Biofeedback Device IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, November 2011 Dong Keun Kim, Jonghwa Kim, Eui Chul Lee, Mincheol Whang, and Yongjoo Cho Presenter: Siao, Jing-Jhou Advisor: Dr. Pei-Jarn Chen Date:2015/11/04 1
Outline Introduction Methodology Experimental results Conclusion 2
Introduction 3
In recent years Emotion communication systems Audiovisual signals Facial expressions Gesticulation 4
Interactive emotional content communication system Physiological sensors Portable wireless biofeedback device Emotional content rendering system 5
Methodology 6
Composition Portable wireless biofeedback device Photoplethysmography (PPG) Skin temperature (SKT) Galvanic skin response (GSR) 7
Russell’s emotion model 8
Overall architecture Overall architecture of implemented interactive emotional content communication system. 9
Diagram of system for physiological signal sampling 10
Physiological sensors Three designed physiological sensors: PPG, SKT, and GSR. 11
Portable wireless biofeedback device 12
Emotion category Positive emotion Negative emotion Neutral emotion 13
TDP(time dependent parameter) 14
TDP rule for emotion recognition t1(Delay)t2(Activation)t3(Half Recovery)t4(Recovery) NegNeuPosNegNeuPosNegNeuPosNeg NeuPos SKT ±10.00±0.40±9.21±5.09±0.74± GSR ±1.16±0.40±1.95±11.06-± PPG ±2.74±0.31±2.91±1.97±1.48±4.93±12.06-± ( unit: seconds ) Neg: Negative, Neu: Neutral, Pos: Positive 15
Emotion state codes Emotion State Codes(Hex Format) Emotion StatesVideo Controls (Color Descriptions) 0X01 ExcitementRGB(254, 126, 0) 0X02 DistressRGB(231, 221, 136) 0X03 DepressionRGB(80, 91, 99) 0X04 ContentmentRGB(179, 98, 18) 0X05 PleasureRGB(230, 0, 0) 0X06 ArousalRGB(255, 240, 25) 0X07 MiseryRGB(25, 59, 108) 0X08 SleepinessRGB(165, 193, 215) 0X09 NeutralRGB(148, 191, 38) 16
Tiled display system 17
Concentration Concentration in gaze position experiment using gaze tracking camera device 18
Concentration GroupVarCon No rendered visual stimuli 0.076(±0.039) Rendered visual stimuli 0.039(±0.021) (1) (2) (3) 19
Experimental Results 20
Emotional content communications 21
Conclusion 22
Conclusion In this study, we proposed a novel interactive emotional content communication system using a portable wireless biofeedback device to support convenient emotion recognition for users. 23
Thanks for your attention ! 24