1. Interactive Emotional Content Communications System using Portable Wireless Biofeedback Device IEEE Transactions on Consumer Electronics, Vol. 57, No. 4, November 2011 Dong Keun Kim, Jonghwa Kim, Eui Chul Lee, Mincheol Whang, and Yongjoo Cho Presenter: Siao, Jing-Jhou Advisor: Dr. Pei-Jarn Chen Date:2015/11/04 1

2. Outline Introduction Methodology Experimental results Conclusion 2

3. Introduction 3

4. In recent years Emotion communication systems  Audiovisual signals  Facial expressions  Gesticulation 4

5. Interactive emotional content communication system Physiological sensors Portable wireless biofeedback device Emotional content rendering system 5

6. Methodology 6

7. Composition Portable wireless biofeedback device  Photoplethysmography (PPG)  Skin temperature (SKT)  Galvanic skin response (GSR) 7

8. Russell’s emotion model 8

9. Overall architecture Overall architecture of implemented interactive emotional content communication system. 9

10. Diagram of system for physiological signal sampling 10

11. Physiological sensors Three designed physiological sensors: PPG, SKT, and GSR. 11

12. Portable wireless biofeedback device 12

13. Emotion category Positive emotion Negative emotion Neutral emotion 13

14. TDP(time dependent parameter) 14

15. TDP rule for emotion recognition t1(Delay)t2(Activation)t3(Half Recovery)t4(Recovery) NegNeuPosNegNeuPosNegNeuPosNeg NeuPos SKT ---15.859.6120.005.605.8316.00 --- ---±10.00±0.40±9.21±5.09±0.74±6.57 --- GSR ---2.651.563.690.79-4.51 --- ---±1.16±0.40±1.95±11.06-±6.55 --- PPG 2.252.433.904.373.458.001.75-6.03 --- ±2.74±0.31±2.91±1.97±1.48±4.93±12.06-±6.03 --- ( unit: seconds ) Neg: Negative, Neu: Neutral, Pos: Positive 15

16. Emotion state codes Emotion State Codes(Hex Format) Emotion StatesVideo Controls (Color Descriptions) 0X01 ExcitementRGB(254, 126, 0) 0X02 DistressRGB(231, 221, 136) 0X03 DepressionRGB(80, 91, 99) 0X04 ContentmentRGB(179, 98, 18) 0X05 PleasureRGB(230, 0, 0) 0X06 ArousalRGB(255, 240, 25) 0X07 MiseryRGB(25, 59, 108) 0X08 SleepinessRGB(165, 193, 215) 0X09 NeutralRGB(148, 191, 38) 16

17. Tiled display system 17

18. Concentration Concentration in gaze position experiment using gaze tracking camera device 18

19. Concentration GroupVarCon No rendered visual stimuli 0.076(±0.039)13.147 Rendered visual stimuli 0.039(±0.021)25.037 (1) (2) (3) 19

20. Experimental Results 20

21. Emotional content communications 21

22. Conclusion 22

23. Conclusion In this study, we proposed a novel interactive emotional content communication system using a portable wireless biofeedback device to support convenient emotion recognition for users. 23

24. Thanks for your attention ! 24