Emotion-aware recommender systems Master’s thesis SupervisorMentorStudent Katrien VerbertKarsten SeippJeroen Reinenbergh

Research topics Emotion recognition o Automatic o Mobile o Unobtrusive Recommender system o Emotions as input and/or feedback o Music recommendation

Emotion recognition – Literature* * Bibliographic references can be found at

Emotion recognition – Literature* * Bibliographic references can be found at

Emotion recognition – Signals Subjective o Surveys o Self-Assessment Manikin o... Behavioural o Facial expressions o Body gestures o …

Emotion recognition – Signals Physiological o Brain activity o Blood volume pulse o Blood pressure o Heart rate o Skin conductance o Skin temperature o Respiration o …

Emotion recognition – Sensors Muse headband o Brain activity o Head movement o Status indicators o Artifacts Empatica E4 wristband o Blood volume pulse o Skin conductance o Temperature o Movement

Emotion recognition – Difficulties o Unobtrusiveness  accuracy o Discrete  dimensional

Android app – Recording sensor data 

Android app – Visualizing sensor data EEGHorseshoe

Android app – Visualizing sensor data ArtifactsAccelerometer

Android app – Demo

Android app – Analyzing sensor data EEGHorseshoe

Android app – Difficulties o Android framework o Sensor APIs

Schedule – First semester o September - October Literature Android basics o November Data extraction Data visualization o December Discrete emotion detection Feature extraction Building classifier(s) Inclusion of Empatica E4 wristband data

Schedule – Second semester o February - March Iterative evaluation and refinement Real-time detection o April Mobile detection Inclusion of recommender system o May Small party Writing o June Big party

Statistics 9 blog posts 3 blog comments 122 papers read/skimmed 290 hours of work o 65% design/implementation o 25% reading o 4% writing o 4% reflection o 2% meetings ≥ 14/20 expected

Q & A