Emotion in Action: Driving Simulator Technique Edelle McMahon & Roddy Cowie School of Psychology Queen’s University Belfast

What we mean by emotion in action (and how it relates to databases) In everyday life, emotion shapes ongoing activities In everyday life, emotion shapes ongoing activities –Research is drawn to ‘pure’ episodes –BUT normally, emotion is coexisting with other plans, agendas, demands –and what happens is an outcome of interactions Conversation is one instance of interaction Conversation is one instance of interaction –SAL etc let us study that context –But it’s not the only one

What we mean by emotion in action (and how it relates to databases) We hypothesise it affects other aspects of life by affecting cognition We hypothesise it affects other aspects of life by affecting cognition –probably not whole story (motivation to make something happen), but a big part The results are distinctive actions The results are distinctive actions –e.g. Aristotle’s ‘impulses; ben Ze’ev’s ‘partiality’ And may play a big part in recognising emotion And may play a big part in recognising emotion

What we mean by emotion in action (and how it relates to databases) We want to understand these effects We want to understand these effects –not just episodes where expressing emotion is top of the agenda Practically important – Practically important – –we can’t assume direct transfer from situations where emotion is be-all & end-all –we may misinterpret apparently ‘pure’ cases We need data that allows us to study these effects We need data that allows us to study these effects –Drive sim is a context – but also an application in itself

The events we can study with STISIM Aspects of driving Aspects of driving –Dangerous driving –Overcautious driving Indicators of cognitive processes Indicators of cognitive processes –Attention –Decision-making Direct signs of emotion Direct signs of emotion –Vocal, facial, physiological, behavioural STISIM a good platform - can monitor a range of emotion outcomes STISIM a good platform - can monitor a range of emotion outcomes

Inducing emotion Desiderata Desiderata i) naturalness ii) rigour Policy Policy –we have tried i), and it’s messy –Ii) will need tweaking Choices Choices –Velten –Computer game –PLUS repeat & reinforce

Data issues primary records (raw data) give primary records (raw data) give –audio-visual –full transcript of driving –physiological records analysis needed to create useful features analysis needed to create useful features

Useful Features : Physiological ECG: – –Heart Rate, Heart Rate Diff., Beat Magnitude GSR: – –GSR Level, GSR Diff RESP: – –Breath Rate, Breath Rate Diff., Breath Magnitude Skin Temp: – –Temp Level, Temp Diff

Useful Features : Performance Explicit Driving Performance: –Pedestrian risk –Out of lane –Off road –Over speed limit –Crashes Implicit Driving Performance: Implicit Driving Performance: –Acceleration –Deceleration –Lateral Velocity –Lateral acceleration –Steering effort –Steering change –Throttle level –Throttle change –Abrupt throttle change (surge) –Braking intensity –Braking intensity change

Plan of work consultation with partners – get it right! consultation with partners – get it right! pilot work on inducing pilot work on inducing experiments proper experiments proper

Thank you!

Contact me on….