Using Real Time data to Understand and support Human Behaviour Paul Watson Newcastle University, UK

Real time Data Sources increasing Sensors Environmental Medical Location CCTV ANPR RFID In Car

Real time Data Sources increasing People (directly) twitter text

Real time Data Sources increasing Software as a Service People (indirectly)

Challenge How can we use real-time information to influence behaviour (for the good)?

Key Stages CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Examples from Recent Work at Newcastle.....

Social Inclusion Through the Digital Economy (Hub) Social Inclusion Digital Technologies

Professor Phil Blythe Visalakshmi Suresh

CENEX Electric Smart Car

GPS & Engine Management Systems Real-time Vehicle Monitoring Existing Traffic Management Systems Real-time Data Management (at Ncl University)

TRIP SUMMARY 1.Power Consumed (.0611KWh) 2.Average Temperature (4) 3.Break Pedal Pressed (996) 4.Distance (8.4 km) 5.Speed (34 km/h) 6.Carbon foot print (6.972 g) TRIP SUMMARY

Battery Depletion Integrate with Satnav to guide driver to charging station

Assisting Older Drivers Can data analysis determine long-term issues? – cognitive impairments Short-term problems – effects of drugs Suggest the need for assistive technologies

Influencing Driver Behaviour CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Engine Management GPS Engine Management GPS Identify patterns that require intervention e.g. Distance Alert

Professor Patrick Olivier, Newcastle University Can we use pervasive technologies to allow people to stay longer in their own homes?

Supporting people with dementia People in the early stages of dementia want to continue living at home. They have problems with: – episodic memory – executive control (planning, sequencing, attentional control) Gets the kettle, fills it, switches it on…But then shell stand there, and Ill say – what are you doing now? and Ive jogged her memory again…She gets the coffee jar, and shell take the top off the jar. And shell look at it and think what am I doing with this off for?

Ambient Kitchen

Activity Recognition Video

Influencing People with Dementia CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? RFID Accelerometers in utensils Floor pressure Video RFID Accelerometers in utensils Floor pressure Video Data Mining, Activity Recognition Partially Ordered Markov Decision Processes Data Mining, Activity Recognition Partially Ordered Markov Decision Processes Prompting Alerts Prompting Alerts

e-Science Central Software as a Service for e-Science

Software as a Service Sharing can be integral part of application - in real time System receives info from all users in real time challenge is how to influence user behaviour Real-time data exchange Sensors Actuators

e-Science Central Store, Analyse, Automate, Share Software as a Service Cloud Computing Social Networking e-Science Central e-Science Central Dynamic Resource Allocation Pay-as-you-Go* Dynamic Resource Allocation Pay-as-you-Go* Web based Works anywhere Web based Works anywhere Controlled Sharing Collaboration Communities Controlled Sharing Collaboration Communities

Blogs and links

e-Science Central – Social Networking

Provenance powers Dashboards & Collective Intelligence

Advise on best practise : Most of your colleagues use workflow W to analyse the type of data youve just uploaded Alert when interesting new data appears Putting people in touch with experts Advise on best practise : Most of your colleagues use workflow W to analyse the type of data youve just uploaded Alert when interesting new data appears Putting people in touch with experts Influencing Behaviour of Scientists CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Provenance (store, analyse, share) Social Connections Provenance (store, analyse, share) Social Connections Graph theory, collective intelligence, provenance analysis

3 Key Technical Challenges

Understanding and Influencing Behaviour Real WorldComputer Model Capture Model Reason Influence Computer Scientists Domain Researchers Social Scientists

Personalisation Influencing requires personalisation There has been recent work on algorithms to analyse vast amounts of data – e.g. collective intelligence, web analysis Assumptions behind most of this work: – no privacy issues – results not needed in real-time More focus needed on personalisation & timeliness – presenting useful information, in real-time, observing privacy

Scalability Real-time data pattern matching & processing complex event processing? Historic Analysis cloud?

Real TimeHistoric App Consumers Consumers & Generators App Sensors Generators App Data WarehouseEvent Processing Our General Architecture Inform Create Models Calibrate Models Aggregations Filter Sensor events Application events

Summary Real time data increasing – Sensors – Software as a Service Key is to extract value from this data by understanding the real-world behaviour it represents Grand challenge is to use this information to influence behaviour (for the good)