1. Using Real Time data to Understand and support Human Behaviour Paul Watson Newcastle University, UK

2. Real time Data Sources increasing Sensors Environmental Medical Location CCTV ANPR RFID In Car

3. Real time Data Sources increasing People (directly) e-mail twitter text

4. Real time Data Sources increasing Software as a Service People (indirectly)

5. Challenge How can we use real-time information to influence behaviour (for the good)?

6. Key Stages CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Examples from Recent Work at Newcastle.....

7. Social Inclusion Through the Digital Economy (Hub) Social Inclusion Digital Technologies

8. Professor Phil Blythe Visalakshmi Suresh

10. CENEX Electric Smart Car

11. GPS & Engine Management Systems Real-time Vehicle Monitoring Existing Traffic Management Systems Real-time Data Management (at Ncl University)

12. TRIP SUMMARY 1.Power Consumed (.0611KWh) 2.Average Temperature (4) 3.Break Pedal Pressed (996) 4.Distance (8.4 km) 5.Speed (34 km/h) 6.Carbon foot print (6.972 g) TRIP SUMMARY

13. Battery Depletion Integrate with Satnav to guide driver to charging station

14. Assisting Older Drivers Can data analysis determine long-term issues? – cognitive impairments Short-term problems – effects of drugs Suggest the need for assistive technologies

15. Influencing Driver Behaviour CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Engine Management GPS Engine Management GPS Identify patterns that require intervention e.g. Distance Alert

16. Professor Patrick Olivier, Newcastle University Can we use pervasive technologies to allow people to stay longer in their own homes?

17. Supporting people with dementia People in the early stages of dementia want to continue living at home. They have problems with: – episodic memory – executive control (planning, sequencing, attentional control) Gets the kettle, fills it, switches it on…But then shell stand there, and Ill say – what are you doing now? and Ive jogged her memory again…She gets the coffee jar, and shell take the top off the jar. And shell look at it and think what am I doing with this off for?

18. Ambient Kitchen

20. Activity Recognition Video

21. Influencing People with Dementia CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? RFID Accelerometers in utensils Floor pressure Video RFID Accelerometers in utensils Floor pressure Video Data Mining, Activity Recognition Partially Ordered Markov Decision Processes Data Mining, Activity Recognition Partially Ordered Markov Decision Processes Prompting Alerts Prompting Alerts

22. e-Science Central Software as a Service for e-Science

23. Software as a Service Sharing can be integral part of application - in real time System receives info from all users in real time challenge is how to influence user behaviour Real-time data exchange Sensors Actuators

24. e-Science Central Store, Analyse, Automate, Share Software as a Service Cloud Computing Social Networking e-Science Central e-Science Central Dynamic Resource Allocation Pay-as-you-Go* Dynamic Resource Allocation Pay-as-you-Go* Web based Works anywhere Web based Works anywhere Controlled Sharing Collaboration Communities Controlled Sharing Collaboration Communities

30. Blogs and links

31. e-Science Central – Social Networking

32. Provenance powers Dashboards & Collective Intelligence

33. Advise on best practise : Most of your colleagues use workflow W to analyse the type of data youve just uploaded Alert when interesting new data appears Putting people in touch with experts Advise on best practise : Most of your colleagues use workflow W to analyse the type of data youve just uploaded Alert when interesting new data appears Putting people in touch with experts Influencing Behaviour of Scientists CollectProcessInfluencePeople How to model and reason about behaviour? How to influence behaviour? Intervention Sensors What data to collect? Provenance (store, analyse, share) Social Connections Provenance (store, analyse, share) Social Connections Graph theory, collective intelligence, provenance analysis

34. 3 Key Technical Challenges

35. Understanding and Influencing Behaviour Real WorldComputer Model Capture Model Reason Influence Computer Scientists Domain Researchers Social Scientists

36. Personalisation Influencing requires personalisation There has been recent work on algorithms to analyse vast amounts of data – e.g. collective intelligence, web analysis Assumptions behind most of this work: – no privacy issues – results not needed in real-time More focus needed on personalisation & timeliness – presenting useful information, in real-time, observing privacy

37. Scalability Real-time data pattern matching & processing complex event processing? Historic Analysis cloud?

38. Real TimeHistoric App Consumers Consumers & Generators App Sensors Generators App Data WarehouseEvent Processing Our General Architecture Inform Create Models Calibrate Models Aggregations Filter Sensor events Application events

39. Summary Real time data increasing – Sensors – Software as a Service Key is to extract value from this data by understanding the real-world behaviour it represents Grand challenge is to use this information to influence behaviour (for the good)