1. Memex Summit, July 2006 SenseCam & memory rehabilitation Georgina Browne, Emma Berry, Narinder Kapur Steve Hodges, Lyndsay Williams, Gavin Smyth, James Srinivasan, Alex Butler, Alban Rrustemi, Ken Wood

2. Memex Summit, July 20062 Background Cambridge Memory Clinic, Addenbrookes HospitalCambridge Memory Clinic, Addenbrookes Hospital

3. Memex Summit, July 20063 Causes and treatment of memory loss Neurodegenerative diseaseNeurodegenerative disease –Alzheimers disease and Lewy Body dementia can be treated with medication – with limited success –No medical treatment for other dementias –External memory aids (in theory) Acquired brain injury (traumatic and non- traumatic)Acquired brain injury (traumatic and non- traumatic) –External memory aids (in theory)

4. Memex Summit, July 20064 Improving memory with SenseCam Different types of memory:Different types of memory: –Episodic – things you have done (personal experiences) –Semantic – facts and concepts –Prospective – things you intend to do (go shopping, visit friends, make and keep appointments) Almost all memory aids treat prospective memoryAlmost all memory aids treat prospective memory

5. Memex Summit, July 20065 Improving memory with SenseCam Episodic memory critical to quality of lifeEpisodic memory critical to quality of life –Forms basis for semantic memories –Guides actions, creates bonds, builds self-concept SenseCam records experiencesSenseCam records experiences –Captures events from patients point of view –Without conscious thought or intrusion –Plays back quickly in simple-to-use, easy-to-view movie Subsequent viewing of image sequencesSubsequent viewing of image sequences –Cues recall & so consolidates storage of memories

6. Memex Summit, July 20066 Improving memory with SenseCam Cambridge Memory Clinic, Addenbrookes HospitalCambridge Memory Clinic, Addenbrookes Hospital 63 year old, well-educated, married woman Mrs B63 year old, well-educated, married woman Mrs B Diagnosed with limbic encephalitis in 2002Diagnosed with limbic encephalitis in 2002 Now has marked amnesiaNow has marked amnesia –usually no memory a couple of days after event

7. Memex Summit, July 20067 Improving memory with SenseCam Goals of patient and husbandGoals of patient and husband –To improve Mrs Bs episodic memory –To share experiences with each other –To improve Mrs Bs self-esteem and confidence

8. Memex Summit, July 20068 Improving memory with SenseCam Study ProtocolStudy Protocol –Experimental condition: SenseCam used to record special days (N=9) –Control condition: written diary used to record special days (N=3) –Baseline condition: no memory aid used to help recall special days (N=2) –Information reviewed every 2 days for 2 weeks –Memory evaluated before each review

9. Memex Summit, July 20069 ResultsResults Proportion of event remembered Memory of an event over time Baseline Days elapsed following event

10. Memex Summit, July 200610 ResultsResults Memory of an event over time Days elapsed following event Diary Baseline Proportion of event remembered

11. Memex Summit, July 200611 ResultsResults Memory of an event over time Days elapsed following event Diary SenseCam Baseline Proportion of event remembered

12. Memex Summit, July 200612 ResultsResults Memory of an event over time Days elapsed following event Diary SenseCam Baseline Proportion of event remembered

13. Memex Summit, July 200613 Results: SenseCam feedback Results from patients point of view:Results from patients point of view: –More relaxed socially and less anxious –Sharing experiences again was a sheer pleasure –Seeing images brings memories flooding back –It has enormous potential as a memory aid and has been a great success for us personally

14. Memex Summit, July 200614 Results: SenseCam feedback PublicationsPublications –Berry, E., Kapur, N., Watson, P., Smith, R., Williams, L., & Wilson, B. (in press). The use of SenseCam as a pictorial diary to improve autobiographical memory in a patient with limbic encephalitis: A preliminary report. Neuropsychological Rehabilitation. –Hodges, S., Williams, L., Berry, E., Izadi, S., Srinivasan, J., Butler, A., Smyth, G., Kapur, N., & Wood, K. SenseCam: A retropsective memory aid. To appear in UbiComp 2006, 8 th International Conference on Ubiquitous Computing, September 17-21, 2006. –Tan, D., Berry, E., Czerwinski, M., Sellen, A., Bell, G., Gemmell, J., Hodges, S., Kapur, N., Meyers, B., Oliver, N., Robertson, G., & Wood, K. (in press). Supporting human memory with a personal digital lifetime store. To appear in J. Teevan & W. Jones (Eds.), Readings in Personal Information Management. Seattle: University of Washington Press.

15. Memex Summit, July 200615 Ongoing research: MSRC SenseCam as an episodic memory aid in patients with early Alzheimers diseaseSenseCam as an episodic memory aid in patients with early Alzheimers disease SenseCam as an episodic memory aid in other patients with memory lossSenseCam as an episodic memory aid in other patients with memory loss SenseCam factors facilitating consolidationSenseCam factors facilitating consolidation –Image-reviewing schedules

16. Memex Summit, July 200616 Ongoing research: collaborative work Collaborations agreed/underway with:Collaborations agreed/underway with: –Professor Narinder Kapur, Head of Neuropsychology, Addenbrookes Hospital, Cambridge –Professor Adam Zeman, Professor of Cognitive and Behavioural Neurology, Peninsula Medical School, Exeter –Professor Jon Evans, Professor of Applied Neuropsychology, University of Glasgow –Dr Chris Butler, Clinical Research Fellow, Department of Neurology, University of Edinburgh –Dr Nick Alderman, Consultant Neuropsychologist, St Andrews Hospital, Northampton –Professor Barbara Wilson, Senior Scientist, MRC Cognition and Brain Sciences Unit, Cambridge –Professor John Hodges, Professor of Behavioural Neurology, University of Cambridge –Professor Phillip Barnard, Research Scientist, MRC Cognition and Brain Sciences Unit, Cambridge –Professor Martin Conway, Director of Research & ESRC Professorial Fellow, Leeds Memory Group, University of Leeds –Dr Andrew Bateman, Clinical Director, Oliver Zangwill Centre of Neuropsychological Rehabilitation, Ely

17. Memex Summit, July 200617 Ongoing research: collaborative work John Hodges, Professor of Behavioural Neurology, Addenbrookes HospitalJohn Hodges, Professor of Behavioural Neurology, Addenbrookes Hospital –Mild Cognitive Impairment –Early Alzheimers Disease Adam Zeman, Professor of Cognitive & Behavioural Neurology, ExeterAdam Zeman, Professor of Cognitive & Behavioural Neurology, Exeter –Epileptic amnesia –Semantic dementia Oliver Zangwill Centre, CambridgeOliver Zangwill Centre, Cambridge –Brain Injury Rehabilitation –Therapy

18. Memex Summit, July 200618 Ongoing research: collaborative work Collaboration with Martin Conway, Professor of Cognitive Psychology, Leeds Memory Group, Editor of the journal MemoryCollaboration with Martin Conway, Professor of Cognitive Psychology, Leeds Memory Group, Editor of the journal Memory SenseCam is potentially the first truly powerful 21st century memory stimulant which could generally improve and strengthen memory in normal aging populations and in those with brain disease

19. Memex Summit, July 200619 Ongoing research: collaborative work Undertaking SenseCam memory studies based on two hypotheses:Undertaking SenseCam memory studies based on two hypotheses: 1.SenseCam movies mimic episodic memory VisualVisual From egocentric point of viewFrom egocentric point of view Temporally orderedTemporally ordered Formed outside awarenessFormed outside awareness Time compressedTime compressed Correspond to changes in goal-directed behaviourCorrespond to changes in goal-directed behaviour Using SenseCam in experimental studies Using SenseCam in experimental studies Investigating extent to which SenseCam stimulates recall and strengthens learningInvestigating extent to which SenseCam stimulates recall and strengthens learning Asking How do we forget over time? and How do our memories decline with age?Asking How do we forget over time? and How do our memories decline with age?

20. Memex Summit, July 200620 Ongoing research: collaborative work Professor Conways hypotheses contd…Professor Conways hypotheses contd… 2.SenseCam movies stimulate brain regions important for memory consolidation Hippocampus and related memory structuresHippocampus and related memory structures Neural networks not easily activated otherwiseNeural networks not easily activated otherwise Using SenseCam in neuroimaging studies Using SenseCam in neuroimaging studies Investigating the functional neuroanatomy of episodic memory in the normal population and in patientsInvestigating the functional neuroanatomy of episodic memory in the normal population and in patients

21. Memex Summit, July 200621 Final words SenseCam may be an extremely powerful aid for people with memory disordersSenseCam may be an extremely powerful aid for people with memory disorders SenseCam may be a potential innoculation against memory decline in the normal ageing populationSenseCam may be a potential innoculation against memory decline in the normal ageing population