From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux

Plan Context Objectives and Approach From smart homes To smart care Pervasive computing Tangible User interface Mobile computing From smart homes Hardware : the lab To smart care Middleware A pervasive reminder system Cognitive assistance Plan recognition In situ clinical studies Conclusion

Context People suffering of cognitive impairments in Quebec Alzheimer disease : 5.1% of people over 65 years old Head trauma : 3000 new cases each year Schizophrenia : 1% of the population They would be able to stay at home if light assistance was provided. But healthcare resources are scarce. So relatives have to take responsibility for care. turns to an exhausting burden. Hence relatives and caregivers urge for help.

Objectives Provide adapted and personalized environmental cues to Foster the autonomy of cognitively impaired people at home Lessen risks and hazards at home Pervasive computing Tangible user interfaces Keep ensuring continuous cognitive assistance outside people’s home Mobile computing Location-based services Help relatives and caregivers to keep in touch at distance with cognitively impaired people

General architecture

From smart homes… Smart homes are augmented environments Heterogeneous networks Sensors networks Embedded computers Information appliances Networked communicating objects

An augmented apartment

A intégrer Ariane Controls Crestron Contrôle audio/vidéo Contrôle de l’éclairage Crestron Contrôle audio/vidéo Multi-affichage sur écran Contrôle du débit d’eau X10

From smart homes… Smart homes are augmented environments Heterogeneous networks Wireless WiFi, Bluetooth, RFID, UWB, etc. Wired Ethernet, Electrical wires Servers Controls over sounds and video streams

From smart homes… Smart homes are augmented environments Sensors networks Identification and localization of objects and people Ubisense, UWB Smart tags (RFID)

From smart homes… Smart homes are augmented environments Embedded computers Not yet investigated

From smart homes… Smart homes are augmented environments Information appliances

From smart homes… Smart homes are augmented environments Networked communicating objects

… to smart care Smart homes can assist cognitively impaired people and foster their autonomy. Indeed such augmented homes can become true cognitive prostheses. As well, smart homes can help caregivers to grant better care give a sense of security to residents and their relatives.

Middleware Spontaneous networking Heterogeneous networks Autonomic computing Mobile code and agents Location and context awareness Security and privacy

A Pervasive Reminder System for Smart Homes Identification and localization of a user Transitory coalition of devices Pervasiveness: Integration in a real living environment Fluid usage Transparent user friendly migration of sessions Zero-configuration Spontaneous networking and service discovery To cope with heterogeneity of devices and hardware, networks Keeping the system in a clean state Simon Guertin, M. Sc.

Multi-channel delivery of geo-referenced services Thèse de Davide

Cognitive assistance What are the primitive information needed What are the objects involved in an activity ? Track primitive actions What is the user doing or wants to do ? Plan recognition Hierarchical models Lattice Assist the user Highligth objects Tangible user interfaces

Plan recognition Hierarchical models Lattice-based models No action models Kautz

Personnalization Appli de Jérémie en maîtrise

Cognitive deficits Attention Memory Planing Initiation

Attention deficits During task completion, the person shifts her attention from the activity under progress to a stimulus causing interference. The person demonstrates difficulty to focus on the activity to be performed and as a consequence, the current activity should be forgotten and never completed.

Planning deficits The planning deficit leads to the difficulty to perform an appropriate sequence of actions in order to achieve a goal.

Memory deficits The memory processes refer to information storage and retrieval. Suffering from memory deficits could lead to difficulties to remember the activity to perform, the steps of the activity or the locations of the tools and materials involved in that activity. Follow-me The lamp turns on to highlight the searched object (red book) The lamp turns off when the object is too far away.

Initiation deficits The initiation deficit leads to inactive periods whereas the person is supposed to perform actions For example, during breakfast time, standing in the kitchen for a long time could be attributed to an initiation deficit.

Clinical studies Centre de recherche Fernand-Séguin, Dr Emmanuel Stip, psychiatrist Expérimentation pageurs JF moreau Centre de résadaptation Estrie Head trauma

Conclusion At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people. Pervasive computing enables a seamless integration of assistance in residents’ everyday life while TUI turn the whole house into a cognitive prosthesis. Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers. A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night. The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks. Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people. Finally the assistance systems remotely share information with caregivers.

Our team Researchers Faculty of science Faculty of engineering Sylvain Giroux, Ph. D. in Computer science Hélène Pigot, Ph. D. in Computer science and B. in occupational therapy André Mayers, Ph. D. in Computer science and M. inpsychology Faculty of engineering Philippe Mabilleau, Ph.D. in engineering Faculty of administration Claude Caron (geo-business) Analyst Francis Bouchard Students 6 Ph. D. students 12 M. Sc. students 6 B.Sc. students, 2 international trainees (M. Sc. level)

Collaborations Medical aspects Computer science CRE, Centre de réadaptation Estrie (head trauma) Institut de gériatrie de Sherbrooke Centre de recherches Fernand Séguin, Université de Montréal (schizophrenia) Institut de réadaptation, Université de Montréal Alzheimer disease Computer science France Telecom Ariane Controls, Canada Université Joseph Fourier, Grenoble UQAM

Thank you for your attention http://domus.usherbrooke.ca/

Collaborations Medical aspects CRE, Centre de réadaptation Estrie (head trauma) Institut de gériatrie de Sherbrooke Centre de recherches Fernand Séguin, Université de Montréal (schizophrenia) Institut de réadaptation, Université de Montréal Alzheimer disease Computer science France Telecom Ariane Controls, Canada Université Joseph Fourier, Grenoble UQAM

At the DOMUS laboratory, on-going research projects aim at building the theory and praxis of pervasive computing and tangible user interfaces (TUI) compulsory to create smart homes for cognitively impaired people. Pervasive computing enables a seamless integration of assistance in residents’ everyday life while TUI turn the whole house into a cognitive prosthesis. Prototypes are used to investigate how pervasive services and TUI can support and enhance healthcare and communication between people and caregivers. A fully-equipped experimental apartment can accommodate cognitively impaired people and their caregivers for day and night. The middleware provides for spontaneous networking, distributed and mobile computing, and sensor networks. Cognitive assistants use descriptions of activities of daily living to reason upon resident actions. They then rely on context awareness and TUI to interact with people. Finally the assistance systems remotely share information with caregivers.