Usability & Human Factors Ubiquitous Computing in Healthcare This material(Comp15_Unit9) was developed by Columbia University, funded by the Department of Health and Human Services, Office of the National Coordinator for Health Information Technology under Award Number 1U24OC

Ubiquitous Computing in Healthcare Learning Objectives 2 History of Ubiquitous Computing Basic Principles Examples of Ubicomp in Healthcare Technical Challenges Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

History of Ubiquitous Computing 3 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Three waves of computing Mainframes (one main processor, many terminals) Personal computing (one computer for one person) Ubiquitous computing = many computers on and around each individual Mobile computing (PDA, cell phone, etc.) Pervasively embedded in the environment (smart environments) Wearable computing

Original Vision 4 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Xerox PARC, Mark Weiser Ubicomp project began in 1988 Paper Writing “the most profound technologies are those that disappear” Vision for computing technologies that are so commonplace that they disappear from people’s conscious attention

Original Vision (cont.): Computing by the inch (PDA, smart phone, mobile phone, voice recorder, etc.) Image of iPhone touch screen first generation taken from Apple.com and image of Motorola flip phone taken from Motorola.com 5 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Original Vision (cont.): Computing by the foot Image of Dell computer taken from Dell.com and iPad image 6 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Original Vision (cont.): Computing by the yard Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Version of Ubicomp Computing on the body (wearable computing) Computing in the environment (ubicomp) Ubicomp, (2008). 8 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Challenges 9 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Natural input Context- aware computing Automated capture and access

Natural Input 10 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Computing distributed in environment requires naturalistic interaction patterns Voice recognition Handwriting Gesture Tangible computing (interact with computing as with physical environment)

Context-Aware Computing 11 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Delivery of information and services based on the automatically sensed context Multiple definitions of context Who, when, where, etc. Success often depends on three factors Accuracy of context information sensed by the system Correctness of interpretation or knowing what action to take in a particular context Consequence of performing this action

Capture and Access 12 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Using technology to capture the flow of activities in real time and provide access to the records on demand Often used for capturing meetings, or brainstorming sessions In healthcare: documenting patient- doctor encounters

Pervasive Healthcare 13 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Making healthcare available everywhere, anytime, and to anyone Application of ubiquitous computing technologies for healthcare

Pervasive Healthcare (cont.) 14 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Acute care settings – digital hospital RFID for patient tracking Context-aware clinical environments Patient-centric technologies – health and wellness Telemedicine (IDEATell) Digital Family Portrait MAHI UbiFit Garden

Improving Patient Safety RFID patient tracking systems Prevent errors (wrong medication to wrong patient) Streamline billing (automatic tracking of procedures) 15 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Context-Aware Surgery Room Doryab, Afsaneh and Bardram, Jakob E. (2011). 16 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Main focus: improving patient safety Providing the right information at the right time in the right place (pertinent patient data) Drawing attention to information of concern (warnings of drug allergies, etc.) utilizing surgical context (physical and clinical)

Patient-Centric Technologies Mynatt, E.D., Rowan, J., Craighill, S., and Jacobs, A. (2001). 17 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Remote monitoringCase manager Education, recommendations, adjustments to care-plan

Health and Wellness Mynatt, E.D., Rowan, J., Craighill, S., and Jacobs, A. (2001). 18 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Georgia Institute of Technology Digital Family Portrait Activity of parents is sensed by motion detection sensors Abstract visualization creates pattern without violating privacy Helping adult children maintain awareness of well-being of their parents

Health and Wellness (cont.) Mamykina, L., Mynatt, E.D., Davidson, P., and Greenblatt, D. (2008). Mamykina, L. and Mynatt, E.D. (2007). 19 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare MAHI (Georgia Institute of Technology) Assistance with diabetes management Mobile phone for capture of experiences (pictures of meals, voice records) Integration with glucose monitor Website for review with diabetes educator

Health and Wellness (cont.) Consolvo,C., McDonald, D.W., Toscos, T., Chen, M.Y., Froehlich, J., Harrison, B., et al. (2008). 20 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare Intel UbiFit Garden On the body monitoring A variety of physical activity types Monitoring physical activity Aesthetically pleasing visualization Monitoring accomplishments Reward for achievement of goals Ambient display on a mobile phone

Ubiquitous Computing in Healthcare Summary Ubiquitous computing is an important and rapidly growing area that has potential to make significant impact on how healthcare is delivered within and outside of clinical settings However, many challenges remain to its successful penetration: –Many of these technologies rely on natural input such as voice or gesture, which is not always accurate and may be hindered by fragmented internet connectivity As new enabling technologies become available, however, better applications of ubiquitous and pervasive computing will be invented 21 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Ubiquitous Computing in Healthcare References Reference Weiser, M. (1993). Some computer science issues in ubiquitous computing. Communication of The ACM, vol.36(7), p Images Slide 5: Image of iPhone ouch screen first generation taken from Apple.com Retrieved on September 10th, Image of Motorola flip phone taken from Motorola.com retrieved on September 10th, 2010 Slide 6: Image of Dell computer taken from Dell.com Retrieved on September 10th, Ipad image retrieved from Apple.com on September 10th, Slide 7: Original vision image retrieved September 10th, 2010 from Original vision image retrieved September 10th, 2010 from Slide 8: Version of Ubicomp image from Science Daily, April 28, 2008 (The Prototype Wearable Eye Tracker, image courtesy of ETH Zurich). Slide 15: Improving Patient Safety Image from MedGadget, March 22, 2010 ( 22 Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare

Ubiquitous Computing in Healthcare References Images (cont.) Slide 16: Doryab, Afsaneh and Bardram, Jakob E. (2011). In Proceedings of the 2011 Workshop on Context-awareness in Retrieval and Recommendation, pages 43-46, New York, NY, USA, Designing activity-aware recommender systems for operating rooms. Slide 17 & 18: Mynatt, E.D., Rowan, J., Craighill, S., and Jacobs, A. (2001). Digital family portraits: supporting peace of mind for extended family members. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI '01). ACM, New York, NY, USA, Slide 19: Mamykina, L., Mynatt, E.D., Davidson, P., and Greenblatt, D. (2008). MAHI: investigation of social scaffolding for reflective thinking in diabetes management. In the Proceedings of the 2008 ACM Conference on Human Factors in Computing (CHI 2008), p Mamykina, L. and Mynatt, E.D. (2007). Investigating and supporting health management practices of individuals with diabetes. In Proceedings of the 1st ACM SIGMOBILE international workshop on Systems and networking support for healthcare and assisted living environments (HealthNet 2007) Slide 20: Consolvo,C., McDonald, D.W., Toscos, T., Chen, M.Y., Froehlich, J., Harrison, B., et al. (2008). Activity sensing in the wild: a field trial of ubifit garden. In Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems (CHI '08). ACM, New York, NY, USA, Health IT Workforce Curriculum Version 3.0/Spring 2012 Usability & Human Factors Ubiquitous Computing in Healthcare