Michael Lawo Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga Michael Lawo, Otthein Herzog, Peter Knackfuß

Michael Lawo Motivation Today, information access is usually possible - anytime and anywhere There is always useful information - somewhere Storage of information is often wanted or even needed But: Information is still rarely used outside the classical office environment E.g.

Michael Lawo The Desktop Computing Paradigm stationary User is focused on the system No interaction with the environment

Michael Lawo The Mobile Computing Paradigm

Michael Lawo Wearable System User Real World The Vision of Wearable Computing  2-way interaction  Environment sensitive Context recognition Augmentation  Unobtrusive  Always „ on “  Highly integrated Interaction and Context are the keys.

Michael Lawo

Working with a Wearable Computer  Wearable Computing often expects users to accomplish different tasks simultaneously Primary Task  Real world task  Often manual tasks  Mobility Secondary Task  Supporting computer task  Interaction with the wearable system Aircraft Maintenance Car Production/Training How to design the user interface?

Michael Lawo Interaction Challenges in Wearable Computing Challenges Information density  Screen size, encoding, etc. Attention grabbing capabilities Social acceptance Use in a dual-task scenario Human-Computer Communication Cycle by Bowman et al. [BKLP05] TextAudio Gestures Special Purpose Challenges Device limitations  Size, weight, power consumption Novel usage patterns Implicit input (context recognition) Use in a dual-task scenario

Michael Lawo Wearable Computing Architecture Application Design Space Architecture Components

Michael Lawo Wearable User Interface Toolkit  Features Development based on reusable components Development with limited knowledge about wearable computing I/O device independent specification  Model-based development, e.g. Concurrent Task Trees (CTT) [Paterno99] Support for context-aware interfaces and automatic interface adaptation Part of the Open Wearable Computing Framework (OWCF) WUI-Toolkit

Michael Lawo Aircraft Disassembly Assistant

Michael Lawo UI Evaluation | HotWire Primary Task Simulator  Idea of the HotWire inspired by kid’s game Originally intended to train motor skills Rules  “Pass a ring from one end of the wire to the other end.”  “Don’t touch the wire with the ring!”  Simulates real world primary tasks Abstracts manual task characteristics Retains properties of wearable computing  E.g. being involved in physical manual tasks Easy to learn Easy to build Usable in the laboratory First Prototype “Der heiße Draht” Commercial Product Laboratory Experiment Version CeBit 2007 HotWire Demo

Michael Lawo Gesture Interaction Experiment

Michael Lawo Context detection  Integration of context recognition system and supporting application for the part assembly (Front Light)  Context recognition Wristband Device Data Acquisition Module (DAM) Context recognition for task tracking  Application (Integration of OWCF components) core framework JContextAPI WUI Speech recognition  Other features QBIC / OQO Zeiss Binocular Look-around HMD Activity monitoring

Michael Lawo Context detection motion jacket  Setup to annotate activities  Recording of checkpoint procedures Synchronization of 3 sensor types (frequency, reliability) Re-labelling of 2 parallel activity annotation streams Parallel work on activity spotting in 2 sensor domains (motion, muscle activity) Motion Jacket UbiSense Tag UbiSense (UWB) Base

Michael Lawo Context detection tests and first results (video)video  Context Recognition in Car Production Supporting application for the part assembly (Front Light)  Context recognition using Wristband Device Context Toolbox Machine Learning Techniques  HMMs  Segmentation

Michael Lawo Hand-Gesture Interaction

Michael Lawo Robust Textile Systems

Michael Lawo Systemarchitecture Middleware Operating System Application Service Framework

Michael Lawo Conclusion  Wearable computing provides services for new user groups, especially in the professional environment Maintenance and assembly Emergency response Sports  Mobile Computing Systems are needed which enable dual-task environments with a primary real-world task  Mobile Systems are needed which use personal and environmental sensors in order to provide assistance functions on the move

Michael Lawo Thank you for your attention. Prof. Dr. Michael Lawo TZI, University of Bremen German chancellor Angela Merkel at TZI’s CeBIT booth