1. Michael Lawo (mlawo@tzi.de) Using Wearable Computing Technology to Empower the Mobile Worker TNC 2009 Malaga 11.6.2009 Michael Lawo, Otthein Herzog, Peter Knackfuß

2. Michael Lawo (mlawo@tzi.de) Motivation Today, information access is usually possible - anytime and anywhere There is always useful information - somewhere Storage of information is often wanted or even needed But: Information is still rarely used outside the classical office environment E.g.

3. Michael Lawo (mlawo@tzi.de) The Desktop Computing Paradigm stationary User is focused on the system No interaction with the environment

4. Michael Lawo (mlawo@tzi.de) The Mobile Computing Paradigm

5. Michael Lawo (mlawo@tzi.de) Wearable System User Real World The Vision of Wearable Computing  2-way interaction  Environment sensitive Context recognition Augmentation  Unobtrusive  Always „ on “  Highly integrated Interaction and Context are the keys.

6. Michael Lawo (mlawo@tzi.de)

7. Working with a Wearable Computer  Wearable Computing often expects users to accomplish different tasks simultaneously Primary Task  Real world task  Often manual tasks  Mobility Secondary Task  Supporting computer task  Interaction with the wearable system Aircraft Maintenance Car Production/Training How to design the user interface?

8. Michael Lawo (mlawo@tzi.de) Interaction Challenges in Wearable Computing Challenges Information density  Screen size, encoding, etc. Attention grabbing capabilities Social acceptance Use in a dual-task scenario Human-Computer Communication Cycle by Bowman et al. [BKLP05] TextAudio Gestures Special Purpose Challenges Device limitations  Size, weight, power consumption Novel usage patterns Implicit input (context recognition) Use in a dual-task scenario

9. Michael Lawo (mlawo@tzi.de) Wearable Computing Architecture Application Design Space Architecture Components

10. Michael Lawo (mlawo@tzi.de) Wearable User Interface Toolkit  Features Development based on reusable components Development with limited knowledge about wearable computing I/O device independent specification  Model-based development, e.g. Concurrent Task Trees (CTT) [Paterno99] Support for context-aware interfaces and automatic interface adaptation Part of the Open Wearable Computing Framework (OWCF) WUI-Toolkit

11. Michael Lawo (mlawo@tzi.de) Aircraft Disassembly Assistant

12. Michael Lawo (mlawo@tzi.de) UI Evaluation | HotWire Primary Task Simulator  Idea of the HotWire inspired by kid’s game Originally intended to train motor skills Rules  “Pass a ring from one end of the wire to the other end.”  “Don’t touch the wire with the ring!”  Simulates real world primary tasks Abstracts manual task characteristics Retains properties of wearable computing  E.g. being involved in physical manual tasks Easy to learn Easy to build Usable in the laboratory First Prototype “Der heiße Draht” Commercial Product Laboratory Experiment Version CeBit 2007 HotWire Demo

13. Michael Lawo (mlawo@tzi.de) Gesture Interaction Experiment

14. Michael Lawo (mlawo@tzi.de) Context detection  Integration of context recognition system and supporting application for the part assembly (Front Light)  Context recognition Wristband Device Data Acquisition Module (DAM) Context recognition for task tracking  Application (Integration of OWCF components) wearIT@work core framework JContextAPI WUI Speech recognition  Other features QBIC / OQO Zeiss Binocular Look-around HMD Activity monitoring

15. Michael Lawo (mlawo@tzi.de) Context detection motion jacket  Setup to annotate activities  Recording of checkpoint procedures Synchronization of 3 sensor types (frequency, reliability) Re-labelling of 2 parallel activity annotation streams Parallel work on activity spotting in 2 sensor domains (motion, muscle activity) Motion Jacket UbiSense Tag UbiSense (UWB) Base

16. Michael Lawo (mlawo@tzi.de) Context detection tests and first results (video)video  Context Recognition in Car Production Supporting application for the part assembly (Front Light)  Context recognition using Wristband Device Context Toolbox Machine Learning Techniques  HMMs  Segmentation

17. Michael Lawo (mlawo@tzi.de) Hand-Gesture Interaction

18. Michael Lawo (mlawo@tzi.de) Robust Textile Systems

19. Michael Lawo (mlawo@tzi.de) Systemarchitecture Middleware Operating System Application Service Framework

20. Michael Lawo (mlawo@tzi.de) Conclusion  Wearable computing provides services for new user groups, especially in the professional environment Maintenance and assembly Emergency response Sports  Mobile Computing Systems are needed which enable dual-task environments with a primary real-world task  Mobile Systems are needed which use personal and environmental sensors in order to provide assistance functions on the move

21. Michael Lawo (mlawo@tzi.de) Thank you for your attention. Prof. Dr. Michael Lawo TZI, University of Bremen mlawo@tzi.de German chancellor Angela Merkel at TZI’s CeBIT booth