CMU Wearable Computers and Pervasive Computing Asim Smailagic Institute for Complex Engineered Systems Carnegie Mellon June 28, 2001

Laboratory for Interactive Computer Systems 2 Approach The three labs have collaborated in design and prototyping of more than 20 generations of wearable computers Design and prototyping of complex systems require one interdisciplinary approach and multi-technology capabilities Rapid prototyping, concurrent design methodology has been applied and refined.

Laboratory for Interactive Computer Systems 3 Complexity The complexity of the prototype architects has increased by over two orders of magnitude, the total design effort has increased less than a factor of two. Over five generations of wearable computers for speech recognition and translation, yielding 4.5 orders of magnitude improvement in performance.

Laboratory for Interactive Computer Systems – 2001 Ten Years of Wearable Computing at Carnegie Mellon

Laboratory for Interactive Computer Systems 5 Wearable and Handheld Computers

Laboratory for Interactive Computer Systems 6 Production vest will go under “Float Coat”

Laboratory for Interactive Computer Systems 7 Spot

Laboratory for Interactive Computer Systems 8

9 Electronics Architecture VGA Display Palm/PDA Jog Dial/ Mouse Wheel MicrophoneSpeakers Finger Print Recognition Digital Camera Temperature Sensor CDPD Modem GPS Receiver PDA Cradle BlueTooth, WaveLan Vehicle’s ECU - RPM, MPH, etc USB Controller Firewire Controller Serial Controller Sound Card VGA Controller Touch Screen Wireless Adapter Computer Radio Card

Laboratory for Interactive Computer Systems 10 Applications A number of previously untried application areas introduced. -Maintenance, Inspection -Repair, Troubleshooting -Augmented Manufacturing -Plant Operations -Real-time Speech Translation -Navigation -Context-Aware Computing -Collaboration -Ubiquitous Computing -Telematics

Laboratory for Interactive Computer Systems 11 Context Aware Computing Knowledge of the user’s context – Location – Orientation – Audio samples from the user environment – Static data Context sensitive help – Proactive smarter assistant offering useful information (whispering in your ear) Multiple sensors can be used to infer user’s intent – Wireless Card, Digital Compass, Thermometer, Camera

Laboratory for Interactive Computer Systems 12 PhD Features and Interaction User’s List: Items can be added, moved, and removed Only “checked” items appear on the map Description: Information on the currently selected item Dynamic information automatically updated Map: Dynamic information automatically updated Map Controls: Zoom & Pan

Laboratory for Interactive Computer Systems 13 Virtual Whiteboard Supports Design Meetings Menu Commands –Session management –Geometric tools –Expandable plug-ins

Laboratory for Interactive Computer Systems 14 Virtual Whiteboard Architecture Overview Service broadcasts received coordinates to all clients via CMU’s Wireless Andrew Client sends a user’s drawing to the service as a series of coordinates Clients draw received coordinates on screen; all clients are synchronized

Laboratory for Interactive Computer Systems 15 Clients The clients have included: -NSF, DARPA, ONR -Boeing -Adtranz -U.S. Air Force -U.S. Marine Corps -Lockheed-Martin -IBM -Chevron -General Motors -Daimler-Benz -Compaq -Shell -AT&T -Intel -General Dynamics Electric Boat

Laboratory for Interactive Computer Systems 16 Collaborative Help The labs have supported additional activities on campus Electronic design in robotics projects Use of fabrication machines Interaction Design Studio helped other projects Multi-departmental projects Formalize, advertise and open all these capabilities to other projects in ICES and CIT.

Laboratory for Interactive Computer Systems 17 Awards Three prestigious international design awards have been received: VuMan 3 MoCCA Digital Ink

Laboratory for Interactive Computer Systems 18 Visionary Research Projects Aura: Pervasive Invisible Computing Handy Andy Ubiquitous Computing Context-Aware Computing Augmented Reality

Laboratory for Interactive Computer Systems 19 Goals Provide expertise in interdisciplinary design, rapid prototyping and user evaluation Promote more interdisciplinary design projects Provide methodology, measurements, and tools to support and teach these methods and to support design meetings Provide a physical space and equipment to support design and fabrication Study interdisciplinary design through practicing it Develop a metric to compare the prototypes and show a performance increase by several orders of magnitude. Educational support

Laboratory for Interactive Computer Systems 20 Research Directions Pervasive Computing –Invisibilty, Minimizing User Distraction –User / Virtual Information Space Interaction –Enhance Human Capabilities Context Aware Computing Visionary Interaction Design Rapid Prototyping of Artifacts Involving Multidisciplinary, Multi-technology Approach

Laboratory for Interactive Computer Systems 21 Research Directions Near Zero Energy / Weight / Volume Wearable Computers Quick Evaluation Methodology New Areas and Applications –New Technologies –New Modalities of Interaction –Help for Elderly –Medical Applications