Microsoft Research Faculty Summit 2003 Brad A. Myers Mobility: Handhelds for Universal Remote Control Pebbles Research Project Human Computer Interaction Institute Carnegie Mellon University http://www.pebbles.hcii.cmu.edu 10 minute talk with 2 demos

Pebbles Project Use handheld devices with other technology Most other projects looking at handhelds to replace other technology Examples: PocketPCs with a PC SmartPhone with appliances

Example Applications Meetings Remote Commander Use PocketPCs as keyboard and mouse so everyone can participate Mouse or Draw Laser Pointer for interaction at a distance

Demo 1: Slide Show Commander Released 1999 Remote Control of PowerPoint Two-way communication Picture of slide, notes, titles, other applications, preview Scribble, click on links

Slide Show Commander, #2 List of applications Preview of other slides

Example Applications Individuals in an Office Shortcutter User-created panels of controls Create custom interfaces and extensions to PC applications Scrolling with left hand on PDA

Example Applications People with Disabilities Use handhelds as interface to PC and appliances for people with neuro-muscular disabilities New input methods

Example Applications In Classrooms Handhelds for testing and note taking

Example Applications In Homes Use handheld for remote control of appliances “Personal Universal Controller” (PUC) Help solve these problems:

Personal Universal Controller Different from so-called “universal” remotes Two-way communication Appliance describes its functions Handheld PUC: Automatically creates interface Controls the appliance Displays feedback about appliance status Specifications Control Feedback

Research Challenges Automatic generation of high-quality user interfaces For PocketPCs, TabletPCs, SmartPhone Also for speech interfaces XML-based specification describes appliance functions and dependencies Rule-based automatic design Connecting with real appliances Custom and standard protocols

Demo 2: Automatic Remote Control Generation Control of: Axis Pan-Tilt-Zoom Camera UPnP interface Windows Media Player Using: PocketPC Microsoft SmartPhone TabletPC Programmed using C# with .NET Compact Framework

Example Screens Axis Camera Windows Media Player

See More About This Work: At Microsoft Faculty Summit Use of Compact Framework: Tuesday, 11:30-12:30, St. Helens DemoFest: lots more devices Tuesday, 1:00-2:30 Download software and papers: http://www.pebbles.hcii.cmu.edu