Handhelds in the Automobile: The Denali Navigation System Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers Brad A. Myers

Brad Myers 2 Talk for General Motors – 4/02/04 General Idea l How can a handheld augment the operation of an automobile? l Not just using a PDA while in a car l PDA augments and interoperates with car l Not for driving l Examples: l Setting functions, controls l Specifying destination for navigation systems l How can a handheld augment the operation of an automobile? l Not just using a PDA while in a car l PDA augments and interoperates with car l Not for driving l Examples: l Setting functions, controls l Specifying destination for navigation systems

Brad Myers 3 Talk for General Motors – 4/02/04 Pebbles Project l This research is part of the Pebbles project l Overall goal: investigate use of handhelds at the same time as PCs and other computerized devices l “Multi-Machine User Interfaces” l Assumption: handhelds will frequently be in close interactive communication with each other and other computers l Wireless and wired technologies l This research is part of the Pebbles project l Overall goal: investigate use of handhelds at the same time as PCs and other computerized devices l “Multi-Machine User Interfaces” l Assumption: handhelds will frequently be in close interactive communication with each other and other computers l Wireless and wired technologies

Brad Myers 4 Talk for General Motors – 4/02/04 Other Domains for Pebbles l Also created applications to study use of PDAs in: l Classrooms l Offices l Meeting rooms l Command Post of the Future l Homes l For the Handicapped l Also created applications to study use of PDAs in: l Classrooms l Offices l Meeting rooms l Command Post of the Future l Homes l For the Handicapped

Brad Myers 5 Talk for General Motors – 4/02/04 Personal Universal Controller l Two-way communication l Appliance describes its functions l Personal Universal Controller then: l Automatically creates user interface l Controls the appliance l Displays feedback about appliance status l Two-way communication l Appliance describes its functions l Personal Universal Controller then: l Automatically creates user interface l Controls the appliance l Displays feedback about appliance status Specifications Control Feedback

Brad Myers 6 Talk for General Motors – 4/02/04 Current PUC Specification Language l XML l Full documentation for the specification language and protocol l Has been used to specify many appliances l Stereo, MP3 player, camera, VCR, room lights, elevator, etc. l XML l Full documentation for the specification language and protocol l Has been used to specify many appliances l Stereo, MP3 player, camera, VCR, room lights, elevator, etc.

Brad Myers 7 Talk for General Motors – 4/02/04 Previously Reported l Modeling the GMC Yukon Denali SUV l Has a sophisticated Driver Information Console system l Three-zone HVAC system l LCD screen-based navigation system l Modeling the GMC Yukon Denali SUV l Has a sophisticated Driver Information Console system l Three-zone HVAC system l LCD screen-based navigation system

Brad Myers 8 Talk for General Motors – 4/02/04 Simulator l Navigation System l 50+ screens covering most navigation features l Limited direct interaction with the map (e.g. scrolling) l Based on interacting with real device l Navigation System l 50+ screens covering most navigation features l Limited direct interaction with the map (e.g. scrolling) l Based on interacting with real device

Brad Myers 9 Talk for General Motors – 4/02/04 Navigation Simulator, cont.

Brad Myers 10 Talk for General Motors – 4/02/04 New Work l More parts of the Navigation Simulator l Audio functions l Various settings l Specification of the Navigation System’s functions in XML l Exercises advanced features of PUC specification language l Automatic generation of (parts of) Navigation System on PocketPCs l More parts of the Navigation Simulator l Audio functions l Various settings l Specification of the Navigation System’s functions in XML l Exercises advanced features of PUC specification language l Automatic generation of (parts of) Navigation System on PocketPCs

Brad Myers 11 Talk for General Motors – 4/02/04 Future Work l Future Work on Simulator l Simulate XM radio l Conduct a comparison user study l Similar to our previous comparison study l Measure time/errors for users using both the physical unit and handheld remote control l Automatic generation with user consistency l Future Work on Simulator l Simulate XM radio l Conduct a comparison user study l Similar to our previous comparison study l Measure time/errors for users using both the physical unit and handheld remote control l Automatic generation with user consistency

Text Input Using EdgeWrite Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers Brad A. Myers

Brad Myers 13 Talk for General Motors – 4/02/04 Input while physically unstable l GM has sponsored research and patent on a new text entry technique called EdgeWrite™ l First aimed at people with motor impairments l Unable to make Graffiti or Jot gestures l Physical edges provide physical stability l Instability might be a property of the environment, not just the person l e.g., on a bus, while walking, or in a car l GM has sponsored research and patent on a new text entry technique called EdgeWrite™ l First aimed at people with motor impairments l Unable to make Graffiti or Jot gestures l Physical edges provide physical stability l Instability might be a property of the environment, not just the person l e.g., on a bus, while walking, or in a car

Brad Myers 14 Talk for General Motors – 4/02/04 Stylus EdgeWrite™ l Move along plastic edges inside square hole l Recognition based on order corners are hit l OK if the path is jittery l No need for: l Shift or caps lock l Separate areas for numbers and letters l Move along plastic edges inside square hole l Recognition based on order corners are hit l OK if the path is jittery l No need for: l Shift or caps lock l Separate areas for numbers and letters

Brad Myers 15 Talk for General Motors – 4/02/04 Character Chart l Three subsets: l Alphanumerics (e.g., abc, 123) l Punctuation (e.g., !?#$*) l Extended characters (e.g., ®¶Øç) l 144 characters with 306 forms l Three subsets: l Alphanumerics (e.g., abc, 123) l Punctuation (e.g., !?#$*) l Extended characters (e.g., ®¶Øç) l 144 characters with 306 forms

Brad Myers 16 Talk for General Motors – 4/02/04 Stylus EdgeWrite™ Results l After 15 minutes of practice, able-bodied novices: l 18% more accurate than Graffiti l About the same in speed (~7 WPM with each) l Note: Tasks included numbers and punctuation l Motor-impaired users were vastly more accurate l 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s) l After 15 minutes of practice, able-bodied novices: l 18% more accurate than Graffiti l About the same in speed (~7 WPM with each) l Note: Tasks included numbers and punctuation l Motor-impaired users were vastly more accurate l 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s)

Brad Myers 17 Talk for General Motors – 4/02/04 Joystick EdgeWrite™ l Could be useful for game consoles, mobile phones, or on power wheelchairs l Compared EdgeWrite to Date Stamp and Selection Keyboard l Tested with unmodified COTS joystick l Could be useful for game consoles, mobile phones, or on power wheelchairs l Compared EdgeWrite to Date Stamp and Selection Keyboard l Tested with unmodified COTS joystick

Brad Myers 18 Talk for General Motors – 4/02/04 Touchpad EdgeWrite™ l Use elevated edges around a Synaptics touchpad l May be easier for people with motor impairments l Maybe mount on the steering wheel or arm-rest? l Use elevated edges around a Synaptics touchpad l May be easier for people with motor impairments l Maybe mount on the steering wheel or arm-rest?

Brad Myers 19 Talk for General Motors – 4/02/04 Touchpad Pilot Study l Two factors l Output visible l Touchpad visible l Touchpad visibility a complete non- factor! l Not seeing output doesn’t degrade performance very much l Two factors l Output visible l Touchpad visible l Touchpad visibility a complete non- factor! l Not seeing output doesn’t degrade performance very much One subject: WPM (maximum)

Brad Myers 20 Talk for General Motors – 4/02/04 Using Joystick on Wheelchair l Custom hardware and software to interface to commercial joystick l Informally evaluated with 7 disabled power-wheelchair users l 6 with Cerebral Palsy, 1 with Multiple Sclerosis l Compared to on-screen keyboard and using EdgeWrite on a touchpad l Custom hardware and software to interface to commercial joystick l Informally evaluated with 7 disabled power-wheelchair users l 6 with Cerebral Palsy, 1 with Multiple Sclerosis l Compared to on-screen keyboard and using EdgeWrite on a touchpad New!

Brad Myers 21 Talk for General Motors – 4/02/04 Results l Touchpad worked better than wheelchair joystick

Brad Myers 22 Talk for General Motors – 4/02/04 EdgeWrite.com l Download EdgeWrite software l Find abridged and full character charts l Find publications l Order plastic templates l See or l Same web site l Download EdgeWrite software l Find abridged and full character charts l Find publications l Order plastic templates l See or l Same web site

Brad Myers 23 Talk for General Motors – 4/02/04 Future EdgeWrite™ work l Mouse/text disambiguation on touchpad l Keyboard/mouse replacement for people with disabilities l Custom (non-commercial) joystick implementation l Cell phone implementation l More user tests! l Mouse/text disambiguation on touchpad l Keyboard/mouse replacement for people with disabilities l Custom (non-commercial) joystick implementation l Cell phone implementation l More user tests!

Human Computer Interaction Institute School of Computer Science Carnegie Mellon University Brad A. Myers Brad A. Myers