2. Utah School of Computing Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2007 CS5540 HCI Rich Riesenfeld Fall 2007

3. Student Name Server Utah School of Computing slide 2 Fall 2007 Major Categories Input -Harder Output -More successful history Input -Harder Output -More successful history

4. Student Name Server Utah School of Computing slide 3 Fall 2007 Inputs - 1 Clickless Interface Example -http://www.dontclick.ithttp://www.dontclick.it TTY Voice Gesture Haptic -Phantom devices, etc Handwriting Clickless Interface Example -http://www.dontclick.ithttp://www.dontclick.it TTY Voice Gesture Haptic -Phantom devices, etc Handwriting

5. Student Name Server Utah School of Computing slide 4 Fall 2007 Inputs - 2 Eye tracking Body forces -Live seat -Sides of back -Etc Structured light Body sensors -Animation Eye tracking Body forces -Live seat -Sides of back -Etc Structured light Body sensors -Animation

6. Student Name Server Utah School of Computing slide 5 Fall 2007 Inputs - 3 Widgets -Buttons, sliders, menus, toggles, etc User Recognition -Get your coffee the way you always get it! Machine Learning -Watch and learn -Windows menus: What is on top of menu? Widgets -Buttons, sliders, menus, toggles, etc User Recognition -Get your coffee the way you always get it! Machine Learning -Watch and learn -Windows menus: What is on top of menu?

7. Student Name Server Utah School of Computing slide 6 Fall 2007 Inputs - 4 Read CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers Read CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers

8. Student Name Server Utah School of Computing slide 7 Fall 2007 Outputs – 1 Flat screen -Resolution, colors, refresh rate, … Stereopsis Techniques -Color filters: R/G, etc -Polarized glasses Sound -Synthetic effects -Speech Flat screen -Resolution, colors, refresh rate, … Stereopsis Techniques -Color filters: R/G, etc -Polarized glasses Sound -Synthetic effects -Speech

9. Student Name Server Utah School of Computing slide 8 Fall 2007 Outputs – 2 Sound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded Sound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded

10. Student Name Server Utah School of Computing slide 9 Fall 2007 Outputs – 3 VR Environments -3D -Fantasy worlds -Overlays on realworld  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload VR Environments -3D -Fantasy worlds -Overlays on realworld  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload

11. Student Name Server Utah School of Computing slide 10 Fall 2007 Outputs – 3 VR Environments Smell Vibrations Newtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise VR Environments Smell Vibrations Newtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise

12. Student Name Server Utah School of Computing slide 11 Fall 2007 Outputs – 4 Background sound -Movie score  Important  Not natural Background sound -Movie score  Important  Not natural

13. Utah School of Computing End Interfaces: Media and Devices