Utah School of Computing Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2005 CS5540 HCI Rich Riesenfeld Fall 2005

Student Name Server Utah School of Computing slide 2 Fall 2005 Major Categories Input -Harder Output -More successful history Input -Harder Output -More successful history

Student Name Server Utah School of Computing slide 3 Fall 2005 Inputs - 1 Clickless Interface Example - TTY Voice Gesture -Body language -Using succinct communications Haptic -Phantom devices, etc Clickless Interface Example - TTY Voice Gesture -Body language -Using succinct communications Haptic -Phantom devices, etc

Student Name Server Utah School of Computing slide 4 Fall 2005 Inputs - 2 Clickless Interface Example - Handwriting Security identification -Fingerprints -Laser identification Eye tracking -Movement Clickless Interface Example - Handwriting Security identification -Fingerprints -Laser identification Eye tracking -Movement

Student Name Server Utah School of Computing slide 5 Fall 2005 Inputs - 2 Body forces -Live seat -Sides of back -Etc Transporter (gestural communications) -Segway Video -Winglet Video Body forces -Live seat -Sides of back -Etc Transporter (gestural communications) -Segway Video -Winglet Video

Student Name Server Utah School of Computing slide 6 Fall 2005 Inputs - 2 Simulators -Disney, Pilot training, NASA Structured light Body sensors -Animation  Motion capture Simulators -Disney, Pilot training, NASA Structured light Body sensors -Animation  Motion capture

Student Name Server Utah School of Computing slide 7 Fall 2005 Inputs - 3 Widgets -Buttons, sliders, menus, toggles, etc User Recognition -Get your coffee the way you always get it! Machine Learning -Watch and learn -Windows menus: What is on top of menu? Widgets -Buttons, sliders, menus, toggles, etc User Recognition -Get your coffee the way you always get it! Machine Learning -Watch and learn -Windows menus: What is on top of menu?

Student Name Server Utah School of Computing slide 8 Fall 2005 Inputs - 3 Multi-channel -Games -Simulators -Training/Education -Music  Electronic keyboard Multi-channel -Games -Simulators -Training/Education -Music  Electronic keyboard

Student Name Server Utah School of Computing slide 9 Fall 2005 Inputs - 4 Read CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers Read CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers

Student Name Server Utah School of Computing slide 10 Fall 2005 Outputs – 1 Flat screen -Resolution, colors, refresh rate, size … -“Big Board” on CNN, MSNBC Stereopsis Techniques -Left/Right visual separation -Color filters: R/G, etc -Polarized glasses Sound -Synthetic effects -Speech Flat screen -Resolution, colors, refresh rate, size … -“Big Board” on CNN, MSNBC Stereopsis Techniques -Left/Right visual separation -Color filters: R/G, etc -Polarized glasses Sound -Synthetic effects -Speech

Student Name Server Utah School of Computing slide 11 Fall 2005 Outputs – 2 Sound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded Sound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded

Student Name Server Utah School of Computing slide 12 Fall 2005 Outputs – 3 Visualizations -Scientific visualization -Information visualizaiton Visualizations -Scientific visualization -Information visualizaiton

Student Name Server Utah School of Computing slide 13 Fall 2005 Outputs – 3 VR Environments -3D  Spinal medication  MRI visualizations  Fly throughs -Fantasy worlds VR Environments -3D  Spinal medication  MRI visualizations  Fly throughs -Fantasy worlds

Student Name Server Utah School of Computing slide 14 Fall 2005 Outputs – 3 -Overlays on real-world  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload -Overlays on real-world  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload

Student Name Server Utah School of Computing slide 15 Fall 2005 Outputs – 3 VR Environments -“Holodecks”, synthetic spaces, avatars -Virtual “try on” for clothes Smell Vibrations Newtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise VR Environments -“Holodecks”, synthetic spaces, avatars -Virtual “try on” for clothes Smell Vibrations Newtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise

Student Name Server Utah School of Computing slide 16 Fall 2005 Outputs – 3 Newtonian Physics: ON (cont ) -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise -Provide artificial physics  New rules/forces Newtonian Physics: ON (cont ) -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise -Provide artificial physics  New rules/forces

Student Name Server Utah School of Computing slide 17 Fall 2005 Outputs – 4 Background sound -Movie score  Important  Not natural Background sound -Movie score  Important  Not natural

Utah School of Computing End Interfaces: Media and Devices