2. Utah School of Computing Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2008 CS5540 HCI Rich Riesenfeld Fall 2008

3. Student Name Server Utah School of Computing slide 2 Fall 2008 Major Categories InputInput -Harder OutputOutput -More successful history InputInput -Harder OutputOutput -More successful history

4. Student Name Server Utah School of Computing slide 3 Fall 2008 Inputs - 1 Clickless Interface ExampleClickless Interface Example -http://www.dontclick.it http://www.dontclick.it TTYTTY VoiceVoice GestureGesture -Body language -Using succinct communications HapticHaptic -Phantom devices, etc Clickless Interface ExampleClickless Interface Example -http://www.dontclick.it http://www.dontclick.it TTYTTY VoiceVoice GestureGesture -Body language -Using succinct communications HapticHaptic -Phantom devices, etc

5. Student Name Server Utah School of Computing slide 4 Fall 2008 Inputs - 2 Clickless Interface ExampleClickless Interface Example -http://www.dontclick.it http://www.dontclick.it HandwritingHandwriting Security identificationSecurity identification -Fingerprints -Laser identification Eye trackingEye tracking -Movement Clickless Interface ExampleClickless Interface Example -http://www.dontclick.it http://www.dontclick.it HandwritingHandwriting Security identificationSecurity identification -Fingerprints -Laser identification Eye trackingEye tracking -Movement

6. Student Name Server Utah School of Computing slide 5 Fall 2008 Inputs - 3 Body forcesBody forces -Live seat -Sides of back -Etc Transporter (gestural communications)Transporter (gestural communications) -Segway Video -Winglet Video Body forcesBody forces -Live seat -Sides of back -Etc Transporter (gestural communications)Transporter (gestural communications) -Segway Video -Winglet Video

7. Student Name Server Utah School of Computing slide 6 Fall 2008 Inputs - 4 SimulatorsSimulators -Disney, Pilot training, NASA Structured lightStructured light Body sensorsBody sensors -Animation  Motion capture SimulatorsSimulators -Disney, Pilot training, NASA Structured lightStructured light Body sensorsBody sensors -Animation  Motion capture

8. Student Name Server Utah School of Computing slide 7 Fall 2008 Inputs - 5 WidgetsWidgets -Buttons, sliders, menus, toggles, etc User RecognitionUser Recognition -Get your coffee the way you always get it! Machine LearningMachine Learning -Watch and learn -Windows menus: What is on top of menu? WidgetsWidgets -Buttons, sliders, menus, toggles, etc User RecognitionUser Recognition -Get your coffee the way you always get it! Machine LearningMachine Learning -Watch and learn -Windows menus: What is on top of menu?

9. Student Name Server Utah School of Computing slide 8 Fall 2008 Inputs - 6 Multi-channelMulti-channel -Games -Simulators -Training/Education -Music  Electronic keyboard Multi-channelMulti-channel -Games -Simulators -Training/Education -Music  Electronic keyboard

10. Student Name Server Utah School of Computing slide 9 Fall 2008 Inputs - 7 Read CNS signalsRead CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers Read CNS signalsRead CNS signals -Muscle signals -Lie detector  Skin conductivity -Direct brain signal interface  cyberkineticsinc.com  cyberkineticsinc.com cyberkineticsinc.com  ALS  Spinal cord injury sufferers

11. Student Name Server Utah School of Computing slide 10 Fall 2008 Outputs – 1 Flat screenFlat screen -Resolution, colors, refresh rate, size … -“Big Board” on CNN, MSNBC Stereopsis TechniquesStereopsis Techniques -Left/Right visual separation -Color filters: R/G, etc -Polarized glasses Flat screenFlat screen -Resolution, colors, refresh rate, size … -“Big Board” on CNN, MSNBC Stereopsis TechniquesStereopsis Techniques -Left/Right visual separation -Color filters: R/G, etc -Polarized glasses

12. Student Name Server Utah School of Computing slide 11 Fall 2008 Outputs – 2 SoundSound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded SoundSound -Synthetic, unnatural sounds  Laser, “wrong,” “dive” -Realistic:  prerecorded DB  generated -Speech  Synthetic  Real, prerecorded

13. Student Name Server Utah School of Computing slide 12 Fall 2008 Outputs – 3 VisualizationsVisualizations -Scientific visualization -Information visualizaiton VisualizationsVisualizations -Scientific visualization -Information visualizaiton

14. Student Name Server Utah School of Computing slide 13 Fall 2008 Outputs – 5 VR EnvironmentsVR Environments -3D  Spinal medication  MRI visualizations  Fly throughs  Fantasy worlds VR EnvironmentsVR Environments -3D  Spinal medication  MRI visualizations  Fly throughs  Fantasy worlds

15. Student Name Server Utah School of Computing slide 14 Fall 2008 Outputs – 6 -Overlays on real-world  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload -Overlays on real-world  Breast biopsy procedure  Assembly or Maintenance Info  HUDs in cockpit  Reduce cognitive overload

16. Student Name Server Utah School of Computing slide 15 Fall 2008 Outputs – 7 VR EnvironmentsVR Environments -“Holodecks”, synthetic spaces, avatars -Virtual “try on” for clothes SmellSmell VibrationsVibrations Newtonian Physics: ONNewtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise VR EnvironmentsVR Environments -“Holodecks”, synthetic spaces, avatars -Virtual “try on” for clothes SmellSmell VibrationsVibrations Newtonian Physics: ONNewtonian Physics: ON -Exploit the known, natural experience  Highly predictable  Concise

17. Student Name Server Utah School of Computing slide 16 Fall 2008 Outputs – 8 Newtonian Physics: ON (cont )Newtonian Physics: ON (cont ) -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise -Provide artificial physics  New rules/forces Newtonian Physics: ON (cont )Newtonian Physics: ON (cont ) -Provide normal physics of environment  Inertia  Collisions (no penetrations)  Gravity  Friction  Noise -Provide artificial physics  New rules/forces

18. Student Name Server Utah School of Computing slide 17 Fall 2008 Outputs – 9 Background soundBackground sound -Movie score  Important  Not natural Background soundBackground sound -Movie score  Important  Not natural

19. Student Name Server Utah School of Computing slide 18 Large Screen Displays Large touch display with gesturesLarge touch display with gestures Fall 2008

20. Student Name Server Utah School of Computing slide 19 Fall 2008 Large Screen Displays

21. Student Name Server Utah School of Computing slide 20 Large Screen Displays Large multi-point input displayLarge multi-point input display Fall 2008

23. Student Name Server Utah School of Computing slide 22 Virtual, Remote (Robotic) Surgery Robotic SurgeryRobotic Surgery -daVinci System Robotic SurgeryRobotic Surgery -daVinci System Fall 2008

24. Student Name Server Utah School of Computing slide 23 Fall 2008

25. Student Name Server Utah School of Computing slide 24 Synthetic Worlds Siggraph (2001)Siggraph (2001) Fall 2008

26. Student Name Server Utah School of Computing slide 25 Fall 2008

27. Student Name Server Utah School of Computing slide 26 Video Clips Magic Board 1Magic Board 1 Magic Board 2Magic Board 2 Magic Board 3Magic Board 3 Braingate 1Braingate 1 Braingate 2Braingate 2 Magic Board 1Magic Board 1 Magic Board 2Magic Board 2 Magic Board 3Magic Board 3 Braingate 1Braingate 1 Braingate 2Braingate 2 Fall 2008

28. Student Name Server Utah School of Computing slide 27 Transporter/WingletTransporter/Winglet Segway deviceSegway device Fall 2008

29. Student Name Server Utah School of Computing slide 28 Fall 2008

30. Utah School of Computing End Interfaces: Media and Devices Interfaces: Media and Devices

31. Student Name Server Utah School of Computing slide 30 Fall 2008 Large Screen Displays

32. bare blk bkgd