1. © 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of 1-1 HCI Human Computer Interaction Week 9

2. 1-2 © 2010 Pearson Addison-Wesley. All rights reserved. What is VR Virtual Reality (VR) is the illusion of a three- dimensional, interactive, computer- generated reality where sight, sound, and sometimes even touch are simulated to create pictures, sounds, and objects that actually seem real.

3. 1-3 © 2010 Pearson Addison-Wesley. All rights reserved. VR must allow the user to view the environment from any point and at any angle VR must allow the user to interact with objects in the environment.

4. 1-4 © 2010 Pearson Addison-Wesley. All rights reserved. History Ivan Sutherland (1960) –First head mounted display and head tracking system MIT (1983) – “Put That There” – “The Aspen Movie Map” UNC (1986) – Using “virtual world” term – Walkthrough, Pixel Flow & Nanomanipulator systems

5. 1-5 © 2010 Pearson Addison-Wesley. All rights reserved. History (cont’d) NASA Ames Research Center –HMD, VPL Datagloves and BOOM –Spatial (3D) Sound –Super Cockpit VPL –First Commercial VR Hardware & systems –“Reality Build for Two” (RB2) –“Body Electric”

6. 1-6 © 2010 Pearson Addison-Wesley. All rights reserved. History (cont’d) Myron Krueger –GlowFlow, Meta play, Psychic space & Videoplace Naval Postgraduate School –SIMNET –NPSNET

7. 1-7 © 2010 Pearson Addison-Wesley. All rights reserved. Use of Special Purpose Equipment Feel of Presence

8. 1-8 © 2010 Pearson Addison-Wesley. All rights reserved. Also known as Desktop VR Use of a monitor to display the visual world Does not require special hardware Low Cost Low Performance Less Immersion

9. 1-9 © 2010 Pearson Addison-Wesley. All rights reserved. Real-time telepresence Interactions are reflected to some real world objects. Delayed telepresence Interactions are recorded, and after satisfaction is applied to the real-world object.

10. 1-10 © 2010 Pearson Addison-Wesley. All rights reserved. Computer generated inputs merged with the user’s view of the real world Components of VR -VR Hardware -VR Software

11. 1-11 © 2010 Pearson Addison-Wesley. All rights reserved. VR Hardware Primary user input interfaces Tracking interfaces Visual interfaces Auditory interfaces Haptic interfaces Olfactory interfaces

12. 1-12 © 2010 Pearson Addison-Wesley. All rights reserved. Primary Interfaces Keyboard, Mouse, Joystick 3D Pointing Devices –Spaceball –CyberWand –Ring Mouse –EGG

13. 1-13 © 2010 Pearson Addison-Wesley. All rights reserved. Primary Interfaces (cont’d) Whole-hand and body input –5 th Glove –Handmaster –ArmMaster –TCAS Dataware

14. 1-14 © 2010 Pearson Addison-Wesley. All rights reserved. Tracking Interfaces Measure head, body, hand or eye motion Major Characteristics –Resolution –Accuracy –System Responsiveness Sample rate, data rate, update rate and latency Major Technologies –Magnetic –Acoustics –Optical

15. 1-15 © 2010 Pearson Addison-Wesley. All rights reserved. Tracking Interfaces (cont’d) Head & Body Tracking –Polhemous IsoTrak II & FastTrak –Flock of Bird –VideoDesk Eye Tracking –BioMuse –DPI Eyetrackey

16. 1-16 © 2010 Pearson Addison-Wesley. All rights reserved. Visual Interfaces (cont’d) Head Mounted Display (HMD) –Datavisor 10x HMD –VR4000 –I-glasses! –VFX1 BOOM

17. 1-17 © 2010 Pearson Addison-Wesley. All rights reserved. Visual Interfaces (cont’d) Stereoscopic Glasses –Shutter glasses –Passive glasses Autostereoscopic –HDVD

18. 1-18 © 2010 Pearson Addison-Wesley. All rights reserved. Auditory Interfaces Auralization –3D simulation of a complex acoustic field Sonification –Audible display of data Speech Recognition Some products –Acoustetron II –RSS-10 Sound Space Processor –Q products

19. 1-19 © 2010 Pearson Addison-Wesley. All rights reserved. Haptic Interfaces Tactile (touch) –CyberTouch –Univ. of Salford Kinesthetic (force) –HapticMaster –PHANToM

20. 1-20 © 2010 Pearson Addison-Wesley. All rights reserved. Olfactory Interfaces Electronic Nose Storage Technologies –Liquid –Gel –Microencapsulation Some Products –BOC Group Olfactory Delivery System –Univ. of Wollongong eNose

21. 1-21 © 2010 Pearson Addison-Wesley. All rights reserved. Software Components Input Process Simulation Process Rendering Process World Database

22. 1-22 © 2010 Pearson Addison-Wesley. All rights reserved. Interaction Techniques “Simple” Virtual HandRay-casting

23. 1-23 © 2010 Pearson Addison-Wesley. All rights reserved. Spotlight Aperture Interaction Techniques (cont’d)

24. 1-24 © 2010 Pearson Addison-Wesley. All rights reserved. Interaction Techniques (cont’d) Sticky Finger Fishing reel Scaled-world grab

25. 1-25 © 2010 Pearson Addison-Wesley. All rights reserved. Navigation Techniques Steering : direction and velocity –hand-directed –gaze-directed –physical devices (steering wheel, flight sticks) Target-based –point at object, list of coordinates Route planning –place markers in world Mine, 1995

26. 1-26 © 2010 Pearson Addison-Wesley. All rights reserved. VR Applications Education Crossing streetConstruct3D

27. 1-27 © 2010 Pearson Addison-Wesley. All rights reserved. VR Applications Recreation

28. 1-28 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Design

29. 1-29 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Simulation Being 747 Flight Simulation

30. 1-30 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application User Interface WNMS

31. 1-31 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Telesurgery Augmented surgery Telepresence TeleRobotics

32. 1-32 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Information Visualization Acetic Acid Quick Sort

33. 1-33 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Entertainment Virtual racing

34. 1-34 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Military