© 2010 Pearson Addison-Wesley. All rights reserved. Addison Wesley is an imprint of 1-1 HCI Human Computer Interaction Week 9

1-2 © 2010 Pearson Addison-Wesley. All rights reserved. What is VR Virtual Reality (VR) is the illusion of a three- dimensional, interactive, computer- generated reality where sight, sound, and sometimes even touch are simulated to create pictures, sounds, and objects that actually seem real.

1-3 © 2010 Pearson Addison-Wesley. All rights reserved. VR must allow the user to view the environment from any point and at any angle VR must allow the user to interact with objects in the environment.

1-4 © 2010 Pearson Addison-Wesley. All rights reserved. History Ivan Sutherland (1960) –First head mounted display and head tracking system MIT (1983) – “Put That There” – “The Aspen Movie Map” UNC (1986) – Using “virtual world” term – Walkthrough, Pixel Flow & Nanomanipulator systems

1-5 © 2010 Pearson Addison-Wesley. All rights reserved. History (cont’d) NASA Ames Research Center –HMD, VPL Datagloves and BOOM –Spatial (3D) Sound –Super Cockpit VPL –First Commercial VR Hardware & systems –“Reality Build for Two” (RB2) –“Body Electric”

1-6 © 2010 Pearson Addison-Wesley. All rights reserved. History (cont’d) Myron Krueger –GlowFlow, Meta play, Psychic space & Videoplace Naval Postgraduate School –SIMNET –NPSNET

1-7 © 2010 Pearson Addison-Wesley. All rights reserved. Use of Special Purpose Equipment Feel of Presence

1-8 © 2010 Pearson Addison-Wesley. All rights reserved. Also known as Desktop VR Use of a monitor to display the visual world Does not require special hardware Low Cost Low Performance Less Immersion

1-9 © 2010 Pearson Addison-Wesley. All rights reserved. Real-time telepresence Interactions are reflected to some real world objects. Delayed telepresence Interactions are recorded, and after satisfaction is applied to the real-world object.

1-10 © 2010 Pearson Addison-Wesley. All rights reserved. Computer generated inputs merged with the user’s view of the real world Components of VR -VR Hardware -VR Software

1-11 © 2010 Pearson Addison-Wesley. All rights reserved. VR Hardware Primary user input interfaces Tracking interfaces Visual interfaces Auditory interfaces Haptic interfaces Olfactory interfaces

1-12 © 2010 Pearson Addison-Wesley. All rights reserved. Primary Interfaces Keyboard, Mouse, Joystick 3D Pointing Devices –Spaceball –CyberWand –Ring Mouse –EGG

1-13 © 2010 Pearson Addison-Wesley. All rights reserved. Primary Interfaces (cont’d) Whole-hand and body input –5 th Glove –Handmaster –ArmMaster –TCAS Dataware

1-14 © 2010 Pearson Addison-Wesley. All rights reserved. Tracking Interfaces Measure head, body, hand or eye motion Major Characteristics –Resolution –Accuracy –System Responsiveness Sample rate, data rate, update rate and latency Major Technologies –Magnetic –Acoustics –Optical

1-15 © 2010 Pearson Addison-Wesley. All rights reserved. Tracking Interfaces (cont’d) Head & Body Tracking –Polhemous IsoTrak II & FastTrak –Flock of Bird –VideoDesk Eye Tracking –BioMuse –DPI Eyetrackey

1-16 © 2010 Pearson Addison-Wesley. All rights reserved. Visual Interfaces (cont’d) Head Mounted Display (HMD) –Datavisor 10x HMD –VR4000 –I-glasses! –VFX1 BOOM

1-17 © 2010 Pearson Addison-Wesley. All rights reserved. Visual Interfaces (cont’d) Stereoscopic Glasses –Shutter glasses –Passive glasses Autostereoscopic –HDVD

1-18 © 2010 Pearson Addison-Wesley. All rights reserved. Auditory Interfaces Auralization –3D simulation of a complex acoustic field Sonification –Audible display of data Speech Recognition Some products –Acoustetron II –RSS-10 Sound Space Processor –Q products

1-19 © 2010 Pearson Addison-Wesley. All rights reserved. Haptic Interfaces Tactile (touch) –CyberTouch –Univ. of Salford Kinesthetic (force) –HapticMaster –PHANToM

1-20 © 2010 Pearson Addison-Wesley. All rights reserved. Olfactory Interfaces Electronic Nose Storage Technologies –Liquid –Gel –Microencapsulation Some Products –BOC Group Olfactory Delivery System –Univ. of Wollongong eNose

1-21 © 2010 Pearson Addison-Wesley. All rights reserved. Software Components Input Process Simulation Process Rendering Process World Database

1-22 © 2010 Pearson Addison-Wesley. All rights reserved. Interaction Techniques “Simple” Virtual HandRay-casting

1-23 © 2010 Pearson Addison-Wesley. All rights reserved. Spotlight Aperture Interaction Techniques (cont’d)

1-24 © 2010 Pearson Addison-Wesley. All rights reserved. Interaction Techniques (cont’d) Sticky Finger Fishing reel Scaled-world grab

1-25 © 2010 Pearson Addison-Wesley. All rights reserved. Navigation Techniques Steering : direction and velocity –hand-directed –gaze-directed –physical devices (steering wheel, flight sticks) Target-based –point at object, list of coordinates Route planning –place markers in world Mine, 1995

1-26 © 2010 Pearson Addison-Wesley. All rights reserved. VR Applications Education Crossing streetConstruct3D

1-27 © 2010 Pearson Addison-Wesley. All rights reserved. VR Applications Recreation

1-28 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Design

1-29 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Simulation Being 747 Flight Simulation

1-30 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application User Interface WNMS

1-31 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Telesurgery Augmented surgery Telepresence TeleRobotics

1-32 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Information Visualization Acetic Acid Quick Sort

1-33 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Entertainment Virtual racing

1-34 © 2010 Pearson Addison-Wesley. All rights reserved. VR Application Military