Virtual Reality Trend for Digital Animation and Global Success Cases Jim X. Chen, Ph.D. Director of Computer Graphics Lab George Mason University Fairfax, VA 22030

Contents Introduction to Virtual Reality and Hardware Virtual Reality Current Trend Virtual Reality Software and Digital Animation Systems VR Research, Applications and Global Successful Cases 9/21/2018 http://graphics.gmu.edu

Intro to VR & Hardware Conventional Computer VR-based Computer World VR-based Computer Computer World 9/21/2018 http://graphics.gmu.edu

All technologies meet together at VR !! VR technologies Computer graphics Character CRT Keyboard Graphic CRT Mouse tablet Realtime CG Virtual console 3D mouse Virtual Reality Computer simulation/ visualization Video arts Virtual products design Tele-conference Tele-Existence 3D CAD TV phone Computer Aided Design Tele-Operation Telephone All technologies meet together at VR !! 9/21/2018 http://graphics.gmu.edu

A sense of of immersion Stereoscopic Tracking Tactile & haptic Acoustic, etc. 9/21/2018 http://graphics.gmu.edu

3D Graphics and Stereoscopes User controlled movement and view Objects may respond to actions and environment Stereoscopes 2 projections 9/21/2018 http://graphics.gmu.edu

Crystal Eyes (http://www.stereographics.com/)

Head Mounted Displays (http://www.fakespace.com/) (http://www.stereo3d.com/)

Tracking Systems (http://www. polhemus. com/) (http://www

ImmersaDesk (http://www.fakespace.com/)

CAVE (http://www.fakespace.com/) (http://evlweb.eecs.uic.edu/pape/CAVE/)

RAVE (http://www.fakespace.com/)

Immersive Work Wall

VisionDome Alternate Realities Corporation http://www.virtual-reality.com/index.html http://www.avrrc.lboro.ac.uk/Visiondome_facility.html

Tactile and Haptic Devices PHANToM (http://www.sensable.com) 9/21/2018 http://graphics.gmu.edu

Cyberglove (http://www.virtex.com)

Immersion Corp: Impulse Engines (2D and 4D [pinch]) 9/21/2018 http://graphics.gmu.edu

Sarcos Dextrous Master 9/21/2018 http://graphics.gmu.edu

REFLEX FREFLEX is a 7 joints articulation systems that mimics human motion Is an exosqueleton system allowing real-time control of robots Update rate of 130Hz 9/21/2018 http://graphics.gmu.edu

Exoskeleton (Iowa State U.) An other exoskeleton system developed at Iowa State University Based on electromagnetic coupling 9/21/2018 http://graphics.gmu.edu

CyberGrasp 9/21/2018 http://graphics.gmu.edu

3 DoF Force Feedback Joystick 9/21/2018 http://graphics.gmu.edu

CyberTouch 9/21/2018 http://graphics.gmu.edu

TouchMaster TouchMaster is a vibro-tactile transducer commercialized by EXOS Use 6 to 10 speakers coils An vibrate at a frequency of 210 Hz 9/21/2018 http://graphics.gmu.edu

Virtual Reality - Immersion Key to the VR field is “immersion”. A VR environment is immersive if it gives the user the feeling of being inside a scene, rather than simply looking at the scene. True VR is nonexistent, but we do what we can: Create a scene that is viewed by the user as if they are in it. Allow the user to interact with objects in the scene in something approximating a “natural” way. Bring in as many senses as we can: Sight & sound are the main ones we deal with. Lots of research is begin done on touch (haptic interfaces). Taste & smell: forget it, for now. 9/21/2018 http://graphics.gmu.edu

VR Terminology Virtual / Synthetic Environments Tele-presence Presence Cyberspace Immersion Simulator / Motion Sickness Lag time 3D rendering / Graphics Engine VRML Bodysuit Head Mounted Display (HMD) 3D Mouse Joystick Stereoscopic Display Liquid Crystal Shutterglasses Ultrasonic / Magnetic / Optical Tracking Cyber / Power / Data Glove Haptic Display Position Tracking 9/21/2018 http://graphics.gmu.edu

Types of VR Window on World (WoW), Desktop Immersive Telepresence Mixed Reality (head up displays) Fishtank VR Entry level VR Basic VR Advanced VR Projected VR (maybe with shutterglasses) Cockpit Simulators 9/21/2018 http://graphics.gmu.edu

Output Devices Visual Audio (Stereo) Tactile Motion Computer Screen, Head Mounted Display, 3D Shutter Glasses, Cyberscope, ImmersaDesk, CAVE, Spherical Projection, Big Screen Technology, Visiondome, Reality Centre. Audio (Stereo) Speakers, Earphones, Speech, Music Tactile Tactile Gloves Motion eg. Flight Simulators using pneumatic motion simulators 9/21/2018 http://graphics.gmu.edu

Input Devices DataGlove and Bodysuit Mouse, Joystick, Keyboard, 3D Mouse Movement Trackers (eg Polhemus) Gesture Recognition (with DataGlove) Speech Recognition 9/21/2018 http://graphics.gmu.edu

Virtual Reality: Current Trend PC-driven VR system (www.quantum3d.com) multi-channel synchronized PC-IG Networked virtual environments with avatars (www.activeworlds.com) Web3D immersive systems (http://www.web3d.org) Image-based/Quicktime VR 9/21/2018 http://graphics.gmu.edu

Digital Communication and Animation: Active Worlds (AW) Universe, populated by Worlds Universe server: universe.activeworlds.com World servers: anywhere on the Internet Enter the Universe Select and enter a world in that Universe 9/21/2018 http://graphics.gmu.edu

The virtual reality of AW Getting into a world in the universe …. The background image The horizontal 0 level surface of the world 9/21/2018 http://graphics.gmu.edu

The virtual reality of AW … later there was: an avatar virtual embodiment of person in AW building blocks (objects) the building material in AW the blocks are active - they can respond with some action, or provide additional information. 1. The world metaphor - emphasis on personality. 9/21/2018 http://graphics.gmu.edu

The window to an AW universe/world 3D area Web area Multifunction area 1. Universe populated by worlds - one universe server can host one or many world servers. The world servers can be allocated at any machine which has permanent Internet address. Synchronous communication area 9/21/2018 http://graphics.gmu.edu

What is Web3D? The term Web3d describes any programming or descriptive language that can be used to deliver interactive 3D objects and worlds across the internet. Virtual Reality Modeling Language (VRML), Java3D and X3D (under development) - also any proprietary languages that have been developed for the same purpose come under the umbrella of Web3d. http://www.web3d.org : web3d consortuim 9/21/2018 http://graphics.gmu.edu

3D for the Web Exploring web-based 3D environments requires the use of a Plug-in Formats/architectures include: The Virtual Reality Modelling Language (VRML): viewers include Blaxxun Contact, Cosmo Player and Cortona X3D Superscape e-Visualizer and Viscape Cult 3D Biovirtual 3DMeNow Active Worlds Shout3D Shockwave 3D 9/21/2018 http://graphics.gmu.edu

History of Web3D 9/21/2018 http://graphics.gmu.edu

Java3D - Class 9/21/2018 http://graphics.gmu.edu

Web3D games http://www.dave2n.com/ http://www.dccard.co.jp/ http://www.activeworlds.com 9/21/2018 http://graphics.gmu.edu

Image-based Virtual Reality VR system using Image-based Rendering Presence + Interaction + Autonomy 9/21/2018 http://graphics.gmu.edu

Image-based Virtual Reality Characteristics of Images Fixed scene geometry Fixed camera movement Fixed light condition Limitation on image resolution 9/21/2018 http://graphics.gmu.edu

Image-based Virtual Reality QuickTimeVR was introduced in 1994 photorealistic virtual reality type effects with limited interaction Applications : Museum, Gallery, Sightseeing, Model House, Cyber Shopping Mall 9/21/2018 http://graphics.gmu.edu

Virtual Reality Software and Digital Animation Systems Low-level graphics libraries Visualization Modeling and Rendering Animation and Simulation VR Software/Web3D: inventor, VRML, X3D, WTK, WUP, etc. 9/21/2018 http://graphics.gmu.edu

Virtual Reality Software and Digital Animation Systems Book: Guide to Graphics Software Tools: http://cs.gmu.edu/~jchen/graphics A shortcut to graphics programming: shortest textbook that covers all A list of all graphics related tools, including Web3D and Virtual Reality Rich online sources to all different tools 9/21/2018 http://graphics.gmu.edu

VR Research, Applications and Global Successful Cases Education/ Training Design Engineering Entertainment Museum Arts VR application Medicine Scientific Visualization Communication Products Engineering 9/21/2018 http://graphics.gmu.edu

VR Research Better, Faster VR with less side-effects. The long-term effects of VR. Applications of VR (eg for assessment of brain damage and rehabilitation) New VR machinery. VR (and 3D) as the interface to a process. Presence (what is it and how do we measure it) 9/21/2018 http://graphics.gmu.edu

VR Research Problems Applications VR still costly for good system Still seen as “research” by most companies Gap between promise and delivery Applications Demonstrating products, Sales, Design, Manufacturing, 3D modelling, Walk through, Visualisation, Training, Process control... 9/21/2018 http://graphics.gmu.edu

Industry A couple of companies using VR VOLVO Nokia British Telecom to test car interior designs and to demonstrate new cars on virtual roads. Combined VR and real car cockpit, gives tactile, visual and audible information. Nokia VR + PHANToM, to test new and potential telephone designs. British Telecom For visualisation of extremely complex telephone network in England and isolation of faults using 3D visual cues. 9/21/2018 http://graphics.gmu.edu

Training / Education Patient teachers of real-world situations Safer and Cheaper environment, no lives at risk. People with special needs Cockpit Simulation (flight simulators) Complex Machinery - manipulate parts and see into difficult areas with on-line help In dangerous Situations, eg. Nuclear Reactor - quick in and out, get used to the layout before entering for real to reduce the chance for human error. With Complex Procedures, eg. Surgical Operations, can practice on virtual patients first, or have the patient scanned and made into a virtual model - complete with force feedback on the surgical instruments. 9/21/2018 http://graphics.gmu.edu

(Augmented) Telepresence VR overlaid onto real-world with see-through HMD. eg: Heads-up display in fighter plane eg: Surgeon operating on a patient with overlays from CAT scans to highlight critical nerves, tendons etc. 9/21/2018 http://graphics.gmu.edu

Users with special needs Specialized requirements which are often well-served by VR systems • visual impairment - screen readers, SonicFinder • physical disability - speech input, gesture recognition, predictive systems (e.g. Reactive keyboard) • learning disabilities (e.g. dyslexia) - speech input, output 9/21/2018 http://graphics.gmu.edu