1. Introduction to Virtual Reality (VR) Rudy Darken & Michael Zyda Naval Postgraduate School { Darken, Zyda }@cs.nps.navy.mil Rudy Darken & Michael Zyda Naval Postgraduate School { Darken, Zyda }@cs.nps.navy.mil

2. Intro to VR Overview What constitutes a "virtual environment"? What problems demand a virtual environment interface? What are the important issues in designing and building virtual environment interfaces? What constitutes a "virtual environment"? What problems demand a virtual environment interface? What are the important issues in designing and building virtual environment interfaces?

3. Virtual Environment Definitions A Computer-Generated, 3D Spatial Environment in Which Users Can Participate in Real-time Virtual Environments Can Be Fully Immersive, Encompassing WorldsFully Immersive, Encompassing Worlds Augmentations (Overlay) to the Real WorldAugmentations (Overlay) to the Real World “Through the Window” Worlds (Non-immersive)“Through the Window” Worlds (Non-immersive) A Computer-Generated, 3D Spatial Environment in Which Users Can Participate in Real-time Virtual Environments Can Be Fully Immersive, Encompassing WorldsFully Immersive, Encompassing Worlds Augmentations (Overlay) to the Real WorldAugmentations (Overlay) to the Real World “Through the Window” Worlds (Non-immersive)“Through the Window” Worlds (Non-immersive)

4. Virtual Environment Definitions Many names for the same thing Artificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic EnvironmentsArtificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic Environments Many names for the same thing Artificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic EnvironmentsArtificial reality, Cyberspace, Virtual Reality, Virtual Worlds, Virtual Environments, Synthetic Environments

5. The origins of the terms for VR... Artificial reality The first term we encounter historically.The first term we encounter historically. This is a term coined by Myron Krueger in the mid- 1970’s.This is a term coined by Myron Krueger in the mid- 1970’s. Krueger intended the term to mean “full-body participation in computer events that is so compelling that it is accepted as real experience”.Krueger intended the term to mean “full-body participation in computer events that is so compelling that it is accepted as real experience”. –Is it live, or is it Memorex? Artificial reality The first term we encounter historically.The first term we encounter historically. This is a term coined by Myron Krueger in the mid- 1970’s.This is a term coined by Myron Krueger in the mid- 1970’s. Krueger intended the term to mean “full-body participation in computer events that is so compelling that it is accepted as real experience”.Krueger intended the term to mean “full-body participation in computer events that is so compelling that it is accepted as real experience”. –Is it live, or is it Memorex?

6. Or… “What is real? How do you define real? If you're talking about what you can feel, what you can smell, what you can taste and see, then real is simply electrical signals interpreted by your brain.” - Morpheus “What is real? How do you define real? If you're talking about what you can feel, what you can smell, what you can taste and see, then real is simply electrical signals interpreted by your brain.” - Morpheus

7. The origins of the terms for VR... Cyberspace The term cyberspace was coined by William Gibson in 1984 in his science fiction novel Neuromancer.The term cyberspace was coined by William Gibson in 1984 in his science fiction novel Neuromancer. Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by thousands of people worldwide.Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by thousands of people worldwide.Cyberspace The term cyberspace was coined by William Gibson in 1984 in his science fiction novel Neuromancer.The term cyberspace was coined by William Gibson in 1984 in his science fiction novel Neuromancer. Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by thousands of people worldwide.Gibson used the term to refer to a single artificial reality that could be experienced simultaneously by thousands of people worldwide.

8. Cyberspace Gibson described huge virtual structures of data in the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous systems.Gibson described huge virtual structures of data in the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous systems. These blue pyramids of financial data or red hemispheres of corporate records were protected from eavesdroppers by visible walls of protection Gibson called “ice”.These blue pyramids of financial data or red hemispheres of corporate records were protected from eavesdroppers by visible walls of protection Gibson called “ice”. Gibson described huge virtual structures of data in the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous systems.Gibson described huge virtual structures of data in the “consensual hallucination” with millions of people directly connected by “jacking in” their nervous systems. These blue pyramids of financial data or red hemispheres of corporate records were protected from eavesdroppers by visible walls of protection Gibson called “ice”.These blue pyramids of financial data or red hemispheres of corporate records were protected from eavesdroppers by visible walls of protection Gibson called “ice”.

9. Cyberspace From Gibson, we get the idea of flying through data space, where there are 3D icons in our visual display, with the 3D icons having assigned meaning and operators that can act on the icons...From Gibson, we get the idea of flying through data space, where there are 3D icons in our visual display, with the 3D icons having assigned meaning and operators that can act on the icons...

10. The origins of the terms for VR... Virtual reality (VR) Coined by Jaron Lanier, founder/head of VPL Research, to bring all of the virtual projects under a single title.Coined by Jaron Lanier, founder/head of VPL Research, to bring all of the virtual projects under a single title. His meaning for the term typically refers to three- dimensional realities implemented with a stereo head- mounted display and data gloves for input.His meaning for the term typically refers to three- dimensional realities implemented with a stereo head- mounted display and data gloves for input. –The VPL system is driven by an IRIS workstation for each eye... Virtual reality (VR) Coined by Jaron Lanier, founder/head of VPL Research, to bring all of the virtual projects under a single title.Coined by Jaron Lanier, founder/head of VPL Research, to bring all of the virtual projects under a single title. His meaning for the term typically refers to three- dimensional realities implemented with a stereo head- mounted display and data gloves for input.His meaning for the term typically refers to three- dimensional realities implemented with a stereo head- mounted display and data gloves for input. –The VPL system is driven by an IRIS workstation for each eye...

11. The origins of the terms for VR... Virtual worlds Virtual world is defined in terms of the characteristics that indicate such a system:Virtual world is defined in terms of the characteristics that indicate such a system: –These characteristics are seeing and interacting with distant, expensive, hazardous, or non-existent 3D environments. –The technology for “seeing” is real-time, interactive 3D computer graphics and the technology for “interacting” is evolving and varied. Virtual worlds Virtual world is defined in terms of the characteristics that indicate such a system:Virtual world is defined in terms of the characteristics that indicate such a system: –These characteristics are seeing and interacting with distant, expensive, hazardous, or non-existent 3D environments. –The technology for “seeing” is real-time, interactive 3D computer graphics and the technology for “interacting” is evolving and varied.

12. Virtual Worlds Virtual worlds (alternate definition): Moving and interacting with a three-dimensional model of a world in real-time such that the experience is almost real or a near-believable simulation of the real.Virtual worlds (alternate definition): Moving and interacting with a three-dimensional model of a world in real-time such that the experience is almost real or a near-believable simulation of the real.

13. The origins of the terms for VR... Virtual environment Virtual environment is a safe alternative to virtual world.Virtual environment is a safe alternative to virtual world. The University of Washington Human Interface Technology (HIT) Lab people are the first people to use the term virtual environment to describe their work.The University of Washington Human Interface Technology (HIT) Lab people are the first people to use the term virtual environment to describe their work. Virtual environment Virtual environment is a safe alternative to virtual world.Virtual environment is a safe alternative to virtual world. The University of Washington Human Interface Technology (HIT) Lab people are the first people to use the term virtual environment to describe their work.The University of Washington Human Interface Technology (HIT) Lab people are the first people to use the term virtual environment to describe their work.

14. The origins of the terms for VR... Synthetic Environment This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds.This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds. Synthetic Environment This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds.This is the term DARPA uses to describe its various programs for seeing/interacting with 3D worlds.

15. The origins of the terms for VR... Metaverse and Avatars Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or appearance of characters (humans) in the Metaverse are called Avatars.Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or appearance of characters (humans) in the Metaverse are called Avatars. This terminology is used in the book Snow Crash, by Neal Stephenson.This terminology is used in the book Snow Crash, by Neal Stephenson. Metaverse and Avatars Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or appearance of characters (humans) in the Metaverse are called Avatars.Sometimes the 3D virtual world (Gibson matrix) is called the Metaverse and the 3D icons or appearance of characters (humans) in the Metaverse are called Avatars. This terminology is used in the book Snow Crash, by Neal Stephenson.This terminology is used in the book Snow Crash, by Neal Stephenson.

16. Visual Simulation & Virtual Environments The key differentiator between visual simulation and virtual environments revolves around the term “accessibility”. Much of the early work in virtual environments reproduced that previously done for visual simulation because the visual simulation work was not accessible, being locked up in proprietary technical reports.Much of the early work in virtual environments reproduced that previously done for visual simulation because the visual simulation work was not accessible, being locked up in proprietary technical reports. The key differentiator between visual simulation and virtual environments revolves around the term “accessibility”. Much of the early work in virtual environments reproduced that previously done for visual simulation because the visual simulation work was not accessible, being locked up in proprietary technical reports.Much of the early work in virtual environments reproduced that previously done for visual simulation because the visual simulation work was not accessible, being locked up in proprietary technical reports.

17. Telepresence There are two kinds of telepresence: Real-time telepresence: A visual virtual world that you interact with. - Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time.A visual virtual world that you interact with. - Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time. There are two kinds of telepresence: Real-time telepresence: A visual virtual world that you interact with. - Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time.A visual virtual world that you interact with. - Interactions are reflected in the movement of some real world object. i.e. a DataGlove being moved to control a robot hand that moves at the same time.

18. Telepresence Delayed telepresence: A visual, virtual world that you interact with while recording the interactions.A visual, virtual world that you interact with while recording the interactions. When you are satisfied with the results, play the interactions across your communications delay.When you are satisfied with the results, play the interactions across your communications delay. Delayed telepresence: A visual, virtual world that you interact with while recording the interactions.A visual, virtual world that you interact with while recording the interactions. When you are satisfied with the results, play the interactions across your communications delay.When you are satisfied with the results, play the interactions across your communications delay.

19. Immersion & Presence There are two entangled terms in VR - immersion and presence. Immersion is best thought of as “How am I interacting with the virtual world?”Immersion is best thought of as “How am I interacting with the virtual world?” “Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the user can perform a task or set of tasks.“Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the user can perform a task or set of tasks. There are two entangled terms in VR - immersion and presence. Immersion is best thought of as “How am I interacting with the virtual world?”Immersion is best thought of as “How am I interacting with the virtual world?” “Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the user can perform a task or set of tasks.“Presence” is the notion that the user of the virtual world feels “present in the virtual world” such that the user can perform a task or set of tasks.

20. Immersion & Presence Sometimes the phrase “immersed in the virtual world” is taken to mean the same as “present in the virtual world”.

21. Measuring presence & immersion... There are papers that discuss the measurement or quantification of “presence”. What is really important though is can human performance be improved through the use of a virtual environment and can that improvement be measured?What is really important though is can human performance be improved through the use of a virtual environment and can that improvement be measured? –Otherwise, we’re just playing with neat toys There are papers that discuss the measurement or quantification of “presence”. What is really important though is can human performance be improved through the use of a virtual environment and can that improvement be measured?What is really important though is can human performance be improved through the use of a virtual environment and can that improvement be measured? –Otherwise, we’re just playing with neat toys

22. Why an immersive interface? The environment encompasses large virtual spaces A large number of parameters are to be manipulated by the operator Tasks are of a hands-busy nature Perspective is important The environment encompasses large virtual spaces A large number of parameters are to be manipulated by the operator Tasks are of a hands-busy nature Perspective is important

24. Where did all the hype come from? Video

25. Video selections Show the Tom Defanti tape made for NSF. Show the Jeff Goldblum episode of FutureQuest. Show the entertainment VR videotape. Show the Tom Defanti tape made for NSF. Show the Jeff Goldblum episode of FutureQuest. Show the entertainment VR videotape.