VR - The Historical Context Part 2 Rudy Darken & Michael Zyda Naval Postgraduate School { Darken, Zyda Rudy Darken & Michael Zyda Naval Postgraduate School { Darken, Zyda

NASA Ames Research Center Mike McGreevy and Scott Fisher developed the first affordable VE system in the mid 1980’s.Mike McGreevy and Scott Fisher developed the first affordable VE system in the mid 1980’s. Their system consisted of a head- mounted display (their own design but contracted out to Leep Optics) and a VPL DataGlove (they contracted with VPL to build this under NASA’s specifications).Their system consisted of a head- mounted display (their own design but contracted out to Leep Optics) and a VPL DataGlove (they contracted with VPL to build this under NASA’s specifications). Mike McGreevy and Scott Fisher developed the first affordable VE system in the mid 1980’s.Mike McGreevy and Scott Fisher developed the first affordable VE system in the mid 1980’s. Their system consisted of a head- mounted display (their own design but contracted out to Leep Optics) and a VPL DataGlove (they contracted with VPL to build this under NASA’s specifications).Their system consisted of a head- mounted display (their own design but contracted out to Leep Optics) and a VPL DataGlove (they contracted with VPL to build this under NASA’s specifications).

NASA’s VIEW Project

NASA’s Early HMD

NASA’s HMD

NASA’s BOOM Mounted Display

NASA Telerobotics

NASA VIEW Project - Spatial Sound - the Convolvotron The purpose of the Convolvotron was to provide 3D sound.The purpose of the Convolvotron was to provide 3D sound. –Small microphones were mounted in the ears of a dummy head. –Sounds were played at various positions around the head and the amplitudes and phase differences between the sounds arrivals at the microphones were recorded. The purpose of the Convolvotron was to provide 3D sound.The purpose of the Convolvotron was to provide 3D sound. –Small microphones were mounted in the ears of a dummy head. –Sounds were played at various positions around the head and the amplitudes and phase differences between the sounds arrivals at the microphones were recorded.

NASA VIEW Project - Spatial Sound - the Convolvotron Those parameters were used in the construction of a device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned.Those parameters were used in the construction of a device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned. –i.e. the sound would be modified for the stereo channels to simulate the phase and amplitude differences that would exist “were” the sound really where the Convolvotron placed it. This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering...This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering... Those parameters were used in the construction of a device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned.Those parameters were used in the construction of a device, the Convolvotron, that could provide real-time, 3D positioning for sound that was otherwise not positioned. –i.e. the sound would be modified for the stereo channels to simulate the phase and amplitude differences that would exist “were” the sound really where the Convolvotron placed it. This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering...This work was done by Beth Wenzel of NASA and Scott Foster of Crystal River Engineering...

NASA VIEW Project - Spatial Sound - the Convolvotron Outputs Spatialized Sound to Stereo Headphones Inputs Sound Location of sound Location of viewer Head orientation of viewer Convolvotron Sound Source

NASA Video Suggestions ACM SIGGRAPH Video Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA.ACM SIGGRAPH Video Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA. ACM SIGGRAPH Video Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA.ACM SIGGRAPH Video Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA. ACM SIGGRAPH Video Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA.ACM SIGGRAPH Video Review 50, 1989, Entry 12: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA. ACM SIGGRAPH Video Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA.ACM SIGGRAPH Video Review 55, 1990, Entry 3: VIEW: NASA/AMES Virtual Environment Workstation - Scott Fisher/NASA. ACM SIGGRAPH Video Review 49, 1988/89, Entries for “Mars the Movie” and “Earth the Movie”. Where is “LA the Movie” (also good)? ACM SIGGRAPH Video Review 49, 1988/89, Entries for “Mars the Movie” and “Earth the Movie”. Where is “LA the Movie” (also good)?

NASA Video Suggestions ACM SIGGRAPH ‘92 Course #9, “Implementation of Immersive Virtual Environments”. Good piece of Hitchner “Virtual Planetary Exploration Project”.ACM SIGGRAPH ‘92 Course #9, “Implementation of Immersive Virtual Environments”. Good piece of Hitchner “Virtual Planetary Exploration Project”. ACM SIGGRAPH ‘93, Course #43 “Implementing VR”. Great NASA and UVA footage. Show the complete tape. Virtual windtunnel project/Bryson. UNC/Robinette (great piece). Univ of Virginia/Pausch Brown University - 3D widgets.ACM SIGGRAPH ‘93, Course #43 “Implementing VR”. Great NASA and UVA footage. Show the complete tape. Virtual windtunnel project/Bryson. UNC/Robinette (great piece). Univ of Virginia/Pausch Brown University - 3D widgets.

USAF Wright Patterson Armstrong Lab The “Super Cockpit”

Super Cockpit - $1M HMD

Super Cockpit Design

VPL Research VPL produced the first commercial VR hardware and system (RB2). VPL developed the DataGlove and PowerGlove and eventually a tactile feedback glove. VPL produced the first commercial VR hardware and system (RB2). VPL developed the DataGlove and PowerGlove and eventually a tactile feedback glove.

VPL Research They commercialized the NASA HMD technology - based on LCD displays and a special optics system. Produced software for the design of virtual environments. Produced a commercial VR system that can support one or two users. They commercialized the NASA HMD technology - based on LCD displays and a special optics system. Produced software for the design of virtual environments. Produced a commercial VR system that can support one or two users.

VPL’s Reality Built for Two (RB2) A development platform for designing and implementing real-time virtual realities. Development was rapid & interactive using a visual programming language.Development was rapid & interactive using a visual programming language. –Behavior constraints and interactions were edited in real-time. A development platform for designing and implementing real-time virtual realities. Development was rapid & interactive using a visual programming language.Development was rapid & interactive using a visual programming language. –Behavior constraints and interactions were edited in real-time.

VPL’s Reality Built for Two (RB2) Changes made to the interactions in the world were seen immediately. For example, attach gravity to an object and see it fall.For example, attach gravity to an object and see it fall. Changes made to the interactions in the world were seen immediately. For example, attach gravity to an object and see it fall.For example, attach gravity to an object and see it fall.

VPL’s Reality Built for Two (RB2) RB2 consisted of 3 software modules and a variety of hardware. The design & control workstation was a Mac II running a solid modeling application called RB2 Swivel and a data flow/real-time animation control package called Body Electric.The design & control workstation was a Mac II running a solid modeling application called RB2 Swivel and a data flow/real-time animation control package called Body Electric. RB2 consisted of 3 software modules and a variety of hardware. The design & control workstation was a Mac II running a solid modeling application called RB2 Swivel and a data flow/real-time animation control package called Body Electric.The design & control workstation was a Mac II running a solid modeling application called RB2 Swivel and a data flow/real-time animation control package called Body Electric.

VPL’s Body Electric

VPL Devices DataGloveEyePhones

VPL Video Suggestions ACM SIGGRAPH Video Review 27, 1987, Entry 2: DataGlove - George Zachary/VPL. Also Entry 6: The Alternate Reality Kit - Randy Smith/Xerox PARC. An excellent piece of how one can interactively manipulate a microworld’s forces.ACM SIGGRAPH Video Review 27, 1987, Entry 2: DataGlove - George Zachary/VPL. Also Entry 6: The Alternate Reality Kit - Randy Smith/Xerox PARC. An excellent piece of how one can interactively manipulate a microworld’s forces. ACM SIGGRAPH Virtual Reality Applications Gallery Jury Reel ’91. The Boeing demo is using the RB2 system! The Matsushita Kitchen Design system uses RB2.ACM SIGGRAPH Virtual Reality Applications Gallery Jury Reel ’91. The Boeing demo is using the RB2 system! The Matsushita Kitchen Design system uses RB2.