5/5/2006Visualization Sciences, Texas A&M University1 Spatially Immersive Visualization Systems (an update) Prof. Frederic I. Parke Visualization Sciences Texas A&M University

5/5/2006Visualization Sciences, Texas A&M University2 Project History u ~1990 Air Force NYIT u ~1998 current concept (w/Ergun) u 2000 CRIC funding (~$5k) u 2002 TITF funding ($165k) u 2005 NSF MRI funding ($500k)

5/5/2006Visualization Sciences, Texas A&M University3 Spatially Immersive Systems u Multiple images projected on surrounding surfaces u Often use stereo images –(active) Sequential images –(passive) Dual stereo images u Provide interaction modes u May use position tracking

5/5/2006Visualization Sciences, Texas A&M University4 Example -‘Cave’ Systems u up to 6 surfaces of a small room or cubical environment u typically systems use only 3 or 4 walls

5/5/2006Visualization Sciences, Texas A&M University5 Immersive Environments Major Components –the computational “fabric” –the display “surfaces” –user interaction and tracking

5/5/2006Visualization Sciences, Texas A&M University6 Visual Computing Clusters u Extended Cluster Concept u Use ‘visual’ computing nodes u Each computational node has a graphics processor u Each node drives a small ‘facet’ of the total display surface

5/5/2006Visualization Sciences, Texas A&M University7 Related Prior Work u Tiled Displays/PowerWalls –Princeton –Argonne National Lab –UNC-CH u Multi-Graphics Project –Stanford

5/5/2006Visualization Sciences, Texas A&M University8 What’s the ‘Ideal’ Display Surface? u Is probably task specific u One concept is a seamless surrounding sphere with high resolution wrap around dynamic images, high update rate, and high complexity modeled environments

5/5/2006Visualization Sciences, Texas A&M University9 Display Geometries u We want better geometric approximations to the ‘ideal’ sphere u The CAVE is a poor approximation u A number of polyhedron configurations are better

5/5/2006Visualization Sciences, Texas A&M University10 Polyhedron Display Systems u Multiple display facets u Each facet driven from one (or two) visual computing node u Low cost per facet u High aggregate performance u High aggregate resolution

5/5/2006Visualization Sciences, Texas A&M University11 Our configuration of interest a 24 facet polyhedron Trapezoidal Icositetrahedra

5/5/2006Visualization Sciences, Texas A&M University12 24 Facet polyhedron as approximation to a sphere

5/5/2006Visualization Sciences, Texas A&M University13 24 Facet projector placement

5/5/2006Visualization Sciences, Texas A&M University14 Simulated cross-sectional view of a 5 meter 24 facet display environment

5/5/2006Visualization Sciences, Texas A&M University15 Another possible configuration a 60 faceted polyhedra Pentagonal Hexcontahedra

5/5/2006Visualization Sciences, Texas A&M University16 Our objectives u Useful and effective u Integration into ‘workflows’ u ‘Low’ cost u Commodity components u Reasonable performance

5/5/2006Visualization Sciences, Texas A&M University17 Challenges u Software Development/Integration u Distributed Data Management u Workflow Integration u Display Synchronization / Stereo Display u Physical Structure/Environment u Suitable Projection Systems u Display Calibration

5/5/2006Visualization Sciences, Texas A&M University18 Stereo Display Passive anaglyphic – red /cyan (one proj) polarization (two projectors)

5/5/2006Visualization Sciences, Texas A&M University19 Physical Structures Screen frame design Minimal ‘seams’ Projector placement Optical folding Projector mounts Heat ‘ripples’ Screen materials Optical properties

5/5/2006Visualization Sciences, Texas A&M University20 Image Compensation u Geometric correction – off axis & projector distortion –‘Image stability’ – explored several approaches u Intensity / color correction

5/5/2006Visualization Sciences, Texas A&M University21 The Problem Image alignment on individual projectors We Want…We Get…

5/5/2006Visualization Sciences, Texas A&M University22 Basic Approach u Compute the correct image u Use as texture on a poly mesh u Pre-distort mesh to compensate for geometric projection distortion

5/5/2006Visualization Sciences, Texas A&M University23 GPU based solutions u Instead of relying on OpenGL default texturing, control the warping through the GPU u Create a 2D displacement texture u Access the displacement texture to get an offset, then access the image with the UV coordinates and the offset

5/5/2006Visualization Sciences, Texas A&M University24 GPU based extensions Color correction Easy to hue/color shift texel values Brightness correction Easy to adjust the brightness of texels Intensity falloff correction by altering brightness based on a grayscale calibration image

5/5/2006Visualization Sciences, Texas A&M University25 Structural Prototypes We have developed a series of structural prototypes We learned something from each!

5/5/2006Visualization Sciences, Texas A&M University26 3/10 scale physical model using 24 identical facets

5/5/2006Visualization Sciences, Texas A&M University27 3/10 Scale Prototype Architecture Building Atrium ~ 5’ diameter (Mid – 2001)

5/5/2006Visualization Sciences, Texas A&M University28 ¾ Scale Presentation Prototype Completed May 2002

5/5/2006Visualization Sciences, Texas A&M University29 Half of 24 facet structural frame

5/5/2006Visualization Sciences, Texas A&M University30 Structure with projected images

5/5/2006Visualization Sciences, Texas A&M University31 Series of Development Systems u 3 screen prototypes 3/4 scale and full scale u 5 screen prototype (full scale) u 7 screen prototype (1/2 scale) (Currently in development) u Software (two generations) ‘3Dengine’ and ‘Guppy3D’

5/5/2006Visualization Sciences, Texas A&M University32 Rear view of 4 screen structure section

5/5/2006Visualization Sciences, Texas A&M University33 Initial 3 facet development system in use

5/5/2006Visualization Sciences, Texas A&M University34 Alternative 3 Facet System

5/5/2006Visualization Sciences, Texas A&M University35 Operational 5 Facet System

5/5/2006Visualization Sciences, Texas A&M University36 Next – Two 7 Facet Systems

5/5/2006Visualization Sciences, Texas A&M University37 Budget for each 7 Facet System u 7 x $17.75k = ~$124k u plus ~ $36k for a control/interface computer, interaction devices, networking, sound, installation, etc… u Total ~ $160k

5/5/2006Visualization Sciences, Texas A&M University38 Per Facet Budget (2005) For each facet ~ $17.75k –2 Visual computing nodes ~ $9k –2 Display projectors ~ $3.5k –Screen and structure ~$3.8k –Misc. components ~$1.45k

5/5/2006Visualization Sciences, Texas A&M University39 Application Projects u Architecture ‘Ranch’ u Montezuma Castle A

5/5/2006Visualization Sciences, Texas A&M University40 Architecture ‘Ranch’

5/5/2006Visualization Sciences, Texas A&M University41 Architecture ‘Ranch’ on 3 facet system

5/5/2006Visualization Sciences, Texas A&M University42 Architecture Ranch on the 5 facet system

5/5/2006Visualization Sciences, Texas A&M University43 Montezuma Castle A

5/5/2006Visualization Sciences, Texas A&M University44 Montezuma Castle A

5/5/2006Visualization Sciences, Texas A&M University45 Montezuma Castle A

5/5/2006Visualization Sciences, Texas A&M University46