University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS Immersive Art takes to the Road Hank Kaczmarski, Nicholas Duchnowski, Abby Watt April 2008

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CAVE FIRST DESCRIBED IN A PAPER PUBLISHED IN COMMUNICATIONS OF THE ACM IN meter on a side structure THREE REAR-PROJECTED WALLS and FRONT-PROJECTED FLOOR (no rear wall or ceiling)

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CAVE™ Technology C AVE A utomatic V irtual E nvironment

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CAVE DRIVEN BY SILICON GRAPHICS SUPERCOMPUTER

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CAVE ACTIVE STEREO PROJECTION 96 to 120 frames per second are created by the supercomputer, half drawn from each of the left and right eye’s perspective. Called “frame-sequential active stereo” because the images appear in left eye/right eye order more rapidly than the human visual cortex can discretely view the images due to liquid crystal electronic (hence active) shutter glasses.

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CUBE FUNDED BY US NATIONAL SCIENCE FOUNDATION MAJOR RESEARCH INSTRUMENTATION GRANT IN 2000 Has six 3-meter square surfaces fully rear- projected

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CUBE DRIVEN BY PC CLUSTER WHICH REPLACES A GRAPHICS SUPERCOMPUTER 1/20 THE COST BETTER PERFORMANCE! BETTER SCALABILITY

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CUBE DRIVEN BY PC CLUSTER ACTIVE STEREO GENLOCKED AND FRAME SYNCHRONIZED GRAPHICS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CUBE ACTIVE STEREO PROJECTION STILL MEANS A VERY EXPENSIVE PROJECTOR EITHER CRT WITH LOW LIGHT OUTPUT BUT NUMEROUS RESOLUTION OPTIONS OR DLP WITH HIGH LIGHT OUTPUT BUT LIMITED RESOLUTION CHOICES BOTH CRT AND DLP PROJECTORS FORCE HIGH MAINTENANCE COSTS ON THE USER

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology THE CAVE and CUBE ACTIVE STEREO PROJECTION MEANS ACTIVE STEREO GLASSES WHICH MEANS ADDITIONAL FINANCIAL AND MAINTENANCE HEADACHES

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS PROJECT DRIVEN BY THE DESIRES OF THE ELECTRONIC ARTISTS ON CAMPUS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS GOALS: USE EXISTING GALLERY SPACE MAKE ENVIRONMENT RECONFIGURABLE MINIMIZE UP-FRONT COSTS MINIMIZE LONG-TERM MAINTENANCE COSTS MAKE SYSTEM ARTIST-FRIENDLY

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS AFFORDABILITY: USE COMMODITY COMPUTERS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS …COMMODITY COMPUTERS CONTAINING COMMODITY GRAPHICS CARDS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS AFFORDABILITY: USE COMMODITY COMPUTERS USE COMMODITY PROJECTORS USE PASSIVE STEREO PROJECTION (TWICE THE NUMBER OF 1/30 THE COST PROJECTORS)

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS LINEAR OR CIRCULAR POLARIZED STEREO PROJECTION MEANS MUCH LESS EXPENSIVE GLASSES (25X LESS EXPENSIVE) Possibly less eye strain for long-term viewing as images are presented to each eye continuously not ½ the time as in active stereo video schemes

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS Three walls, no floor projection Obtuse-angled walls to allow greater viewing space but at the expense of a somewhat less immersive experience

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS Gallery

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS ADAPT ACCEPTED COMPUTER PLATFORMS FOR INTERFACES

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS ADAPT ACCEPTED INTERACTION DEVICES FOR INTERACTION IN CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS DRIVEN BY PC CLUSTER CIRCULAR POLARIZED STEREO PROJECTION RENDER NODES FILE SERVER OPERATOR CONSOLE AUDIOGAMEPAD CPU iPAQ

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology 360 in CANVAS Three walls Six projectors Obtuse-angled walls to allow greater viewing space

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CANVAS VOLUME RENDERING USING HARDWARE ACCELERATION UNIVERSITY OF SAO PAULO

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Motion Capture in Virtual Enviroments

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Creating Art with Programming Requires knowledge of: –C++ or Python –OpenGL –Syzygy Distributed OS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology How Artists Create for a CANVAS Program/work with a programmer Use KAMScript –Can import.obj models (from 3ds Max, Maya, etc) –Can import.wrl VRML files (models and animations) –Can create art using KAMscript commands

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology What is KAMScript? Simple scripting language Built with C++/OpenGL Requires no programming experience Open-source

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Example Scene

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Creating Art with KAMScript This scene is created with 33 lines of KAMScript code.

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology A History of New Crayon Land (2007) Nicholas Duchnowski Sumi Land (2007) Nicholas Duchnowski

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology What is an Icon? - Gallery Created by University law professor William Van Hagey –no programming experience –first-time user of KAMScript

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology KAMScript Variations MiXTAPEStry (2006) University of Illinois at Urbana-Champaign & Duke University

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology KAMScript Variations Trees You Can’t Climb (2006) John Jennings Damien Duffy Nicholas Duchnowski

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS Keep all of the application base developed in the ten years from the the inception of the CAVE through current Cube programs Keep all of the economy and usability built into the CANVAS Add portability and reconfigurability Add an electronic docent Add fault tolerance Incorporate the technology into a larger museum venue

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology The Traveling CANVAS

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CALCULART

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CALCULART

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CALCULART

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology CALCULART

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Technology – 3D scanning

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology NextEngine 3D Scanner High-quality, low-size scans Relatively easy to use –Difficulty with complex models Texture mapped models –.OBJ file less than 5 MB

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Regel (3.38 MB) Benign Orthanc (3.59 MB)

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Corrupt (2.11 MB) Boy (2.63 MB) Twirl (1.65 MB)

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Scan Textures

University of Illinois at Urbana-ChampaignBeckman Institute for Advanced Science and Technology Acknowledgements We would like to thank Rose Marshack, Kathleen Harleman, Benjamin Schaffer, Jim Crowell, Camille Goudeseune, Jim Farrar, Debbie Carrier, George Francis, and Gene Jenneman for their support.