Emerging Multidisciplinary Technology: Virtual and Collaborative Design Environments Ronald D. Kriz* University Visualization and Animation Group * Department of Engineering Science and Mechanics UVAGUVAG Lecture: November 14, 2002 MBA Entrepreneurial Leadership Class

Summary of collaborative virtual environments (VEs), application program interfaces (APIs), and applications developed at Virginia Tech Future development of collaborative VEs Presentation UVAGUVAG

n Collaborative APIs: u EVL’s CAVERNsoft: Limbo / Tandem u VT’s DIVERSE n Chronology: Collaborative VEs at VT u AtomView (NSF PACI: NCSA-VT) u Limbo Apps: F CAVE Collaborative Console (CCC) F CCC_atom (CCC + AtomView) u DIVERSE Apps: Physics Based Simulations F Crane-Ship (ONR-DURIP) F Haptic Feedback - Molecular Docking (ASPIRES) F NUWC’s CONRAY Undersea Warfare (ONR-NavCIITI) F NIST’s RAVE: SmokeView F Lockheed Martin: Collaborative Engineering Design UVAGUVAG Summary of Collaborative VEs APIs, and applications developed at VT

UVAGUVAG Crane Ship: A. Nayfeh, D. Mook, L. Arsenault, R.Williams, R. Kriz: Added motion base to CAVE floor (ONR: $360K) In-kind-labor to move and re-build CAVE ($432K): A. Jarosz, J. Kelso, S. Parkih, C. Logie, R. Kriz Head Mounted Display VR Lab: D. Bowman (CS Dept. $120K) VR projs. M. Setareh, R. Schubert, J. McLain-Kark DIVERSE: L. Arsenault, J. Kelso, R. Kriz (NIST $60K) Molecular Docking (ASPIRES $50K) : D. Bevan, L. Watson, S. Parkih, R. Kriz NAVCIITI CONRAY (ONR: $1.6M): F. das Neves, J. Kelso, R. Kriz

EVL’s CAVE-Libraries, CAVERNsoft, Limbo Iowa State VR-Juggler: VT’s DIVERSE UVAGUVAG Application Programming Interfaces (APIs) used and developed at VT:

UVAGUVAG What is a CAVE?

UVAGUVAG Viewer immersed In 3D-structure. Gives viewer unique perspective to study 3D structure / property relationships. UVAGUVAG

Advanced Communications & Information Technology Center (ACITC) VT-Collaboration on-campus (Connecting desktop to CAVE was critical) UVAGUVAG University Visualization & Animation Group (UVAG )

2100 SF

UVAGUVAG Shared Virtual Environments CAVERNsoft - Limbo: CAVE Collaborative Console (CCC)

UVAGUVAG World-Wide Collaboration Jason Leigh & Andrew Johnson Electronic Visualization Lab, UIC Argonne National Lab IHPC, Singapore CRCACS, Australian NU IML, Tokyo Univ. CCPO, Old Dominion Unv. NCSA, UIUC UVAG, Virginia Tech Northwestern Univ. Remote Participants:

UVAGUVAG I hear you. You hear me. But where are you and what are you looking at? Collaborative Awareness Tools Kevin Curry Class Project, 1998: Rosson: Computer- Supported Cooperative Work M.S. Thesis, 1999: “Supporting Collaborative Awareness in Tele-Immersion”

UVAGUVAG Participants Awareness Recorder CAVE Collaborative Console (CCC) Fernado das Neves, Ron Kriz, John Kelso

AtomView UVAGUVAG NCSA: J. Shalf VT: R. Kriz / D. Farkas With AtomView material scientists can analyze and interpret physics based simulation results Physics based Simulation

UVAGUVAG UVAGUVAG

UVAGUVAG Two users in CCC_atom viewing a Large Ni-Al B2 simulated structure. AtomView Modes: Scale Model Scale Atoms Navigate Play animation CCC features not shown: Shared views Jump next to Tether to Record play Greg Edwards

D evice I ndependent V irtual E nvironment: R econfigurable, S calable, E xtensible UVAGUVAG

GNU GPL - LGPL fosters collaboration

Collaborative VEs that scale from the desktop to the CAVE D_Atomview: a DIVERSE application developed at VT that visually analyzes and interprets nanostructures predicted by High Performance Computer (HPC) models. Used both in the CAVE and a laptop computer using a CAVE simulator. D_Atomview : D_Collab_Tools: Desktop CAVE-simulator embedded in a nanostructure -- avatars not shown Collaborative CAVE-to-CAVE-to-desktop demonstration October 2002 UVAGUVAG

VE systems used for insight in scientific research NIST’s RAVE: SAVG Bose-Einstein Condensate Examples of physics based simulations and IVRs at: VT’s University Visualization and Animation Group (UVAG) NIST: Scientific Applications and Visualization Group (SAVG) DIVERSE used in the CAVE at Virginia Tech (VT) and the RAVE at the National Institute for Standards and Technology (NIST) VT’s CAVE: UVAG fourth-order stiffness tensor UVAGUVAG

NIST Smokeview 2.0 using DIVERSE DGL API NIST Smokeview running in DGL CAVE simulator ( DGL: OpenGL interface to DIVERSE )

UVAGUVAG Visualization and Analysis of Complex Flows in a Cardiovascular System A. Etebari, P. Vlachos, R. Kriz Engineering Science and Mechanics Desk-top, I-Desk, CAVE stress tensor glyph Ali Etebari

UVAGUVAG DIVERSE Applications: Physics Based Simulations Crane Ship 6-DOF I-Dock 6-DOF Haptic Feedback NUWC/NRL CONRAY Undersea Acoustic 3-DOF Command & Control n-DOF

Prof. Ali Nayfeh, ESM Dr. Lance Arsenault, CS Eric Tester CS ONR Crane-Ship Simulation in the CAVE

CAVE floor with plug inserted

CAVE floor painted with plug inserted

CAVE floor plug removed showing the top of the motion platform CAVE right wall CAVE front wall

Application of Visualization and Haptic Feedback to Enhance Molecular Docking D. Bevan, Biochemisty L. Watson, Computer Sci R. Kriz & S. Parikh, ESM ( BevanWatsonKrizParikh Future Simulation Beowulf Cluster

UVAGUVAG ONR-NavCIITI Task2.1 C & C Visualization CONnical acoustic arRAY CONRAY model Desktop CAVE I-Desk Das Neves

Top Ranked Project by ONR Review Panel, May 24, 2001

UVAGUVAG ONR-NavCIITI Task2.1 Command & Control Visualization NUWC: K. Lima, L. Mathews, R. Shell NRL: Larry Rosenblum, Doug Maxwell VT: R. Kriz, J. Kelso, F. das Neves ONR Briefing May 24, 2001 “Visualization for Multiwarfare Planning and Execution” Physics based simulation model of acoustics in a 3D world: bottom Bounce, etc.

UVAGUVAG Combined Research Curriculum Development Network Program Interface Builder (NPIB) is a rapid application deve- lopment tool that researchers could use to create, maintain, and archive numerous parametric studies based on their legacy computer simulations. R. Batra, ESMD. Farkas, MSE R. Kriz, ESM Macro Nano Micro

UVAGUVAG Example: 3D Wave Surface Working “Real-Time” Archive Submit

UVAGUVAG Results.html Results Viewed at Desktop Results Viewed In the CAVE (see next slide) notifies user simulation completed

Fourth order tensor glyph viewed in the CAVE Used in ESM5344 “Wave Propagation in Solids” to study anisotropies associated with crystal class symmetries. These geometries are also used to study reflected and refracted interface waves.

Usability and Engineering Lab D. Hix and J. Gabbard Randy Levensalor CS-Masters Thesis Immersive WorkBench NAVCIITI: Visualization and HCI: Usability Engineering

Cooperative manipulation n PhD work of Marcio Pinho (PUCRS) n Can multiple users manipulate the same object at the same time? n Separation of DOFs 3D Interaction Group D. BowmanM. Pinho single user multiple users

Immersive structural visualization n Design, simulation, and visualization of building structures n Both 2D and 3D interfaces D. Bowman 3DI Group M. SetarehR. Schubert SAP5 FEM Analysis 3DI group collaboration with Architecture’s VE-Lab Architectures’RDF-VE-Lab

Virtual Environment Workshop, August 2001 UVAGUVAG J. Lockhart / R. Kriz Multimedia / VRML HPC: Clusters S. Varadarajan HCI 2D-3D Interface Design D. Bowman/C. Wingrave HCI Usability J. Gabbard DIVERSE Arsenault / Kelso Organizer VE-HPC TRAINING

UVAGUVAG Observations & Conclusions: Virtual and collaborative design environments have been at best working prototypes that are too difficult to use as a day-to-day application. Better API’s are needed so that scientists, engineers, and educators can build their own applications based on the content within their discipline. The best designed collaborative environments will work only within existing collaborative groups.