1. Emerging Multidisciplinary Technology: Virtual and Collaborative Design Environments Ronald D. Kriz* University Visualization and Animation Group * Department of Engineering Science and Mechanics UVAGUVAG Lecture: November 14, 2002 MBA Entrepreneurial Leadership Class http://www.jwave.vt.edu/~rkriz/Presentations/Lang/Lang_Nov02.ppt

2. Summary of collaborative virtual environments (VEs), application program interfaces (APIs), and applications developed at Virginia Tech Future development of collaborative VEs Presentation UVAGUVAG

3. n Collaborative APIs: u EVL’s CAVERNsoft: Limbo / Tandem u VT’s DIVERSE n Chronology: Collaborative VEs at VT u AtomView (NSF PACI: NCSA-VT) u Limbo Apps: F CAVE Collaborative Console (CCC) F CCC_atom (CCC + AtomView) u DIVERSE Apps: Physics Based Simulations F Crane-Ship (ONR-DURIP) F Haptic Feedback - Molecular Docking (ASPIRES) F NUWC’s CONRAY Undersea Warfare (ONR-NavCIITI) F NIST’s RAVE: SmokeView F Lockheed Martin: Collaborative Engineering Design UVAGUVAG Summary of Collaborative VEs APIs, and applications developed at VT

4. UVAGUVAG Crane Ship: A. Nayfeh, D. Mook, L. Arsenault, R.Williams, R. Kriz: Added motion base to CAVE floor (ONR: $360K) In-kind-labor to move and re-build CAVE ($432K): A. Jarosz, J. Kelso, S. Parkih, C. Logie, R. Kriz Head Mounted Display VR Lab: D. Bowman (CS Dept. $120K) VR projs. M. Setareh, R. Schubert, J. McLain-Kark DIVERSE: L. Arsenault, J. Kelso, R. Kriz (NIST $60K) Molecular Docking (ASPIRES $50K) : D. Bevan, L. Watson, S. Parkih, R. Kriz NAVCIITI CONRAY (ONR: $1.6M): F. das Neves, J. Kelso, R. Kriz

5. EVL’s CAVE-Libraries, CAVERNsoft, Limbo http://www.vrco.com http://www.evl.uic.edu/cavern/cavernG2 Iowa State VR-Juggler: http://www.vrjuggler.org VT’s DIVERSE http://www.diverse.vt.edu UVAGUVAG Application Programming Interfaces (APIs) used and developed at VT:

6. UVAGUVAG What is a CAVE?

7. UVAGUVAG Viewer immersed In 3D-structure. Gives viewer unique perspective to study 3D structure / property relationships. UVAGUVAG

8. Advanced Communications & Information Technology Center (ACITC) VT-Collaboration on-campus (Connecting desktop to CAVE was critical) UVAGUVAG University Visualization & Animation Group (UVAG )

9. 2100 SF

11. UVAGUVAG Shared Virtual Environments CAVERNsoft - Limbo: CAVE Collaborative Console (CCC) http://www.sv.vt.edu/future/cave/software/ccc/

12. UVAGUVAG World-Wide Collaboration Jason Leigh & Andrew Johnson Electronic Visualization Lab, UIC Argonne National Lab IHPC, Singapore CRCACS, Australian NU IML, Tokyo Univ. CCPO, Old Dominion Unv. NCSA, UIUC UVAG, Virginia Tech Northwestern Univ. Remote Participants:

13. UVAGUVAG I hear you. You hear me. But where are you and what are you looking at? Collaborative Awareness Tools Kevin Curry Class Project, 1998: Rosson: Computer- Supported Cooperative Work M.S. Thesis, 1999: “Supporting Collaborative Awareness in Tele-Immersion”

14. UVAGUVAG Participants Awareness Recorder CAVE Collaborative Console (CCC) Fernado das Neves, Ron Kriz, John Kelso

15. AtomView UVAGUVAG NCSA: J. Shalf VT: R. Kriz / D. Farkas With AtomView material scientists can analyze and interpret physics based simulation results Physics based Simulation

16. UVAGUVAG UVAGUVAG

17. UVAGUVAG Two users in CCC_atom viewing a Large Ni-Al B2 simulated structure. AtomView Modes: Scale Model Scale Atoms Navigate Play animation CCC features not shown: Shared views Jump next to Tether to Record play Greg Edwards

18. D evice I ndependent V irtual E nvironment: R econfigurable, S calable, E xtensible UVAGUVAG

19. GNU GPL - LGPL fosters collaboration

20. Collaborative VEs that scale from the desktop to the CAVE D_Atomview: a DIVERSE application developed at VT that visually analyzes and interprets nanostructures predicted by High Performance Computer (HPC) models. Used both in the CAVE and a laptop computer using a CAVE simulator. D_Atomview : http://www.sv.vt.edu/future/cave/software/D_atomview/D_atomview.html D_Collab_Tools: http://anray2.campus.vt.edu:1800/user/CollabWebPage/ Desktop CAVE-simulator embedded in a nanostructure -- avatars not shown Collaborative CAVE-to-CAVE-to-desktop demonstration October 2002 UVAGUVAG

21. VE systems used for insight in scientific research NIST’s RAVE: SAVG Bose-Einstein Condensate Examples of physics based simulations and IVRs at: VT’s University Visualization and Animation Group (UVAG) NIST: Scientific Applications and Visualization Group (SAVG) DIVERSE used in the CAVE at Virginia Tech (VT) and the RAVE at the National Institute for Standards and Technology (NIST) VT’s CAVE: UVAG fourth-order stiffness tensor UVAGUVAG

23. NIST Smokeview 2.0 using DIVERSE DGL API NIST Smokeview running in DGL CAVE simulator ( DGL: OpenGL interface to DIVERSE )

24. UVAGUVAG Visualization and Analysis of Complex Flows in a Cardiovascular System A. Etebari, P. Vlachos, R. Kriz Engineering Science and Mechanics Desk-top, I-Desk, CAVE stress tensor glyph Ali Etebari

25. UVAGUVAG DIVERSE Applications: Physics Based Simulations Crane Ship 6-DOF I-Dock 6-DOF Haptic Feedback NUWC/NRL CONRAY Undersea Acoustic 3-DOF Command & Control n-DOF

26. Prof. Ali Nayfeh, ESM Dr. Lance Arsenault, CS Eric Tester CS ONR Crane-Ship Simulation in the CAVE

33. CAVE floor with plug inserted

34. CAVE floor painted with plug inserted

35. CAVE floor plug removed showing the top of the motion platform CAVE right wall CAVE front wall

36. Application of Visualization and Haptic Feedback to Enhance Molecular Docking D. Bevan, Biochemisty L. Watson, Computer Sci R. Kriz & S. Parikh, ESM (http://www.sv.vt.edu/future/cave/resprj/idock/idock.html) BevanWatsonKrizParikh Future Simulation Beowulf Cluster

37. UVAGUVAG ONR-NavCIITI Task2.1 C & C Visualization CONnical acoustic arRAY CONRAY model Desktop CAVE I-Desk Das Neves

38. Top Ranked Project by ONR Review Panel, May 24, 2001

39. UVAGUVAG ONR-NavCIITI Task2.1 Command & Control Visualization NUWC: K. Lima, L. Mathews, R. Shell NRL: Larry Rosenblum, Doug Maxwell VT: R. Kriz, J. Kelso, F. das Neves ONR Briefing May 24, 2001 “Visualization for Multiwarfare Planning and Execution” Physics based simulation model of acoustics in a 3D world: bottom Bounce, etc. http://www.sv.vt.edu/future/cave/resprj/navciiti/nuwc_task2-1/

40. UVAGUVAG Combined Research Curriculum Development http://www.jwave.vt.edu/crcd Network Program Interface Builder (NPIB) is a rapid application deve- lopment tool that researchers could use to create, maintain, and archive numerous parametric studies based on their legacy computer simulations. R. Batra, ESMD. Farkas, MSE R. Kriz, ESM Macro Nano Micro

41. UVAGUVAG Example: 3D Wave Surface Working “Real-Time” Archive Submit

42. UVAGUVAG Results.html Results Viewed at Desktop Results Viewed In the CAVE (see next slide) email notifies user simulation completed

43. Fourth order tensor glyph viewed in the CAVE Used in ESM5344 “Wave Propagation in Solids” to study anisotropies associated with crystal class symmetries. These geometries are also used to study reflected and refracted interface waves.

44. Usability and Engineering Lab D. Hix and J. Gabbard Randy Levensalor CS-Masters Thesis Immersive WorkBench NAVCIITI: Visualization and HCI: Usability Engineering

45. Cooperative manipulation n PhD work of Marcio Pinho (PUCRS) n Can multiple users manipulate the same object at the same time? n Separation of DOFs 3D Interaction Group http://www.cs.vt.edu/~bowman/3di/ D. BowmanM. Pinho single user multiple users

46. Immersive structural visualization n Design, simulation, and visualization of building structures n Both 2D and 3D interfaces D. Bowman 3DI Group M. SetarehR. Schubert SAP5 FEM Analysis 3DI group collaboration with Architecture’s VE-Lab Architectures’RDF-VE-Lab

47. Virtual Environment Workshop, August 2001 UVAGUVAG J. Lockhart / R. Kriz Multimedia / VRML HPC: Clusters S. Varadarajan HCI 2D-3D Interface Design D. Bowman/C. Wingrave HCI Usability J. Gabbard DIVERSE Arsenault / Kelso Organizer VE-HPC TRAINING

48. UVAGUVAG Observations & Conclusions: Virtual and collaborative design environments have been at best working prototypes that are too difficult to use as a day-to-day application. Better API’s are needed so that scientists, engineers, and educators can build their own applications based on the content within their discipline. The best designed collaborative environments will work only within existing collaborative groups.