1. Virtual and Collaborative Design Environments Ronald D. Kriz* University Visualization and Animation Group * Department of Engineering Science and Mechanics UVAGUVAG Lockheed Martin Campus Visit October 25, 2001 Durham Hall, Rm 260, 11:15AM http://www.jwave.vt.edu/~rkriz/Presentations/LM_25oct01.ppt

2. Summary of collaborative virtual environments (VEs), application program interfaces (APIs), and applications developed at Virginia Tech Future development of collaborative VEs Presentation UVAGUVAG

3. n Collaborative APIs: u EVL’s CAVERNsoft: Limbo / Tandem u VT’s DIVERSE n Chronology: Collaborative VEs at VT u AtomView (NSF PACI: NCSA-VT) u Limbo Apps: F CAVE Collaborative Console (CCC) F CCC_atom (CCC + AtomView) u DIVERSE Apps: Physics Based Simulations F Crane-Ship (ONR-DURIP) F Haptic Feedback - Molecular Docking (ASPIRES) F NUWC’s CONRAY Undersea Warfare (ONR-NavCIITI) F NIST’s RAVE: SmokeView F Lockheed Martin: Collaborative Engineering Design UVAGUVAG Summary of Collaborative VEs APIs, and applications developed at VT

4. Extending the Use of Collaborative Virtual Environments to Engineering Design Using High Speed Networks Lockheed Martin University Grant Program Pat McKenzie Lockheed Astronautics Denver, Colorado “The goal of this project is to demonstrate that the CAVE Simulator, when combined with Limbo and CCC awareness tools can be used to deliver a collaborative virtual design environment with an emphasis on HCI and usability.” UVAGUVAG !!! IDEA !!! The CAVE desktop simulator allows desktop-to-desktop collaborative design with a fully immersive option

5. UVAGUVAG Crane Ship: A. Nayfeh, D. Mook, L. Arsenault, R.Williams, R. Kriz: Added motion base to CAVE floor (ONR: $360K) In-kind-labor to move and re-build CAVE ($432K): A. Jarosz, J. Kelso, S. Parkih, C. Logie, R. Kriz Head Mounted Display VR Lab: D. Bowman (CS Dept. $120K) VR projs. M. Setareh, R. Schubert, J. McLain-Kark DIVERSE: L. Arsenault, J. Kelso, R. Kriz (NIST $60K) Molecular Docking: D. Bevan, L. Watson,S. Parkih, R. Kriz NAVCIITI CONRAY: F. das Neves, J. Kelso, R. Kriz

6. EVL’s CAVERNsoft: Limbo http://www.evl.uic.edu/cavern/cavernG2 VT’s DIVERSE http://www.diverse.vt.edu UVAGUVAG Application Programming Interfaces (APIs) used and developed at VT:

7. UVAGUVAG What is a CAVE?

8. UVAGUVAG Viewer immersed In 3D-structure. Gives viewer unique perspective to study 3D structure / property relationships. UVAGUVAG

9. Advanced Communications & Information Technology Center (ACITC) VT-Collaboration on-campus (Connecting desktop to CAVE was critical) UVAGUVAG University Visualization & Animation Group (UVAG )

10. 2100 SF

12. UVAGUVAG Shared Virtual Environments CAVERNsoft - Limbo: CAVE Collaborative Console (CCC) http://www.sv.vt.edu/future/cave/software/ccc/

13. UVAGUVAG World-Wide Collaboration Jason Leigh & Andrew Johnson Electronic Visualization Lab, UIC Argonne National Lab IHPC, Singapore CRCACS, Australian NU IML, Tokyo Univ. CCPO, Old Dominion Unv. NCSA, UIUC UVAG, Virginia Tech Northwestern Univ. Remote Participants:

14. UVAGUVAG I hear you. You hear me. But where are you and what are you looking at? Collaborative Awareness Tools Kevin Curry Class Project, 1998: Rosson: Computer- Supported Cooperative Work M.S. Thesis, 1999: “Supporting Collaborative Awareness in Tele-Immersion”

15. UVAGUVAG Participants Awareness Recorder CAVE Collaborative Console (CCC) Fernado das Neves, Ron Kriz, John Kelso

16. AtomView UVAGUVAG NCSA: J. Shalf VT: R. Kriz / D. Farkas With AtomView material scientists can analyze and interpret physics based simulation results Physics based Simulation

17. UVAGUVAG UVAGUVAG

18. UVAGUVAG Two users in CCC_atom viewing a Large Ni-Al B2 simulated structure. AtomView Modes: Scale Model Scale Atoms Navigate Play animation CCC features not shown: Shared views Jump next to Tether to Record play Greg Edwards

19. D evice I ndependent V irtual E nvironment: R econfigurable, S calable, E xtensible UVAGUVAG

21. GNU GPL - LGPL fosters collaboration

22. UVAGUVAG DIVERSE Applications: Physics Based Simulations Crane Ship 6-DOF I-Dock 6-DOF Haptic Feedback NUWC/NRL CONRAY Undersea Acoustic 3-DOF Command & Control n-DOF

30. CAVE floor with plug inserted

31. CAVE floor painted with plug inserted

32. CAVE floor plug removed showing the top of the motion platform CAVE right wall CAVE front wall

33. Application of Visualization and Haptic Feedback to Enhance Molecular Docking D. Bevan, Biochemisty L. Watson, Computer Sci R. Kriz & S. Parikh, ESM (http://www.sv.vt.edu/future/cave/resprj/idock/idock.html) BevanWatsonKrizParikh Future Simulation Beowulf Cluster

34. UVAGUVAG ONR-NavCIITI Task2.1 C & C Visualization CONnical acoustic arRAY CONRAY model Desktop CAVE I-Desk Das Neves

35. Top Ranked Project by ONR Review Panel, May 24, 2001

36. UVAGUVAG ONR-NavCIITI Task2.1 Command & Control Visualization NUWC: K. Lima, L. Mathews, R. Shell NRL: Larry Rosenblum, Doug Maxwell VT: R. Kriz, J. Kelso, F. das Neves ONR Briefing May 24, 2001 “Visualization for Multiwarfare Planning and Execution” Physics based simulation model of acoustics in a 3D world: bottom Bounce, etc. http://www.sv.vt.edu/future/cave/resprj/navciiti/nuwc_task2-1/

37. Usability and Engineering Lab D. Hix and J. Gabbard Randy Levensalor CS-Masters Thesis Immersive WorkBench NAVCIITI: Visualization and HCI: Usability Engineering

38. Cooperative manipulation n PhD work of Marcio Pinho (PUCRS) n Can multiple users manipulate the same object at the same time? n Separation of DOFs 3D Interaction Group http://www.cs.vt.edu/~bowman/3di/ D. BowmanM. Pinho single user multiple users

39. Immersive structural visualization n Design, simulation, and visualization of building structures n Both 2D and 3D interfaces D. Bowman 3DI Group M. SetarehR. Schubert SAP5 FEM Analysis 3DI group collaboration with Architecture’s VE-Lab Architectures’RDF-VE-Lab

40. Virtual Environment Workshop, August 2001 UVAGUVAG J. Lockhart / R. Kriz Multimedia / VRML HPC: Clusters S. Varadarajan HCI 2D-3D Interface Design D. Bowman/C. Wingrave HCI Usability J. Gabbard DIVERSE Arsenault / Kelso Organizer VE-HPC TRAINING

41. UVAGUVAG Observations & Conclusions: Virtual and collaborative design environments have been at best working prototypes that are too difficult to use as a day-to-day application. Better API’s are needed so that scientists, engineers, and educators can build their own applications based on the content within their discipline. The best designed collaborative environments will work only within existing collaborative groups.