 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile --- April 4, 2001 Walter B. Panko, PhD – Professor, Health Informatics

 University of Illinois at Chicago Virtual Reality: The Future has Arrived 3-Dimensional Education Simulations Pre-Treatment planning CAVE, Immersadesk, and NGI technologies currently applied to surgery School of Biomedical and Health Information Sciences and Department of Surgery, College of Medicine

 University of Illinois at Chicago Virtual Reality in Medicine Laboratory Established 1997 Medical artists Physicians Bioengineers Engineers Programmers Graphics Experts “Integrating virtual reality technologies into the practice of medicine” School of Biomedical and Health Information Sciences and Department of Surgery, College of Medicine

 University of Illinois at Chicago Underlying Theme Strength through Collaboration

 University of Illinois at Chicago Underlying Theme Strength through Collaboration, thus is our natural partner

 University of Illinois at Chicago Next Generation Internet List of Major Partners Electronic Visualization Lab - UIC

 University of Illinois at Chicago VRMed Lab Mission “The Killer App”

 University of Illinois at Chicago Key Collaboration Electronic Visualization Lab - Virtual Reality systems, software and networking -They develop, we apply -Close collaboration Electronic Visualization Lab

 University of Illinois at Chicago ImmersaDesk TM Image by Tycho Hoogland

 University of Illinois at Chicago ImmersaDesk TM Image by Tycho Hoogland

 University of Illinois at Chicago Tele-Immersive Virtual Reality Two or more ImmersaDesk TM systems –stereo vision –viewer centered perspective –large angles of view –interactivity Networked collaboration (using CAVERNsoft) –converse, see each other, and point in 3D! Electronic Visualization Lab

 University of Illinois at Chicago This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM

 University of Illinois at Chicago This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM

 University of Illinois at Chicago Adding Value via Collaboration

 University of Illinois at Chicago Biomedical Tele-Immersion for the Next Generation Internet Electronic Visualization and Networking Tom DeFanti, PhD Biomedical Visualization and Tele-Immersive Environment Co-PI Mary Rasmussen, Ray Evenhouse, Sean Prokasy Greg Blew, Fred Dech, Zhuming Ai, PhD, J.J. Kempiners Domain (Colorectal, Otolaryngology, and General Surgery) Russell K. Pearl, MD Theodore Mason, MD W. Scott Helton, MD Evaluation and Medical Education Marcia Edison, PhD Principal and Co-Principal Investigator Jonathan C. Silverstein, MD, MS, Walter B. Panko, PhD This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM

 University of Illinois at Chicago Department of Otolaryngology - Head and Neck Surgery Virtual Temporal Bone Collaborators: Dept. of Otolaryngology - Head and Neck Surgery Dept. of Surgery, UIC Universiteit Utrecht, Nederland

 University of Illinois at Chicago Temporal Bone Anatomy Highly complex Critical to understanding common problems Surgeon’s conceptual visualization difficult to achieve with 2D illustrations or photos Cadaver dissection even difficult –many repeated attempts to learn Few local experts in any region Department of Otolaryngology - Head and Neck Surgery

 University of Illinois at Chicago Histologic sections digitized Structures segmented by hand drawing around structures by medical artists with domain experts 3-Dimensional surface geometry files generated –IsoView (Metro-Web), Cosmo Worlds (SGI) –VRML 2.0 files displayed in Performer (SGI) Displayed in Networked ImmersaDesks using CAVERNsoft (Tele-Immersive Virtual Reality) Temporal Bone Methods This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM

 University of Illinois at Chicago Dept. of Otolaryngology - Head and Neck Surgery,

 University of Illinois at Chicago Browser Demonstration Version of Virtual Temporal Bone Department of Otolaryngology - Head and Neck Surgery

 University of Illinois at Chicago Dept. of Otolaryngology - Head and Neck Surgery,

 University of Illinois at Chicago Dept. of Otolaryngology - Head and Neck Surgery,

 University of Illinois at Chicago Virtual Pelvic Floor Collaborators: Division of Colon and Rectal Surgery, Cook County Hospital, Chicago, IL Dept. of Surgery, UIC Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

 University of Illinois at Chicago Division of Colon and Rectal Surgery, Cook County Hospital, Chicago Virtual Pelvic Floor

 University of Illinois at Chicago Virtual Pelvic Floor Video - Internet2 Members Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

 University of Illinois at Chicago Division of Colon and Rectal Surgery, Cook County Hospital, Chicago Virtual Pelvic Floor

 University of Illinois at Chicago Division of Colon and Rectal Surgery, Cook County Hospital, Chicago Virtual Pelvic Floor

 University of Illinois at Chicago Division of Colon and Rectal Surgery, Cook County Hospital, Chicago Virtual Pelvic Floor

 University of Illinois at Chicago Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

 University of Illinois at Chicago Virtual Cranioplasty Tele-Immersive environments for surgery Cranial defects due to disease or trauma Virtual Reality and virtual prototyping

 University of Illinois at Chicago

Virtual Cranioplasty Expected Results Improved Appearance Improved Protection Surgery time cut to 1/3 Hospital stay from 7 to 2 days Unexpected Results Increased blood flow to brain Increased cerebrospinal fluid (CSF) pressure Increased cognitive function

 University of Illinois at Chicago Eye Diseases in Virtual Reality Collaborators: Dept. Of Ophthalmology and Visual Sciences, UIC Electronic Visualization Lab, UIC

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality

 University of Illinois at Chicago Eye Diseases in Virtual Reality Content expert: Balaji K. Gupta MD 1 Production/direction: Mary Rasmussen 2 VR software/programming: Zhuming Ai 2 Modeling: Ja Lu Lin 3 1. Dept. of Ophthalmology and Visual Sciences, UIC 2. VRMedLab, UIC 3. Electronic Visualization Lab, UIC

 University of Illinois at Chicago Radiological Tele-Immersion for Next Generation Networks Collaborators: Dept. of Radiology, UIC Electronic Visualization Lab, UIC Distributed, collaborative, stereoscopic visualization and manipulation of three-dimensional radiological image data This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM

 University of Illinois at Chicago Radiological Tele-Immersion VR software/programming: Zhuming Ai, PhD, Fred Dech Content expert: Jonathan Silverstein M.D. This project has been funded in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM and Grant R01-LM

 University of Illinois at Chicago Virtual Reality: The Future has Arrived 3-Dimensional Education Simulations Pre-Treatment planning CAVE, Immersadesk, and NGI technologies School of Biomedical and Health Information Sciences and Department of Surgery, College of Medicine

 University of Illinois at Chicago

Barriers yet to conquer Barr Cost Ubiquitous high-performance networking (1GB >=) Cultural change

 University of Illinois at Chicago Barriers yet to conquer Barr Cost – trends are in right direction Ubiquitous high-performance networking (1GB >=) Cultural change – may be hardest part

Fit In? Quality of Service (QoS) Issues Where Does  University of Illinois at Chicago

QoS Basic Types –Resource reservation –Prioritization Need? –More traffic –More demanding applications In healthcare, applications demand more frequent.  University of Illinois at Chicago

Tele-Immersion QoS Requirements Bandwidth needs: High Priority: High Multicast Guaranteed bandwidth  University of Illinois at Chicago

Remote Surgery or Simulation QoS Requirements Bandwidth needs: Moderate Priority: Highest Low Latency Guaranteed bandwidth  University of Illinois at Chicago

Distributed Anatomy Lab QoS Requirements Bandwidth needs: Low-moderate Priority: Low-medium Low Latency Guaranteed bandwidth: Not needed  University of Illinois at Chicago

Compared to other domains, the need for “big pipe” is not as important. Caveat  University of Illinois at Chicago

TM