The Evolution of a VR-based IGT Environment Terry Peters, Robarts Research Institute David Gobbi, CEO, Atamai Inc.

IGT Workshop Motivation Why AtamaiViewer? –IGT research requires software! –There was nothing out there in 1997 –All IGT projects require similar components –Leverage VTK, MINC –Our own Tracking code

IGT Workshop History 1997 – New lab, new possibilities –Evolution: MINC –Adopt VTK, add Yves Starreveld (Surgeon-Programmer) 2000 – company formed –Strong support from Robarts Institute 2004 – funding from CFI, SGI –VASST project begins –AtamaiViewer is christened

IGT Workshop Software Development Philosophy Power to the students! –Most students are not programmers –Python scripting to complement C++ core –Students should use each other’s software! Contribute to larger community –vtkImageReslice to vtkImageMapToColors (and everything in between) –VTK Python wrapping –VTK on OSX

IGT Workshop Architecture ITK AtamaiVTK Atamai Python Classes AtamaiViewer “core” VTK Tkinter GUI AtamaiViewer plugin modules C++ Python

IGT Workshop Expandability AtamaiViewer API “Core” VASST EpilepsyViewer Volume Rendering Data IO Electrodes MPR Packages SkullStripper fMRI Tracking Ultrasound Cine Modules

IGT Workshop

Features Tracking –Polaris, Aurora, XarTraX, Flock of Birds Data Types –Images, meshes, point lists, transform files Visualization –Stereo (monitor, HMD or workbench) –Polygons, volume rendering, image slices Time-varying data –Cine cardiac viewing

IGT Workshop Features Multiple file formats –MINC, DICOM, VFF, Analyze, PNG, JPEG Expandability –Modules –Packages (collections of modules) customize front-end, change look and feel

IGT Workshop Applications Epilepsy Viewer –Atamai product (3 sites) Stereotaxy Viewer –Frame-based (Parkinson’s) VASST –Augmented Reality AtamaiViewer “core” –Powerful in its own right

IGT Workshop EP Atlas Database 4 R 50uA PE Starreveld et al, 2000

IGT Workshop Deep brain surgery Planning

IGT Workshop Guidance for Cardiac Interventions

IGT Workshop AR for port placement for Robotic CABG

IGT Workshop Track the tools with magnetic tracking systems VR tools US image US Transducer

IGT Workshop TEE image with virtual valve tool

IGT Workshop..with clipping device and “pre-op image”

IGT Workshop Delineating the dynamic target Target identified solely from pre-op images is unreliable Interactively define target from US image

IGT Workshop Clinical study

IGT Workshop Challenges facing engineering of IGT systems (non) availability of ubiquitous tracking environments Non uniform software development environment Closed real-time systems (particularly US)

IGT Workshop How can NCIGT help? Coordinate setting of standards for collaborative software development. Provide management role Stimulate coordinated multi-institutional research in new tracking technologies Act as lobby group to pressure industry to make streaming 3D (esp US) more accessible from imaging systems