A Tangible Model Augmented Reality Application For Structural Biology Alexandre Gillet The Scripps Research Institute

Content Tangible Models. Augmented Reality (AR). Augmented Tangible Models. Demo.

Auto-Fabricated tangible models VIDEO

PMV

Mixed or Augmented Reality

ARToolKit --- Link physical models to computer PyARTK is integrated with Python Molecule Viewer(Pmv). The latter is built on top of DejaVu and ViewerFramework Python packages designed to provide support for building 3D visualization applications. Pmv provides the environment to create the molecular modeling geometry needed. The ARToolKit library was integrated with python by using the SWIG wrapping technologie. ARtoolKit is a software library that can be used to calculate camera position and orientation relative to physical markers in real time. It uses a single camera for position/orientation tracking. The fiduccial tracking code uses simple black squares. HITLab, U. Washington (M. Billinghurst, T. Furness, S. Weghorst)

PyARTK: a Python package for AR PyARTK: Python wrapper of ARToolKit Provides: patternMgr: setGeom setMask setAnimation AR Video environment Pmv 3D model

PyARTK: Animation

Masking Z buffer Masking PMV ART Viewer Tangible Model HIV 3D printing 2D image of physical object can occlude Virtual object. === Z Buffer Masking. ART Viewer Tangible Model HIV

Demo Show live demo.

Acknowledgements NIH, NSF Michel Sanner Arthur Olson Daniel Stoffler Here is a list of people involve in the project that I would like to acknowledge. Michel Sanner for helping me putting that software together Arthur Olson for offereing me to work on this very cool project. Daniel Stoffler works on the 3D tangible interfacing. NIH, NSF