Building A Shape Display Intel Research Renewal 2002 Elaine Cohen, David Johnson, Sam Drake School of Computing University of Utah Sept. 2002 University of Utah School of Computing

Research Objective Computer graphics renders approximations to scene light transport to evoke shape. Haptics renders approximations to the forces of contact to evoke shape. We want to render the actual shape! A shape display would allow combined visual and haptic exploration of 3D data. Sept. 2002 University of Utah School of Computing

Problems with Graphics What is this shape? Even current high-end graphics devices are inadequate to accurately convey shape. Sept. 2002 University of Utah School of Computing

Problems with Haptics Crushing computational burden kHz rates needed localized exploration Sept. 2002 University of Utah School of Computing

Prior Work Tactile community Haptic community Sept. 2002 University of Utah School of Computing

Tactile Community The Somatosensory Laboratories - JHU 400 pin tactile array Limited vertical travel < 1mm Complicated mechanism Sept. 2002 University of Utah School of Computing

More Tactile Community University of Exeter 100 pin array Sept. 2002 University of Utah School of Computing

Haptics Community 6x6 pin haptic screen from Iwata Lab in Japan in SIGGRAPH ’01 – shows graphics community interest Sept. 2002 University of Utah School of Computing

Our Proposed Shape Display Sept. 2002 University of Utah School of Computing

What is Different? Separate actuation from pin density and resolution. High resolution array of passive shape elements An actuated shape “print head” Cheaper - 1 million pins can add up fast! Several orders of magnitude more pins than existing displays High performance actuators and algorithmic techniques help make up for lost refresh rate. Sept. 2002 University of Utah School of Computing

Current Status Validated basic design with small scale prototype Built graphical simulator and software controllers to test concepts and control prototype device Prototyped mass manufacture of custom plastic pins Researched and designed next-gen device, leveraging other equipment grant money Sept. 2002 University of Utah School of Computing

Prototype Design Sept. 2002 University of Utah School of Computing

5x5 Prototype Built using CNC machine tool for actuation Manufactured hex brass pins with notch Preparing to attach Moving a pin Sept. 2002 University of Utah School of Computing

5x5 Prototype Successful in grabbing and moving pins to desired location Made modifications to allow Easier attachment and detachment Higher density packing of pins with low-profile hook Sept. 2002 University of Utah School of Computing

Next generation design Capable of setting ~100 pins/second Almost a meter of travel 150mm vertical travel Shown with 2 pin actuators, actual device will have 4 or more Sept. 2002 University of Utah School of Computing

Simulation Sept. 2002 University of Utah School of Computing

Advantages Free multi-user stereo display No computation for contact Subtle shape cues Sept. 2002 University of Utah School of Computing

Research Plan Year 1 – validate design, build prototype Year 2 – build high-resolution shape display, applications to demonstrate Year 3 – algorithmic techniques to improve performance, additional applications. Sept. 2002 University of Utah School of Computing

Applications Terrain visualization - military, forestry Urban planning Medical training/planning Entertainment Telecollaborative design Museum exhibits “Build by example” Sept. 2002 University of Utah School of Computing

Possible Algorithmic Improvements Spatially localized changes “Shape sprites” Real-time update in small region Multiresolution approaches Sept. 2002 University of Utah School of Computing

Knowledge Sharing Talks at Intel Hoping to submit to I3D in late October, possibly with Intel participation SIGGRAPH emerging technologies demo submission Application papers Intern at Intel to replicate shape display? Sept. 2002 University of Utah School of Computing

Conclusion Building first shape display with meaningful resolution. Leverages innate human talents at interpreting complex 3D data. Application to problems with complex 3D data. Sept. 2002 University of Utah School of Computing