1. Building A Shape Display Intel Research Renewal Elaine Cohen, David Johnson, Sam Drake School of Computing University of Utah
Sept. 2002
University of Utah
School of Computing

2. Research Objective
Computer graphics renders approximations to scene light transport to evoke shape.
Haptics renders approximations to the forces of contact to evoke shape.
We want to render the actual shape!
A shape display would allow combined visual and haptic exploration of 3D data.
Sept. 2002
University of Utah
School of Computing

3. Problems with Graphics
What is this shape?
Even current high-end graphics devices are inadequate to accurately convey shape.
Sept. 2002
University of Utah
School of Computing

4. Problems with Haptics Crushing computational burden kHz rates needed
localized exploration
Sept. 2002
University of Utah
School of Computing

5. Prior Work Tactile community Haptic community Sept. 2002
University of Utah
School of Computing

6. Tactile Community The Somatosensory Laboratories - JHU
400 pin tactile array
Limited vertical travel < 1mm
Complicated mechanism
Sept. 2002
University of Utah
School of Computing

7. More Tactile Community
University of Exeter 100 pin array
Sept. 2002
University of Utah
School of Computing

8. Haptics Community 6x6 pin haptic screen from Iwata Lab in Japan
in SIGGRAPH ’01 – shows graphics community interest
Sept. 2002
University of Utah
School of Computing

9. Our Proposed Shape Display
Sept. 2002
University of Utah
School of Computing

10. What is Different? Separate actuation from pin density and resolution.
High resolution array of passive shape elements
An actuated shape “print head”
Cheaper - 1 million pins can add up fast!
Several orders of magnitude more pins than existing displays
High performance actuators and algorithmic techniques help make up for lost refresh rate.
Sept. 2002
University of Utah
School of Computing

11. Current Status Validated basic design with small scale prototype
Built graphical simulator and software controllers to test concepts and control prototype device
Prototyped mass manufacture of custom plastic pins
Researched and designed next-gen device, leveraging other equipment grant money
Sept. 2002
University of Utah
School of Computing

12. Prototype Design
Sept. 2002
University of Utah
School of Computing

13. 5x5 Prototype Built using CNC machine tool for actuation
Manufactured hex brass pins with notch
Preparing to attach
Moving a pin
Sept. 2002
University of Utah
School of Computing

14. 5x5 Prototype
Successful in grabbing and moving pins to desired location
Made modifications to allow
Easier attachment and detachment
Higher density packing of pins with low-profile hook
Sept. 2002
University of Utah
School of Computing

15. Next generation design
Capable of setting ~100 pins/second
Almost a meter of travel
150mm vertical travel
Shown with 2 pin actuators, actual device will have 4 or more
Sept. 2002
University of Utah
School of Computing

16. Simulation
Sept. 2002
University of Utah
School of Computing

17. Advantages Free multi-user stereo display No computation for contact
Subtle shape cues
Sept. 2002
University of Utah
School of Computing

18. Research Plan Year 1 – validate design, build prototype
Year 2 – build high-resolution shape display, applications to demonstrate
Year 3 – algorithmic techniques to improve performance, additional applications.
Sept. 2002
University of Utah
School of Computing

19. Applications Terrain visualization - military, forestry Urban planning
Medical training/planning
Entertainment
Telecollaborative design
Museum exhibits
“Build by example”
Sept. 2002
University of Utah
School of Computing

20. Possible Algorithmic Improvements
Spatially localized changes
“Shape sprites”
Real-time update in small region
Multiresolution approaches
Sept. 2002
University of Utah
School of Computing

21. Knowledge Sharing Talks at Intel
Hoping to submit to I3D in late October, possibly with Intel participation
SIGGRAPH emerging technologies demo submission
Application papers
Intern at Intel to replicate shape display?
Sept. 2002
University of Utah
School of Computing

22. Conclusion Building first shape display with meaningful resolution.
Leverages innate human talents at interpreting complex 3D data.
Application to problems with complex 3D data.
Sept. 2002
University of Utah
School of Computing