Yi-Ping Hung Professor, Graduate Institute of Networking and Multimedia National Taiwan University

 On-Surface Interactions Multi-Touch Tangible Object Detection  Beyond-Surface Interactions Interactive 3D Viewer Motivation

IDEA: Using an Invisible Projection Location & Orientation : 6 degrees of freedom ColorProjector IR Projector IR Cameras x 2 Mirror

Applications

iLamp  Project high-resolution content on the surface, mimicking the use of a desk lamp.

iFlashlight  A mobile version of iLamp, facilitating information explorations and cooperative tasks.

iView  An intuitive tool to see 3D content or augmented information from different perspectives.

Implementation

Marker Split and Merge  Adapting the maker size  Markers split, when camera at closeup  Markers merge, when at far distance

Marker On/Off  Marker on for camera positioning  Marker off for finger detection  Finger-ROI detection for marker on/off With Marker OffWithout Marker Off ROI

IR Projector IR Cameras IR Camera of Mobile Device Smoothing Simulated Background Observed ImageForegrounds Tangible Objects Finger Touches Layout Manager Prediction Color Projector ROI Applications Kalman Filtering Real scene Block Diagram

Video Demo

Thanks