Image Pool

(a)(b)

(a)(b)

(a)(c)(b)

ID = 0ID = 1

User IR Cameras IR Cameras IR Projector IR Projector IR-Color Camera IR-Color Camera Color Projector

(a) (b)

IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI 1 st Frame 2 nd Frame

IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector Initial Frame

IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame

IR Projector IR Cameras IR Camera of Mobile Device Smoothing Simulated Background Observed Image Foregrounds Tangible Objects Finger Touches Layout Manager Prediction Color Projector ROI Applications Kalman Filtering Real scene

Capture Image Simulated Background Real Background

R c T c R p T p R cp T cp