Image Pool
(a)(b)
(a)(b)
(a)(c)(b)
ID = 0ID = 1
User IR Cameras IR Cameras IR Projector IR Projector IR-Color Camera IR-Color Camera Color Projector
(a) (b)
IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI 1 st Frame 2 nd Frame
IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector Initial Frame
IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame
IR Projector IR Cameras IR Camera of Mobile Device Smoothing Simulated Background Observed Image Foregrounds Tangible Objects Finger Touches Layout Manager Prediction Color Projector ROI Applications Kalman Filtering Real scene
Capture Image Simulated Background Real Background
R c T c R p T p R cp T cp