1. Image Pool

2. (a)(b)

3. (a)(b)

4. (a)(c)(b)

5. ID = 0ID = 1

6. User IR Cameras IR Cameras IR Projector IR Projector IR-Color Camera IR-Color Camera Color Projector

13. (a) (b)

14. IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI 1 st Frame 2 nd Frame

15. IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector Initial Frame

16. IR Projector IR Cameras IR Camera of Mobile Device Second Frame Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI IR Projector IR Cameras IR Camera of Mobile Device Simulated Background Observed Image Foregrounds Layout Manager Color Projector ROI First Frame

17. IR Projector IR Cameras IR Camera of Mobile Device Smoothing Simulated Background Observed Image Foregrounds Tangible Objects Finger Touches Layout Manager Prediction Color Projector ROI Applications Kalman Filtering Real scene

21. Capture Image Simulated Background Real Background

26. R c T c R p T p R cp T cp