1. Images for paper By shooting

2. Sample collection Hard/Soft vertical touch Finger touch position 5 timer 2

3. Background Subtraction Normalization Simple Highpass MonoThreshold 3 Background Subtraction Normalization Difference of Gaussian Threshold Normalization Difference of Gaussian Background Subtraction BinaryFinger Analysis Normalization Difference of Gaussian Background Subtraction BinaryFinger Analysis Normalization Approximate DoG Background Subtraction BinaryFinger Analysis

4. Image Fusion (Blend) IR Camera IR camera Undistortion HomoWarp 4 Image Fusion (Stitching) IR Camera IR camera Undistortion HomoWarp

5. Detection Module Verify Next Parameter Set Generator Detection Result Ground Truth Error Rate Parameter Set Parameter Set’ 5

6. 6

7. 7 Detection system Sample set Training Parameter Set Detection Result Ground Truth Optimal Parameter Set

8. 8 Verify Next Parameter Set Generator Detection Result Ground Truth Error Rate

9. 9 Detection system Sample set Training Parameter Set Detection Result Ground Truth Optimal Parameter Set Verify Next Parameter Set Generator Detection Result Ground Truth Error Rate Parameter Set

10. 10

11. 11

12. 12 Detection system Test set Optimal parameter finder Parameter Combination Detection Result Optimal Parameter Combination Ground truth (Trace) Verify Next Parameter Set Generator Detection Result Ground Truth # of miss & # of false alarm Parameter Combination Optimal parameter finder

13. Applicable Parameters Determinator Parameter Combination Detection Result Applicable set of Parameters Test Set Touch Data Ground truth (Trace) Detection System

14. 14 frame 1 frame 2 miss frame 1 frame 2 False alarm miss

15. 15 frame 1 frame 3 frame 2frame 1 frame 3 frame 2 frame 3 False alarm miss

16. 16 frame 1 False alarm

17. Undistortion 17

18. Dead zone 18

19. 19

20. 20 Image Stiching Image Stiching Finger Detection Finger Detection Finger Tracking Finger Tracking

21. Image blend 21

23. Hardware configuration Order of diffuser layer and touch-glass layer 23 Diffuser layer IR illuminator IR camera spot IR illuminator IR camera Touch-glass layer IR camera spot IR camera

24. Modified by 510 Order of diffuser layer and touch-glass layer 24 Diffuser layer IR illuminator IR camera spot IR illuminator IR camera Touch-glass layer IR camera spot IR camera 2 1 4 3

25. Sampling Measure

27. 5 5 2 2 1 1 6 6 2 2 5 5 4 4 3 3 1 1 4 4 3 3 6 6 2 2 5 5

28. 5 5 2 2 1 1 6 6 2 2 5 5 4 4 3 3 1 1 4 4 3 3 6 6 2 2 5 5

33. (2) IR Camera (3) IR Illuminator (1) Peripheral Projector

35. Optimal Parameter Finder Finger Detection System Interface

36. GPU Direct3D HLSL Dshow

37. GShow DirectShow Undistortion HomoWarp Image Fusion Image Fusion Background Subtraction Background Subtraction Normalization Difference of Gaussian Binary Finger Analysis Finger Analysis Finger Tracking Finger Tracking Multi-touch Finger Detection System GShow DirectShow Undistortion HomoWarp Image Blending Image Blending Background Subtraction Background Subtraction Normalization Difference of Gaussian Binary Finger Analysis Finger Analysis Finger Tracking Finger Tracking Multi-touch Finger Detection System

38. Normalization Difference of Gaussian Background Subtraction BinaryFinger Analysis Normalization Difference of Gaussian Background Subtraction BinaryFinger Analysis

41. Subtract value Smooth kernel ThresholdFinger size Low bound 071015 Step3239 High bound15172560 RGB To Gray Background Subtraction Normalization Approximate DoG Threshold Frame per second 410385400