1. Enabling User Interactions with Video Contents Khalad Hasan, Yang Wang, Wing Kwong and Pourang Irani

2. Motion Control 2

3. 3 End Call Voice Control

4. 4 Face Recognition

5. 5 Gaps Interaction with video contents Suitable querying and interface component Selection technique Motivation

6. 6 Gaps Interaction with video contents Suitable querying and interface component Selection technique Motivation

7. 7 Computer Vision Comparison among state-of-art algorithms Apply best algorithm to extract objects HCI Interaction with video contents Techniques for selection Contribution

8. Object Detection & Tracking 8

9. 9 Tracking-Learning-Detection (TLD): Kalal et al. Datasets: http://vision.ucsd.edu/~bbabenko/project_miltrack.shtml

10. 10 Struck: Hare et al.

11. 11 StruckTLDStruckTLD Time(sec) Frame/Sec Coke251471.166.21 Girl401931.325.69 Tiger1394530.906.68 Tiger2334621.095.89 Average345.00 63.75 1.126.12 Speed Comparison

12. 12 TLDStruck Coke0.940.69 Girl0.930.80 Tiger10.860.77 Tiger20.790.63 Average0.880.72 Precision

13. Interactions 13

14. 14 Input Device

15. 15 Kinect Input

16. Static Target Selection Target

17. Moving Target Selection

18. 18 Selection Techniques Left-hand with Basic Left-hand with Ghost Left-hand with Crossing Depth with Basic Depth with Ghost Depth with Crossing

19. 19 Selection Techniques Left-hand with Basic

20. Action Target Ghost (Khalad et al. CHI 2011)

21. 21 Selection Techniques Left-hand with Ghost

22. 22 Selection Techniques Left-hand with Crossing

23. 23 Selection Techniques Selection Left-hand Depth

24. 24 Results Technique Basic Ghost Crossing Task Completion Time (ms) 6,000 ― 4,000 ― 2,000 ― 0 ― Left-hand Depth

25. 25 Results Technique Basic Ghost Crossing Average Number of Attempts 2.0 ― 1.5 ― 1.0 ― 0.5 ― 0 ― Left-hand Depth

26. 26

27. 27 Take-Home TLD is faster & accurate Both hands for Kinect based interactions Selection is best achieved with static proxies

28. 28 Future work Computer Vision Multiple tracked objects Online detection & tracking HCI Selection Techniques New form of interactions with Kinect

29. Thank you