Some Libraries for Kinect 1 2. Open NI Open NI supports many API functions, can combine middleware to increase ability for Kinect. * Support: - Detect gesture. - Skeleton tracking - Windows, Linux, Mac OSX

Some Libraries for Kinect 2 3. Point cloud library Point cloud is library to process image in 3D space. Having many algorithms such as: filtering, surface reconstruction, segmentation, feature estimation… PCL can apply on many platforms such as: Window, Mac OS, Linux, Android,…

Some applications by using Kinect 1. Display the depth image side by side with color image 3

Some applications by using Kinect 2. Looking at the pixel 4 Figure 3.2 Display R,G,B values when click mouse on image

Some applications by using Kinect 3. Finding the closest Pixel 5 Figure 3.3 Our red circle following my outstretched fist

Implement 1. System design Figure 4.1 General design 6

7 Rs232 Kinect USB cable IRsend sensor Microcontroller board Tivi PC

Implement 1. System design Figure 4.2 Detail design Kinect IDE MCU IDE Kinect Driver

Implement 9 Define pin Start Set communication UpDown LeftRight Val 1, Val 2, Val 3 Val 1 = 1Val 1 = 2Val 1 = 0 Yes No Yes No Yes Val 2 = 1Val 2 = 2 Yes No Val 2 = 0 No Disable Yes Stop

Conclusions 10 The Kinect has been one of the pioneer in the consumer market of the human / virtual environment interaction without using some actual buttons or controller, but only by using natural gesture or speech. We have seen that this field has progressed a lot since the Kinect has been released (a bit more than 1 year) and find its application in many different domain whereas the Kinect was orignally planed to be mostly used for games. The Kinect has opened the doors of the Virtual and Augmented Reality to everybody but it is not the perfect device, it still needs a better reliability (better sensors, cameras and microphones) also related components, or combined (screens, robotics...) need to be improved to develop all the capacity of the Kinect.

11 References [1] Chumbley, Eric M., Francis G. O'Connor, and Robert P. Nirschl. "Evaluation of Overuse Elbow Injuries - February 1, American Academy of Family Physicians." American Academy of Family Physicians. American Academy of Family Physicians, 1 Feb Web. 12 July [2] “Golf Swing Tips.” Golf Swing Tips. Golfswingtips.4u.com, Web. 9 July [3] “OpenNI Modules.” Downloads. OpenNI TM, Nov Web. June-July [4] “Physical Therapy Charges.” Akron General. Akron General Health System, Web. 14 July [5] “Shoulder Problems and Injuries – Topic Overview.” WebMD. WebMD, LLC, 2011.

12 Thank you for your attention