1. Kinect Development By: Richard Isely III

2. Outline What is the Kinect History ▫How it started ▫Microsoft Project The Components of the Kinect ▫What they are/How they work ▫Development Issues ▫Solution Hacking the Kinect ▫OpenKinect Microsoft SDK Demo

3. What is the Kinect? Image from: http://uncrate.com/p/2010/11/kinect-xl.jpghttp://uncrate.com/p/2010/11/kinect-xl.jpg

4. History It all started with the Wii Moore’s Big Plans Project loses momentum

5. Project Natal Alex Kipman takes over project PrimeSense Chosen to Create Prototype Demo for Executives

6. Components of the Kinect Image From: http://guide-images.ifixit.net/igi/xKZqFJXNYEGTvYbI.mediumhttp://guide-images.ifixit.net/igi/xKZqFJXNYEGTvYbI.medium

7. Components of the Kinect Major components ▫IR Projector ▫IR Camera ▫VGA Camera ▫Microphone Array ▫Motorized Tilt Image From: http://www.everybodyplays.co.uk/images/screenshots/picsforarticles/kinect.jpg

8. VGA Camera Allows the Player to be shown on screen. Take still shots.

9. Microphone Array Four Microphones Position Detection Noise Cancelation http://social.microsoft.com/Forums/getfile/18629/

10. Microphone Array (Development Issue) Voice Recognition ▫Background Noise ▫Various Accents

11. Microphone Array (Solution) Background Noise ▫MSR Team develops Audio processing Solution  Audio Processing Tricks Various Accents ▫Acoustical Model built into the Array

12. Motorized Tilt Built into the base of the Kinect 54 Degree tilt range ▫27 Degrees up ▫27 Degrees down Records Actual angle of Kinect

13. IR Projector and Camera (Depth Sensor) What’s being projected Time of Flight How the Kinect does it Image From: http://bbzippo.files.wordpress.com/2010/11/dsc00014s_thumb.jpg?w=700&h=528

14. IR Projector and Camera (Depth Sensor) Continued ps1080 Chip What it produces ▫Depth Image Image From: http://www.primesense.com/images/technology/Chip_Diagram.gifhttp://www.primesense.com/images/technology/Chip_Diagram.gif

15. Using the Depth Image Pixel Data ▫16-bit number  Depth Data  Given in millimeters  Player Data  Range 0-6

16. Depth Image (Development Issue) Initializing Recognition Losing Player Mid-Game Body Type Issue

17. Depth Image (Solution) Breaking up the data ▫From 1 Blob to 31 body parts ▫Body parts to joints ▫Joints to Skeletal image Decision Tree

18. Depth Image (Solution)

20. Hacking the Kinect Race to create a driver ▫Bounty set ▫Cracked in 7 days OpenKinect ▫PrimeSense Releases Libraries

21. Microsoft SDK First Release (June 17 th, 2011) ▫Skeletal Recognition ▫Voice Recognition ▫Beta Version Latest Release and new Kinect ▫Near mode ▫Commercial Development ▫C++, C#, and VB

22. Demo

23. Conclusion What the future may hold ▫Possible Application ▫Cheap form of motion detection ▫Commercial Availability

24. Sources [1] Ashley, James and Jarrett Webb. Beginning Kinect Programming with the Microsoft Kinect SDK. Apress, 2012. [eBook]. [2] Hall, Jonathan, Sean Kean, and Phoenix Perry. Meet the Kinect: An Introduction to Programming Natural User Interfaces. Apress, 2011. [eBook] [3] Borenstein, Greg. Making Things See: 3D vision with Kinect, Processing, Arduino, and MakerBot. Make, 2012. [eBook] [4] “Kinect for Windows.” Microsoft Support. Sat. 10 Mar. 2012. http://support.xbox.com/en-US/kinect-for-windows/kinect-for- windows-info

25. Sources (continued) [5] “OpenNI.” PrimeSense. Sun. 11 Mar. 2012. http://75.98.78.94/default.aspx [6] “About PrimeSense.” PrimeSense. Sun. 11 Mar. 2012. http://www.primesense.com/en/company-profile [7] “OpenKinect: About.” OpenKinect. Sat. 17 Mar. 2012 http://openkinect.org/wiki/Main_Page [8] “Kinect for Windows Quickstart Series.” Channel9. By: Dan Fernandez. Sat. 17 Mar. 2012 http://channel9.msdn.com/Series/KinectQuickstart