1. Connect with your

10. Wow!

11. Motorized Tilt RGB Camera 3D Depth Sensors Microphone Array

12. openkinect.org www.openni.org kinectforwindows.org

13. Kinect for Windows

14. That’s not USB You’ll need this Xbox Kinect

15. What you Need SDK

16. Demo 0 Hello Tilt

17. BGR32 Format width in pixels height in pixels Stride = Bytes Per Row = bytes per pixel * width = 4 * width 4 Bytes Per pixel Byte Array:

18. Demo 1 Hello Colorful World

19. Depth data 500mm 2000mm 2030mm 2010mm 2000mm 500mm 2500mm

20. Depth data Max resolution for raw depth data is 640 x 480 2 bytes per pixel of depth data (short) 11011110 pixel 00001 11101010 00000 11101010 00001 depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth 000

21. Demo 2 Depth

22. Depth + Player Data 500mm 2000mm 2030mm 2010mm 2000mm 500mm 2500mm player 1 SkeletonStream.Enable(); var player = pixel & DepthImageFrame.PlayerIndexBitmask; 11011110 00001 010

23. Demo 3 Depth + Player Data

24. Skeletal Tracking

25. skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.Tracked skeletonFrame.Skeletons from skeleton in skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.PositionOnly

26. hand_left wrist_left elbow_left shoulder_left hand_right wrist_right elbow_right shoulder_right hip_left head hip_right knee_left knee_right ankle_right ankle_left foot_leftfoot_right hip center spine shoulder_center Skeleton.Joints[JointType] Joint.Position (X,Y,Z) Skeletons are mirrored X, Y, Z in meters Origin(0,0,0) = center of camera. +Z is out +X is to the right +Y is up

27. Demo 3 Skeletal Tracking

28. Composites + ColorColor +

29. ColorColor ColorColor + + + MapDepthFrameToColorFrame MapDepthToColorImagePoint MapDepthToSkeletonPoint MapSkeletonPointToColor MapSkeletonPointToDepth

30. Demo 4 Green Screen

31. Kinect Audio

33. Echo Cancellation

34. EchoCancellationMode: None, CancellationOnly, CancellationAndSuppression int EchoCancellationSpeakerIndex: Index of speaker to cancel

35. Noise Suppression

36. Noise Supression bool NoiseSuppression – true, false

37. Automatic Gain Control

38. bool AutomaticGainControl – true, false

39. Beam Forming

40. -0.875 radians -50 degrees 0.875 radians 50 degrees.0175 radians 10 degrees

41. Demo 5 Speech Recognition

42. Audio @!%!#!! Gotchas Use Microsoft.Speech not System.Speech Must run in an MTA AEC SystemModes crash if no speaker output. Must plug Kinect into Wall DevicePairGuid / Qualitymetrics = crash Should run in ThreadMode Priority Highest?

43. Demo 6 Beam Forming

44. Kinect SDK 1.5! Seated Skeletal Tracking Face Tracking Joint Rotation Kinect Studio

45. Creative Commons Acknowledgments Flickr by Ian Lewis Flickr by major nelson Flickr by markodesign Flickr by stephantom Flickr by Abstract Machine Flickr By Aixo.co.kr Flickr By Andresmh Flickr by Antony Bennison Flickr by Ars Electronica Flickr By bm.iphone Flickr by campuspartymexico Flickr by Chris Jagers Flickr By ci_polla Paola Sucato Flickr by creepyhalloweenimages Flickr by cvander Flickr by IMAL.org Flickr by Institut Douglas Flickr by Joshua and AmberFlickr by Logon Sakai Flickr by openexhibits Flickr by Paul_Clarke Flickr by petyr.rahl Flickr by pt Flickr by Stilldavid Flickr by y3rdua Flickr by yesyesnono Flickr by yum9me Flickr by Jeff Howard Flickr by jhscreenwm Flickr by Kyle McDonald Flickr by Morten Rand-Hendriksen Flickr by Stuart Herbert Flickr by Visiophone Flickr by orkomedix Michael Zöllner and Stephan Huber at the University of Konstanz Openclip by J_Alves Openclip by jetxee Openclip by molumen Openclip by shokunin Openclip by Jhnri Openclip by Machovka Adafruit image of Hector Martin Thanks!!