1. Coding4Fun: Build Fun, Cool, Commercial Applications Using the Kinect for Windows SDK Dan Fernandez Director Microsoft Corporation Rick Barraza Senior Technical Evangelist Microsoft Corporation DEV330

4. IR Emitter Color Sensor IR Depth Sensor Tilt Motor Microphone Array

5. Horizontal Vertical

7. BGR32 Format – Every Pixel (0,0 | 0,1 | 0,2) has blue, green, red, empty BGREmpty 255 0 BGREmpty 255 0 320x240 640x480 80x60

8. DEMO

9. DDDDDDDDDDDDDPPP 1514131211109876543210 DepthPlayer Index

10. NearDefault 0.4m/1.3 ft0.8m/2.6 ft

11. 1.3’2.6’9.8’13.1’26.2’.4.8348 Default Mode Near Mode Feet Meters UnknownNormal

12. 1.3’2.6’9.8’13.1’26.2’.4.8348 Default Mode Near Mode Feet Meters UnknownToo NearNormalToo Far

13. DEPTH FORMULAS Depth data short[] allData = new short[depthFrame.PixelDataLength]; Get depth for a point (X:160, Y:120, Width: 320) int index = (width * y) + x; // 38,560 Get X, Y for an index (Index: 5,000, Width:320) int x = index % width; // 200 int y = index / width; //15 Distance Formula short depthPoint = allData[index]; int depth = depthPoint >> DepthImageFrame.PlayerIndexBitmaskWidth; // 2,000 Player Formula int player = depthPoint & DepthImageFrame.PlayerIndexBitmask; // 1

14. DEMO

15. Max of two skeletons per Kinect 6 Player Proposals HandLeft WristLeft ShoulderLeft Head ElbowLeft ShoulderRight HandRight WristRight ElbowRight ShoulderCenter FootLeft AnkleLeft KneeLeft HipLeft HipCenter HipRight FootRight AnkleRight KneeRight Spine Seated (10) Default (20)

16. Z Axis X Axis Y Axis Joints in meters from camera Negative Positive Negative Positive

17. Each joint has associated tracking state Tracked, Not tracked, or Inferred Inferred - Occluded, clipped, or low confidence joints Use TransformSmoothParameters to smooth joint data to reduce jitter Kinect transform smoothing uses Holt Double Exponential Smoothing - http://en.wikipedia.org/wiki/Holt-Wintershttp://en.wikipedia.org/wiki/Holt-Winters Skeleton.ClippedEdges = FrameEdges.Top;

18. Fatigue Kills GesturesUse Coding4Fun ScaleTo extension method

19. DEMO

20. KINECT AS AN OFFICE MONITOR.

21. KINECT AS AN OFFICE MONITOR.

22. DEMO

23. http://download.codeplex.com/Download?ProjectName=kinectservice&DownloadId=336928 Kinect data over the network using sockets Color, Depth, Skeleton, and Audio Client libraries for WPF, Windows Phone & WinRT

24. Real-time tracking of multiple faces 2D/3D Mesh and Points 3D Head Pose Animation Units Z Axis

25. Pitch +20 -20 Yaw -45+45 Roll -90 +90

26. DEMO

28. SPEECH RECOGNITION GRAMMAR yes yes please yes yeah yep ok please out._value = "Yes"; var grammar = new Choices(); grammar.Add(“yes please"); grammar.Add(“yes"); grammar.Add(“yeah"); grammar.Add(“yep"); grammar.Add(“ok"); Ensure AutomaticGainControl = false Sample : C:\Program Files\Microsoft SDKs\Speech\v11.0\Samples\Sample Grammars Speech Recognition: English/Great Britain, English/Ireland, English/Australia, English/New Zealand, English/Canada, French/France, French/Canada, Italian/Italy, Japanese/Japan, Spanish/Spain and Spanish/Mexico

29. DEMO

30. Rotation in camera space, or amount of rotation from parent bone Player orientation stored in HipCenter, or ShoulderCenter when seated Matrix or Quaternion format for animations

33. DEMO

34. BoxingBots – In Expo Hall

35. Connect. Share. Discuss. http://europe.msteched.com Learning Microsoft Certification & Training Resources www.microsoft.com/learning TechNet Resources for IT Professionals http://microsoft.com/technet Resources for Developers http://microsoft.com/msdn

36. Evaluations http://europe.msteched.com/sessions Submit your evals online