KINECT FOR WINDOWS Ken Casada Developer Evangelist, Microsoft Switzerland | blogblog

KINECT FOR WINDOWS Kinect SDK for Windows & Kinect Sensors Kinect for Windows Commercial Kinect for Windows Sensor Tested and supported by Microsoft Optimized for use with computers and devices running Windows 7 or Windows Embedded Standard 7 Kinect for Windows Runtime v1.0: supported Kinect for Xbox 360 Can only be used for development purposes Optimized for use with Xbox 360 Kinect for Windows Runtime v1.0: not supported, does not function

KINECT FOR WINDOWS KINECT SENSORS IR Projector RGB Camera (Color Sensor) IR Depth Sensor Tilt Motor Microphone Array

KINECT FOR WINDOWS RESOLUTIONS Color 12 FPS: 1280X960 RGB 15 FPS: Raw YUV 640x FPS: 640x480 Depth 30 FPS: 80x60, 320x240, 640x480

KINECT FOR WINDOWS DISTANCES 1.3’2.6’9.8’13.1’26.2’ Default Mode Near Mode Feet Meters

KINECT FOR WINDOWS DEMO

KINECT FOR WINDOWS SKELETON DATA

KINECT FOR WINDOWS DEMO

KINECT FOR WINDOWS SOUND POSITION Sound Source Angle – the angle and confidence level of where audio is coming from Beam Angle – The angle used to record audio that you can set as a “directional microphone”

KINECT FOR WINDOWS SPEECH RECOGNITION yes yes please yes yeah yep ok please out._value = "Yes"; var grammar = new Choices(); grammar.Add(“yes please"); grammar.Add(“yes"); grammar.Add(“yeah"); grammar.Add(“ok");

KINECT FOR WINDOWS DEMO

KINECT FOR WINDOWS GET STARTED Order Kinect Hardware Download Kinect SDK

KINECT FOR WINDOWS RESOURCES Install Kinect Explorer KinectWpfViewers Coding4Fun Toolkit Skeletal scaling

KINECT FOR WINDOWS DEPTH DATA Returns the distance and player for every pixel Ex: 320x240 = 76,800 pixels Distance Distance in mm from Kinect ex: 2,000mm (6.56 feet) Player 1-6 players

KINECT FOR WINDOWS MODE ModeDepth & PlayerCenter Hip JointOther 19 Joints DefaultYes NearYes No, for v1.0

KINECT FOR WINDOWS SKELETAL JOINTS Each player with set of joints in meters Each joint has associated state Tracked, Not tracked, or Inferred Inferred - Occluded, clipped, or low confidence joints Use TransformSmoothParameters to smooth joint data to reduce jitter

KINECT FOR WINDOWS SKELETAL TRACKING Maximum two players tracked at once Six player proposals per Kinect Each skeleton has a unique identifier - TrackingID SkeletonStream Set AppChoosesSkeletons to false Use ChooseSkeletons method to choose which skeletons to track

KINECT FOR WINDOWS FORMULAS Distance Formula int depth = depthPoint >> DepthImageFrame.PlayerIndexBitmaskWidth; Player Formula int player = depthPoint & DepthImageFrame.PlayerIndexBitmask;