Coding4Fun: Build Fun, Cool, Commercial Applications Using the Kinect for Windows SDK Dan Fernandez Director Microsoft Corporation Rick Barraza Senior.

Slides:



Advertisements
Similar presentations
What’s New in Kinect for Windows v2 Click to add title
Advertisements

Creating Robust, Maintainable Coded UI Tests with Visual Studio 2012 Eric Maino Senior Developer Microsoft Corporation DEV312.
What's New in Microsoft Deployment Toolkit 2012 Michael Niehaus Senior Program Manager Microsoft Corporation.
Introducing the New Visual Studio 2012 Unit Testing Experience Peter Provost Sr. Program Manager Lead Microsoft Corporation DEV214.
Working on an Agile Team with Visual Studio 2012 and Team Foundation Server 2012 Peter Provost Sr. Program Manager Lead Microsoft Corporation DEV318.
Troubleshooting Windows 7 Deployments Michael Niehaus Senior Program Manager Microsoft Corporation.
Connect with your. Wow! Motorized Tilt RGB Camera 3D Depth Sensors Microphone Array.
Customizing the User State Migration Tool Michael Niehaus Senior Program Manager Microsoft Corporation WCL322.
Dev-Ops Best Practices on the Microsoft Stack Victor Mushkatin Group Program Manager Microsoft Corporation DEV363.
Making Agile Estimation Work Joel Semeniuk and Stephen Forte AAP309.
Deep Dive into the Team Foundation Server 2012 Agile Planning Tools Gregg Boer Principal Program Manager Microsoft Corporation.
The Busy Developer’s Guide to Virtualization Brian A. Randell Senior Consultant MCW Technologies AAP301.
Visual Studio Tips & Tricks Dustin Campbell Microsoft Corporation Scott Cate EventDay.com DEV319.
Implementing Scrum Using Team Foundation Server Richard Hundhausen President, Accentient DEV212.
Implementing Team Foundation Server in the Enterprise: Guide to a Successful Implementation Jeff Levinson Solutions Architect The Boeing Company DEV343.
Building Windows 8 Apps for the Enterprise Robert Green Technical Evangelist Microsoft Corporation.
Optimizing Microsoft SQL Server Analysis Services for Big Data Adam Jorgensen Microsoft Corporation.
Dev-Ops Best Practices on the Microsoft Stack Victor Mushkatin Group Program Manager Microsoft Corporation DEV363.
Building Metro style UIs Paul Gusmorino Lead Program Manager Microsoft Corporation DEV354.
Building Metro style apps with HTML and JavaScript Paul Gusmorino Lead Program Manager Microsoft Corporation.
Continuous Feedback in Agile Teams Justin Marks Senior Program Manager Microsoft Corporation Sebastian Holst Chief Marketing Officer PreEmptive Solutions.
Building Metro style apps with HTML and JavaScript Paul Gusmorino Lead Program Manager Microsoft Corporation.
Page 1 | Microsoft Work With Skeleton Data Kinect for Windows Video Courses Jan 2013.
Coding4Fun: Build Fun, Cool, Commercial Applications Using the Kinect for Windows SDK Dan Fernandez Director Microsoft Corporation Rick Barraza Senior.
Visual Studio Tips & Tricks Dustin Campbell Microsoft Corporation Scott Cate EventDay.com DEV319.
Real World High Availability and Site Resilience Design Robert Gillies Solution Architect Microsoft Corporation EXL308.
1 EEC-492/592 Kinect Application Development Lecture 2 Wenbing Zhao
Programming with the Kinect for Windows SDK
ASP.NET for Mobile and Tablet Development Damian Edwards Senior Program Manager Microsoft Corporation.
Visual C#/Visual Basic: Becoming a Guru with Existing Features Peter Ritchie Principle Peter Ritchie Inc. Software Consulting DEV325.
Creating LOB Metro style Apps in XAML Using Blend and Visual Studio Jeffrey Ferman Program Manager Microsoft Corporation DEV369.
Paul D. Sheriff DEV216 MVVM Made Easy Paul D. Sheriff
Continuous Delivery of Windows Azure Cloud Services (DEV310) Paul Yuknewicz Principal Program Manager Lead, Visual Studio Microsoft.
Identify & Fix Performance Problems with Visual Studio 2012 Ultimate Benjamin Day Benjamin Day Consulting, Inc. benday.com/blog
Connect with your. Hi I’m Justin Weinberg I’m a Carnegie Mellon Graduate Manager Consultant at Sogeti Founder of the North Texas Silverlight User Group.
Demystifying Team Foundation Server Builds Mickey Gousset Principal Consultant Infront Consulting Group DEV342.
What’s New in WF4.5 Dave Cliffe Program Manager Microsoft Corporation.
Taking Control of Visual Studio through Extensions and Extensibility Anthony Cangialosi Senior Program Manager Lead Microsoft Corporation DEV311.
DEV351.
WCL328 - Windows Intune for the Enterprise David Nudelman Senior Consultant – Microsoft MVP OCSL - UK.
App Controller Tabrez Mohammed Yuan Zheng Program Managers Microsoft Corporation MGT303.
KINECT FOR WINDOWS Ken Casada Developer Evangelist, Microsoft Switzerland | blogblog.
A Lap Around Windows Presentation Foundation (WPF) 4.5 Pete Brown | XAML and Gadget Guy Microsoft Corporation DEV335.
Introduction to Kinect For Windows SDK
INO301. BGR32 Format – Every Pixel (0,0 | 0,1 | 0,2) has blue, green, red, empty BGREmpty Kinect Image Sizes: 80x60, 320x240, 640x480.
Cloud-Ready Data Services. cloud data services.
Advanced Microsoft SharePoint 2010 Upgrade Troubleshooting Shane Young – Todd Klindt SharePoint Nerds Rackspace OSP339.
ADO.NET Entity Framework 4.3 for Real Web Applications Adam Tuliper Software Architect Cegedim DEV215.
Coding4Fun: Build Fun, Cool, Commercial Applications Using the Kinect for Windows SDK Dan Fernandez Director Microsoft Corporation Brian Peek Senior Technical.
Async Made Simple in Windows 8, with C# and Visual Basic Alex Turner Program Manager VB/C# Compilers Microsoft Corporation DEV332.
Expressive Intelligence Studio // Center for Games and Playable Media // Microsoft Kinect Intro CMPS179 Game.
Demystifying Forefront Edge Security Technologies – TMG and UAG Richard Hicks Director – Sales Engineering Celestix Networks, Inc. SIA208.
Going Beyond F11: Debug Better and Faster with Visual Studio 2012 Brian A. Randell Senior Consultant MCW Technologies DEV317.
BGR32 Format – Every Pixel (0,0 | 0,1 | 0,2) has blue, green, red, empty BGREmpty Kinect Image Sizes: 80x60, 320x240, 640x480 DPI: 96.
Introduction to Microsoft Kinect Sensor Programming
What web developers need to know when building Metro style apps
Using Windows Runtime and SDK to build Metro style apps
Advanced IntelliTrace in Production
DEV410: Deep Dive into Team Foundation Server 2012 Reporting
EEC-693/793 Applied Computer Vision with Depth Cameras
Building Awesome Metro style HTML apps in Blend
Integrating with Windows 8 Experiences
Building Metro style apps with XAML with .NET
Building Business Applications in LightSwitch
Using Windows Runtime and SDK to build Metro style apps
Creating and Consuming OData Services for Business Applications
Sayed Ibrahim Hashimi Program Manager Microsoft Corporation
Brandon Bray Principal Group Program Manager Microsoft Corporation
What’s New in Visual Studio LightSwitch
Building RESTful services using OData
Presentation transcript:

Coding4Fun: Build Fun, Cool, Commercial Applications Using the Kinect for Windows SDK Dan Fernandez Director Microsoft Corporation Rick Barraza Senior Technical Evangelist Microsoft Corporation DEV330

IR Emitter Color Sensor IR Depth Sensor Tilt Motor Microphone Array

Horizontal Vertical

DEMO

DDDDDDDDDDDDDPPP DepthPlayer Index

NearDefault 0.4m/1.3 ft0.8m/2.6 ft

1.3’2.6’9.8’13.1’26.2’ Default Mode Near Mode Feet Meters UnknownNormal

1.3’2.6’9.8’13.1’26.2’ Default Mode Near Mode Feet Meters UnknownToo NearNormalToo Far

DEPTH FORMULAS Depth data short[] allData = new short[depthFrame.PixelDataLength]; Get depth for a point (X:160, Y:120, Width: 320) int index = (width * y) + x; // 38,560 Get X, Y for an index (Index: 5,000, Width:320) int x = index % width; // 200 int y = index / width; //15 Distance Formula short depthPoint = allData[index]; int depth = depthPoint >> DepthImageFrame.PlayerIndexBitmaskWidth; // 2,000 Player Formula int player = depthPoint & DepthImageFrame.PlayerIndexBitmask; // 1

DEMO

Max of two skeletons per Kinect 6 Player Proposals HandLeft WristLeft ShoulderLeft Head ElbowLeft ShoulderRight HandRight WristRight ElbowRight ShoulderCenter FootLeft AnkleLeft KneeLeft HipLeft HipCenter HipRight FootRight AnkleRight KneeRight Spine Seated (10) Default (20)

Z Axis X Axis Y Axis Joints in meters from camera Negative Positive Negative

Each joint has associated tracking state Tracked, Not tracked, or Inferred Inferred - Occluded, clipped, or low confidence joints Use TransformSmoothParameters to smooth joint data to reduce jitter Kinect transform smoothing uses Holt Double Exponential Smoothing - Skeleton.ClippedEdges = FrameEdges.Top;

Fatigue Kills GesturesUse Coding4Fun ScaleTo extension method

DEMO

KINECT AS AN OFFICE MONITOR.

KINECT AS AN OFFICE MONITOR.

DEMO

Rotation in camera space, or amount of rotation from parent bone Player orientation stored in HipCenter, or ShoulderCenter when seated Matrix or Quaternion format for animations

Kinect data over the network using sockets Color, Depth, Skeleton, and Audio Client libraries for WPF, Windows Phone & WinRT

Real-time tracking of multiple faces 2D/3D Mesh and Points 3D Head Pose Animation Units Z Axis

Pitch Yaw Roll

DEMO

SPEECH RECOGNITION GRAMMAR yes yes please yes yeah yep ok please out._value = "Yes"; var grammar = new Choices(); grammar.Add(“yes please"); grammar.Add(“yes"); grammar.Add(“yeah"); grammar.Add(“yep"); grammar.Add(“ok"); Ensure AutomaticGainControl = false Sample : C:\Program Files\Microsoft SDKs\Speech\v11.0\Samples\Sample Grammars

DEMO

AAP205 – Leveraging Natural User Interface Technologies to Deliver Improved User Experience (Tim Huckaby) Project Detroit – By Registration BoxingBots – In Expo Hall

Visual Studio Home Page :: Jason Zander’s Blog :: Facebook :: Twitter :: Somasegar’s Blog ::

Connect. Share. Discuss. Learning Microsoft Certification & Training Resources TechNet Resources for IT Professionals Resources for Developers

Required Slide Complete an evaluation on CommNet and enter to win!

Scan the Tag to evaluate this session now on myTechEd Mobile