EEC 490 GROUP PRESENTATION: KINECT TASK VALIDATION Scott Kruger Nate Dick Pete Hogrefe James Kulon

PART ONE: INTRODUCTION  Project Proposal  Create Guidelines Of Kinect Parameters  Accuracy Of The Kinect Sensors  Use Of Multiple Kinects  Static, Dynamic Movement Data Collected

INTRODUCTION CONTINUED  Work With Health Science Professors  Use Eight Camera Motion Analysis System  Compare Kinect Accuracy To Eight Camera Motion Analysis System  Establish Limitations Of Kinect Hardware

INTRODUCTION CONTINUED  Six Exercises  Hamstring Stretch Sitting Position  Scapular Plane Turn  Sit To Stand  Lateral Weight Shifting In Standing  Video Game Bowling In Sitting  Side Lying Hip Abduction

PART TWO: SOFTWARE  C#  Microsoft SDK 1.0  SQL Databases  Storage  Retrieval  Exporting Data Collected To Excel

SOFTWARE CONTINUED  Twenty Joints Of Detection  Database: Data Storage  Body Part (string)  X Coordinate Position (float)  Y Coordinate Position (float)  Z Coordinate Position (float)

SOFTWARE CONTINUED Skeleton

SOFTWARE CONTINUED  Initial Design Functionality  Start, Stop Recording  Collect Data  Tilt Camera Up/Down  Green Dots Highlight Joint Of Detection  Export To Excel

SOFTWARE CONTINUED

 Advanced Design Functionality  Replay Skeleton Movements  Slow, Pause Skeleton  Different Views  Total Frames Collected

SOFTWARE CONTINUED

PART THREE: MOTIONS LAB DEMO

MOTIONS LAB DEMO CONTINUED  Health Science Department (03/23/12)  Four Kinects  Front, Back, Side, Corner Angles  Different Heights  Different Separation Of Distance To Center

MOTIONS LAB DEMO CONTINUED  Health Science Lab Requirements  37 Strobes Of Detection Placed On Body  User Only Wears Shorts  Shorts Are Tied  Distance, Angles Of Some Joints Must Be Measured: Ankles To Knees

MOTIONS LAB DEMO CONTINUED  Eight Exercises  Walking  Weight Shift- Arms Out, Side To Side  Weight Shift- Foot Out, Front To Back  Wrist Rotation Sword

MOTIONS LAB DEMO CONTINUED  Eight Exercises (Continued)  Stand To Sit To Stand With Chair  Seated Bowling  Hamstring Stretch On Table  Hip Abduction On Table

MOTIONS LAB CONTINUED STANDING WEIGHT SHIFT

MOTIONS LAB CONTINUED

 Observations  Weight Shift: Ankle Joints Scattered  Sit To Stand, Bowling Sitting: Leg Joints Estimated Due To Chair  Table Exercises: All Joints Scattered  Walking: Hard Time Acquiring Data

MOTIONS LAB CONTINUED  Problems Of Demo  Only Front Angle Data Useful  Heights of Kinects Not Measured  Distance From Center Not Measured  No Universal Coordinate System

PART FOUR: CAPTURE SESSION Two Kinects Side-by-Side

CAPTURE SESSION CONTINUED Grid Layout GRID LAYOUT

CAPTURE SESSION CONTINUED Five Separate Movement Sets

CAPTURE SESSION CONTINUED Data Analysis

CAPTURE SESSION CONTINUED  Data Analysis  SDK Scale Is In Centimeters  Maximum Depth Is Approximately Four Meters  Field Of View Is 45 Degrees

CAPTURE SESSION CONTINUED Frame Rate Variance

CAPTURE SESSION CONTINUED Kinect Can Be Very “Noisy”

CAPTURE SESSION CONTINUED Abrupt Jumps

CAPTURE SESSION CONTINUED Z-axis is Most Stable

CAPTURE SESSION CONTINUED  Defined Physical Operating Parameters  Data Anomalies - Software Or Hardware  Better Experimental Setup

PART FIVE: CONCLUSION  Future Progress  Good (Green), Wrong (Red) Point Colors  Wrong Point Data Discarded  On Screen Grid  Animation

CONCLUSION CONTINUED  Algorithms To Solve Limitation Warnings  Back  Side  Extremity Crossing  Tables, Chairs Interference  Voice Commands

CONCLUSION CONTINUED  Compare Data To Physical Therapy System  Third Party Packages  More Sophisticated  More Capable  Microsoft SDK 1.0: Barebones

CONCLUSION CONTINUED  Summary  Learned How To Program Kinect  Found Limitations Of Kinect  Collected Data  Compared, Analyzed Data

QUESTIONS?