Therapy Kinection Computer Science Department Davis Farish, Scott Grace, Kyle Sarantsev, Chris Walton, Chris Witter

Agenda Project Origin/Goal Microsoft Kinect Vail Sport Test (VST) Development Environment System Video Demo Summary © Computer Science Department, Texas Christian University

Origin of Project Wanted a project that utilized the Microsoft Kinect. Sought to contribute to the healthcare industry. Therapists were interested in validating the grading of the Vail Sport Test. Currently use an expensive and complex system. Post analysis. Charges patients extra for the service. Requires patients to wear markers. Group proposed utilizing the Kinect to develop a cheaper, simpler system. Allows real-time, automatic test analysis. No markers. © Computer Science Department, Texas Christian University

Project Goal Objectively score the Vail Sport Test using the Kinect. Provide tool to validate the grading of the Vail Sport Test in the Physical Therapy field. Create an inexpensive, user friendly, and easily deployable system. © Computer Science Department, Texas Christian University

Microsoft Kinect Interfaces with a Windows PC. Joint data is presented as (X,Y,Z) coordinates. Ability to track 20 joints on the human body. Limitation: can only capture data 30 times a second. © Computer Science Department, Texas Christian University

Vail Sport Test (VST) Used to assess Anterior Cruciate Ligament (ACL) injuries, as well as other leg injuries. Allows therapists to determine if an athlete can return to sport or not. Consists of 4 components, each designed to put stress on the injured leg. Currently subjectively graded. Grading not used by all physical therapists. © Computer Science Department, Texas Christian University

Kinect Hip Adjustment Kinect measures the hip joint at the Anterior Superior Iliac Spine (ASIS). Physical therapists use the Greater Trochanter to measure the knee flexion angle. Distance from Iliac Crest to Greater Trochanter, is the Y offset. Distance from Iliac Crest to ASIS, is the Z offset. Offsets are stored in the database for each new patient prior to testing. © Computer Science Department, Texas Christian University

Components of VST Single Leg Squat 3 minutes, max of 15 points. 5 points for each minute interval. Lateral Bounding 90 seconds, max of 15 points. 5 points for each 30 second interval. Forward Jogging 2 minutes, max of 12 points. 6 points for each minute interval. Backward Jogging 2 minutes, max of 12 points. 6 points for each minute interval. © Computer Science Department, Texas Christian University

Scoring Based on criteria provided by therapist Dr. Craig Garrison. Knee angle Between 30° and 60° Knee lock Must avoid knee lock during extension. Knee Valgus Knee position in relation to foot and hip. Trunk angle Forward, backward, left, and right. Landing position and duration Must be inside bounds and cant stay landed longer that 1 second Extension of patella Patient must avoid patella passing the toe. If a patient fails any of these standards 3 consecutive times, no point is awarded for that standard of the current minute of the component. The patient must score 46/54 points to pass. © Computer Science Department, Texas Christian University

Development Environment Windows 7 64 bit SP 1 Visual Studio 2010 Ultimate Kinect Studio V Developer Toolkit Browser V Microsoft SQL Server Express LocalDB © Computer Science Department, Texas Christian University Primary Support Environment Operating System Windows 7 SP 1 – 64-bit File Sharing Tortoise SVN CoreFTP Lite Software Necessary for Project Microsoft Word 2010 Microsoft Excel 2010 Microsoft PowerPoint 2010 Adobe Creative Suite CS4/CS5 Camtasia Studio 8 System Development Environment Desktop Application Visual Studio 2010 – C# WPF Application Kinect Developer Toolkit Browser V Microsoft Kinect Kinect Studio V Database Microsoft SQL Server Compact Edition

System Configuration © Computer Science Department, Texas Christian University

Database Structure PATIENT PIDLnameFnameMinitCreateDateIC-GTIC-ASISTHR_ID INJURY PIDInjuryNumPhysicianDiagSideDateSurgActive_FlagStudyNumSubject IDStartDateEndDate TEST PIDInjuryNumTestIDTestDate COMPONENT_1 PIDInjuryNumTIDPart1_1Part1_2Part1_3Part1_4Part1_5Part1_TotalPart1_Reps COMPONENT_1 (Cont.) Part1_FinPart2_1Part2_2Part2_3Part2_4Part2_5Part2_TotalPart2_RepsPart2_FinPart3_1 COMPONENT_1 (Cont.) Part3_2Part3_3Part3_4Part3_5Part2_FinPart3_TotalPart3_RepsTotalScore © Computer Science Department, Texas Christian University

Database Interface © Computer Science Department, Texas Christian University

Demo

Results & Moving Forward Provides real-time, accurate feedback to the patients. Program can judge all standards at once. Difficult for a therapist to watch all standards at once. Patient benefits from improved accuracy in test administration. Able to accurately measure joint angles within 5°. Required an increased tolerance for measurements; more sensitive than the human eye In testing found high degree of success across a wide range of subjects. Therapists will have the system to use on patient. Allows for validation of the grading of the Vail Sport Test. Current status: final testing, bug testing, cleaning up code. © Computer Science Department, Texas Christian University

Questions?