1. Project By: Brent Elder, Mike Holovka, Hisham Algadaibi

2. What is our project about?  Design an interface for Window 7  Controlled by the Microsoft Kinect Device

3. Why?  Gesture based interaction between humans and computers have seen a large growth in popularity  To start developing towards interfaces that adapt more to humans  Get beyond the traditional input devices  Break into the field of gesture recognition

4. Goals  Gesture Recognition  Software that will translate our gestures and movements recorded by the Kinect into commands that will control our interface  Voice Recognition  Applications  An array of different interface components and applications that will respond our gestures

5. Who is it for?  We are the clients  Research into the field of Human – Computer interaction  Benefit our future careers  Help to inspire future students

6. How?  Kinect SDK  Rainmeter: Desktop Customization Tool

7. Hardware RGB Camera3D depth sensors Multi-array microphones Motorized tilt

8. What is Kinect SDK?  Programming toolkit  Drivers  Rich APIs for raw sensor streams  Languages

9. Concept Video

10. Features  Raw sensor streams  Skeletal tracking  Depth Data  Advanced audio capabilities

11. Rainmeter  Desktop Customization Tool  Allows you to place fully customizable widgets on desktop  Range from monitoring system resources to controlling media player  Run shell commands  Free and open source  Source Code available at Google Project site  Vocab

12. Rainmeter Plugins  Plugins: .dll file which provides additional functionality not included in installation  Plugins are developed using C# or C++  Same as Kinect SDK  Development team includes plugin template file  On Google Project Site

13. Rainmeter Plugins Continued  Also include toolkit (Rainmeter.cs) which provides the necessary development tools  Soon to be Wiki page up for plugin development as well

14. Success Criteria  Creation of software that will translate predefined gestures into commands  Interface that will respond accordingly to those commands  Learning experience

15. Risks  Programming difficulties  Not enough time to finish all features  Kinect SDK in Beta 2  Inaccuracy of the Kinect Device  Incapability of Kinect SDK with Rainmeter

16. Design

17. Planned Gestures  Hand moving (Mouse movement)  One Finger Click (Left mouse click)  Two Finger Click (Left mouse double click)  Horizontal and Vertical Swipe motion  Grab and hold (ex. Dragging files)  Keyboard command short-cuts

18. Planned Voice Commands  Kinect Activate  Kinect Deactivate  Kinect Shutdown  Kinect Restart  Kinect Sleep

19. Data Modeling  Not a database driven system  Gestures will be identified within the code  Voice commands may be able to be store in a database

20. Functional Requirements  Accept input from the Kinect sensor  Ability to interpret different hand gestures  Ability to interpret different voice commands  Simple mouse control  A variety of different applications that are part of the interface.  The interface will recognize at most two hands and one person

21. Gantt Chart - Research

22. Gantt Chart – Development Phase 1

23. Gantt Chart – Development Phase 2

24. Gantt Chart – System Testing/Refactoring

25. Division of Labor  We are all knowledgeable with code development  We will each be working on every level of the project  Work will be divided evenly among us

26. Questions?