1. Senior Capstone Project Gaze Tracking System
Proposal Presentation
IRALAR
Breanna Heidenburg -- Michael Lenisa -- Daniel Wentzel
Advisor: Dr. Malinowski

2. Presentation Outline Project Overview System Design Functionality
Progress
Demonstration
Future Plans

3. Project Overview
Summary,
Applications, &
Previous Work

4. Project Overview Summary
Track a user’s eye
Use input to control computer
Mouse/Tablet Functionality
Create user interface
Augmented/Mixed Reality
Heads Up Display (HUD)

5. Project Overview Applications
Biomedical
Allow control for patients who would otherwise not be able to control a computer.
Marketing
To see how people ‘read’ documents
Important for use when companies create new advertisements

6. Project Overview Previous Work
Patents
Research work
Oculog
OpenEyes
OpenCV
Commercially available solutions

7. Project Overview Previous Work : Patents
Eye tracking
Visible Spectrum
Infrared Spectrum
Controlling a cursor on a screen
At a distance
Head mounted
Augmented reality
Proposed for use in medical scenarios

8. Project Overview Previous Work : Research
Oculog
Infrared spectrum
Similar mounting
Controlled MIDI devices
OpenEyes
Visible spectrum
Starburst algorithm
OpenCV
Masters Thesis
Very similar Problems -> Solutions

9. Project Overview Previous Work : OpenCV
Developed by Intel in 2002
Library for Open Source Computer Vision
Written in C
Provides functions for image manipulation and calculations

10. Project Overview Previous Work : Commercial Solutions
Tobii
Non-intrusive
Mounted below desktop monitor
faceLAB
Multiple eye tracking
Detects fatigue
Driver State System
Measures driver fatigue
EyeLink
Uses HMD
3 cameras

11. System Design
Goals,
Block Diagram, &
Software Flow

12. Build upon previous designs Methods
System Design Goals
Build upon previous designs
Replicate/Improve results
Methods
Visible spectrum imaging
Logitech Webcam
OpenCV
Multiple positioning algorithms will be used
Move cursor
Built into Windows
User Interface
Generated using SVG (Scalable Vector Graphics)

13. System Design Block Diagram

14. System Design Software Flow

15. Functionality
Requirements & Specifications

16. Functionality Requirements
Can be carried by one person
At least one image capture device
Stationary display
Ability to initiate an action
“Mouse Click”
Method to test accuracy of system

17. Functionality Specifications
Resolution
Horizontal =12.8 Pixels
Vertical = 9.6 Pixels
VGA resolution ~ 2%
Frame Rate
Minimum = 2 fps (500 mS)
Maximum = 30 fps ( 33 mS)
Best Case = 10 fps (100 mS)
Maximum determined by camera refresh rate

18. Progress
Software Progress,
Demonstration, &
Time Entered

19. Progress Software Progress
Eye Tracking Application
Cursor Movement
Test UI

20. Progress Software Progress : Eye Tracking
Software can recognize eye
Programmatically displays calculated results
Algorithm:
Edge detection
Shape recognition
Problems:
Poor performance
Lighting
Eye color
Reflections

21. Progress Software Progress : Cursor Movement
Cursor Movement functions properly
Function call to:
Move cursor to given coordinates
Perform action:
Left Click
Right Click

22. Progress Software Progress : Test UI
Test UI complete
Scalable Vector Graphics (SVG)
Automatic Generation (scripted)
Resolution
Percentage Specification
Detects cursor position
Changes sector color

23. Progress Software Progress : Test UI

24. Progress Software Progress : Test UI

25. Progress Demonstration

26. Progress Time entered
Total Hours Entered:
206 Hours

27. Future Plans
Required Parts,
Project Division,
Timeline, &
Competition

28. Future Plans Required Parts
Head Mounting Unit
Camera (Logitech Quick Cam for Notebooks)
Lighting system (LEDs)
Polarizing Filter
Mobile Computer
ASUS EeePC
Head Mounted Display
Vuzix m920
LitEye-500

29. Future Plans Project Division
Task
B. Heidenburg
M. Lenisa
D. Wentzel
Feasibility Research
20%
40%
Image Processing App.
80%
Cursor Position
100%
System Test UI
Interactive UI
30%
70%
Application UI
System Testing
Usability Research
Document Preparation
Mount Development
50%
Web-Site Development

30. Future Plans Timeline

31. Future Plans Competition
RESNA
Biomedical Design Competition
Entry due: May 5th, 2008
Older entries:
Topics vary from year to year
1998 submission:
“eye tracking systems for alternative input”

32. Questions