Tablet-Based Gaze Tracker P / Tina Podrasky (ISE)Michael Krenzer (EE)Hemsley Pichardo (EE) Brad Wideman (CE)Matt Kelly (CE) Susan Farnand (Sponsor)Les Moore (Faculty Guide) MISSION STATEMENT: TO DESIGN AND MANUFACTURE A TABLET-BASED GAZE TRACKER THAT USES A MODIFIED WEB CAMERA TO DETERMINE WHERE THE USER IS LOOKING IN RESPECT TO A SECONDARY VIDEO BEING RECORDED BY THE TABLET’S BUILT-IN REAR CAMERA. MOTIVATION: o TEACHING TOOL FOR NOVICE PHOTOGRAPHERS o ALLOWS FOR THE GREATEST LEVEL OF PORTABLITY CURRENTLY AVAILABLE BACKGROUND: CURRENTLY EXISTING GAZE TRACKERS o REMOTE GAZE TRACKER- ATTACHES TO A DESKTOP COMPUTER –NOT PORTABLE o EYEGLASSES WITH INTEGRATED CAMERAS- REQUIRES THE USER TO WEAR A LAPTOP BACKPACK- SEMI PORTABLE ADDITIONAL INFORMATION: FOR ADDITIONAL INFORMATION VISIT OUR TEAM WEBSITE AT INFRARED LED CIRCUIT: USED TO CREATE THE GLINTS REQUIRED FOR GAZE TRACKING o 6 IR LEDS IN TWO CLUSTERS o 2 RESISTORS 150Ω AND 22Ω o TWO PCB BOARDS ON EITHER END OF THE TABLET o OSRAM SFH-4550 LEDS o LEDs SANDED TO DIFFUSE INFRARED LIGHT RESULTS/ CONCLUSIONS: o MANY CUSTOMER NEEDS WERE MET, BUT GAZE TRACKING SHOULD BE MORE ROBUST o GAZE TRACKING IS DIFFICULT TO ACCURATELY IMPLEMENT, BUT EXTREMELY USEFUL o HUGE IMPLICATIONS FOR RESEARCH AND ACCESSIBIILITY PURPOSES o A POWERFUL AND PORTABLE OPEN-SOURCE GAZE TRACKING LIBRARY IS HIGHLY DESIRABLE o BO HU o JAN MANETI o JEFFERY PELZ o FLURIN RINDISBACHER o ANDREW SHUMAN MOUNT AND CASE DESIGN: o ABS PLASTIC CASE – USED TO MOUNT CAMERA AND IR LEDS o CLEAR PLASTIC COVERS – ALLOWS IR LIGHT TO REFLECT OFF THE USERS EYE WHILE PROTECTING THE CAMERA’S LENS o MOUNT MADE OUT OF GOPRO CAMERA PARTS o CONNECTOR MADE OF ALUMINUM ALLOY – SIMILAR DESIGN TO EXISTING GOPRO CONNECTOR TEST RESULTS FOR USABILITY: o 15 SUBJECTS RUN FOUR RANDOMIZED CALIBRATION ROUTINE o THE SUBJECT FOLLOW A SINGLE DOT TO FIVE DIFFERENT LOCATIONS ON THE SCREEN o TWO DIFFERENT CALIBRATION VARIABLES - FAST OR SLOW AND WITH OR WITHOUT DIRECTION o FAST WITH DIRECTION WAS DETERMINED TO BE THE MOST ACCURATE ROUTINE DESIGN PROCESS: o SAFE AND PORTABLE DEVICE THAT OPERATES IN REAL-TIME o UTILIZES TWO CAMERAS: ONE TO CAPTURE THE USER’S EYE ANOTHER TO CAPTURE THE USERS SUBJECT MATTER o PROVIDES VISUAL FEEDBACK THAT OVERLAIYS THE USER’S GAZE POINTS WITH THE IMAGE ON THE TABLET’S DISPLAY DESIGN SPECIFICATIONS: o ALL COMPONENTS MUST RUN OFF THE TABLET’S INTERNAL BATTERY AND LAST FOR 30 MINUTES BEFORE RECHARGING o TABLET MUST HAVE A REAR-FACING CAMERA AND RUN ANDROID o TABLET MUST HAVE A USB PORT FOR INTERFACING WITH THE CAMERA o THE DEVICE MUST OPERATE SUCCESSFULLY INDOORS AND OUTDOOES o THE SOFTWARE ON THE TABLET MUST NOT HAVE RESTRICTIONS ON MODIFICATION THAT CANNOT BE BYPASSED TESTING CAMERA FOCUS DISASSEMBLED CAMERA WITH REPLACEMENT FILTER MODIFICATION OF WEBCAM: o ORIGINAL CAMERA IS THE LOGITECH C510 o CAMERA’S IR FILTER WAS REMOVED o REPLACEMENT FILTER MADE FROM FILM NEGATIVES WAS PLACED ABOVE THE IMAGE SENSOR CAMERA FOCUSING: o CAMERA WAS FOCUSED USING THE ISO12233 CHART o ADRIANA BECKER-GOMEZ o FRANK COST o KEVIN ENCARNACION o CHRIS FEUZ o DAVID HATHAWAY ACKNOWLEDGEMENTS: SPECIAL THANKS TO: MAIN EFFECT AND RESIDUAL PLOTS FOR SPEED AND DIRECTION SUBJECT USING THE CALIBRATION ROUTINE IMAGES USED FOR DEBUGGING: o PUPIL IS FOUND BY ALGORITHM AND CIRCLED o PUPIL CENTER IS CROSSED o CORNEAL REFLECTION CANDIDATES ARE FOUND AND CROSSED o COMBINATION OF PUPIL CENTER AND CONREAL REFLECTIONS USED TO DETERMINE GAZE POINT DEBUGGING IMAGES TAKEN WITH GAZE TRACKER