The Gaze Controlled Robotic Platform creates a sensor system using a webcam. A specialized robot built upon the Arduino platform responds to the webcam input on the user’s cue. By processing the image captures, the robot is directed to the target destination indicated by the user’s simulated gaze. Website: The user interface consists of two components, a push-button console and a pair of glasses. The glasses simulate the user’s gaze using a switch activated laser pointer. The console consists of two buttons, one to initiate robot movement and another to recalibrate the robot movement. A status LED indicates when the robot has reached its destination. The same LED with flash in the event of an error to direct the user to PC debug output. Gaze Controlled Robotic Platform RIT Computer Engineering Senior Design Project Spring 2010 Nicholas Harezga, Jeremy Thornton, Matthew Wozniak System Description User Interface Constraints Environmental Surface: Flat with no obstructions Lighting: Indoor lighting, dim to bright (detection range dependent on lighting) Robot and Software Camera Detection Range: 7’ x 6’ (camera 3-4’ high) Battery Life: ~10 hours idle; ~2 hours in use (Motor power will decrease as charge drops) Wheel encoder accuracy: degrees Turning accuracy: 4.5 degrees Forward motion step: 0.1 inches Forward speed: ~1.6 ft/s System Overview Costs ComponentCostCost to group Asus EEE PC$291.99Already owned Xbee 1 mW Chip (x2)$45.90 Xbee Explorer$9.95Already owned Xbee Explorer USB$24.95 FT245RL to USB Board$ mm Push Button (x2)$3.80 Logitech Pro 9000 Webcam$59.99Already owned Laser Module$12.90 Arduino Pro Mini$18.95Already owned Phototransistor for Wheel Encoders (x2)$2.26 Ardumoto Motor Shield$24.95$0.00* Lego DC Motors$29.99Already owned 7.2V 3000mAh Battery$24.00Already owned 3.7V Polymer Lithium Ion 2000mAh Battery$16.95$0.00* Miscellaneous Items (Enclosure parts, breadboard, etc.)$40.00 Total Cost$624.53$ Computer Vision Acknowledgements Note: Items marked with an asterisk were paid for by the CE Department.  Dr. Zack Butler of the RIT Computer Science Department. Mobile robot navigation, and computer vision ideas.  Karl Voelker, 5th year CS BS/MS student. Debugging and design help of computer vision algorithms.  Thomas Schellenberg, 4th year CS BS/MS student. Computer vision algorithms and concepts help.  Andrew Wozniak, 3rd year Graphic Design student. Poster design tips. The Team Jeremy Thornton, Nicholas Harezga, Matthew Wozniak The intent of this system was to be as simple as possible to allow users of varying technical backgrounds to set up and use the system with minimal hassle. There are 4 main components to this system: a PC with wireless communication, a scene camera to capture the operational field, the user control module, and the robotic platform. The computer will interpret the scene, determine the location of the laser relative to the robot, and wirelessly transmit instructions to the robot.