By: Hadley Scholtz Supervisor: Mehrdad Ghaziasgar Co - supervisor: James Connan Mentor: Ibraheem Frieslaar
Quick Recap High Level Design Low Level Design User Interface Specification Project Plan References Demo
Problem ◦ Text in foreign languages are not understood ◦ Users with impaired vision ◦ Users that are illiterate. Previous Solution ◦ Excellent novel idea. Proposed Solution ◦ Application with which users can take pictures, make selections and have selections read on their command.
Take Picture or Opening an existing one Take Picture or Opening an existing one Make Selections Send to server Source image and coordinates Image pre- processing Optical Character Recognition and translation Send extracted text to device Text-to- speech Audio playback
Image Segmentation: main(){ Load image from the command line Read in the text file 4 lines at a time Store every line in a variable corresponding to the coordinate //(Line 1: Left, Line 2: Top, Line 3: Width, Line 4: Height) while(there are lines in coordinates file){ segmentIntoRegions(image, left, top, width, height) } segmentIntoRegions(image, left, top, width, height){ clone the image into another image set a region of interest on the cloned image and the given coordinates crop the image on the region of interest and save it into its own file }
Overview of UIS ◦ Take picture or open existing one ◦ Select text segments ◦ Save and send coordinates to server ◦ Tap selection to listen to audio
The splash screen as seen by the user
The home screen as seen by the user
The camera
The selection confirmation screen
The selection screen
The menu screen
The language selection screen
Bradsky, G., & Kaehler, A. (2008). Learning OpenCV Computer Vision with the OpenCV Library. California: O'Reilly Media Inc. Morris, J. (2011). Android User Interface Development. Birmingham: Packt Publishing Ltd. Felker, D., & Dobbs, J. (2011). Android Application Development FOR DUMMIES. New Jersey: Wiley Publishing Inc.
Overview: Taking a picture Making Selections Sending selections to server Verifying file uploads