I4MA Demo

Flow Chart 2. Snooze Skip verification or go home Back 1. Home Page 3. Medicine List 5. Cancel Take Picture Back Cancel 4. Take Picture 10. Take Assessment 1 Retry 11. Take Assessment 2 6. Picture Preview Send Picture 12. Finish Assessment Server Verify Image Failed Skip verification or go home 7. Fail Verification Pass Skip Verification 8. Pass Verification Home 9. Additional Info

Screen 1 Home page for this program, it can receive two types of message: take medicine or take assessment.

Screen 2 Snooze setting.

Screen 3 Medicine List Screen. It will show a short description for each medicine and if there is a dosage change, it will also show a alert message.

Screen 4 Take picture screen.

Screen 5 Skip verification dialog. It show up after user click cancel on take picture screen. It allow user to skip medicine verification or go back to home page.

Screen 6 Picture preview screen. User can choose to send picture or take picture again, skip medicine verification or go to homepage.

Screen 7 Medicine verification successful screen. It will show a brief list of medicines need to take and award user with 100 bonus points.

Screen 8 Failed verification screen. It will show name, picture and dosage of medicines that failed verification. User can choose to skip medicine verification and take medicine or retry to take picture again.

Screen 9 Addition information. It shows up after user click done upon successfully verified medicine or click skip button when verification failed. After this screen, user go to homepage directly.

Screen 10 Take assessment screen 1

Screen 11 Take assessment screen 2

Screen 12 After user click finish, assessment result will be send to server and award user with 50 bonus points. After user click ok, user will go to homepage.

Image Processing Patients take pictures of pills. Black rectangle card as reference. Send picture to the server. Server does image processing, gets the result.

Pill Detection Analysis Edge Detection Difference* Kirsh Prewitt Sobel

Pill Detection Analysis Detection Flow Pills are found based on clusters. # of clusters = # of pills + 1. Noise reduction. Calculate dimension of the card. Calculate pill size, maintain pill color. Display results.

Pill Detection Demo Target Pills: A B C D E F

Limitations Pictures taken with big angle does not work very well. Cannot distinguish different pills of the same shape and color. Background must have uniform color.

Pill Detection Analysis Possible Improvements Fine-tune the calculations. More pill attributes. Need exact pills. More advanced algorithms.