1. I4MA Demo

2. Flow Chart 2. Snooze Skip verification or go home Back 1. Home Page
3. Medicine List
5. Cancel Take Picture
Back
Cancel
4. Take Picture
10. Take Assessment 1
Retry
11. Take Assessment 2
6. Picture Preview
Send Picture
12. Finish Assessment
Server Verify Image
Failed
Skip verification or go home
7. Fail Verification
Pass
Skip Verification
8. Pass Verification
Home
9. Additional Info

3. Screen 1
Home page for this program, it can receive two types of message: take medicine or take assessment.

4. Screen 2
Snooze setting.

5. Screen 3
Medicine List Screen. It will show a short description for each medicine and if there is a dosage change, it will also show a alert message.

6. Screen 4
Take picture screen.

7. Screen 5
Skip verification dialog. It show up after user click cancel on take picture screen. It allow user to skip medicine verification or go back to home page.

8. Screen 6
Picture preview screen. User can choose to send picture or take picture again, skip medicine verification or go to homepage.

9. Screen 7
Medicine verification successful screen. It will show a brief list of medicines need to take and award user with 100 bonus points.

10. Screen 8
Failed verification screen. It will show name, picture and dosage of medicines that failed verification. User can choose to skip medicine verification and take medicine or retry to take picture again.

11. Screen 9
Addition information. It shows up after user click done upon successfully verified medicine or click skip button when verification failed. After this screen, user go to homepage directly.

12. Screen 10
Take assessment screen 1

13. Screen 11
Take assessment screen 2

14. Screen 12
After user click finish, assessment result will be send to server and award user with 50 bonus points. After user click ok, user will go to homepage.

15. Image Processing Patients take pictures of pills.
Black rectangle card as reference.
Send picture to the server.
Server does image processing, gets the result.

16. Pill Detection Analysis Edge Detection
Difference*
Kirsh
Prewitt
Sobel

17. Pill Detection Analysis Detection Flow
Pills are found based on clusters.
# of clusters = # of pills + 1.
Noise reduction.
Calculate dimension of the card.
Calculate pill size, maintain pill color.
Display results.

18. Pill Detection Demo
Target Pills:
A B
C D
E F

19. Limitations Pictures taken with big angle does not work very well.
Cannot distinguish different pills of the same shape and color.
Background must have uniform color.

20. Pill Detection Analysis Possible Improvements
Fine-tune the calculations.
More pill attributes.
Need exact pills.
More advanced algorithms.