2. Extracting Valuable Information Lazily Shiry Ginosar Advisor: Professor Manuel Blum Graduate Mentor: Luis von Ahn

6. One picture is worth a thousand words

7. If you have never seen an image, a description might help your imagination

8. Our task was to attach a description to every image on the web Wait… Didn’t already do that!? Not really…

9. only provides word labels. These are great for image search but not enough for accessibility

10. Labels: Man, Woman

11. Our task was to attach a description to every image on the web Our task was to attach a descriptive paragraph to every image on the web

12. Following the EVIL tradition, this was done in the form of a FUN GAME

14. Input Output behavior image Descriptive paragraph

15. The game is an internet race between multiple players all aiming to find the same randomly chosen image. They are the “seekers”

16. The only information they have about this image comes from a written description that is given to them

17. We provide them with an image search engine Because searching is cool

18. The seeker’s screen

19. One of the players is the “describer”. He is the only one who gets to see the image. He will provide us with the description we are looking for

20. The describer’s screen

21. Once a seeker finds the correct image, he becomes the next describer and a new image is chosen

28. Gain Points The seeker that finds the image first wins 100 pints The describer wins 200 points if someone finds his image

29. Lose Points The seeker loses 10 points for each wrong guess The describer loses 5 points for every image he passes

30. This FUN GAME will hopefully provide us with descriptions of all images on the web Thus contributing to the accessibility of the web

31. One picture is worth a thousand words

32. www.peekaboom.org/phetch