2. Human Computation Luis von Ahn Carnegie Mellon University

3. Verification technology developed in collaboration with Carnegie Mellon University

4. Help! I’ve been waiting for 20 minutes, and nothing happens “ ” Verification technology developed in collaboration with Carnegie Mellon University

6. (From www.slashdot.org) QUICKVOTE Which is the best Computer Science Grad School in the US? CMU MIT vote Berkeley StanfordCornell Washington

7. Verification technology developed in collaboration with Carnegie Mellon University

8. CAPTCHA Sweat Shops Spam companies hire humans to type CAPTCHAs all day long $2.50 per hour for each human 720 captchas per hour per human 1/3 cent per account

9. VOTE FOR LUIS 2012

10. Type the word in the box if you want to see the next picture Free Nude Photos

12. A

15. Can we use this human effort for good? Roughly 200 million CAPTCHAs are typed every day 10s of human time per CAPTCHA

16. Digitizing Books Scan OCR DE xi Ii ARIi.. COPBCtrAGE\, DeC. I l 1 QOn. Tlie royal palace at Frieclericheberg took fire last night. The li.ing himself directed the operations fns extinguishing the lire. The whole structure , , ed.

17. Scanned book Word that OCR can’t read Randomly distorted image of word

18. Free

24. Words Digitized Per Day

27. Two Words Instead of One? Typing two English words takes as long as typing 6-8 random characters

28. Years 1851-1980 will be completed in 2009 Where do the Words Come From?

29. 400,000,000 (6% of the world’s population)

30. CAPTCHA Sweat Shops Mahiddin: Would you help us find some Captcha Project? reCAPTCHA Support: What kind of CAPTCHA project are you looking for? Mahiddin: We are manually break different type of CAPTCHA right now. We have the ability type every day many Captcha. Tell us how we can help you. reCAPTCHA Support: How fast can you type? Mahiddin: Personally I can type more than 60 WPM. But I have a big team. We can give you lot of product. reCAPTCHA Support: Do you mind helping spammers? Mahiddin: No problem, you can tell me details first.

31. reCAPTCHA Support: One last question: how do you deal with IP address blocking? Please type the following paragraph:

32. Sleeping (7.6h) TV (2.4h) Email and IM (1.7h) Caring for Others (1.1h) Household Chores (1h) Eating and Drinking (1.1h) Electronic Games (1.1h) Other (7.6h) Bathroom (17m) Solving CAPTCHAs (1.9s/day) Reusing Wasted Cycles

33. 9 Billion Human-Hours of Solitaire were Played in 2003 Empire State Building Panama Canal 7 million human-hours (6.8 hours of solitaire) 20 million human-hours (less than a day of solitaire)

34. Labeling Images With Words Martha Stewart Flowers Super Evil Still an open problem

35. Image Search On The Web Uses filenames and html text

36. Desiderata A method that can label all images on the web Fast and cheap

37. Using Humans The ESP game could label all images on google in a few weeks The ESP game Cleverly

38. Two-player online game Partners don’t know each other and can’t communicate Object of the game: Type the same word Only thing in common is An image The ESP Game

40. 50 million agreements with 200,000 players The ESP Game is Fun There are many people that play over 20 hours a week

41. Labeling The Entire Web Individual games in Yahoo! and MSN average over 5,000 players at a time 5000 people playing simultaneously can label all images on Google in 2 months!

43. Search Results

48. Guesses Over Time britney crazy hot rehab shaved head a male younger than 40

49. saddam mr. wilson man face moustache Sample Labels bush george president man dumb yuck Coming soon: Meet your soul mate through the game!

50. Why do people like the ESP Game?

51. The esp game gives its players a weird and beautiful sense of anonymous intimacy. On the one hand, you have no idea who your partner is. On the other hand, the two of you are bringing your minds together in a way that lovers would envy. ” The esp game gives its players a weird and beautiful sense of anonymous int On the one hand, you have no idea who your partner is. The ESP game gives its players a weird and beautiful sense of anonymous intimacy. “

52. Strangely addictive “ ” It’s so much fun trying to guess what others think. You have to step outside of yourself to match “ ” It’s fast-paced “ ” Helps me learn English “ ” It’s like crack! “ ”

53. Blogs In other crowning achievements, I haven't played in at least a week, and I am still on the top ten list of players on the ESP game. Number eight if I remember correctly. “ God, my life is sad. ”

54. Many fascinating things about the ESP Game: How it uses a game structure to build an index of images on the web What words become taboo from frequent use How interesting some of the images pulled randomly from the web are “ But by far the most intriguing aspect of the game is how often your random, unknown partner is a complete idiot. ”

55. I do research on ESP (extra sensory perception), and have an online ESP telepathy test on my website Dear Luis von Ahn, Your game is a fraud Please refrain from using the term ESP, as it makes us legitimate ESP researchers look like a fraud “ ”

56. Audio ESP SUCKS

57. Edith Law Two-Player Game Both players can see each other’s guesses Players may or may not be listening to the same song Object of the game: Tell if you’re both hearing the same thing

58. rock electric guitar male singer loud electric guitar rock

60. Translation Crowdsourcing Language

62. Reference If Pakistan's history is an indicator, Musharraf's decision to impose martial law could be the straw that breaks the camel's back. If Pakistan's history is any indicator, Musharraf's decision to impose martial law may prove to be the proverbial straw that breaks the camel's back. Input Our Method (20c/word) Falls Pakistans Geschichte ein Indikator ist, so könnte Musharrafs Entscheidung, das Kriegsrecht zu verhängen, jener sprichwörtliche Tropfen sein, der das Fass zum Überlaufen bringt.

63. www.gwap.com www.recaptcha.net

64. Special Thanks To Aditya Akella Josh Benaloh Lenore Blum Manuel Blum Randy Bryant Sharon Burks Shuchi Chawla Mike Crawford Laura Dabbish Alexei Efros Alan Eustace Bill Gates Shiry Ginosar Severin Hacker Nick Hopper Susan Hrishenko Takeo Kanade Mihir Kedia John Langford Edith Law Bryant Lee Peter Lee Roy Liu Jitendra Malik Udi Manber Ben Maurer Colin McMillen Moni Naor Lenore Ramm Roni Rosenfeld Push Singh Slide Design Luis von Ahn CAPTCHA Crew Luis von Ahn Manuel Blum Nicholas Hopper John Langford The ESP Game Crew Luis von Ahn Laura Dabbish reCAPTCHA Crew Luis von Ahn Ben Maurer Colin McMillen David Abraham Mike Crawford Tag a Tune Crew Edith Law Luis von Ahn Roger Dannenberg Speaker’s Entertainment Provided By Homestarrunner.Com David Stork Latanya Sweeney Jenn Tam Anthony Tomasic Shingo Uchihashi Manuela Veloso Jeannette Wing Wardrobe Provided By Charles Spiegel This Work Has Been Partially Supported By Intel Microsoft Research Google, Inc The MacArthur Foundation