1. Eyes on the World: Putting Your Photos in Context Mor Naaman Yahoo! Research Berkeley

2. http://zonetag.research.yahoo.com 2 Attraction Map of Paris Stanley Milgram, 1976. Psychological Maps of Paris

3. http://zonetag.research.yahoo.com 3 Attraction Map of London Jaffe et al, 2006.

4. http://zonetag.research.yahoo.com 4 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

5. http://zonetag.research.yahoo.com 5 Alternative Outline How? What? Why?

6. http://zonetag.research.yahoo.com 6 Information Overload? Flickr “geotagged”

7. http://zonetag.research.yahoo.com 7 What can we derive? Dataset: (photo_id, user_id, latitude, longitude) (photo_id, tag) Given all photos from a geographic region, - find a “representative” summary set - generate a meaningful visualization

8. http://zonetag.research.yahoo.com 8 Issues to Tackle Noisy data Photographer biases –In locations –In Tags Wrong data Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate

9. http://zonetag.research.yahoo.com 9 Intuition More “activity” in a certain location indicates importance of that location Tag that are unique to a certain location can suggest importance of that location

10. http://zonetag.research.yahoo.com 10 (Very) Simple Example

11. http://zonetag.research.yahoo.com 11 Summary of San Francisco Golden Gate BridgeTransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Bay Bridge Ocean Beach Chinatown

12. http://zonetag.research.yahoo.com 12 Tag Maps

13. http://zonetag.research.yahoo.com 13 Tag Maps

14. http://zonetag.research.yahoo.com 14 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

15. http://zonetag.research.yahoo.com 15 Outline How? What? Why?

16. http://zonetag.research.yahoo.com 16 Another Look at the Tag Map

17. http://zonetag.research.yahoo.com 17 ZoneTag(?) How would we: Create/store? Find? Share? Discover? “Everything in the world exists to end up in a photograph” -- Susan Sontag

18. http://zonetag.research.yahoo.com 18 Programmable Context-aware Network-connected Quality… it’s getting there Why Cameraphones? Numbers, numbers… – 500,000,000 (Source: Future Image Inc.)

19. http://zonetag.research.yahoo.com 19 Current Mobile Experience Difficult to share (or even save!) Hard to find –No context –No semantic information

20. http://zonetag.research.yahoo.com 20 ZoneTag Experience 2-click upload (same key!) Photo uploaded with location and time metadata

21. http://zonetag.research.yahoo.com 21 ZoneTag Experience Tagging made easy –Tag/annotate your photos from the phone

22. http://zonetag.research.yahoo.com 22 Where do locations come from? Bluetooth GPS (when available) User-contributed cell tower mapping

23. http://zonetag.research.yahoo.com 23 Where do tags come from? Tags I used in this context (`home’) Tags my friends used in this context (`Research Meeting’) Tags other people used in this context (`PARC’, ‘Mor Naaman’, `This talk sucks’)

24. http://zonetag.research.yahoo.com 24 Where do tags come from? Stuff around you: –Yahoo! Local –Upcoming.org (`Mor Naaman @ PARC’, `PARC George E. Pake Auditorium’) Stuff from you (any RSS 2.0 feed): –Calendar ( G, Upcoming.org, Kiko,…) –Favorite hangouts

25. http://zonetag.research.yahoo.com 25 Suggested Tags “When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…”

26. http://zonetag.research.yahoo.com 26 Where do tags go? Back to the original RSS items –Upcoming.org Action Tags –Trigger a call to a web service With parameters –Command line - from your phone Rotate:rightEmail:dadGroup:zonetagScanr:document

27. http://zonetag.research.yahoo.com 27 I’m Too Lazy (you’re not alone) Tagging is the means, not the goal Benefits even if you never tagged a single image (Bradley Horowitz, elatable.com) (?)

28. http://zonetag.research.yahoo.com 28 Things We Learned “Best” feature: 2-click upload –Even users that often tag For some, last chance to annotate Mobile tagging - not just experts, not all experts…

29. http://zonetag.research.yahoo.com 29 Things We Learned Tagging behavior: –All over the place –More than Shozu –Connected to privacy

30. http://zonetag.research.yahoo.com 30 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

31. http://zonetag.research.yahoo.com 31 Outline How? What? Why?

32. http://zonetag.research.yahoo.com 32 Why Tag? What are tags?

33. http://zonetag.research.yahoo.com 33 Why Tag? Bay Bridge, Fog, [San Francisco, 94105]

34. http://zonetag.research.yahoo.com 34 Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], …

35. http://zonetag.research.yahoo.com 35 Why Tag? Liz, sunbathing, sunny, sunglasses, concrete, [Palo Alto, 94306], …

36. http://zonetag.research.yahoo.com 36 Tag Affordances on Flickr Displayed next to photo Can be used to search: –Your own photos –Others’ photos –Public photos

37. http://zonetag.research.yahoo.com 37 Tags on ZoneTag By default, tags are kept from one photo to next Tags used in a location will be suggested in that location –To you –To others Immediate (i.e., during event) Place name tags added automatically

38. http://zonetag.research.yahoo.com 38 User Study 13 ZoneTag users (23-45, 9m, 4f) All “taggers” (no use to ask non-taggers why they tag) Structured interviews

39. http://zonetag.research.yahoo.com 39 Expected… Organization/retrieval Creator/synthesizer “Tagging for community”

40. http://zonetag.research.yahoo.com 40 Found… Motivation taxonomy No “synthesizers” Inspired by community Organization/retrieval Creator/Synthesizer “Tagging for community” X

41. http://zonetag.research.yahoo.com 41 Motivation Taxonomy “If I tagged ahead of time I can go back and get all my pictures of [my children]…” “…I then think “well, maybe I should tag this” so I can find it again later” “I’m obsessive- compulsive”

42. http://zonetag.research.yahoo.com 42 Motivation Taxonomy “I want at least one hook of association in there that can help me reconstruct…”

43. http://zonetag.research.yahoo.com 43 Motivation Taxonomy “I tag photos with what I think might be interesting to other people, stuff I think people will like” “I know that tagging can connect my photos to activities, and get more interest” “I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ” “...at night, by the fires all around the market,... at each word that one man says -- such as 'wolf', 'sister', 'hidden treasure', 'battle', 'scabies', 'lovers' -- the others tell, each one, his tale of wolves, sisters, treasures, scabies, lovers, battles.” -- Italo Calvino, Invisible Cities

44. http://zonetag.research.yahoo.com 44 Motivation Taxonomy “…so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.”

45. http://zonetag.research.yahoo.com 45 Breakdown

46. http://zonetag.research.yahoo.com 46 Suggested Tags Useful for entry, when they “work” –Critical mass needed –Better filtering Inspire and give example Overtagging may be issue “Tag suggestions were huge for me; they really cut down on typing” “I thought: this is how I want it to work all the time!” “This person was in my phone for a month - who is she???” “I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco”

47. http://zonetag.research.yahoo.com 47 Open Questions Those who don’t… Better filtering, tag suggestions Longer usage trends Effect of community on usage …

48. http://zonetag.research.yahoo.com 48 Final Notes All Flickr/ZT photos, Creative Commons or with author permission http://www.flickr.com/photos/frozenquack/106111967/ http://www.flickr.com/photos/bryce_edwards/272002447/ http://www.flickr.com/photos/plasticbag/188818779/ http://www.flickr.com/photos/groovymother/131591824/ http://www.flickr.com/photos/deaneckles/220482624/

49. http://zonetag.research.yahoo.com 49 ZoneTag For All Everything we can do, you can do (better?) –Cell ID translation –Suggested Tags –More… Use ZT-technology with your app! Email me

50. http://zonetag.research.yahoo.com 50 Thanks With: Shane Ahern, Simon King, Rahul Nair, Nathan Good, Marc Davis, Morgan Ames, Dean Eckles, Alex Jaffe, Tamir Tassa Download, sign up, get the full scoop: http://zonetag.research.yahoo.com Become an intern, get involved: Email me. Mor Naaman mor@yahoo-inc.com