Eyes on the World: Putting Your Photos in Context Mor Naaman Yahoo! Research Berkeley

2 Attraction Map of Paris Stanley Milgram, Psychological Maps of Paris

3 Attraction Map of London Jaffe et al, 2006.

4 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

5 Alternative Outline How? What? Why?

6 Information Overload? Flickr “geotagged”

7 What can we derive? Dataset: (photo_id, user_id, latitude, longitude) (photo_id, tag) Given all photos from a geographic region, - find a “representative” summary set - generate a meaningful visualization

8 Issues to Tackle Noisy data Photographer biases –In locations –In Tags Wrong data Whatever, color, city, spectrum, santa barbara, california, usa, Lookatme, Herbert Bayer Chromatic Gate

9 Intuition More “activity” in a certain location indicates importance of that location Tag that are unique to a certain location can suggest importance of that location

10 (Very) Simple Example

11 Summary of San Francisco Golden Gate BridgeTransAmerica AT&T Baseball Park Golden Gate Twin Peaks Golden Gate Bay Bridge Ocean Beach Chinatown

12 Tag Maps

13 Tag Maps

14 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

15 Outline How? What? Why?

16 Another Look at the Tag Map

17 ZoneTag(?) How would we: Create/store? Find? Share? Discover? “Everything in the world exists to end up in a photograph” -- Susan Sontag

18 Programmable Context-aware Network-connected Quality… it’s getting there Why Cameraphones? Numbers, numbers… – 500,000,000 (Source: Future Image Inc.)

19 Current Mobile Experience Difficult to share (or even save!) Hard to find –No context –No semantic information

20 ZoneTag Experience 2-click upload (same key!) Photo uploaded with location and time metadata

21 ZoneTag Experience Tagging made easy –Tag/annotate your photos from the phone

22 Where do locations come from? Bluetooth GPS (when available) User-contributed cell tower mapping

23 Where do tags come from? Tags I used in this context (`home’) Tags my friends used in this context (`Research Meeting’) Tags other people used in this context (`PARC’, ‘Mor Naaman’, `This talk sucks’)

24 Where do tags come from? Stuff around you: –Yahoo! Local –Upcoming.org (`Mor PARC’, `PARC George E. Pake Auditorium’) Stuff from you (any RSS 2.0 feed): –Calendar ( G, Upcoming.org, Kiko,…) –Favorite hangouts

25 Suggested Tags “When I went to upload, there were already all these exotic tags like "Bill Graham Civic Auditorium" and "Bob dylan live" available...it sure was convenient to just select and go…”

26 Where do tags go? Back to the original RSS items –Upcoming.org Action Tags –Trigger a call to a web service With parameters –Command line - from your phone Rotate:right dadGroup:zonetagScanr:document

27 I’m Too Lazy (you’re not alone) Tagging is the means, not the goal Benefits even if you never tagged a single image (Bradley Horowitz, elatable.com) (?)

28 Things We Learned “Best” feature: 2-click upload –Even users that often tag For some, last chance to annotate Mobile tagging - not just experts, not all experts…

29 Things We Learned Tagging behavior: –All over the place –More than Shozu –Connected to privacy

30 Outline Wisdom of the tags –mining information from geo-tagged photos ZoneTag –your photos in context Why we tag –a user study of tagging

31 Outline How? What? Why?

32 Why Tag? What are tags?

33 Why Tag? Bay Bridge, Fog, [San Francisco, 94105]

34 Why Tag? RedSox, Fenway, GreenMonster, [Boston, 02215], …

35 Why Tag? Liz, sunbathing, sunny, sunglasses, concrete, [Palo Alto, 94306], …

36 Tag Affordances on Flickr Displayed next to photo Can be used to search: –Your own photos –Others’ photos –Public photos

37 Tags on ZoneTag By default, tags are kept from one photo to next Tags used in a location will be suggested in that location –To you –To others Immediate (i.e., during event) Place name tags added automatically

38 User Study 13 ZoneTag users (23-45, 9m, 4f) All “taggers” (no use to ask non-taggers why they tag) Structured interviews

39 Expected… Organization/retrieval Creator/synthesizer “Tagging for community”

40 Found… Motivation taxonomy No “synthesizers” Inspired by community Organization/retrieval Creator/Synthesizer “Tagging for community” X

41 Motivation Taxonomy “If I tagged ahead of time I can go back and get all my pictures of [my children]…” “…I then think “well, maybe I should tag this” so I can find it again later” “I’m obsessive- compulsive”

42 Motivation Taxonomy “I want at least one hook of association in there that can help me reconstruct…”

43 Motivation Taxonomy “I tag photos with what I think might be interesting to other people, stuff I think people will like” “I know that tagging can connect my photos to activities, and get more interest” “I want to look at all [my neighborhood’s] tags. … That’s definitely a reason I’m putting these tags in ” “...at night, by the fires all around the market,... at each word that one man says -- such as 'wolf', 'sister', 'hidden treasure', 'battle', 'scabies', 'lovers' -- the others tell, each one, his tale of wolves, sisters, treasures, scabies, lovers, battles.” -- Italo Calvino, Invisible Cities

44 Motivation Taxonomy “…so that my friends can see what I am up to” I can tell my mom [with the tag] “look, we went to…” “I left reviews of places – like at the airport, when my flight was delayed, I tagged “Aloha Air sucks.”

45 Breakdown

46 Suggested Tags Useful for entry, when they “work” –Critical mass needed –Better filtering Inspire and give example Overtagging may be issue “Tag suggestions were huge for me; they really cut down on typing” “I thought: this is how I want it to work all the time!” “This person was in my phone for a month - who is she???” “I try to use as many suggested tags that apply. … I also use it for auto-completion – I type “s” to get San Francisco”

47 Open Questions Those who don’t… Better filtering, tag suggestions Longer usage trends Effect of community on usage …

48 Final Notes All Flickr/ZT photos, Creative Commons or with author permission

49 ZoneTag For All Everything we can do, you can do (better?) –Cell ID translation –Suggested Tags –More… Use ZT-technology with your app! me

50 Thanks With: Shane Ahern, Simon King, Rahul Nair, Nathan Good, Marc Davis, Morgan Ames, Dean Eckles, Alex Jaffe, Tamir Tassa Download, sign up, get the full scoop: Become an intern, get involved: me. Mor Naaman