1. 2004.11.02 - SLIDE 1IS 202 - FALL 2004 Lecture 19: Phone Project Introduction Prof. Ray Larson & Prof. Marc Davis UC Berkeley SIMS Tuesday and Thursday 10:30 am - 12:00 am Fall 2004 SIMS 202: Information Organization and Retrieval

2. 2004.11.02 - SLIDE 2IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

3. 2004.11.02 - SLIDE 3IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

4. 2004.11.02 - SLIDE 4IS 202 - FALL 2004 Metadata Metadata is –“Data about Data” (database systems) –Information about Information First used (to the best we can discover) in 1978 (meta-data) Used for databases in (Meta-Data Base) –“a data base which itself contains the structural and semantic data of other data bases” »Thomas R. Cousins & Wayne D. Dominick, “The Management of Data Bases of Data Bases” ASIS Proceedings, 1978.

5. 2004.11.02 - SLIDE 5IS 202 - FALL 2004 Metadata Structures and languages for the description of information resources and their elements (components or features) “Metadata is information on the organization of the data, the various data domains, and the relationship between them” (Baeza-Yates p. 142)

6. 2004.11.02 - SLIDE 6IS 202 - FALL 2004 Dublin Core Elements Title Creator Subject Description Publisher Other Contributors Date Resource Type Format Resource Identifier Source Language Relation Coverage Rights Management

7. 2004.11.02 - SLIDE 7IS 202 - FALL 2004 Mega-Metadata Standards METS - Metadata Encoding and Transmission Standard (http://www.loc.gov/standards/mets) –Developed by the Digital Library Federation as an implementation strategy for preservation metadata –"XML document format for encoding metadata necessary for both management of digital library objects within a repository and exchange of such objects between repositories (or between repositories and their users)” –Provides a flexible mechanism for encoding descriptive, administrative, and structural metadata for a digital library object, and for expressing the complex links between these various forms of metadata

8. 2004.11.02 - SLIDE 8IS 202 - FALL 2004 Controlled Vocabularies Vocabulary control is the attempt to provide a standardized and consistent set of terms (such as subject headings, names, classifications, etc.) with the intent of aiding the searcher in finding information That is, it is an attempt to provide a consistent set of descriptions for use in (or as) metadata

9. 2004.11.02 - SLIDE 9IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

10. 2004.11.02 - SLIDE 10IS 202 - FALL 2004 Phone Project Groups Group 1 –Andrew Fiore, Callie Jones, Kelly Bryant, Shufei Lei, Ken Langford Group 2 –Jen King, Helen Kim, Andrea Nelson, Bruce Rinehart, Kelly Snow Group 3 –Steve Chan, LuLu Guo, Melissa Chan, Kavita Mittal, Irina Lib Group 4 –Benjamin Hill, Tim Dennis, Morgan Ames. Sarah Poon, Michael Wooldridge Group 5 –David Hong, Josh Chao, Andrew Iskander, Catherine Newman, Rupa Patel, Jen Hastings Group 6 –Jaime Parada, Judd Antin, Scott Fisher, Chitra Madhwacharyula, Lila Manguy, Carrie Burgerner Group 7 –Matthew Rothenberg, Mano Marks, Colleen Whitney, Jinghua Luo, Christine Jones, Yun Jung Group 8 –Christina Nigro, Paul Poling, Sarai Mitnick, David Thaw, Sarita Yardi

11. 2004.11.02 - SLIDE 11IS 202 - FALL 2004 What is the Problem? Today people cannot easily find, edit, share, and reuse media Computers don’t understand media content –Media is opaque and data rich –We lack structured representations Without content representation (metadata), manipulating digital media will remain like word- processing with bitmaps

12. 2004.11.02 - SLIDE 12IS 202 - FALL 2004 Signal-to-Symbol Problems Semantic Gap –Gap between low- level signal analysis and high-level semantic descriptions –“Vertical off-white rectangular blob on blue background” does not equal “Campanile at UC Berkeley”

13. 2004.11.02 - SLIDE 13IS 202 - FALL 2004 Signal-to-Symbol Problems Sensory Gap –Gap between how an object appears and what it is –Different images of same object can appear dissimilar –Images of different objects can appear similar

14. 2004.11.02 - SLIDE 14IS 202 - FALL 2004 M E T A D A T A Traditional Media Production Chain PRE-PRODUCTIONPOST-PRODUCTIONPRODUCTIONDISTRIBUTION Metadata-Centric Production Chain

15. 2004.11.02 - SLIDE 15IS 202 - FALL 2004 The Media Metadata Opportunity Vastly more media will be produced Without ways to manage it (metadata creation and use) we lose the advantages of digital media Most current approaches are insufficient and perhaps misguided Great opportunity for innovation and invention Need interdisciplinary approaches to the problem

16. 2004.11.02 - SLIDE 16IS 202 - FALL 2004 Moore’s Law for Cameras 2000 Kodak DC40 Nintendo GameBoy Camera $400 $ 40 2002 Kodak DX4900 SiPix StyleCam Blink

17. 2004.11.02 - SLIDE 17IS 202 - FALL 2004 Capture+Processing+Interaction+Network

18. 2004.11.02 - SLIDE 18IS 202 - FALL 2004 Camera Phones as Platform Media capture (images, video, audio) Programmable processing using open standard operating systems, programming languages, and APIs Wireless networking Personal information management functions Rich user interaction modalities Time, location, and user contextual metadata

19. 2004.11.02 - SLIDE 19IS 202 - FALL 2004 Camera Phones as Platform In the first half of 2003, more camera phones were sold worldwide than digital cameras By 2008, the average camera phone is predicted to have 5 megapixel resolution Last month Casio and Samsung introduced 3.2 megapixel camera phones with optical zoom and photo flash There are more cell phone users in China than people in the United States (300 million) For 90% of the world their “computer” is their cell phone

20. 2004.11.02 - SLIDE 20IS 202 - FALL 2004 Phone Project Overview In this project we will be creating, sharing, and reusing mobile media and metadata You and your Project Group will design application use scenarios and develop and refine metadata frameworks for your photos We will be using the Nokia 7610 mobile media phone and software developed by Garage Cinema Research

21. 2004.11.02 - SLIDE 21IS 202 - FALL 2004 Phone Project Overview In the SIMS 202 Phone Project you and your Project Group will –Experience the actual process of information organization and retrieval (especially as regards metadata creation and use) –Work in small, focused teams performing a variety of tasks in image acquisition, description, and application design –Develop an ongoing resource for SIMS (an annotated photo database) that can be used for internal research and teaching, as well as for external promotional and informational purposes

22. 2004.11.02 - SLIDE 22IS 202 - FALL 2004 Phone Project Requirements Create engaging and useful application scenarios and photos for use by your team and the entire class –The photos you take and the applications you will design to use them should be interesting and useful to you and your colleagues Create a shared, reusable resource of annotated photos –Design your metadata such that all photos are accessible not only for the needs of your particular application, but also for the reusability of your photos and metadata by other applications

23. 2004.11.02 - SLIDE 23IS 202 - FALL 2004 Phone Project Assignments DATEASSIGNEDDUE Tuesday, November 2 Cameraphone Use Scenario – Application Idea Thursday, November 4 Tuesday, November 9Photo Metadata Design Cameraphone Use Scenario – Application Idea Thursday, November 11 Tuesday, November 16Photo Metadata Design Thursday, November 18Metadata Revision Tuesday, November 23Photo Capture and AnnotationMetadata Revision Thursday, November 25 Tuesday, November 30Project PresentationsPhoto Capture and Annotation Thursday, December 2 Tuesday, December 7Project Presentations

24. 2004.11.02 - SLIDE 24IS 202 - FALL 2004 Phone Project Assignments Cameraphone Use Scenario – Application Idea (Assignment 5) –You will brainstorm and storyboard an application for a mobile media device that accesses a server and facilitates the creation, sharing, and reuse of media and metadata. You will develop user personas and scenarios of how the application works and how the user experiences it. The applications you will design should be interesting and useful to you and your colleagues.

25. 2004.11.02 - SLIDE 25IS 202 - FALL 2004 Phone Project Assignments Photo Metadata Design (Assignment 6) –Having your application and the overall project goals in mind, you will design a suitable metadata framework to use for annotating photos such that all photos would be accessible not only for the needs of your particular application, but also for the reusability of your photos and metadata by other applications.

26. 2004.11.02 - SLIDE 26IS 202 - FALL 2004 Phone Project Assignments Photo Metadata Revision (Assignment 7) –You will consolidate your classification scheme with one other team to develop a revised and unified metadata framework.

27. 2004.11.02 - SLIDE 27IS 202 - FALL 2004 Phone Project Assignments Photo Capture and Annotation (Assignment 8) –With the goals of your application and the overall goals of the class project in mind, each group member is required to take at least 10 photos (at least 5 relevant to your application idea and at least 5 photos of any thing else you wish to photograph), upload them, and annotate them with your revised metadata framework.

28. 2004.11.02 - SLIDE 28IS 202 - FALL 2004 Phone Project Assignments Project Presentations (Assignment 9) –In a special class session, your group will present your application ideas, metadata frameworks, and annotated photos to your fellow students. Each group will have 10 minutes to present their innovative work.

29. 2004.11.02 - SLIDE 29IS 202 - FALL 2004 Phone Project Context Metadata In order to collect the data needed for these purposes, your use of the system will be logged in a number of anonymized ways: –Location Your GPS location will be logged whenever you take a picture with the cameraphone and are using the Bluetooth- enabled GPS device we will provide you. Your network CellID will be logged whenever you take a picture. This information may be correlated with various other sources of information (e.g., raw location data may be correlated with a Point of Interest database) to try to refine the location information (e.g., in which building the phone was used.) –Presence Your phone will broadcast its Bluetooth ID and be recorded whenever another MMM-2 phone user takes a picture within 10 meters of your phone.

30. 2004.11.02 - SLIDE 30IS 202 - FALL 2004 Phone Project Context Metadata –Social Networking The phone calls you make from the phones provided to you will be logged. (The phone conversations will not be recorded, but a log will be kept of which numbers were called when and for how long.) The sharing activities done on the MMM-2 web site will be logged to determine with whom you shared your photos. –Annotation The captions and annotations you make of photos on the phone and on the web will be logged. You can hide your automatically sensed Bluetooth presence information at any time by turning off Bluetooth on the phone. You can hide your automatically sensed GPS location at any time by turning off the Bluetooth-enabled GPS device we will provide you.

31. 2004.11.02 - SLIDE 31IS 202 - FALL 2004 Confidentiality The contextual metadata, as well as any additional information provided by you or other students will be kept by Garage Cinema Research for an indefinite time This may include images of you or provided by you, as well as metadata about you and your photos or provided by you Your name and email address will be stored separately from the identifying information for your phone Your name, email address, and the complete phone numbers that you call will be kept in a password- protected file accessible only by the immediate members of the research team

32. 2004.11.02 - SLIDE 32IS 202 - FALL 2004 Confidentiality No information will be collected about you while the equipment is not in use You can choose not to use the equipment Only pictures that you choose will be added to the Mobile Media Metadata system database You will have the option to remove your images or alter the associated metadata at any time You may withdraw from participation in this project at any time

33. 2004.11.02 - SLIDE 33IS 202 - FALL 2004 Opt Out Options Selectively turn off GPS Selectively turn off Bluetooth Only pictures that you choose will be added to the Mobile Media Metadata system database You will have the option to remove your photos or alter the associated metadata at any time Opt out of Phone Project and do alternate assignments

34. 2004.11.02 - SLIDE 34IS 202 - FALL 2004 Responsibility for Equipment These phones, their voice and data services, and the GPS devices have been donated to Garage Cinema Research for the IS202 Phone Project. You are responsible for the free Nokia 7610 and GPS Bluetooth device you will be provided. If you damage or lose them, you will be responsible for replacing them. You are also responsible for using the phone in accord with the service agreement. Any calls made above the supplied plan may be billed to you.

35. 2004.11.02 - SLIDE 35IS 202 - FALL 2004 Phone Plan The free supplied service plan is the AT&T Wireless (Cingular) GSM America Local Plan which includes: –700 any time minutes per month –Unlimited nights and weekends starting at 9:00 pm –1000 mobile-to-mobile minutes per month –Free nationwide long distance If you plan to travel outside of the plan calling area and use your phone, please let us know in advance and we may be able to upgrade your free service plan accordingly for the duration of your travel

36. 2004.11.02 - SLIDE 36IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

37. 2004.11.02 - SLIDE 37IS 202 - FALL 2004 Assignment 5: Process Brainstorm application ideas Evaluate your ideas and agree on one to pursue Come up with a persona and scenario for your application idea Write a description of your application idea involving one persona and one scenario Draw a storyboard with explanatory text Document the results of your brainstorming Create your group website

38. 2004.11.02 - SLIDE 38IS 202 - FALL 2004 Assignment 5: Deliverables Brief description of the application idea you selected Persona description Scenario description Annotated storyboard Work distribution table List all brainstorming ideas and reasons for selecting or rejecting each

39. 2004.11.02 - SLIDE 39IS 202 - FALL 2004 Assignment 5: Turning It In Submit an email to is202- ta@sims.berkeley.edu with the following information (due November 9, before class): –Group name –URL of your group website –URL to description (application, persona, scenario), storyboard, brainstorming results, work distribution table –Time it took you to complete the assignment –Any comments on assignment (optional)

40. 2004.11.02 - SLIDE 40IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

41. 2004.11.02 - SLIDE 41IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

42. 2004.11.02 - SLIDE 42IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

43. 2004.11.02 - SLIDE 43IS 202 - FALL 2004 Lecture Contents Review –Metadata and Controlled Vocabularies Phone Project Introduction –Project Overview –Assignment 5 –Phone and MMM-2 Tutorial –GPS Demo –Discussion Action Items for Next Time

44. 2004.11.02 - SLIDE 44IS 202 - FALL 2004 Homework (!) Read –“The Semantic Web” (Berners-Lee, Hendler, Lassila) –“RDF Primer” (Minola and Miller)RDF Primer Section 6.2 – 6.7 are optional Assignment 5: Cameraphone Use Scenario –Due by Tuesday, November 9, 2004