1. 2004.08.30 SLIDE 1IS246 – FALL 2004 Lecture 01: Introduction IS246 Multimedia Information Prof. Marc Davis UC Berkeley SIMS Monday and Wednesday 2:00 pm – 3:30 pm Fall 2004 http://www.sims.berkeley.edu/academics/courses/is246/f04/

2. 2004.08.30 SLIDE 2IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

3. 2004.08.30 SLIDE 3IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

4. 2004.08.30 SLIDE 4IS246 – FALL 2004 Who Am I? Assistant Professor at SIMS (School of Information Management and Systems) Background 1980 – 1984B.A. from Wesleyan University in the College of Letters 1984 – 1987M.A. from the University of Konstanz in Literary Theory and Philosophy 1990 – 1995Ph.D. from MIT Media Laboratory in Media Arts and Sciences 1993 – 1998Member of the Research Staff and Project Coordinator at Interval Research Corporation 1999 – 2002Chairman and CTO of Amova

5. 2004.08.30 SLIDE 5IS246 – FALL 2004 Why Am I Here? Creating technology and applications that will enable daily media consumers to become daily media producers Research and teaching in the theory, design, and development of digital media systems for creating and using media metadata to automate media production and reuse

6. 2004.08.30 SLIDE 6IS246 – FALL 2004 Student Introductions Who are you? –Name –Undergrad degree and current department –Special areas of expertise and interest Why are you here? –What you want to learn from the course

7. 2004.08.30 SLIDE 7IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

8. 2004.08.30 SLIDE 8IS246 – FALL 2004 Global Media Network Digital media produced anywhere by anyone accessible to anyone anywhere Today’s media users become tomorrow’s media producers Not 500 TV Channels — 500,000,000 multimedia Web sources

9. 2004.08.30 SLIDE 9IS246 – FALL 2004 What is the Problem? Today people cannot easily find, edit, share, and reuse media Computers don’t understand media content –Media is opaque and data rich –We lack structured representations Without content representation (metadata), manipulating digital media will remain like word- processing with bitmaps

10. 2004.08.30 SLIDE 10IS246 – FALL 2004 Types of Multimedia Data 1D –Audio (speech, music, sound effects, etc.) –MIDI 2D –Photographs –Graphics 3D –Video (2D + Time) –Animation (2D + Time) –Computer graphic models 4D –Computer graphic model animation (3D + Time)

11. 2004.08.30 SLIDE 11IS246 – FALL 2004 Moore’s Law for Cameras 2000 Kodak DC40 Nintendo GameBoy Camera $400 $ 40 2002 Kodak DX4900 SiPix StyleCam Blink

12. 2004.08.30 SLIDE 12IS246 – FALL 2004 2004: Nokia 7610 Phone Integrated megapixel (1152 x 864 pixels) camera Integrated video recorder with audio function and 4x digital zoom for video clips up to 10 minutes long 65,536 color-display, 176 x 208 pixels Bluetooth wireless technology and USB connectivity Advanced XHTML browser 8 MB internal dynamic memory and 64 MB Reduced Size MultiMediaCard (MMC) Downloadable Java™ MIDP 2.0 applications

13. 2004.08.30 SLIDE 13IS246 – FALL 2004 The Media Problem Vastly more media will be produced Without ways to manage it (metadata creation and use) we lose the advantages of digital media Most current approaches are insufficient and perhaps misguided Great opportunity for innovation and invention Need interdisciplinary approaches to the problem

14. 2004.08.30 SLIDE 14IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

15. 2004.08.30 SLIDE 15IS246 – FALL 2004 Goals of the Course Acquire theoretical and practical foundations to analyze, design, and produce multimedia information systems –Media theory –Media practice –Current and future media systems and applications Learn to apply media theory to media design Gain further experience in project-based learning and teamwork Develop an enduring framework and methodology for media analysis and design

16. 2004.08.30 SLIDE 16IS246 – FALL 2004 What This Course Is Graduate level lecture/seminar/studio in multimedia information Highly interdisciplinary –Information Management and Systems, Computer Science, Electrical Engineering –Film Studies, Cognitive Science, Linguistics –Film Practice, Design, HCI Project-based and team-oriented Requires stretching, commitment, and active participation

17. 2004.08.30 SLIDE 17IS246 – FALL 2004 What This Course Is Not Topics –Computer science or engineering course on media signals and systems –Film criticism course –Advanced media production skills course –Media networking, protocols, compression course Methods –Exams

18. 2004.08.30 SLIDE 18IS246 – FALL 2004 Who This Course Is For Students from –SIMS –Film Studies –EECS –Law, Business, Journalism, Architecture –Other departments Interested in –Synergizing a variety of disciplinary approaches to a complex, important, and fascinating problem domain that will shape the future of human communication, technology, and culture

19. 2004.08.30 SLIDE 19IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

20. 2004.08.30 SLIDE 20IS246 – FALL 2004 Course Format Most classes will be lecture/discussion sessions –Lecture ~50 minutes –Discussion ~30 minutes For each class two students will prepare discussion questions and help lead discussion Some classes will be working sessions –Assignment 3 Overview and Ideation –Annotated Storyboard Working Session and Crit –Final Project Overview and Ideation Some classes will be student presentations –Media Production and Theory Presentations –Final Project Presentations

21. 2004.08.30 SLIDE 21IS246 – FALL 2004 Course Overview Course phases –Theoretical and practical foundations –Current issues and methods –The future of multimedia Course assignments –Theory application –Using a camcorder –Short media production –Final project

22. 2004.08.30 SLIDE 22IS246 – FALL 2004 Course Sessions: Part I Theoretical and practical foundations –Communications theory and semiotics (Reddy, Iser, Barthes, Saussure) –Formalist media theory (Bordwell, Kuleshov) –Semiotic media theory (Metz, Eco) –Integrating theory and practice (Eisenstein) –Video production overview (Guest: Rachel Strickland) –Audio production overview (Guest: Rachel Strickland) Theory and history of computation (Hillis, Winograd) –Computational media theory (Manovich, Dorai & Venkatesh, Bloch)

23. 2004.08.30 SLIDE 23IS246 – FALL 2004 Course Sessions: Part II Current issues and methods –Metadata for media (Davenport, Davis) –Automated media analysis (Agrain, Jain, Foote -- Guest: Jonathan Foote) –Multimedia journalism (Guest: Paul Grabowicz) –Media asset management and reuse process (Christel, Dimitrova, Prelinger, Jenkins) –Commercial editing systems (Adobe Premiere) –Commercial media asset management systems (Virage) –Research multimedia systems (FotoFile -- Guest: Abbe Don) –Research multimedia systems (Informedia – Guest: Michael Smith) –Multimedia standards (MPEG-7)

24. 2004.08.30 SLIDE 24IS246 – FALL 2004 Course Sessions: Part III The future of multimedia –Future of multimedia information technology (Bush, McLuhan, Davis, Chang) –Active capture (Davis, Nack, Barry) –Adaptive media (Davis, Stern, Varian) –Mobile Media (Naaman, Sarvas, Toyama) –Final project presentations

25. 2004.08.30 SLIDE 25IS246 – FALL 2004 Course Assignments Theory application Using a camcorder: “Object lesson” Short media production –Annotated storyboard and goal statement –Rough edit –Presentation Final project –Team and idea formation –Project proposal –Project design specifications –Project presentation and write-up

26. 2004.08.30 SLIDE 26IS246 – FALL 2004 Grading 20% Theory Application Assignment 20% Mini Media Production Project 40% Final Project 20% Class Participation

27. 2004.08.30 SLIDE 27IS246 – FALL 2004 SIMS Digital Media Studio Hardware –Terabyte file server –Gigabit Ethernet –2 Mac G4 workstations –2 PC workstations –Various audio/video input options –5 Sony DCR-TRV50 DV camcorders –5 Audio field recording packs –Greenscreen Software –Adobe Premiere –Adobe AfterEffects –Adobe PhotoShop –FinalCut Pro –Media Streams Collaboration tools –Brainstorming area –Wall whiteboards

28. 2004.08.30 SLIDE 28IS246 – FALL 2004 Office Hours Marc Davis –Thursdays 1:00 pm – 3:00 pm –And by appointment Ryan Shaw –TBA

29. 2004.08.30 SLIDE 29IS246 – FALL 2004 Today’s Agenda Introductions Problem Domain Goals of Course Course Overview Action Items for Next Time

30. 2004.08.30 SLIDE 30IS246 – FALL 2004 Purchase Course Materials Purchase Course Textbooks –David Bordwell and Kristin Thompson. Film Art: An Introduction. 7 th Edition. McGraw Hill, New York, 2004. –W. Daniel Hillis. The Pattern on the Stone: The Simple Ideas That Make Computers Work. Perseus Books Group, New York, 1999.

31. 2004.08.30 SLIDE 31IS246 – FALL 2004 SIMS/CIS Computer Orientation See Ryan Shaw about –Filling out SIMS/CIS Account Request Form –Seeing Roberta Epstein on the second floor of South Hall to get SIMS/CIS orientation

32. 2004.08.30 SLIDE 32IS246 – FALL 2004 Readings for Next Time Wednesday 09/01 –Michael Reddy: “The Conduit Metaphor: A Case of Frame Conflict in Our Language about Language” (Brooke) –Wolfgang Iser: “The Reading Process: A Phenomenological Approach” (Geoff) –Roland Barthes: “The Death of the Author” (Rebecca) –Roland Barthes: “From Work to Text” (Sarah)

33. 2004.08.30 SLIDE 33IS246 – FALL 2004 In Class Writing marc@sims.berkeley.edu ryanshaw@sims.berkeley.edu What is multimedia information? What are the main challenges in multimedia information systems?