1. Multimedia Digital Libraries Sugata Mukhopadhyay March 14, 2000

2. Announcement Discussion Class – Wed 3/15/00 Review of Prelim

3. Examples Archived news broadcasts Video Text Transcripts Recorded lecture archives Experience on Demand

4. Challenges Quantity of Data Isochronous delivery requirements Automatic extraction of semantics for indexing Searching ability

5. Example: Data Size Text (1 page) : 5K / 1K Image (1024x768) : 2.3M / 300K Voice (1 min) : 480K / 60K Music (1 min, CD) : 10.2M / 1M Video (1 min, VHS) : 400M / 10M Video (1 min, NTSC) : 1.6G / 35M Video (1 min, HDTV) : 4.8G / 200M

6. Example: Searching Images Color Histograms, Color Coherence Vectors Audio Speech recognition Query by humming Bird sound recognition Video Content based retrieval Closed captioning

7. Case Study The Cornell Lecture Browser Demo

9. Schematic of the Setup Seats Podium Tracking Camera Fixed Camera

10. System Dataflow Classroom Processing Host Synchronize Slide Match Auto Edit Transcode FEDORA Repository Slides Digital Objects

11. Why use a Digital Library ? Presentation form vs stored form Archived data delivery must adapt to advances in technology Access policy enforcement and rights management Extensibility of archived data delivery (Algorithms we haven't dreamt of)

12. FEDORA Digital Object Container for aggregating digital material Repository Service layer for Digital Objects Dissemination Generic components associating a set of behaviors to a Digital Object

13. FEDORA DigitalObject application/ postscript application/ MARC Primitive Disseminator Structural Kernel Extensible Behavior Layer

14. application/ MARC DS 1 application/ postscript DS 2 Primitive Disseminator Client communicates with generic requests Book, DublinCore ListDisseminatorTypes Book Disseminator DublinCore Disseminator GetDissemination (Book.GetPage(1)) GetChapter GetTOC GetPage GetChapter(n), GetPage(n),GetTOC() GetMethods(Book)

15. Object Granularity Video1Video2 Metadata Slides Aggregate Object Video1Video2 MetaData

16. Thin vs Thick Clients Video1Video2 Metadata Slides GetSlides()GetVideo()GetSynch()GetMeta()

17. Thin vs Thick Clients II Video1Video2 Metadata Slides GetApplet()

18. Adaptability Goals Change in internal data representation must not impact clients New disseminations should be added seamlessly

19. Conclusion  Multimedia digital libraries present a new set of challenges BUT  Leverage off the large body of research in traditional digital libraries