Structured Media for Media Integration & Document Authoring Tien TRAN_THUONG and Cécile ROISIN Project OPERA - INRIA Grenoble - France

Work Context and Objective  Structured media n Multimedia Document: u Set of basic media: audio, video, text, image, HTML, etc. u Multimedia document model: the way to integrate a set of basic media in time, space and hypermedia  Madeus language u Authoring & presentation system for multimedia documents  Madeus editor n Objective: semantic media fragment integration and authoring more complex and efficient documents

Current media fragment integration n Anchor and Area elements u Decompose media into spatial/temporal segments for hypermedia and fine-grained synchronizations (CMIF, HyTime, SMIL)  Ex: Area in SMIL2.0 <area id="Madeus" begin= "5s" end= "7s" coords= "84, 249, 188, 272" href ="Madeus-Editor.html" /> Active area absolute specification, no structure and lack of signification u The fragment attribute of the Area element provides naming facilities for external structured media <area fragment="Madeus-frag" href="Madeus-Editor.html" />

Structured media n Atomic media is a media node in a document that refers to a media content n Structured media is a media node in a document that refers to a media content and includes or refers to a structure description of that media content

Multimedia content description n DCMES: Dublin Core Metadata Element Set n RDF: Resource Description Framework n Mpeg7: Multimedia Content Description Interface F Need a multimedia content description model for composing multimedia document

Experimentation in Madeus n Structured video: sequence, scene, shot, videoEvent, videoObject, etc. n Structured audio: speech, music, sound, audioEvent, audioObject, etc. n Structured free text: word, phrase, sentence, paragraph, etc. Media structure description u Temporal/spatial synchronization of video/audio fragment with other media or media fragments u Hyperlink/tracking/erasing action on video objects u Hyperlink/highlight action on text fragments Media fragment integration Allows

Authoring multimedia documents Video Media integration Image Audio Free text Media content Multimedia document  Media is directly used  atomic media  Media description process before used  structured media Analysis & Generation Authoring media content description Media content model Media content described by standards (Mpeg7)

Conclusion and Perspectives n An authoring tool for complex multimedia presentations n Export to presentation-oriented formats n Fragments authoring for media (Image, Audio, Free text) n Import of multimedia content description standards (Mpeg7) n Need for media analysers to be integrated in my tool