Different Levels of Interaction : -Passive : only visualization -Reactive : limited inetraction ( e.g., scroll pane functionality). -Proactive : choose a path or make selections (e.g. button) -Reciprocal: corresponds to user authoring of information

Interaction Models : -Navigational: choose to dicide where to go next -Design: user can modify the visual style of the presentation (e.g. colors) -Movie: User can control the global time (e.g. VCR capabilities)

Tradionally multimedia presentations did not have that much logic: -Virtual visit to a museum, DVD menus …… Real – time interactive systems: -Virtual Reality worlds, games Application logic needs of a programming language (if, case, goto, …..) -Compiled languages C, C++ -Virtual Machine: Java -WWW, MPEG-7, Director, Scripting

Video Description Dublin core: the semantic indexing schema for video content description. MPEG-7: the future standard tools will enable to define the semantic schemas for description of the audiovisual information. Video => Analysis -> Description -> Applications Scheme of audiovisual applications *Our video modeling for composing multimedia document.

Methodology Specification of a modeling for the description of video content: –Multi-level structuration, –temporal and spatial relations, –actions interactive on the video elements. Specification in XML Experimentation in Video

Video Content Description Multi-level Structuration Video Structure –Structural Description Semantic –Semantic Description Thesaurus –Thesaurus <!ELEMENT VideoContent (MetaInfo, MediaInfo, Summary, Structure, Semantic, Thesaurus)> <!ELEMENT Thesaurus (ReferenceDictionary*, UserDictionary*)> Raw video Occ.1Occ.2Occ.3Occ.4 NabilIrene Structure Semantic Thesaurus Researcher

Video Structure Description Motivation: for composition, the basis is to have the Structure description level. Semantic and Thesaurus are more necessary for retrieval applications or as a support for structuration level. *First step is Structure description

High Level Description Video Video Structure –Sequences Sequences –Scenes Scenes –Shots Shots

Shot Content Description Shot Content Shot –Transition Trans. –SpatialLayout SpatialLayout Reference –Event Event Semantic Index Background –Background Occurrence –Occurrence CameraWork –Camerawork <!ELEMENT Occurrence (Region+, Trajectory?, Occurrence*) > *

Occurrence Content Description Occurrence Content Occurrence –Trajectory Trajectory –Regions Region –Occurrences Occurrence Texture Contour Texture Centroid Region Color Regions

Experimentation of the model in Madeus - VideoMadeus

Madeus Architecture JAVA XercesJMF OUTILS Editor/Presentation Tools EXECUTION View TIME LINE View HIERARCHICAL View VIDEO STRUCTURED View... PARSERS LOGIC STRUCTURATION TEMPORAL STRUCTURATION SPATIAL STRUCTURATION EVENT MANAGEMENT MODEL MANAGEMENT MADEUS Madeus document To extend Madeus to VideoMadeus, video content description is handled both in composition and in presentation parts. SAVE

Internal Document Madeus Document Model Structured document organized according to the dimensions: Logical, temporal, spatial. Madeus Document Actor Content Temporal Spatial Logical …... Madeus Document Actor Content Temporal Spatial Content that describes the content information of the document Actor that defines how this basic information in the content part is used in the document (style information, link, etc.) Temporal for the synchronization between document parts Spatial for layout specification

Relations Temporal relations (Allen extension) – meets, starts, equals, during, overlaps, parmin,etc. Spatial relations – left_align, right_align, center_v, center_h, top_align, bottom_align, etc. … … … … d

Overview of VideoMadeus Video edition View " Structure View " Semantic View " Thesaurus View Element Management " Edit " Play " Search Execution View " Temporal " Spatial Synchronization Management " Hyperlink " Follow-up " Erase " Display, etc... Behavior Management Synchronization Video Index on video Requested descriptions Modified description Requested descriptions XML Description of video content Data Management Internal Structure (MODEL) Parser Modify Editing and Presentation Tools

VideoMadeus document