Annotation of Multimedia Documents. Approaches to Cooperation and Personalization. Annotation System January Amanzio Rigamonti TU Hamburg-Harburg, Germany Polytechnic of Milan, Italy

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO AA

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Motivations Models of Communication o “One to Many” Models Mass-media (TV, Radio,Papers, etc.) World Wide Web o “Many to Many” Models NewsGroups (subject-oriented) Annotation Systems (document-oriented) AA

A. Rigamonti - Annotation System Motivations Advantages of Digital Processes and Digital Annotations o Flexibility o Search Methods o Editing o Copying Methods o Access Control Aspects of Cooperation and Personalization

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Concept of Annotation Active Role of the Reader Definition Of Annotation Meta-Information associated with a Document providing an enrichment of the Document Meta-Information associated with a Document providing an enrichment of the Document

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Requirements of Annotation Systems Objects of Annotation o Documents o Annotations Types of Annotation o Text Annotation o Graphic Annotation o Annotation as a Service Annotation Management o Annotation Sets o Public / Group / Private Annotations o Mechanisms of Merging

A. Rigamonti - Annotation System Requirements of Annotation Systems User Management o Groups of Users o Mechanism of Authentication Architectural Components of an Annotation System o Client o Annotation Server o Proxy Server o Document Server

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Use cases Example : Creating Annotations AA

A. Rigamonti - Annotation System A Model of Annotation M

A. Rigamonti - Annotation System A Model of Annotation

A. Rigamonti - Annotation System Project Management Hierarchy of Projects Concept of Workspace Public Workspace / Project Workspace M AA PUBLIC PROJECT 2

A. Rigamonti - Annotation System Example: Hierarchy of Projects M AA PUBLIC Subjects Digital Libraries Subjects WEL Annotation System Multimedia index

A. Rigamonti - Annotation System A Model of Annotation

A. Rigamonti - Annotation System Users and Access Modifiers User Management – Generic User – Project Administrator – System Administrator Access Modifiers of Annotations M AA

A. Rigamonti - Annotation System Notification off-line Causes: Create Annotation / Delete Annotation / Add-Delete Member of Project AA

A. Rigamonti - Annotation System Activity Diagram: Notification M AA

A. Rigamonti - Annotation System A Model of Annotation

A. Rigamonti - Annotation System Annotation Management Creating Annotations Annotation of an Annotation Deleting Annotations Searching for Annotations m Search by Person m Search by Document m Search by Annotation m Search by Subject m Search by Project M

A. Rigamonti - Annotation System Creating Annotations AA Annotation Database WEL Project Digital Libraries Project Document

A. Rigamonti - Annotation System Annotation of an Annotation Hierarchy of Annotations AA Access Modifiers Control

A. Rigamonti - Annotation System Access Modifiers Control Access Modifiers of Annotations

A. Rigamonti - Annotation System Annotation of an Annotation Hierarchy of Annotations A Access Modifiers Control

A. Rigamonti - Annotation System Deleting Annotations AA

A. Rigamonti - Annotation System Active Databases Active Components of the Annotation System – Concept of ECA rules (Event-Condition-Action) – Mechanisms of Notification – Administrative Tasks m User Management m Project Management m Business Rules – Propagation of Changes

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Employed Methods and Technologies UML (Unified Modelling Language) o Use cases o Class Diagrams o Activity Diagrams Oracle v8.0 / SQL (Structured Query Language) o Trigger Java Language o JDBC: communication between Applications and Database o RMI (Remote Method Invocation)

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Components of the Architecture o Annotation Server Database Application Layer User Authentication o Browser Graphical User Interface o Proxy Server Merging of Documents and Annotations o Aspects of communication RMI (Remote Method Invocation) TCP / IP AA

A. Rigamonti - Annotation System System Architecture AA

A. Rigamonti - Annotation System Annotation Server: Interfaces AA

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System Conclusions and Evaluations WEL Project (Warburg Electronic Library) Future Works o Active Database o Distributed Database for large Applications o Object-Oriented Database o Active components of Annotation Annotation as a Service o Mechanisms of Garbage Collection

A. Rigamonti - Annotation System Table of Contents Motivations Concept of Annotation Requirements of Annotation Systems Annotation System Employed Methods and Technologies Architecture Conclusions and evaluations DEMO

A. Rigamonti - Annotation System DEMO Aspects of Annotation Management o Add Annotation o Delete Annotation o Display Annotation o Search Annotation

A. Rigamonti - Annotation System Annotation System User Specifications o User Goals Create Annotations Delete Annotations Search Annotations Read Annotations Notification Projects Management –Add Project –Delete Project –Add User to Project Group / Delete User from Project Group

A. Rigamonti - Annotation System Annotation System Subjects Management – Subjects of Person – Subjects of Annotation – Subjects of Project o Actors Annotation Server User Annotation Reader Annotation Author Project Administrator System Administrator

A. Rigamonti - Annotation System Classes and Interfaces

A. Rigamonti - Annotation System Annotations and Digital Libraries Cooperation and Personalization o Mechanisms of Notification o Private Annotation to Documents o Groups of Users Advantages of Digital Annotations in the Digital Libraries o Flexibility o Search Methods o Versatility o Share Consultation WEL (Warburg Electronic Library)