Description of some multimedia ontologies Rapha ë l Troncy Thursday 1 st of December, 2005.

Slides:



Advertisements
Similar presentations
An Ontological Approach for the Management of Rights Data Dictionaries Roberto García, Jaime Delgado DMAG (Distributed Multimedia Applications Group) Universitat.
Advertisements

Rhizomik Semantic Integration and Retrieval of Multimedia Metadata Roberto García and Universitat de Lleida, Lleida, Spain Òscar Celma Universitat Pompeu.
Ontological Infrastructure for a Semantic Newspaper Roberto García 1, Ferran Perdrix 1,2, Rosa Gil 1 1 GRIHO – Human Computer Interaction Research Group.
Semantic Integration and Retrieval of Multimedia Metadata Facilitating Business Interoperability from the Semantic Web Roberto García, Rosa Gil Universitat.
OMV Ontology Metadata Vocabulary April 10, 2008 Peter Haase.
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
1 Ontolog OOR Use Case Review Todd Schneider 1 April 2010 (v 1.2)
DELOS WP5 Workshop: Semantic Interoperability in DL systems, 17 th September 2004, Bath, UK Semantic Interoperability in Digital Library Systems Task 3:
Profiles Construction Eclipse ECESIS Project Construction of Complex UML Profiles UPM ETSI Telecomunicación Ciudad Universitaria s/n Madrid 28040,
Using Several Ontologies for Describing Audio-Visual Documents: A Case Study in the Medical Domain Sunday 29 th of May, 2005 Antoine Isaac 1 & Raphaël.
Using XSLT for Interoperability: DOE and The Traveling Domain Experiment Monday 20 th of October, 2003 Antoine Isaac, Raphaël Troncy and Véronique Malaisé.
A Stepwise Modeling Approach for Individual Media Semantics Annett Mitschick, Klaus Meißner TU Dresden, Department of Computer Science, Multimedia Technology.
MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? Wednesday 5 th of December, 2007 Oscar CelmaRapha.
Of 27 lecture 7: owl - introduction. of 27 ece 627, winter ‘132 OWL a glimpse OWL – Web Ontology Language describes classes, properties and relations.
Using the Semantic Web to Construct an Ontology- Based Repository for Software Patterns Scott Henninger Computer Science and Engineering University of.
Philips Research France Delivery Context in MPEG-21 Sylvain Devillers Philips Research France Anthony Vetro Mitsubishi Electric Research Laboratories.
MPEG-7 Multimedia Content Description Standard January 8, 2003 John R. Smith Pervasive Media Management Group IBM T. J. Watson Research Center 19 Skyline.
Future of MDR - ISO/IEC Metadata Registries (MDR) Larry Fitzwater, SC 32 WG 2 Convener Computer Scientist U.S. Environmental Protection Agency May.
 Copyright 2005 Digital Enterprise Research Institute. All rights reserved. Towards Translating between XML and WSML based on mappings between.
A Motivating Scenario for Designing an Extensible Audio- Visual Description Language Monday 25 th of October, 2004 Raphaël Troncy, Jean Carrive, Steffen.
Integrating Structure and Semantics into Audio-visual Documents Tuesday 21 st of October, 2003 Raphaël Troncy 2nd International Semantic Web Conference.
Information Systems & Semantic Web University of Koblenz ▪ Landau, Germany Semantic Web - Multimedia Annotation – Steffen Staab
Formalization of documentary knowledge and conceptual knowledge with ontologies : applying to the description of audio-visual documents Friday 23 rd of.
SQL Databases are a Moving Target Juan F. Sequeda – Syed Hamid Tirmizi –
MPEG-7 Interoperability Use Case. Motivation MPEG-7: set of standardized tools for describing multimedia content at different abstraction levels Implemented.
OWL 2 in use. OWL 2 OWL 2 is a knowledge representation language, designed to formulate, exchange and reason with knowledge about a domain of interest.
ISURF -An Interoperability Service Utility for Collaborative Supply Chain Planning across Multiple Domains Prof. Dr. Asuman Dogac METU-SRDC Turkey METU.
1 Ontology-based Semantic Annotatoin of Process Template for Reuse Yun Lin, Darijus Strasunskas Depart. Of Computer and Information Science Norwegian Univ.
Development Process and Testing Tools for Content Standards OASIS Symposium: The Meaning of Interoperability May 9, 2006 Simon Frechette, NIST.
Michael Eckert1CS590SW: Web Ontology Language (OWL) Web Ontology Language (OWL) CS590SW: Semantic Web (Winter Quarter 2003) Presentation: Michael Eckert.
Metadata. Generally speaking, metadata are data and information that describe and model data and information For example, a database schema is the metadata.
Revelytix SICoP Presentation DRM 3.0 with WordNet Senses in a Semantic Wiki Michael Lang February 6, 2007.
Enabling Access to Sound Archives through Integration, Enrichment and Retrieval WP2 – Media Semantics and Ontologies.
Using Several Ontologies for Describing Audio-Visual Documents: A Case Study in the Medical Domain Sunday 29 th of May, 2005 Antoine Isaac 1 & Raphaël.
SKOS. Ontologies Metadata –Resources marked-up with descriptions of their content. No good unless everyone speaks the same language; Terminologies –Provide.
1 Artificial Intelligence Applications Institute Centre for Intelligent Systems and their Applications Stuart Aitken Artificial Intelligence Applications.
Integration of Domain & Application Knowledge in MPEG-7/21 in the DS-MIRF Framework Laboratory of Distributed Multimedia Information Systems & Applications.
11 CORE Architecture Mauro Bruno, Monica Scannapieco, Carlo Vaccari, Giulia Vaste Antonino Virgillito, Diego Zardetto (Istat)
Oreste Signore- Quality/1 Amman, December 2006 Standards for quality of cultural websites Ministerial NEtwoRk for Valorising Activities in digitisation.
Metadata Common Vocabulary a journey from a glossary to an ontology of statistical metadata, and back Sérgio Bacelar
Working with Ontologies Introduction to DOGMA and related research.
Dictionary based interchanges for iSURF -An Interoperability Service Utility for Collaborative Supply Chain Planning across Multiple Domains David Webber.
2.An overview of SDMX (What is SDMX? Part I) 1 Edward Cook Eurostat Unit B5: “Central data and metadata services” SDMX Basics course, October 2015.
Inference-based Semantic Mediation and Enrichment for the Semantic Web AAAI SSS-09: Social Semantic Web: Where Web 2.0 Meets Web 3.0 March 25, 2009 Dan.
Practical RDF Chapter 12. Ontologies: RDF Business Models Shelley Powers, O’Reilly SNU IDB Lab. Taikyoung Kim.
1 Proposal on MFI-5: Process model registration based on ontology (MFI4Process) He Keqing Wang Chong 2006/08/29.
1 Open Ontology Repository initiative - Planning Meeting - Thu Co-conveners: PeterYim, LeoObrst & MikeDean ref.:
DANIELA KOLAROVA INSTITUTE OF INFORMATION TECHNOLOGIES, BAS Multimedia Semantics and the Semantic Web.
COMM: Designing a Well-Founded Multimedia Ontology for the Web Wednesday 14 th of November, 2007 Richard Arndt Steffen Staab Rapha.
Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards.
WonderWeb. Ontology Infrastructure for the Semantic Web. IST Project Review Meeting, 11 th March, WP2: Tools Raphael Volz Universität.
Extending the Metadata Registry for Semantic Web - Enforcing the MDR for supporting ontology concept - May 28, 2008 ISO/IEC JTC 1/SC 32 WG 2 Meeting Sydney,
OWL Web Ontology Language Summary IHan HSIAO (Sharon)
A Reduced Yet Extensible Audio- Visual Description Language: How to Escape From The MPEG-7 Bottleneck Thursday 28 th of October, 2004 Raphaël Troncy, Jean.
Semantic Interoperability in GIS N. L. Sarda Suman Somavarapu.
Designing and Using an Audio-Visual Description Core Ontology Friday 8 th of October, 2004 Antoine Isaac & Raphaël Troncy.
Introduction to MPEG  Moving Pictures Experts Group,  Geneva based working group under the ISO/IEC standards.  In charge of developing standards for.
LegalRuleML Metamodel Tara Athan, Harold Boley, Guido Governatori, Monica Palmirani, Adrian Paschke, Adam Wyner July 13, 2013 RuleML th International.
Working meeting of WP4 Task WP4.1
Building Trustworthy Semantic Webs
Knowledge Management Systems
Lecture #11: Ontology Engineering Dr. Bhavani Thuraisingham
LegalRuleML Metamodel
Model-Driven Ontology Engineering
The Re3gistry software and the INSPIRE Registry
ece 720 intelligent web: ontology and beyond
2. An overview of SDMX (What is SDMX? Part I)
Linking Guide Michel Böhms.
2. An overview of SDMX (What is SDMX? Part I)
Semantic Interoperability in Digital Library Systems
Presentation transcript:

Description of some multimedia ontologies Rapha ë l Troncy Thursday 1 st of December, 2005

Multimedia Ontologies Multimedia ontologies can be related to many works, standards, communities … Focus here on MPEG-7... as a whole ISO Standard composed of 11 parts but it is still growing … DDL = XML Schema + small extensions Descriptors and Description Schemes  1182 elements, 417 attributes, 377 complex types in the schema (MDS + Visual + Audio parts)  40 Classification Schemes

Agenda DSTC's Proposal Jane Hunter & Suzanne Little (ABC model) TUC's Proposal Chrisa Tsinaraki (DELOS) INA's Proposal Antoine Isaac & Raphaël Troncy DMAG/MTG's Proposal Roberto Garcia & Oscar Celma

DSTC's Proposal (summary) 1st proposal chronologically MPEG-7 ontology developed in RDFS, then converted into DAML+OIL and now OWL Contains 60 classes and 40 properties OWL Full ontology Cover the upper level of the MDS segments and decomposition agent, role, place, time and instrument basic visual descriptors Available at:

TUC's Proposal Software Engineering Framework aiming to facilitate Knowledge-based MPEG-7 Multimedia Application Development Being developed in TUC/MUSIC Consists of: An Ontological Infrastructure Methodologies for Interoperability between MPEG-7 and OWL An underlying MPEG-7 Repository Tools implementing the DS-MIRF approach

DS-MIRF Ontological Infrastructure

An Upper Ontology that fully captures the MPEG-7 MDS and a part of the MPEG-7 Visual Being extended to capture the MPEG-21 DIA Architecture Transformation Rules to transform OWL Ontologies and OWL/RDF metadata into MPEG-7 documents Implemented in the GraphOnto Ontology and Metadata Editor

TUC's Ontology Definition Methodology Manual definition based on the following rules: MPEG-7 Simple Datatype Representation: Integration of the XML Schema simple datatypes (rdfs:Datatype) MPEG-7 Complex Type Representation: Homonym OWL Classes  Attributes & Simple Type Elements: Datatype Properties  Complex Type Elements: Object Properties  Subclassing:  Simple Types: Datatype property with rdf:ID “type_nameContent” – where type_name is the type of the supertype  Complex Types: rdfs:subclassOf  Constraints: OWL Restrictions MPEG-7 Classification Scheme Representation: Individuals of the MDS type “ClassificationSchemeType”

TUC's Proposal (summary) Cover the full standard Contains 420 classes and 175 properties for the MDS part OWL DL Cover also the CSs The 40 CSs have been translated into simple OWL hierarchy Available at: zip zip

INA's Proposal Different uses of AV Document Descriptions Archival and description of documents from a cultural heritage point of view: INA Exchanging program identification and characterization for interactive TV: TV-Anytime Diffusion of program information (news agencies): ProgramGuideML Storing and sharing AV content descriptions (automatic extraction results): MPEG-7 standard

Can we find an AV core ontology? There are many common needs amongst observed applications Characterization of programs and sequences Decomposition of programs and sequences Ability to introduce description of the activities that constitute the context of AV documents (roles of people involved, ways production and broadcast are achieved) These concepts are close to a "neutral" archival viewpoint

C.O. content Concerning AV objects: distinction sequence/program decomposition and qualification of those objects link to external world themes and entities (content description) Underlying use patterns for elicited categories

Example: Upper-level categorization of sequences

Example: Upper-level categorization of program

INA's Proposal (summary) Cover the MDS upper part, and partially the audio and visual parts Contains 610 classes OWL DL Cover also (partially) the CSs adapted to TV Anytime (and ProgramGuideML) adapted to INA's needs Linked to the DOLCE ontology Available at:

DMAG/MTG's Proposal Reuse MPEG-7 implicit semantics. XML  Semantic Web: XSD2OWL: schema to ontology. XML2RDF: XML instance data to RDF instances. Tested as integration base for: MusicBrainz, Simac, Music Vocabulary, etc.

XMLSchema to OWL Mappings complexType//element complexType|group|attributeGroup element|attribute XML Schema owl:intersectionOf owl:unionOf owl:maxCardinality owl:minCardinality rdfs:subClassOf owl:Restriction owl:Class rdfs:range rdfs:subPropertyOf rdf:Property owl:DatatypeProperty owl:ObjectProperty OWL

DMAG/MTG's Proposal (summary) Cover the whole MPEG-7 + the upper level of the Classification Schemes Contains 2372 classes and 975 properties OWL Full Available at:

Questions ?

Towards an harmonization of these multimedia ontologies Rapha ë l Troncy Thursday 1 st of December, 2005

Preliminary results Current state: Proposals are made individually, for specific research project The OWL files contains some errors  Corrected versions available for DSTC and DMAG/MTG ontologies Different conceptualizations have been obtained … even if they start from the same MPEG-7 schema No MPEG-7 endorsement

(Personal) Idea: Three step process Aligning pair-wise ontologies Visual part of aceMedia vs DMAG vs TUC MDS part of Hunter vs DMAG vs TUC vs INA CSs part of DMAG vs TUC vs INA Merging and fusing Re-engineering (manually) ! Current proposals are based on automatic translation rules from XSD to OWL (except INA) Does NOT go beyond what XML Schema can express

Open Issues OWL DL vs OWL Full Real modularization of MPEG-7 upper part, visual, audio, CSs requires breaking some existing relationships ! Do we have to capture all MPEG-7 ? people, agent, role, place are not multimedia- specific Are there more multimedia ontologies currently developed ? Proton: Boemie: re-use the aceMedia ontologies (MDO, VDO)

Questions ?