Universität Innsbruck Leopold Franzens  Copyright 2007 DERI Innsbruck EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel WP 2 – Media Semantics and Ontologies Martin Hepp, Michael Luger, and Francois Scharffe University of Innsbruck

2 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Outline Workpackage Overview RDF Storage and Retrieval Service Metadata Mapping Archivist Metadata Management Future Work Publications

3 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Workpackage overview T2.2 Ontology and Semantics for Media Object Representation (Completed)‏ –Audio and speech ontology integrated to the framework. Still need testing of the representation functionalities of the speech extension. –MARC import module delivered. To be integrated in the archivist application. T2.3 Ontology Management Environment (Ongoing)‏ –WSMT Ontology management environment delivered. Still need to enhance the ontology language integration part (release planned in January)‏ –General architecture delivered (see publications)‏ –Web prototype delivered. The code was re-factored enabling its sharing. Plan is to set it on –RDF storage service just released (see later). Support to other partners will be provided for writing SPARQL queries. –Archivist application for ontology population still to be realized. (Start in January, see later)‏

4 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Universität Innsbruck Leopold Franzens EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel  Copyright 2006 DERI Innsbruck WP2 – Media Semantics and Ontologies

5 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval The Big Picture

6 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval The Big Picture

7 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval

8 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Persistent Storage Insert, Update & Delete Operations Intended for RDF Metadata generated from Feature Extractors –object identifiers, metadata, and related media Retrieval SPARQL Query Endpoint Decoupled Component Access via HTTP REST or Java API

9 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Sesame 2 Framework –Chosen after investigation of popular Semantic Web Frameworks Boca, Jena, Joseki, Virtuoso, RDF RAP, etc. –Open Source (BSD license)‏ –Modularized architecture –Storage File System, Memory, RDBMS Storage Taken from

10 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Sesame 2 Architecture RDF Model Rio SAIL API SAIL Query Model SeRQL SPARQL Repository Access API HTTP Server application HTTP / SPARQL protocol Taken from J. Broekstra et al - ESWC'06 Tutorial: Application Development with the Sesame Framework

11 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Programmatic (Remote) Access –Storage (Insert, Update, Delete Operations)‏ Sesame 2 Java API –RDF Statements: From File, Stream, utilizing Java I/O –Individual RDF Statements HTTP REST API –Client libraries available for the majority of programming languages –Allows RDF/XML, N-Triple, N3,... –Retrieval over SPARQL Endpoint Sesame 2 Java API HTTP REST API –Returns results in SPARQL Query Results XML Format

12 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Sesame 2 Framework –Storage Memory, File System, or Relational Database Allows RDF/XML, N-Triples, N3,... –Retrieval SPARQL Endpoint Results in SPARQL Results Format (XML)‏ –Programmatic Access Sesame 2 Java API HTTP Protocol –client libraries available for majority of programming languages

13 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Programmatic Access – Example GET /sesame/repositories/easaier?query=“select * where {?a ?b ?c}” HTTP/1.1 Host: localhost Accept: application/sparql-results+xml GET /sesame/repositories/easaier?query=“select * where {?a ?b ?c}” HTTP/1.1 Host: localhost Accept: application/sparql-results+xml POST /sesame/repositories/easaier HTTP/1.1 Host: localhost Content-Type: application/rdf+xml [RDF statements] POST /sesame/repositories/easaier HTTP/1.1 Host: localhost Content-Type: application/rdf+xml [RDF statements]

14 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Tutorial

15 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel RDF Storage and Retrieval Sesame 2 Framework –Native Inferencing Support for RDFS & OWL-Lite Fragment –Extensible Support for External Reasoners and Rule Engines –OWLIM OWL Reasoner being ported to Sesame2 (WSML support)‏ Transaction Support Context Support

16 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel The Archivist Application Allows the archivist to populate the archive by –Uploading Audio Content‏ Selection of the feature extraction algorithms –Importing new external sources (ex:Hotbed)‏ –Importing Metadata (e.g. MARC)‏ –Subsequently Update RDF Store & Binary Store Configure parameters of the client applications.

17 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Metadata Management MARC21 Metadata Mapping –Utilisation of MARCXML Toolkit (from loc.gov)‏ MARC21 -> MARCXML Conversion –XSLT Transformation to RDF Dublin Core –Open Issue / TODO Address special fields according to the MusicOntology METS –Administrative Format (LOC)‏ On-demand integration of other archives. WSML Conversion with OWL-DL

18 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Future Work Continue and finish the OWL-WSML conversion. Develop the archivist application Support other partners with usage of the RDF storage and query functionalities Support the integration of other archives. Prepare the report on metadata management infrastructure and ontology language for media objects

19 EASAIER 18 Month Coordination Meeting, Tel Aviv, Israel Publications –Michael Luger, Ying Ding, François Scharffe, Rubing Duan, Zhixian Yan. EASAIER: Semantic Music Retrieval Portal. Poster and Demonstration, SAMT Conference, Genova, Italy, –Michael Luger, Ying Ding, Zhixian Yan, François Scharffe, Rubing Duan, Yves Raimond, Luc Barthélémy, Josh Reiss. EASAIER: Semantic Music Retrieval Portal. Poster and Demonstration, ISWC, Busan, Korea, –François Scharffe, Yves Raimond, Luc Barthélémy, Ying Ding, and Michael Luger. Publishing and Accessing Digital Archives using the EASAIER Framework. Workshop on cultural heritage and the semantic web. ISWC, Busan, Korea, –François Scharffe. Ontology and Semantic Web Aspects. Enabling Access to Sound Archives Workshop. Minerva Conference, Jerusalem, 2007.