1. Ontological Infrastructure for a Semantic Newspaper Roberto García 1, Ferran Perdrix 1,2, Rosa Gil 1 1 GRIHO – Human Computer Interaction Research Group Universitat de Lleida, Spain 2 SEGRE Media Group, Spain

2. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

3. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

4. Semantic Integration and Retrieval of Multimedia Metadata Introduction Press and Media companies getting digital and Web Segre: newspaper, radio, television and web portal. Multiple kinds of media text, photo, video,… Heterogeneous sources agencies, journalists, partners, institutions,… Heterogeneity: difficult to integrate and manage.

5. Semantic Integration and Retrieval of Multimedia Metadata Introduction Related standards: International Press NewsCodes, subjects reference system, taxonomy NITF, news documents structure NewsML, model news as multimedia packages Multimedia MPEG-7, descriptive multimedia metadata TV-Anytime, multimedia taxonomies Common aspect: non formal semantics, XML-based

6. Semantic Integration and Retrieval of Multimedia Metadata Introduction Journalists News Agencies Legacy News+Media Receiver News+Photos Custom XML NITF, NewsCodes, NewsML,… Archivist User

7. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

8. Semantic Integration and Retrieval of Multimedia Metadata Proposal Semantic Metadata and Ontology facilitate management and integration. Related previous work: ELIN (Electronic Newspaper Initiative) NEPTUNO (Semantic Web Technologies for Digital Newspaper) NewMARS (Multimedia Advanced Redistribution Surveillance)

9. Semantic Integration and Retrieval of Multimedia Metadata Proposal Journalists News Agencies Legacy Receiver Semantic Repository User

10. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

11. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework NewsML, NITF, NewsCodes, MPEG-7, TVAnytime XML Semantic Web XML Semantics Reuse Methodology. ReDeFer implementation XSD2OWL: schema to ontology. XML2RDF: XML instance data to RDF instances. CS2OWL: classification scheme to ontology

12. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework ReDeFer XSD2OWL Mappings: owl:intersectionOf owl:unionOf sequence choice owl:maxCardinality owl:minCardinality @maxOccurs @minOccurs rdfs:subClassOfextension@base|restriction@base owl:RestrictioncomplexType//element owl:ClasscomplexType|group|attributeGroup rdfs:rangeelement@type rdfs:subPropertyOfelement@substitutionGroup rdf:Property owl:DatatypeProperty owl:ObjectProperty element|attribute OWLXML Schema

13. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework NewsCodes Subjects Ontology Subjects taxonomy NITF 3.3 Ontology Structure concepts (paragraph, subheadline,…) Metadata properties (copyright, authorship, issue date,…) NewsML 1.2 Ontology News multimedia structure (envelope, component, item,…) MPEG-7 Ontology Complete ontology (2372 classes and 975 properties) TVAnytime Ontologies Content and Format CSs

14. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: MPEG-7 Validation, compare to other MPEG-7 Ontologies: Hunter02: not complete, RDF+DAML. Tsinaraki04: not complete, semantic part of MDS. Troncy03: not complete, from an ontology to MPEG-7.

15. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: MPEG-7 Hunter02MPEG-7 Ontology

16. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: MPEG-7 MPEG-7 Ontology

17. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: MPEG-7 Tsinaraki04 MPEG-7 Ontology Class (AudioType partial restriction(Audio cardinality(1)) MultimediaContentType) Class (AudioType partial restriction(Audio cardinality(1)) restriction(Audio allValuesFrom(AudioSegmentType))) MultimediaContentType)

18. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: Instances ReDeFer XML2RDF: XML tree RDF graph. Deduce blank node types from XSD2OWL ontologies restrictions.

19. Semantic Integration and Retrieval of Multimedia Metadata Ontological Framework: Instances XML2RDF example

20. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

21. Semantic Integration and Retrieval of Multimedia Metadata Integration Framework Load Ontological Framework

22. Semantic Integration and Retrieval of Multimedia Metadata Integration Framework NITF packaged in NewsML container IPTCs NITF-to-NewsML Metadata Mapping Stylesheet …

23. Semantic Integration and Retrieval of Multimedia Metadata Integration Framework NewsML multimedia items context and content-based MPEG-7 metadata XML2RDF: RDF for NewsML-NITF instances Bridge subjects to NewsCodes ontology RDF for MPEG-7 metadata

24. Semantic Integration and Retrieval of Multimedia Metadata Integration Framework

25. Semantic Integration and Retrieval of Multimedia Metadata Integration Framework

26. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

27. Semantic Integration and Retrieval of Multimedia Metadata Conclusions

28. Semantic Integration and Retrieval of Multimedia Metadata Conclusions Press and Media domain: heterogeneous and metadata intensive Semantic Web and Ontology facilitate management and integration Existing work NewsML, NITF, NewsCodes, MPEG-7, TVAnytime,…

29. Semantic Integration and Retrieval of Multimedia Metadata Conclusions XSD2OWL: take profit from XML Schema hidden semantics We formalise them when building ontologies, but also implicitly when we make XML Schemas. XML2RDF: reuse existing XML metadata to add momentum to the Semantic Web

30. Semantic Integration and Retrieval of Multimedia Metadata Contents Introduction Proposal Ontological framework Integration framework Conclusions Future Work

31. Semantic Integration and Retrieval of Multimedia Metadata Future Work Generate ontology for legacy system XML Map legacy ontology to NewsML-NITF ontologies Integrate automatic and assisted MPEG-7 metadata multimedia annotation Complete the integration framework

32. Semantic Integration and Retrieval of Multimedia Metadata Future Work User Interface: Rhizomik Media MPEG-7, TVAnytime, DC, Copyright Ontology… Rhizomer-based semantic portal Rhizomer

33. Thank you for your attention More at: http://rhizomik.net …/redefer …/semanticnewspaper …/ontologies/mpeg7ontos Contact: roberto@rhizomik.net {fperdrix,rgil}@diei.udl.es