BRER Project COMÈTE, an RDF-based Architecture for a Learning Objects Management System GLOBE Conference - February 8, 2012 Paloma: eduSource, RÉA-UQ, eduRafael, LORNET- TELOS, Q4R, IDLD Eurêka : APOP, CCDMD, DECclic, ORI-OAI Universités numériques thématiques: UNIT, UVED, UMVF, AUNEGE Université partenaires: Rennes, Valenciennes, PolyToulouse, INSA-Lyon Intrnational collaboration GLOBE, ISO-MLR IMS-LD, IMS-LODE (ILOX), EUN

BRER Project Objectives 1. Network francophone LR repository operators to provide collaboration for harvesting francophone LR repositories. 2. Provide tools to resource providers and distributors to increase a critical mass of learning resources (LR). 3. Build a semantic software infrastructure (COMÈTE) from previous systems (Paloma, Eureka, ORI-OAI). 4. Build methodological tools and strategy based on the Quality for Reuse project. 5. Sustain and maintain Quebec/Canadian expertise in the area of LR repositories.

Unfortunately….. New standards: MLR, ILOX, besides DC, LOM,…Harvested repositories managers will not agree on a common standard and/or profile (e.g. Eureka and ORI-OAI) New standards: MLR, ILOX, besides DC, LOM,…Harvested repositories managers will not agree on a common standard and/or profile (e.g. Eureka and ORI-OAI) Metadata will never be 100% syntaxically valid for a given standard or profile Metadata will never be 100% syntaxically valid for a given standard or profile Correct and Systematic Use of Controlled Vocabulary is not widespread Correct and Systematic Use of Controlled Vocabulary is not widespread Most search is through keywords unkown to most users or providing unfocused results Most search is through keywords unkown to most users or providing unfocused results Tools are not semantically aware, based on disconnected metadata (unaware of the “Linked Data” paradigm) Tools are not semantically aware, based on disconnected metadata (unaware of the “Linked Data” paradigm)

Comète’s Proposal Storage of original and modified MD records in a RDF store (Fedora) for OAI-PMH harvesting Storage of original and modified MD records in a RDF store (Fedora) for OAI-PMH harvesting COMÈTE Meta model above various MD formats COMÈTE Meta model above various MD formats –Conversion of LOM, Dublin Core, ILOX, MLR => Meta model –Meta model conversion => HTML –Representation of identities by references Integration of ORI-OAI Metadata Editor (open format) Integration of ORI-OAI Metadata Editor (open format) VCard conversion => vCard-RDF VCard conversion => vCard-RDF Basic search in the RDF Store (sparql requests) Basic search in the RDF Store (sparql requests) Generate Query Engine results in Atom Generate Query Engine results in Atom

COMETE Meta model From a conceptual point of view: From a conceptual point of view: Semantic network of relevant common entities which play a role in the system’s dynamic From a technical point of view: From a technical point of view: All RDF relations obtained through conversion, additions, and the system’s data processing while or after harvesting

RDF Triples data base in+the+Resource+Index in+the+Resource+Index 30,000 resources, 6,000 authors, 500 organizations: > 1 M triples

Actueal Architecture

Actual Architecture

Comète’s Core Module Single entry point to Fedora services Creating / manipulating digital objects Creating / manipulating digital objects Creating / manipulating datastreams Creating / manipulating datastreams Creating / manipulating RDF relations Creating / manipulating RDF relations + API on these elements (SPARQL requests…) + API on these elements (SPARQL requests…) Fedora Digital Object

Data Transformer Module Uniform API for transforming, converting and extracting data Produces html for sheets, identities (person, organization), from the metamodel (XSL transformation) Produces html for sheets, identities (person, organization), from the metamodel (XSL transformation) GET /{recordId}/html

Query Engine Module Core API to expose data to other system parts Full text search Full text search GET /searchJson/?q=…&start=…&limit=… Feed Atom Feed Atom GET /searchAtom/?q=…&start=…&limit=… Facet, resources from a same author Facet, resources from a same author GET /advancedSearchJson/?id=…&start=…&limit=…

Identity Module Management of identities in order to maintain their coherence and avoid duplication Processing vCards and open text Processing vCards and open text Research (lookup) Research (lookup) Heuristics for unicity Heuristics for unicity Incremental build when fusions Incremental build when fusions Pre-processing on vCards Pre-processing on vCards POST /identities/ GET /isEquivalentIdentities/?id1=…&id2=… POST /mergeIdentities/?id1=…&id2=… DELETE /identities/{id}

Next development stages Short term Identity Editor (creation, fusion…) Identity Editor (creation, fusion…) Representation of vocabularies by reference Representation of vocabularies by reference Improving full-text search (indexing) Improving full-text search (indexing) Search by vocabulary Search by vocabulary Hierarchical navigation Hierarchical navigation Long term Systematic validation during data harvest and export Workflow Systematic validation during data harvest and export Workflow Search by relevance Search by relevance Exploitation of vocabulary equivalents Exploitation of vocabulary equivalents Repository exposition for harvesting Repository exposition for harvesting

Advantages of the approach Modular architecture (real); REST service approach Modular architecture (real); REST service approach Metamodel independent from metadata formats Metamodel independent from metadata formats Interoperability with LOM, Dublin Core, ILOX, MLR and profiles Interoperability with LOM, Dublin Core, ILOX, MLR and profiles Semantic network (RDF database) for more intelligent search Semantic network (RDF database) for more intelligent search

Questions/Comments ? BRER Team Co-Direction : Gilbert Paquette & Pierre-Julien Guay Coordination : Monique Charpentier Architecture & Development Team : Benoit Grégoire, Alexis Miara, Frédéric Bergeron Functional Team : Andrée Beaudin-Lecours, Monique Charpentier, Consultant: Marc-Antoine Parent (GTN-Q) Yohan Colmant (ORI-OAI - France) GLOBE Conference - February xx 2012