“Sharing and advancing knowledge and experience about standards, technologies and implementations. Sharing and advancing knowledge and experience about standards, technologies and implementations. Next Generation of ISO/IEC Metadata Registries Applicability for Open Ontology Repositories Bruce Bargmeyer University of California/Berkeley Lab May 22, 2008 “Metadata DownUnder” “Metadata DownUnder” : 11th Open Forum on Metadata Registries Sydney, NSW Australia

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Topics ●Use cases for Edition 3 of ●Proposals for Edition 3 ●Related effort: Open Ontology Repository ●Requirements for OOR ●ISO/IEC and and OOR ●Potential Applications for and OOR 2

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 3 Use Case: Combine Data, Metadata & Concept Systems IDDateTempHg A B X NameDatatypeDefinitionUnits IDtext Monitoring Station Identifiernot applicable DatedateDateyy-mm-dd Tempnumber Temperature (to 0.1 degree C)degrees Celcius HgnumberMercury contaminationmicrograms per liter Inference Search Query: “find water bodies downstream from Fletcher Creek where chemical contamination was over 10 micrograms per liter between December 2001 and March 2003” Data: Metadata: BiologicalRadioactive Contamination leadcadmium mercury Chemical Concept system:

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 4 Use Case: Find and process non-explicit data Analgesic Agent Non-Narcotic Analgesic AcetominophenNonsteroidal Antiinflammatory Drug Analgesic and Antipyretic Datril Anacin-3Tylenol For example… Patient data on drugs contains brand names (e.g. Tylenol, Anacin-3, Datril,…); However, want to study patients taking analgesic agents

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 5 Use Case: Specify and compute across Relations, e.g., within a food web in an Arctic ecosystem An organism is connected to another organism for which it is a source of food energy and material by an arrow representing the direction of biomass transfer. Source: (from SPIRE)

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 6 Use case: Use data from systems that record the same facts with different terms ●Reduce the human toil of drawing information together and performing analysis -> shift to computer processing.

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 7 Use Case: Use data from systems that record the same facts with different terms Common Content OASIS/ebXML Registries Common Content ISO Registries Common Content Ontological Registries Common Content CASE Tool Repositories Common Content UDDI Registries Country Identifier Data Element XML Tag Term Hierarchy Attribute Business Specification Table Column Software Component Registries Common Content Database Catalogs Business Object Dublin Core Registries Common Content Coverage

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 8 Data Elements DZ BE CN DK EG FR... ZW ISO 3166 English Name ISO Numeric Code ISO Alpha Code Algeria Belgium China Denmark Egypt France... Zimbabwe Name: Context: Definition: Unique ID: 4572 Value Domain: Maintenance Org. Steward: Classification: Registration Authority: Others ISO 3166 French Name L`Algérie Belgique Chine Danemark Egypte La France... Zimbabwe DZA BEL CHN DNK EGY FRA... ZWE ISO Alpha Code Same Fact, Different Terms Algeria Belgium China Denmark Egypt France... Zimbabwe Name: Country Identifiers Context: Definition: Unique ID: 5769 Conceptual Domain: Maintenance Org.: Steward: Classification: Registration Authority: Others Data Element Concept

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Use Case: Draw information together from a broad range of studies, databases, reports, etc. 9

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 10 Use Case: Gain Common Understanding of meaning between Data Creators and Data Users Users Information systemsData Creation Users EEA USGS DoD EPA environ agriculture climate human health industry tourism soil water air textdata environ agriculture climate human health industry tourism soil water air text ambiente agricultura tiempo salud hunano industria turismo tierra agua aero textdata environ agriculture climate human health industry tourism soil water air textdata Others... ambiente agricultura tiempo salud huno industria turismo tierra agua aero textdata A common interpretation of what the data represents

11 Concept System Store Metadata Registry Concept System Thesaurus Themes Data Standards Ontology GEMET Structured Metadata Users Concept systems: Keywords Controlled Vocabularies Thesauri Taxonomies Ontologies Axiomatized Ontologies (Essentially graphs: node-relation-node + axioms) }

12 Management of Concept Systems Metadata Registry Concept System Thesaurus Themes Data Standards Ontology GEMET Structured Metadata Users Concept system: Registration Harmonization Standardization Acceptance (vetting) Mapping (correspondences) }

13 Life Cycle Management Metadata Registry Concept System Thesaurus Themes Data Standards Ontology GEMET Structured Metadata Users Life cycle management: Data and Concept systems (ontologies) }

14 Grounding Semantics Metadata Registry Concept System Thesaurus Themes Data Standards Ontology GEMET Structured Metadata Users Registries Semantic Web RDF Triples Subject (node URI) Verb (relation URI) Object (node URI) Ontologies

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Proposals for ISO/IEC Edition 3 ●Work underway since Edition 2 was published about 5 years ago. ●Revisions proposed for UML model in Part 3 ●UML model is also translated to an OWL ontology ●Proposals discussed in WG 2 and National Body SDOs. ●Proposals posted to Bugzilla at: issues.metadata- standards.org ●Some proposals initiated by the eXtended Metadata Registry (XMDR) project. ●See XMDR.org Wiki for current proposed UML model and ontology 15

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Progress on Edition 3 ●Committee Draft was balloted for ISO/IEC Part 3, hundreds of comments were received. All comments were resolved at December 2007, Korea meeting of WG2. However many detailed model changes and new text are required. ●Work is underway to revise text and model to prepare Committee Draft 2 of ISO/IEC Part 3. ●Ray Gates from Canada is the Editor for Part 3, Kevin Keck from USA developed many of the proposed changes and maintains the model. 16

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Progress on Edition 3 ●XMDR project built a prototype to test and validate proposals for Edition 3. ●Live prototype is at xmdr.org ●Prototype is loaded with content representing Edition 2 (for backward compatibility) and new types of content envisioned for Edition 3: concept systems including ontologies. 17

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Modular XMDR Archtitecture Registry Store Search & Content Serving (Jena, Lucene) XMDR metamodel (OWL & xml schema) standard XMDR files Logic Index Content Loading & Transformation (Lexgrid & custom) Human User Interface (HTML fromJSP and javascript; Exhibit) Metadata Sources concept systems, data elements USERS Web Browsers…..Client Software Application Program Interface (REST) Authentication Service Validation (XML Schema) Mapping Engine Logic Indexer (Jena & Pellet) Text Indexer (Lucene) Metamodel specs (UML & Editing) (Poseidon, Protege) XMDR data model & exchange format XML, RDF, OWL Text Index Postgres Database Third Party Software

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Related Effort Open Ontology Repository ●You are invited to participate 19

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Ontology Summit ●NIST, NSF, MITRE, National Center for Ontological Research (NCOR), and others organized an Ontology Summit meeting held in April (The third in a series.) ●The theme of the 2008 Ontology Summit was the vision for an Open Ontology Repository. This vision forms a base for the international Open Ontology Repository community. ●This year's summit supported development of such a repository (or set of repositories) by serving as a venue - both virtual and face-to-face - in which many of the issues relating to the design, implementation, and ongoing use of an ontology repository were discussed and a communiqué was issues. ●This was the third in a series of Ontology Summit meetings 20

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Two Thrusts ●The theoretical aspects are discussed in Ontology-Summit Forum –See: bin/wiki.pl?OntologySummit2008 ●The practical aspects of building an Open Ontology Repository are pursued in the OOR- Forum. –See: bin/wiki.pl?OpenOntologyRepository 21

“Sharing and advancing knowledge and experience about standards, technologies and implementations. OOR Charter ●Promote the global use and sharing of ontologies by: ●Establishing a hosted registry-repository ●Enabling and facilitating open, federated, collaborative ontology repositories; ●Establishing best practices for expressing interoperable ontology and taxonomy work in registry-repositories. 22

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Key Issues ●OpenOntologyRepository_Scope - documentation related to this OOR initiative's mission, charter, objectives, goals, terms of reference, definitions, scope,... etc. ●OpenOntologyRepository_Requirement - documentation related to the requirements of the "open ontology repository" to be implemented through the OOR initiative. ●OpenOntologyRepository_UseCases ●OpenOntologyRepository_Approach - documentation related to this OOR initiative's approach, and the process to use. ●OpenOntologyRepository_Architecture - documentation related to the architecture of the "open ontology repository" to be implemented through the OOR initiative. ●OpenOntologyRepository_Plan - documentation related to the OOR initiative's deliverables, timeline, milestones & deadlines, project plans, etc. 23

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Scope ●An ontology repository is a facility where ontologies and related information artifacts can be stored, retrieved and managed. 24

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Message from Leo Obrst (MITRE) “I'd advise folks to look over xmdr.org (eXtended Metadata Registry) before they re-invent 95% of the wheels, including definitions, architecture, requirements, use cases, etc. Although XMDR, like the ISO “11179 Metadata Registry standard, is concerned with more than an ontology registry/repository, their notions are extremely salient to our effort. And no, I am not involved in XMDR, and am only interested in seeing that good work is recognized, and possible duplication of effort is avoided.” 25

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL * ●Provide Capability to Submit an Ontology to the Repository –Extract administrative and descriptive data from the metadata fields of an OWL ontology Metadata should follow existing metadata standards Submitted items should be tracked with version numbers (after determining the levels of granularity needed for versioning) Generate a meta-card entry for the ontology ●Provide Centralized Data Storage. –Ontology metadata (ontology metadata includes the source, date, version number and other core metadata as defined by appropriate standards bodies) –OWL ontology –RDF store –Linkage to XML and database data and documents ●Metrics and Logging Requirements. –Provide data access and storage metrics. –Provide audit logs of repository activity * Functional requirements proposed by LeoObrst on

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (2) ●Provide User Services via a Web Interface to –Search metadata indices –Link from the metadata index to the specific OWL or RDF storage location –Browse repository contents –Provide visual representation of ontologies –Search RDF instance stores with ontology-assistance –Specify agent-directed searches of instance store content ●Machine User Services –Query repository and triples store using a conceptual query language, such as SPARQL –Query the repository and triples store using REST –Query the repository and triples store using SOAP –Use an API to programmatically create, view, and modify repository contents –Define machine services in appropriate machine-interpretable format, such as OWL-S 27

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (3) ●Provide a Repository of Downloadable Web Tools –Define a process with criteria for determining what kinds of tools to make available –Provide an index to available tools –Provide search capability to available tools ●Validation Requirements –Validate an OWL ontology to ensure that it is valid OWL –Confirm the RDF against its terminology defined in RDFS 28

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (4) ●OWL Services –Browsing Services –Query Services –Indexing Services Provides services for external search engines and entity extractors to index and mine repository contents –Visualization Services –Edit Services –Validation Services –Annotation Services –Web-Page Markup –Semantic Search Services –Crawl and Index 29

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (5) ●Reasoning Services –Provide services to check ontology consistency, build classification, verify concepts’ satisfiability and check entailment –Provide services to support rules and execute minimally automated deductive reasoning and proof ●Import Services –Support importing of modular ontologies into larger ontologies; this is at least partially a function of the knowledge representation language itself. 30

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (6) ●Semantic Mapping Services –Schema Translation Automatically generate translation code between database schemas with an OWL mapping specification –Visually-aided Mapping A user would generate a mapping between an existing ontology and the ontology expected by the custom visualization tool. The data would then be translated according to the mappings. The resulting data can then be viewed by the custom visualization tool –Disambiguation A user would generate a mapping between multiple ontologies to identify where classes and properties are the same. The data from multiple sources could then be imported into a repository where a reasoning tool can determine what objects are the same. The results could then be viewed in a browser 31

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Functional Requirements of a Repository for RDF/OWL (7) ●Ontology and Instance Versioning Services –Provide services to support semantic versioning of ontologies and knowledge bases (instances). ●Terminology to Concept Mapping Services –Provide services to support mapping user terminology to the concepts that represent the meaning of that terminology, using thesauri, lexicons, and other terminological resources. 32

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Metamodels for Basic Ontology Constructs ISO/IEC & and OOR Registration Metamodel Normative Basic Elements ISO/IEC (MMF) Ontologies Common Facility for MDR/MMF Terminology Basic Classes Basic Relationship XMDR Registry Ontology Evolution Content Management Query Service Analysis and Extraction ODM Metamodel f or CL ISO/IEC19502(MOF) Registering ODM Metamodel for OWL ISO/IEC11179 (MDR) From Prof. Hajime Horiuchi

“Sharing and advancing knowledge and experience about standards, technologies and implementations. eXtended Metadata Registry (XMDR) What XMDR Brings to the Table: ●Use cases and Requirements ●Potential design specifications –Proposed specifications for ISO/IEC Edition 3 – A UML Model, definitions, and OWL ontology ●Modular software architecture and open source software modules ●Open Source XMDR software ●Test content – concept systems including thesauri, taxonomies, ontologies ●A group of participants (XMDR project) that has considerable experience in this area. See: XMDR.org 34

“Sharing and advancing knowledge and experience about standards, technologies and implementations. GEO/GEOSS/GMES ●The work addresses information challenges identified by major initiatives including the Intergovernmental Group on Earth Observations (GEO), Global Earth Observation System of Systems (GEOSS), and Global Monitoring for Environment and Security (GMES). The techniques and technologies developed will be useful for GEO/GEOSS/GMES. In particular, this work addresses priority challenges identified by the GEOSS Architecture & Data Management (ADM) committee to “enable increased interoperability across existing data management systems: –Identify & address integration gaps in data management systems –Utilize community standards for data & metadata –Enable integrated measurements, data, products & predictive models –Examine the need for future data management requirements.” –Architecture & Data Management (ADM) Working Group Report February 22, See: 35

“Sharing and advancing knowledge and experience about standards, technologies and implementations. GEOSS Architecture ●The OOR effort presents an opportunity to – move the XMDR results from R&D & Standards toward provision of key infrastructure for GEOSS & GMES –Demonstrate the utility of ISO/IEC and ISO/IEC ●As the OOR group proceeds, we can convey the OOR developments to GEO/GEOSS/GMES, particularly the GEOSS ADM for inclusion in the registry portion of the GEOSS architecture. 36

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Next Steps ●Presentations to OOR participants about ISO/IEC 11179, ISO/IEC and XMDR ●Interaction with the OOR effort ●Extend the OOR and XMDR efforts to propose use by GEOSS ADM and GMES ●Demonstrate XMDR in Ecoinformatics Test Bed ●For GEOSS, do the work necessary to register the components (GEMET, XMDR) and register the services 37

“Sharing and advancing knowledge and experience about standards, technologies and implementations. Acknowledgements ●Hajime Horiuchi, Tokyo International University ●Kevin Keck, LBNL ●John McCarthy LBNL ●Leo Obrst, MITRE ●Harold Solbrig, Apelon ●Peter Yim, CIM Engineering, Inc. This material is based upon work supported by the National Science Foundation under Grant No , and USEPA. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation, USEPA or USDOD. 38

“Sharing and advancing knowledge and experience about standards, technologies and implementations. 39