GLOBAL BIODIVERSITY INFORMATION FACILITY Éamonn Ó Tuama Senior Programme Officer, IDA 21 June Metadata publishing with the IPT

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

”Data Intensive Science” ”Fourth Science Paradigm” e-Infrastructure Reflection Group (European Strategy Forum on Research Infrastructures). Report on Data Management, November ”Digital Data Deluge” The Fourth Paradigm: Data-Intensive Scientific Discovery high quality metadata for long term curation and use of datasets Key requirement : Why metadata?

William K. Michener, Meta-information concepts for ecological data management, Ecological Informatics, Volume 1, Issue 1, January 2006, Pages 3-7, ISSN , DOI: /j.ecoinf ( 4HJRS57-3/2/ea2e08412c f540e c0) Information about datasets deteriorates over time!

Why metadata? Metadata supports: - Discovery - Interpretation/Evaluation - Provenance - Quality - Fitness-for-use - Analytical re-use

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

Metadata Standards Ecological Metadata Language (EML) v

Metadata Standards Dublin Core

Metadata Standards Directory Interchange Format (DIF)

Metadata Standards ISO 19115/19139 Geographic Metadata ISO 19115: ISO 19139:

Metadata Standards Natural Collections Descriptions (NCD)

Metadata Standards Federal Geographic Data Committee (FGDC) Biological Profile An extension of the FGDC CSDGM (Content Standard for Digital Geospatial Metadata) * *

Metadata Standards Multimedia Resources Metadata Schema

NAP ISO Attributes describing the metadata Components to describe the resource Source: napMetadataProfileV101.pdf/view

ISO 19115/19139 North American Profile of ISO Several Resources available for crosswalk; transform; view EML to FGDC Biological Profile # FGDC CSDGM to ISO Transform # FGDC CSDGM to ISO Crosswalk # ISO XML to HTML View: # FGDC BIO to ISO Transform # FGDC BIO to ISO Crosswalk FGDC CSDGM ISO EML to ISO Open source INSPIRE-compliant MD editor (multilingual functionality)

Metadata and Languages A Multilingual Metadata Catalog for the ILTER: Issues and Approaches. Vanderbilt, K.L., et al., Ecological Informatics, Volume 5, Issue 3, May 2010, Pages , doi: /j.ecoinf Adopt a lingua franca, e.g., English -data publishers provide discovery level metadata in English; -full metadata in local language. - Just use local language with keywords from multilingual thesauri, e.g. GEMET, the GEneral Multilingual Environmental Thesaurus; 27 languages. AGROVOC; agriculture, forestry, fisheries, food and related domains e.g., environment; 20 languages. Long term solution: multilingual ontologies - Issues? – additional burden; tools, metadata standards

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

GBIF EML Profile - Requirements gathering -GBIF Metadata Task Group -EML; ISO 19115; NCD; INSPIRE Directive GBIF EML schema - GBIF community site: metadata network - GBIF profile documentation

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

Preparing metadata - Metadata editors e.g., IPT; Spreadsheet template; Morpho; EUOSME - Scripting -Output directly from existing metadata database - transform from another metadata specification to EML - Editing XML directly -Validation essential

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

Where does the metadata go?

Sources of Metadata GBIF Data Cache - Registered IPT installations - National/regional/organisation level catalogues - Thematic catalogues, e.g., OBIS Our approach: -no imposed metadata standard or preferred catalogue implementation for participants; -avoidance of lossy conversions in submitting metadata GBIF Participants External networks e.g., Knowledge Network for Biocomplexity (KNB)

GBIF metadata architecture GBIF Catalogue GBIF Registry EuroGEOSS Catalogue e.g., GBIF Node IPT Instance Catalogue e.g.,KNB GBIF Data Cache OAI-PMH Direct payload GBIF metadata catalogue specification:

OAI-PMH l Open Archives Initiative Protocol for Metadata Harvesting l Providing a low-barrier mechanism for interoperability across distributed metadata repositories l Data providers expose metadata; Service providers consume metadata through a client application known as a harvester that issues OAI-PMH service requests over HTTP: 1. GetRecord 2. Identify 3. ListIdentifiers 4. ListMetadataFormats 5. ListRecords 6. ListSets 1. return individual record 2. retrieve information about repository 3. retrieve headers of records 4. return metadata formats available 5. return records from repository 6. retrieve set structure (groupings) of repository GBIF: role as harvester and provider

Outline - Why metadata? - The GBIF EML profile - Metadata standards - Preparation of metadata - Where does the metadata go? - Preparing metadata using the IPT

IPT metadata editor - Preparing metadata according to GBIF EML profile - specimens/observations - names (checklists) - other (e.g., ecological data) - derived products (e.g., species distribution maps) - Data set level metadata - Output as part of DwC-A zip file (EML.xml) - Metadata for published and unpublished data sets

How to contact GBIF: Web site: Data portal: data.gbif.org GBIF Secretariat Universitetsparken Copenhagen Denmark Phone: Fax: