Unified Metadata Model- WIGOS/CGMS Mapping

Slides:



Advertisements
Similar presentations
THE DONOR PROJECT Titia van der Werf-Davelaar. Project Financed by: Innovation of Scientific Information Provision (IWI) Duration: –phase 1: 1 may 1998.
Advertisements

Foundational Objects. Areas of coverage Technical objects Foundational objects Lessons learned from review of Use Case content Simple Study Simple Questionnaire.
Interoperability Principles in the Global Earth Observations System of Systems (GEOSS) Presented 13 March 2006 at eGY in Boulder, CO by: Eliot Christian,
EOSDIS Common Metadata Repository (CMR) Unified Metadata Model for Collections (UMM-C) Meeting June 12, 2014.
Overview of key concepts and features
TC3 Meeting in Montreal (Montreal/Secretariat)6 page 1 of 10 Structure and purpose of IEC ISO - IEC Specifications for Document Management.
1 ISO – Metadata Next Generation International consensus being built on structured metadata within a broader Geomatics Standard under ISO Technical.
1 Objective of today’s lesson S oftware engineering occurs as a consequence of a process called system engineering. Instead of concentrating solely on.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
ISO Standards: Status, Tools, Implementations, and Training Standards/David Danko.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Data Exchange Tools (DExT) DExT PROJECTAN OPEN EXCHANGE FORMAT FOR DATA enables long-term preservation and re-use of metadata,
Teaching Metadata and Networked Information Organization & Retrieval The UNT SLIS Experience William E. Moen School of Library and Information Sciences.
Advertising your data: Using data portals and metadata registries Nancy Hoebelheinrich Knowledge Motifs LLC Version 1.0 [Reviewed August 2012]
1 Introduction to Modeling Languages Striving for Engineering Precision in Information Systems Jim Carpenter Bureau of Labor Statistics, and President,
Statistics New Zealand Classification Management System Andrew Hancock Statistics New Zealand Prepared for 2013 Meeting of the UN Expert Group on International.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
® GRDC Hydrologic Metadata - core concepts - 5 th, WMO/OGC Hydrology DWG New York, CCNY, August 11 – 15, 2014 Irina Dornblut, GRDC of WMO at BfG Copyright.
Metadata Implementation Ted Habermann NOAA National Geophysical Data Center Documentation: It’s not just discovery... 50% change in global average Why?
Producer Questions 6 December Producer Questions 2 Purpose The SIP standard envisions the development of a formal model of the data for.
Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
WGISS-40: IDN Report Michael Morahan WGISS-40 Fall meeting / Harwell, United Kingdom
National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.
NASA Perspectives on Data Quality July Overall Goal To answer the common user question, “Which product is better for me?”
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Introduction Module 1: Introduction & Overview of the FGDC CSDGM.
Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.
Creating Good Documentation NOAA National Geophysical Data Center
Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.
LPDAAC/USGS_EROS CMR Metadata Reconciliation Meeting March 4-5, 2015.
NSIDC CMR Metadata Reconciliation Meeting December 10-11, 2014.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
DM_PPT_NP_v01 Configuration Management of UMM Models January 2016.
Introduction to Metadata March 2016 What is Metadata?
IPDA Architecture Project International Planetary Data Alliance IPDA Architecture Project Report.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
Geospatial metadata Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
NASA Earth Science Data Stewardship
Advertising your data: Using data portals and metadata registries
Michael Morahan CEOS WGISS-43 Meeting
Physical Data Model – step-by-step instructions and template
WGISS Connected Data Assets
WHAT DOES THE FUTURE HOLD? Ann Ellis Dec. 18, 2000
Applicability of WIGOS for EUMETSAT Satellite Earth Observations
Active Data Management in Space 20m DG
GeoJSON(-LD) Encoding of Granule Metadata
Christian Ansorge Arona, 09/04/2014
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
Data Management: Documentation & Metadata
Earth Data Search Tool Demo
2. An overview of SDMX (What is SDMX? Part I)
Relation between WIS and WIGOS metadata
Session 2: Metadata and Catalogues
Metadata in Digital Preservation: Setting the Scene
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
Overview of Oracle Site Hub
Open Archival Information System
Metadata The metadata contains
ESIP Winter Meeting 2016 January 2016
Proposal of a Geographic Metadata Profile for WISE
Robert Dattore and Steven Worley
COMPONENT – BASED SOFTWARE ENGINEERING MODULE 2 – SECOND SEMESTER MKHIZE, BSC HONS COMPUTER SCIENCES, DIP IT, ICDL.
Introduction to reference metadata and quality reporting
Palestinian Central Bureau of Statistics
Presentation transcript:

Unified Metadata Model- WIGOS/CGMS Mapping Sept 21st, 2016 The material is based upon work supported by the National Aeronautics and Space Administration under Contract Number NNG15HZ39C

Agenda Introduction to CMR Unified Metadata Model Comparison of Unified Metadata Model with WIGOS and CGMS UML Data Models Detailed Analysis of mappings: WIGOS->UMM and CGMS->UMM Discussion of similarities/differences

Unified Metadata Model (UMM) What is the purpose for the Unified Metadata Model (UMM)? The UMM provides a common metadata model to unify legacy systems (i.e. GCMD, ECHO) with new systems (i.e. CMR). How does the UMM support Interoperability? In the context of the CMR, the UMM enables legacy systems to interoperate to enable continued support to user groups who depend on these systems. In the future, UMM will support a wider range of systems, and has been enhanced to support better interoperability. Systems interoperate in a variety of ways: data governance, data exchange, data discovery, data archiving/storage. The UMM is subdivided into several sub-models: UMM-Collection UMM-Granule UMM-Variable UMM-Services UMM-Visualization The UMM supports interoperability of legacy systems, and additionally supports interoperability of other national and international systems. It contains metadata representing several key entities associated with EOS data: Collection, Granules, Variables, Services, Visualization

Unified Metadata Model

WIGOS Metadata Model

Comparison of Unified Metadata Model with WIGOS UML Data Model High-level comparison METADATA INFORMATION MetadataDate not present. DATA IDENTIFICATION (UMM-C->ShortName is at the collection level. WIGOS->observer_variable/measureand appears to be at the variable level - clarification sought). MEASUREMENT/VARIABLE UMM-Var/Variable/Name maps to observed_variable/measurand. UMM-C/Description maps to WIGOS->purpose_of_observation. UMM-C does not have a mapping for WIGOS->environment. DESCRIPTIVE KEYWORDS DISTRIBUTION INFORMATION TEMPORAL INFORMATION UMM-C->Temporal Extent maps to temporal_extent, however we are not clear as to what level of detail there is in the definition of the WIGOS fields and whether it allows for PrecisionOfSeconds, and PeriodicDateTimes to be defined. SPATIAL INFORMATION UMM-C->SpatialExtent maps to spatial_extent however we are not clear as to what level of detail there is in the definition of the WIGOS fields in terms of definition of horizontal extents including: bounding box, polygons, also vertical extents. ACQUISITION INFORMATION UMM-C->Platform maps reasonable well to WIGOS->Station/Platform.

Clarification of mappings: WIGOS->UMM QUESTIONS It appears that the WIGOS Metadata Model is centered on the observed variable. Is there a concept of data set, or collection level in this model? For example, how are observed variables grouped over the timeline of a campaign? Are there a set of files available for a specific variable, e.g. ozone, or CO2, etc.? Are they all considered to be of the same ”standard” file structure, or do data sets of the same observed variable become versioned over time, perhaps with different file structures? How would the observed variable (files) be organized in the archive? How are the observed variables named? Are the names full-length science names, e.g. carbon_dioxide_concentration or abbreviated names, e.g. CO2_conc.? Has the distribution of the data sets of the observed variables been considered? It is important to checksum the files, and hold details of the files, e.g. size, units, checksum values, in the metadata? For the purposes of improving interoperability with other systems, has the ISO Metadata standard been considered, in terms of mapping to an ISO 19115 metadata model? How would the archive be searched? What use cases are expected for searching for observed variable data? What keywords are expected to match the fields in the metadata model, and which fields are expected to be the target of these searches?

CGMS Metadata Model

Comparison of Unified Metadata Model with CGMS UML Data Model High-level comparison METADATA INFORMATION MetadataDate not present. DATA IDENTIFICATION (UMM-C->ShortName is at the collection level. CGMS->Product_Information/Product_Name/ appears to be at the collection level – clarification sought). MEASUREMENT/VARIABLE UMM-Var/Variable/Name does not map to anything in the CGMS model. UMM-C/Description maps to CGMS->Product_Information/Product_Description. DESCRIPTIVE KEYWORDS CGMS->Product Access Guide Domains shows a hierarchy of various science keyword categories. Potentially these map to UMM-C->ScienceKeywords. (Need clarification on how these keywords are stored in the CGMS metadata, or target fields in the metadata, if employed during a search). DISTRIBUTION INFORMATION UMM-C->Distribution maps to Product_Distribution fields. TEMPORAL INFORMATION UMM-C->Temporal Extent maps to Temporal_Extent, however we are not clear as to what level of detail there is in the definition of the CGMS fields and whether it allows for PrecisionOfSeconds, and PeriodicDateTimes to be defined. SPATIAL INFORMATION UMM-C->SpatialExtent maps to SpatialCoverage however we are not clear as to what level of detail there is in the definition of the CGMS fields in terms of definition of horizontal extents including: bounding box, polygons, also vertical extents. ACQUISITION INFORMATION UMM-C->Platform maps well to CGMS->Spacecraft_Information.

Clarification of mappings: CGMS->UMM QUESTIONS What is the level of granularity of the Product_Information? Is it at the observation level, i.e. collection, granule or variable level? How is the information grouped over time? How is the data structured in the files? Does the concept of variables exist in the model? How do measurements/variables become part of the product? Has the method of observation been considered in the metadata model? How is the procedure for sampling/capturing the product preserved for future reference? Could this change over the course of time of a campaign? How can this method be associated with the data products? Does this have a bearing on the data quality? Are there levels of processing in the production of the data product? Is there a standard algorithm or code base used in the production of the data product? How can this become versioned along with the product? On the topic of Product Access Guide Domains, we have noted the use of various science keyword categories. How are these categories mapped to the observed data product in the metadata? How would the archive be searched? What use cases are expected for searching for observed variable data? Which fields are expected to be the target of these searches? Where is there more detail on the function of the Realtime Access, Offline Access, and View Access classes and how these are functionally differentiated in the archive system? For both WIGOS and CGMS: What overlap exists between the WIGOS and CGMS metadata models? How are the two models meant to operate together in a larger archive? For example, are there any metadata relationships between, say the Product_Information in the CGMS and the observed variables in the WIGOS? How are these relationships documented, and furthermore, how are these implemented in the catalog? Besides the WIGOS and CGMS metadata models which are described fully in the published documents, is there any other documentation which helps detail any interoperability considerations between the two systems? For example, are the any studies which map the two metadata models to, say ISO 19115? Are there any other elements of the metadata models, which perhaps are surfaced in the search tools, or data gateways, which we can gain further insights to help in making the WIGOS and CGMS collections interoperable with the IDN  collections?

Discussion of similarities/differences Spatial Information Temporal Information Acquisition Information Differences Variable level information in WIGOS Product level information in CGMS (potentially at Collection level – clarification sought) Next Steps: Hold discussions between teams representing each model to resolve outstanding issues and determine whether any changes are necessary to the models to promote interoperability between the systems.

This material is based upon work supported by the National Aeronautics and Space Administration under Contract Number NNG15HZ39C.