Incorporating ISO Metadata Using HDF Product Designer

Slides:

Advertisements

Similar presentations

Adding OAI-ORE Support to Repository Platforms Alexey Maslov, Adam Mikeal, Scott Phillips, John Leggett, Mark McFarland Texas Digital Library TCDL09.

Advertisements

Documenting Data to Support Discovery and Use Dave Neufeld Ted Habermann John Kozimor.

JobTracker™ A Job Tracking System for Architects & Engineers Produced by LA Solutions.

The HDF Group ESIP Summer Meeting Easy access HDF files via Hyrax Kent Yang The HDF Group 1 July 8 – 11, 2014.

Matthew Cechini Raytheon - EED ID: IN31C-07.  ECHO Metadata Overview  Introduction  Problem Space  Solutions ISO Lessons Learned – Perceived.

The HDF Group ESIP Summer Meeting HDF-Java Overview Joel Plutchak The HDF Group 1 July 8 – 11, 2014.

Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF.

Fabian Vilers Hands on ASP.NET MVC.

Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)

Software Cluster Improve Collaboration and Community Engagement Work with diverse communities that contribute to the sustainability of scientific software.

ISO Standards: Status, Tools, Implementations, and Training Standards/David Danko.

1 CF Unleashed: Introduction to Cf/Radial Joe VanAndel National Center for Atmospheric Research 2013/1/8 The National Center for Atmospheric.

OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.

The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.

1Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 8 Reporting from Contract.

EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.

The HDF Group ESIP Summer Meeting HDF OPeNDAP update Kent Yang The HDF Group 1 July 8 – 11, 2014.

Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.

DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.

Python File Handling. In all the programs you have made so far when program is closed all the data is lost, but what if you want to keep the data to use.

Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.

UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?

The netCDF-4 data model and format Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012.

Creating Archive Information Packages for Data Sets: Early Experiments with Digital Library Standards Ruth Duerr, NSIDC MiQun Yang, THG Azhar Sikander,

Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.

Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.

Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.

JPL/Caltech proprietary. Not for public release or redistribution. This document has been reviewed for export control and it does NOT contain controlled.

National Aeronautics and Space Administration Jet Propulsion Laboratory California Institute of Technology Pasadena, California EDGE: The Multi-Metadata.

Retrieving and Transforming ISO Metadata ESIP Summer 2014.

DM_PPT_NP_v01 SESIP_0715_JR HDF Server HDF for the Web John Readey The HDF Group Champaign Illinois USA.

HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.

Vers national spatial data infrastructure training program What is Metadata? Introduction to Metadata An overview of geospatial metadata, presentation.

Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.

DM_PPT_NP_v01 UTC Participant Survey Results Kathleen L Carr October 13, 2015.

Exporting WaterML from the Earth System Modeling Framework Xinqi Wang Louisiana State University NCAR SIParCS Program August 4, 2009.

GeoTIFF – An OGC and NASA Standard John Kozimor, Ted Habermann The HDF Group Earth Science 1.

July 20, Update on the HDF5 standardization effort Elena Pourmal, Mike Folk The HDF Group July 20, 2006 SPG meeting, Palisades, NY.

ARMAP, AOV, ISO Metadata, and RESTful Architectures for Data Sharing and Interoperability IASC/SAON Arctic Data Committee meeting 26 October, 2015.

Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.

Implementing Marine XML for NOAA Observing Data Nazila Merati and Eugene Burger NOAA/Pacific Marine Environmental Laboratory Seattle, WA.

Copyright © 2007, Oracle. All rights reserved. Using Document Management and Collaboration Appendix B.

Intelligent Data Systems Lab. Department of Computer Science & Engineering Python Installation guide 컴퓨터의 개념 및 실습.

TSDS (HPDE DAP). Objectives (1) develop a standard API for time series-like data, (2) develop a software package, TSDS (Time Series Data Server), that.

ESDIS Standards Office Yonsook Enloe, CTSI 3/2/ FGDC Meeting1.

10 th GHRSST Science Team Meeting Santa Rosa, CA 3 June 2009.

Using Community-Driven Metadata Conventions with On-Line Data

Product Designer Hub – Taking HPD to the Web

HDF Product Designer: Using Templates to Achieve Interoperability

Data Are from Mars, Tools Are from Venus

An introduction to MEDIN Data Guidelines September 2016

Moving from HDF4 to HDF5/netCDF-4

Big Earth Data Initiative (BEDI) Metadata Improvement: Case Studies

Metadata Evaluation & Improvement, Case Studies

Efficiently serving HDF5 via OPeNDAP

An introduction to MEDIN Data Guidelines.

Metadata Management Tool

Identifiers Answer Questions

WGISS-45 International Directory Network (IDN) Report

The Re3gistry software and the INSPIRE Registry

Unified Metadata Model- WIGOS/CGMS Mapping

HDF Support for NASA Data Producers

SAHARA Project overview and update May 2018

Re3gistry Software rc1.0 INSPIRE registry service rc 5

Hierarchical Data Format (HDF) Status Update

HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting

Priority list of datasets for eReporting (Priority Datasets) INSPIRE

Adapting an existing web server to S3

NASA Earthdata Knowledge Base

Presentation transcript:

Incorporating ISO Metadata Using HDF Product Designer Aleksandar Jelenak, John Kozimor, Ted Habermann The HDF Group This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C

The Problem The need for more contextual data (metadata) in HDF5 files is growing.

The Solution Use the current conventions to the their fullest extent. Store the rest of metadata using the ISO 19115 standards.

HDF Product Designer Can Help Support for the most widely used Earth science metadata conventions. The latest release (v1.4) allows import of ISO metadata objects into user designs.

https://wiki.earthdata.nasa.gov/x/qorT Use Case Overview Recommendations Conceptual Model (UML) Implementation (XML) Implementation (NcML) HPD Design Name Usage (UMM) Crosswalks

Convention Support

Convention Support

Importing ISO Objects Separate project with pre-built ISO metadata components.

Importing ISO Objects All groups in the ISO design have default role and type attributes. Do not change these! Repeating roles have "_<uniqueID>" added to their names

Export As… JSON Export Python, MATLAB, IDL code HDF5 Template File

Sample of Python Code # Group: /gmi:acquisitionInformation grp_1 = f.create_group('gmi:acquisitionInformation') # Creating attributes for /gmi:acquisitionInformation grp_1.attrs['role'] = "gmi:acquisitionInformation" grp_1.attrs['type'] = "gmi:MI_AcquisitionInformation" # Group: /gmi:acquisitionInformation/gmi:instrument grp_2 = grp_1.create_group('gmi:instrument') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument grp_2.attrs['role'] = "gmi:instrument" grp_2.attrs['type'] = "gmi:MI_Instrument" grp_2.attrs['id'] = "instrument_1" # Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation grp_3 = grp_2.create_group('gmi:citation') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation grp_3.attrs['role'] = "gmi:citation" grp_3.attrs['type'] = "gmd:CI_Citation" grp_3.attrs['id'] = "fgdccitation_26722.114902.35002" # Group: /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date grp_4 = grp_3.create_group('gmd:date') # Creating attributes for /gmi:acquisitionInformation/gmi:instrument/gmi:citation/gmd:date grp_4.attrs['role'] = "gmd:date" grp_4.attrs['type'] = "gmd:CI_Date"

HDF5 Template File Keyword values in HDF5

This work was supported by NASA/GSFC under Raytheon Co This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C