Presentation is loading. Please wait.

Presentation is loading. Please wait.

Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF.

Similar presentations


Presentation on theme: "Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF."— Presentation transcript:

1 Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF Group

2 Layers of Access HDF5 Data HDF & NetCDF Library Climate Forecast Conventions MatLab, IDL, IDV, Ferret, GMT OPeNDAP Geospatial Database SQL Community Data Models, Open GIS Specifications ArcMap, ArcIMS, WMS, WFS, WCS GML, KML, SimpleFeatures HDF/netCDFGIS

3 The ISO Metadata Standard (19115)

4

5 Documentation Objects

6 People/Organizations

7 Citations

8 ISO Lineage Model Source Step Product Processing and Algorithm Descriptions

9 Lineage

10 THREDDS Data Server Multiple Dialects: THREDDS Catalog THREDDS Catalog file1.nc file2.nc file3.nc file4.nc file1.nc file.nc file2.nc file.nc THREDDS Catalog THREDDS Catalog THREDDS Catalog THREDDS Catalog Extract Data OPeNDAP WMS WCS Extract Metadata (NcISO) NcML ISO Rubric THREDDS Metadata Server

11

12 Documentation in Three Dialects ISO ACDD NcML https://geo-ide.noaa.gov/ wiki/index.php?title=NcISO http://groups.google.com/ group/ncisometadata

13 Documentation Repository ISO 19115, 19115-2, 19119 and extensions Documentation Repository ISO 19115, 19115-2, 19119 and extensions THREDDS netCDF (NcML) netCDF (NcML) DIF, FGDC, Data.Gov DIF, FGDC, Data.Gov SensorML WCS, WMS, WFS, SOS Open Provenance Model, PROV Open Provenance Model, PROV KML Documentation in Multiple Dialects 101010101010101 010111110010010 110100100100100 100010010001001 010100100101001 001010100010010 001010010010010 101010101010101 010101010001001 0101000010100

14 Conventions Discovery Use / Mashup Understanding Climate-Forecast (CF) Conventions Standard variable names and data organizations Unidata Attribute Convention for Data Discovery ISO Conventions

15 Metadata Where Are Citations? XML dataset / resource sourcekeyword thesaurus & ontology evaluation procedure standard specification algorithmfeature catalog application schema alternate metadata & service standard associated resource name/metadata additional documentation constraints reference source metadata process reference & documentation software reference feature catalog format specification Documentation

16 Questions? ted.habermann@noaa.gov

17 The Design Process SMAP.xml SMAP.h5 SMAPHDF.xml SMAP2.xml h5dump HDF2ISO.xsl ISO2NCML.xml ISO2NCML.xsl NCML2h5py.py NCML2h5py.xsl The content of these two files must match 1.SMAP.xml: an ISO compliant XML file that contains the metadata elements identified in the SMAP metadata model. This is the content that must traverse the system into and out of the HDF5 file. 2.ISO2NCML.xsl: an xsl file that transforms ISO metadata into a candidate NcML representation. This representation is used because it is intuative and easy to read. It also provides a connection to the netCDF/CF community. 3.ISO2NCML.xml: an NcML file that contains an extract of the SMAP content in netCDF4 compliant NcML. 4.NCML2h5py.xsl: an xsl that transforms NCML into python that is compliant with the python HDF5 library (h5py). The python that comes out of this transform instantiates the group structure from ISO2NCML.xml in HDF5 5.NCML2h5py.py: The python program that, when executed, instantiates the structure from ISO2NCML.xml into HDF5. 6.SMAP.h5: the HDF5 file created using NCML2h5py.py 7.SMAPHDF.xml: the XML representation of the content of SMAP.h5 8.HDF2ISO.xsl: an xsl that transforms the HDF/XML into ISO 19139 9.SMAP2.xml: the output of the process that should match the original (SMAP.xml).


Download ppt "Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF."

Similar presentations


Ads by Google