Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center
Metadata Types and Sharing Discovery Use / Mashup Understanding Discovery Portal Community Metadata Collections User
Documentation Repository ISO 19115, , and extensions Documentation Repository ISO 19115, , and extensions THREDDS netCDF DIF, FGDC, Data.Gov DIF, FGDC, Data.Gov SensorML WCS, WMS, WFS, SOS ISO KML Multiple Dialects
Designated Communities - Users Data preservation is communicating with the future
Custom Documentation Custom Documentation FGDC Mandatory Identification Metadata FGDC Mandatory Identification Metadata FGDC Discovery Distributor FGDC Discovery Distributor FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing ISO Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO Quality Coverage Usability Platform Instrument Processing Algorithm ISO Quality Coverage Usability Platform Instrument Processing Algorithm FGDC to ISO International Standard Unified Modeling Language FGDC to ISO International Standard Unified Modeling Language Basic Content Extended Content ISO Services ISO Features ISO Services ISO Features Standards Evolution
Spiral 1: Initial Content Spiral 1: Initial Content Metadata Content Independent of standard Metadata Content Independent of standard Standard Guidance / Implementation Standard Guidance / Implementation Check Back With Users Check Back With Users Spiral 2-N: Scientific Questions New Requirements New Use Cases Check Back With Data Collectors/ Providers Check Back With Data Collectors/ Providers
Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Text Searches Purpose Extent Description Lineage Statement Project Keywords Text Searches Purpose Extent Description Lineage Statement Project Keywords Quality/Lineage Sources Process Steps Quality Reports / Coverages Quality/Lineage Sources Process Steps Quality Reports / Coverages Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Discovery Understanding Connection OnlineResource: Linkage (URL) Name Description Function Connection OnlineResource: Linkage (URL) Name Description Function Spiral Development / Training: Potential Spirals
SpiralNone0-33%34-66%67-99%All Identification Connection Extent Distribution Description Content Lineage Acquisition Information Metadata Evaluation for Dataset X Date: 2010/10/24 Spirals and Rubrics
NcML vs. ISO Satellite HIOOS CoastWatch NESDIS SST
ISO Scores (Initial) ISO Rubric Score FGDC - CoRISFGDC - NOSUAF
This attribute exists in the NcML files extracted from data files on TDS. It was not considered in the initial translation, but can be combined with publisher information to form either distribution information or a service operation connectPoint = distribution | service
ISO Rubric Score FGDC - CoRISFGDC - NOSUAF = distribution | service
This attribute provides information about the project that is responsible for the dataset. Initially this information was translated into an MD_AggregationInformation object with MD_InitiativeTypeCode=project. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode=project ( ). ISO keywords are associated with shared vocabularies (thesauri). If the project keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.
ISO Rubric Score FGDC - CoRISFGDC - NOSUAF
This attribute provides information about the publisher of the dataset. Initially this information was translated into a CI_ResponsibleParty with CI_RoleCode = publisher. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode = dataCenter ( ). ISO keywords are associated with shared vocabularies (thesauri). If the dataCenter keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.
=dataCenter keyword ISO Rubric Score FGDC - CoRISFGDC - NOSUAF
NcML vs. ISO Satellite HIOOS CoastWatch
Improvement Plan 1.Improve standard (add new keyword types) 2.Create and encourage adoption of shared vocabularies for discovery 3.Improve translation from NcML to ISO 4.Integrate ncISO into TDS 5.Create good xsl stylesheets for documentation display 6.Encourage existing and new data providers to support data discovery conventions 7.Find partners for further improvement in NcML and ISO
NGDC Ionosonde Group is starting to write time series data for many Ionosonde Stations. The NGDC Metadata Team has been working with them to help them understand use and discovery conventions for netCDF. StationNcMLISO Initial313 Intermediate2017 Final4021 New Data Providers
Positive deviance says that if you want to create change, you must scale it down to the lowest level of granularity and look for people within the social system who are already manifesting the desired future state. Take only the arrows that are already pointing toward the way you want to go, and ignore the others. Identify and differentiate those people who are headed in the right direction. Give them visibility and resources. Bring them together. Aggregate them. Barbara Waugh Leadership Model: Positive Deviance