Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center.

Slides:



Advertisements
Similar presentations
Documenting Data to Support Discovery and Use Dave Neufeld Ted Habermann John Kozimor.
Advertisements

Metadata workshop, June The Workshop Workshop Timetable introduction to the Go-Geo! project metadata overview Go-Geo! portal hands on session.
Foundational Objects. Areas of coverage Technical objects Foundational objects Lessons learned from review of Use Case content Simple Study Simple Questionnaire.
Merging Metadata Standards: FGDC CSDGM and ISO Sharon Shin Federal Geographic Data Committee Metadata Coordinator
NOAA Documentation Improvement Ted Habermann How do we measure and visualize improvements in NOAA Documentation? Record Count Completeness (Rubric Scores)
Connecting HDF And ISO Metadata Ted Habermann, NASA/ESDIS Hook Hua, Barry Weiss, NASA/Jet Propulsion Lab Mike Folk, Gerd Heber, Elena Pourmal, The HDF.
Oregon Spatial Data Library Partnership Metadata Training OU Knight Library Eugene, Oregon December 3, 2009 Kuuipo Walsh Institute for Natural Resources.
1 ISO – Metadata Next Generation International consensus being built on structured metadata within a broader Geomatics Standard under ISO Technical.
Geospatial standards Beyond FGDC Geog 458: Map Sources and Errors March 3, 2006.
Data Discovery 1.Data discovery systems 2.TDS and metadata 3.NcISO services.
Doug Nebert Senior Advisor for Geospatial Technology CSS, FGDC Secretariat.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Evolution of Metadata Standards: New Features in ISO Ted Habermann NOAA National Data Centers December, 2007
ISO Standards: Status, Tools, Implementations, and Training Standards/David Danko.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Documentation Developments Ted Habermann, NOAA/NESDIS/NGDC Adoption of ISO Metadata Standards - Crossing the Chasm Facilitating the Transition Documentation.
Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.
Oy Metadata Content j of Metadata. Discovery Access Understanding Levels of Metadata joy of Metadata Metadata Standards Why standards Which standards.
Cover Environment and Natural Resources Service Sustainable Development Department Food and Agriculture Organization of the.
Geospatial One Stop Modules Two and Three. Module 2 Inventory/Document existing Federal agency framework datasets and publish metadata to clearinghouse.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
Interoperable Documentation Ted Habermann, NOAA/NESDIS/NGDC NCAR Earth Observing Laboratory, June 2010 Links: GEO-IDE Wiki:
North American Profile: Partnership across borders. Sharon Shin, Metadata Coordinator, Federal Geographic Data Committee Raphael Sussman; Manager, Lands.
Creating Documentation and Metadata: Metadata for Discovery Lola Olsen 1, Tyler Stevens 2, 1 National Aeronautics and Space Administration (NASA) 2 Wyle.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
Sept 19,  Provides a common set of terminology and definitions  A framework for describing resources and processes  Enables computer based interoperability.
Page 1 LAITS Laboratory for Advanced Information Technology and Standards ISO & Status Liping Di Laboratory for Advanced Information Technology.
Metadata Implementation Ted Habermann NOAA National Geophysical Data Center Documentation: It’s not just discovery... 50% change in global average Why?
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
National Coastal Data Development Center A division of the National Oceanographic Data Center Please a list of participants at each location to
Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.
Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.
Workshop Resources.
Adoption of RDA-DFT Terminology and Data Model to the Description and Structuring of Atmospheric Data Aaron Addison, Rudolf Husar, Cynthia Hudson-Vitale.
Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center AGU, Spring 2008.
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata
ODP Interoperability Package Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT, Buenos Aires, Argentina, 7 – 11 October.
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Introduction Module 1: Introduction & Overview of the FGDC CSDGM.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
Creating Good Documentation NOAA National Geophysical Data Center
Sneak Preview: Sneak Preview: The New US Geospatial Metadata Standard GeoMaxim Federal Geographic Data Committee (FGDC) Lynda Wayne, GISP Sharon Shin.
Registering Earth Science Data and Data Related Services Using NASA’s Global Change Master Directory (GCMD) Tyler Stevens (GIS/Services Coordinator) ESIP.
U.S. Department of the Interior U.S. Geological Survey The Biological Data Profile Extending the FGDC Metadata Standard Kirsten Larsen.
Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.
Metadata Content Entering Metadata Information. Discovery vs. Access vs. Understanding Cannot search on content if it is not documented. Cannot access.
Metadata Training for SEFSC Science Staff Part Two.
ESRI Education User Conference – July 6-8, 2001 ESRI Education User Conference – July 6-8, 2001 Introducing ArcCatalog: Tools for Metadata and Data Management.
Merging Metadata Standards: FGDC CSDGM and ISO and Sharon Shin Federal Geographic Data Committee Metadata Coordinator
Standard Metadata in Scientific Data Formats September 19, 2007 Flash at:
ISO 191** Overview A “Family” of Standards. Resources ISO Standards Web Page – Technical.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
A look to the past for the future- The North American Profile Sharon Shin Metadata Coordinator Federal Geographic Data Committee.
Convergence And Trust in Earth and Space Science Data Systems Ted Habermann, NOAA National Geophysical Data Center Documentation: It’s not just discovery...
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.
Content Standards for Digital Geospatial Metadata Mandatory Legend Identification Information Data Quality Information Spatial Data Organization Information.
CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,
The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.
Geospatial metadata Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
ODP Interoperability Package
Presented by Sharon Shin, FGDC Developed by Lynda Wayne, GeoMaxim-FGDC
Identifiers Answer Questions
Unified Metadata Model- WIGOS/CGMS Mapping
NORTH CAROLINA state and local government METADATA PROFILE
Relation between WIS and WIGOS metadata
Session 2: Metadata and Catalogues
Proposal of a Geographic Metadata Profile for WISE
Chapter 5.5 Metadata John Cima.
Presentation transcript:

Documenting UAF Data Ted Habermann NOAA/NESDIS/National Geophysical Data Center

Metadata Types and Sharing Discovery Use / Mashup Understanding Discovery Portal Community Metadata Collections User

Documentation Repository ISO 19115, , and extensions Documentation Repository ISO 19115, , and extensions THREDDS netCDF DIF, FGDC, Data.Gov DIF, FGDC, Data.Gov SensorML WCS, WMS, WFS, SOS ISO KML Multiple Dialects

Designated Communities - Users Data preservation is communicating with the future

Custom Documentation Custom Documentation FGDC Mandatory Identification Metadata FGDC Mandatory Identification Metadata FGDC Discovery Distributor FGDC Discovery Distributor FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC Complete Entity and Attribute Data Quality Lineage Spatial Organization Spatial Reference FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing FGDC RSE Identifier Documentation Mission Platform Instrument Aggregation Algorithm Processing ISO Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO Code Lists Many Identifiers OnLine Resources Responsible Parties Data Quality Reports Spatial/Temporal Extents Metadata Levels / Scope ISO Quality Coverage Usability Platform Instrument Processing Algorithm ISO Quality Coverage Usability Platform Instrument Processing Algorithm FGDC to ISO International Standard Unified Modeling Language FGDC to ISO International Standard Unified Modeling Language Basic Content Extended Content ISO Services ISO Features ISO Services ISO Features Standards Evolution

Spiral 1: Initial Content Spiral 1: Initial Content Metadata Content Independent of standard Metadata Content Independent of standard Standard Guidance / Implementation Standard Guidance / Implementation Check Back With Users Check Back With Users Spiral 2-N: Scientific Questions New Requirements New Use Cases Check Back With Data Collectors/ Providers Check Back With Data Collectors/ Providers

Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Identification Id Title Abstract Resource Date Topic Category Theme Keyword Metadata Contact Science Contact Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Extent Geospatial Bounding Box Temporal Start/End Vertical Min/Max Place Keywords Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Distribution Distributor Contact Online Resource Distribution Format Data Center Keywords Browse Graphic Text Searches Purpose Extent Description Lineage Statement Project Keywords Text Searches Purpose Extent Description Lineage Statement Project Keywords Quality/Lineage Sources Process Steps Quality Reports / Coverages Quality/Lineage Sources Process Steps Quality Reports / Coverages Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Acquisition Information Instrument Platform Instrument Keywords Platform Keywords Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Content Information Attribute Type Attribute Names Attribute Definitions Attribute Units Discovery Understanding Connection OnlineResource: Linkage (URL) Name Description Function Connection OnlineResource: Linkage (URL) Name Description Function Spiral Development / Training: Potential Spirals

SpiralNone0-33%34-66%67-99%All Identification Connection Extent Distribution Description Content Lineage Acquisition Information Metadata Evaluation for Dataset X Date: 2010/10/24 Spirals and Rubrics

NcML vs. ISO Satellite HIOOS CoastWatch NESDIS SST

ISO Scores (Initial) ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

This attribute exists in the NcML files extracted from data files on TDS. It was not considered in the initial translation, but can be combined with publisher information to form either distribution information or a service operation connectPoint = distribution | service

ISO Rubric Score FGDC - CoRISFGDC - NOSUAF = distribution | service

This attribute provides information about the project that is responsible for the dataset. Initially this information was translated into an MD_AggregationInformation object with MD_InitiativeTypeCode=project. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode=project ( ). ISO keywords are associated with shared vocabularies (thesauri). If the project keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.

ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

This attribute provides information about the publisher of the dataset. Initially this information was translated into a CI_ResponsibleParty with CI_RoleCode = publisher. As an alternative this attribute could be treated as a keyword with MD_KeywordTypeCode = dataCenter ( ). ISO keywords are associated with shared vocabularies (thesauri). If the dataCenter keywords come from a shared vocabularies, like the CF_Standard_Names, this convention would be a significant step towards increased interoperability. The NASA Global Change Master Directory has an existing shared vocabulary for dataCenters.

=dataCenter keyword ISO Rubric Score FGDC - CoRISFGDC - NOSUAF

NcML vs. ISO Satellite HIOOS CoastWatch

Improvement Plan 1.Improve standard (add new keyword types) 2.Create and encourage adoption of shared vocabularies for discovery 3.Improve translation from NcML to ISO 4.Integrate ncISO into TDS 5.Create good xsl stylesheets for documentation display 6.Encourage existing and new data providers to support data discovery conventions 7.Find partners for further improvement in NcML and ISO

NGDC Ionosonde Group is starting to write time series data for many Ionosonde Stations. The NGDC Metadata Team has been working with them to help them understand use and discovery conventions for netCDF. StationNcMLISO Initial313 Intermediate2017 Final4021 New Data Providers

Positive deviance says that if you want to create change, you must scale it down to the lowest level of granularity and look for people within the social system who are already manifesting the desired future state. Take only the arrows that are already pointing toward the way you want to go, and ignore the others. Identify and differentiate those people who are headed in the right direction. Give them visibility and resources. Bring them together. Aggregate them. Barbara Waugh Leadership Model: Positive Deviance