ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center.

Slides:

Advertisements

Similar presentations

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR SIPS STATUS Helen Conover Information Technology & Systems Center The University of Alabama.

Advertisements

SJSK 1 HDF-EOS Workshop II Metadata Requirements for EOSDIS Data Providers Siri Jodha Singh Khalsa

NASA Agency Report Ken McDonald NASA May 2002

Caro-COOPS Data Management: Metadata. Cast-Net addresses the need for improved connectivity among coastal observing systems by creating a regional framework.

1 ISO – Metadata Next Generation International consensus being built on structured metadata within a broader Geomatics Standard under ISO Technical.

NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.

Metadata (for the data users downstream) RFC GIS Workshop July 2007 NOAA/NESDIS/NGDC Documentation.

September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.

Inter-American Workshop on Environmental Data Access Panel discussion on scientific and technical issues Merilyn Gentry, LBA-ECO Data Coordinator NASA.

Agenda: DMWG SM policy status ESIP meeting recap Reminder - DM Webinar Series New and updated web pages on DM website Metadata Training Sessions CDI meeting.

Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.

Elements of a Data Management Plan: Identifying the materials to be created Ruth Duerr National Snow and Ice Data Center Version Review Date Section:

U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.

EOSDIS FY2014 Annual Metrics Report Prepared By: Lalit Wanchoo, Adnet, Inc. Young-In Won, Wyle, Inc. Brian Krupp, Adnet, Inc. January 2015.

Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK

AMSR at NSIDC PoDAG XV Briefing NSIDC 28 September 1999.

Why do I want to know about HDF and HDF- EOS? Hierarchical Data Format for the Earth Observing System (HDF-EOS) is NASA's primary format for standard data.

BOE/Work Break Down The following slides provide a high level view of the BOE/WBS structure of the proposed NSIDC DAAC Contract.

Extensible Markup Language (XML) Extensible Markup Language (XML) is a simple, very flexible text format derived from SGML (ISO 8879).ISO 8879 XML is a.

Page 1 Status of HDF-EOS, Related Software, and Tools Abe Taaheri, Raytheon IIS HDF & HDF-EOS Workshp XIII Riverdale, MD November 4, 2009.

Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .

Archival Information Packages for NASA HDF-EOS Data R. Duerr, Kent Yang, Azhar Sikander.

Creating Archive Information Packages for Data Sets: Early Experiments with Digital Library Standards Ruth Duerr, NSIDC MiQun Yang, THG Azhar Sikander,

Elements of a Data Management Plan: Roles and Responsibilities Ruth Duerr National Snow and Ice Data Center Version 1.0 Review Date.

Preservation Strategies: Emerging standards for preservation Ronald Weaver National Snow and Ice Data Center Version 1.0 Review Date.

Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.

EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC

WSL Workshop The Long and Winding Road to MODIS Data.

MOWG 2 Sept 15-16,1999 David Hancock1 KEY PERSONNEL Dr. Bob Schutz, GLAS Science Team Leader Dr. Jay Zwally, ICESat Project Scientist, GLAS Team Member.

EOS Terra MODIS Land Processing and Distribution Overview Joseph M Glassy, Director, MODIS Software Development at NTSG School of Forestry, Numerical Terradynamics.

Metadata for Data Understandability Ted Habermann NOAA National Geophysical Data Center AGU, Spring 2008.

ESDIS Project Status 11/29/2006 Dan Marinelli, Science Systems Development Office.

Instant Karma: Accessing Provenance Information for AMSR-E Science Data Products AMSR-E Science Team Meeting 29 June 2011 UAHuntsville The University of.

NASA Earth Science Data and Information System (ESDIS) Project Data Preservation Activities – Update Andrew Mitchell (NASA Goddard Space Flight Center)

Geospatial Program Office Office of the CIO WAGIC Presentation August 20, 2015 Creating and Exporting Metadata for Harvest.

Metadata – use data discovery e.g. a library catalog data assessment determine the fitness-for-purpose of a data set data retrieval e.g., format.

NASA Perspectives on Data Quality July Overall Goal To answer the common user question, “Which product is better for me?”

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.

Jianchun Qin, Liguang Wu, Michael Theobald, A. K. Sharma, George Serafino, Sunmi Cho, Carrie Phelps NASA Goddard Space Flight Center, Code 902 Greenbelt,

1 U.S. Department of the Interior U.S. Geological Survey LP DAAC Stacie Doman Bennett, LP DAAC Scientist Dave Meyer, LP DAAC Project Scientist.

Creating Good Documentation NOAA National Geophysical Data Center

ASDC Ingest Automation Efforts through Collaboratory for quAlity Metadata Preservation (CAMP) Presented by: Aubrey Beach (Booz Allen Hamilton, NASA ASDC)

7/13/04 Shaida Johnston MODIS Science Team Meeting 1 Current MODIS Data System: Processing, Archiving and Distribution Shaida Johnston July 13, 2004.

PoDAG 21: Flow Diagrams 1 Data Flow Diagram(s) PoDAG asked for a data flow diagram with an indication where NSIDC was involved.  Each data stream is unique,

Evolving a Legacy System Evolution of the Earth Observing Data and Information System M. Esfandiari 1, H. Ramapriyan 1, J. Behnke 1, E. Sofinowski 2 1.

AMSR-E and AMSR-E Validation Status at NSIDC Amanda Leon, NSIDC AMSR-E Lead Joint AMSR-E Science Team Meeting Asheville, NC June 2011.

KEY PERSONNEL Dr. Bob Schutz, GLAS Science Team Leader Dr. Jay Zwally, ICESat Project Scientist, GLAS Team Member Mr. David Hancock, Science Software Development.

Metadata Training for SEFSC Science Staff Part Two.

ESRI Education User Conference – July 6-8, 2001 ESRI Education User Conference – July 6-8, 2001 Introducing ArcCatalog: Tools for Metadata and Data Management.

Getting Familiar with Metadata Laurie Porth Rocky Mountain Research Station Audience: Scientists/researchers who have heard of metadata and now need to.

16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.

MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.

The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.

British Atmospheric Data Centre ( Searching: Whither NDG? Bryan Lawrence.

MODIS SDST, STTG and SDDT MODIS Science Team Meeting (Land Discipline Breakout Session) July 13, 2004 Robert Wolfe Raytheon NASA GSFC Code 922.

Elements of a Data Management Plan: Organization and standards Ruth Duerr National Snow and Ice Data Center Version Review Date.

TERRA UPDATE Launch Date NSIDC DAAC Launch Readiness MODIS Snow and Ice Products General Product Release Timeline.

Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.

What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.

Preservation Strategies: What goes into a long term archive? Ronald Weaver National Snow and Ice Data Center Version 1.0 Review Date.

Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.

CLASS Metadata and Remote Sensing Extensions CLASS Data Provider’s Conference September 2005 Anna Milan, Ted.Habermann,

Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.

1 Digital Object Identifiers Update ESIP Data Stewardship Committee Meeting May 16, 2016 Presenters: Nate James, ESDIS Lalit Wanchoo, ADNET Systems Inc.

AIRS Meeting GSFC, February 1, 2002 ECS Data Pool Gregory Leptoukh.

NASA Earth Science Data Stewardship

Building A Repository for Digital Objects

Persistent Identifiers Implementation in EOSDIS

NSIDC DAAC Statistics PoDAG XXIII Report.

A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.

Presentation transcript:

ECS Metadata Considerations for Preservation SiriJodha S. Khalsa National Snow and Ice Data Center

A Little History ECS = NASA's Earth Observing System (EOS) Data and Information System (EOSDIS) Core System Data model based on FGDC Content Standard for Digital Geospatial Metadata  CSDGM became basis of ISO ECS data model became basis of RS extension to FGDC  which was used in

The ECS Metadata Model Bounded set of attributes (287 originally) intended to cover essential characteristics of all earth science data sets Granule-level (inventory) and Collection (catalog/discovery) metadata

ECS Metadata Types In addition:  Archival Metadata: Product-specific metadata that accompanies the granule when it is delivered to the data users, but need not be searchable by the system.  Structural Metadata: describes the specific data structures within the granule, including information necessary for geolocation of the data. Only in Data Product  Subsystem Persistent Metadata: Metadata generated by each subsystem to help identify, process and track objects in the system

Metadata provides information to:  Identify (title, origin, contents)  Locate (position, date & time)  Interpret (descriptions, units & scaling factors, accuracy)  Document (software version, production history, ancillary inputs)

Production System (as originally planned) SCF Data Product Generation Metadata ECS Ancillary Data Ancillary Data Collection and Granule, AutoQA, PH ESDT

Production System (as it evolved) SIPS Data Ingest Metadata ECS Ancillary Data Ancillary Data ESDT

Location of Metadata ECS Databases  Ingest, data pool, archive, etc. HDF-EOS Data Files Distributed metadata files Online documentation (DAACs, Instrument Team & Product Team Websites)

Issues DAACs will not alter original files (and therefore the metadata they contain)  QA updates only in distributed metadata, so metadata can get out of sync Metadata spread across several different ECS databases, DAAC websites, the product itself  How gather for preservation?