DAAC Roles with Common Metadata Repository (CMR) ESDIS System Engineering Technical Interchange November 2014 Copyright © 2014 Raytheon Company. All Rights.

Slides:



Advertisements
Similar presentations
Copyright © 2007 Vangent, Inc. All Rights Reserved. Example of OOR Architecture Open Ontology Repository Architecture – Some Considerations April 28-29,
Advertisements

ECHO Browse Reclassification Document ID: ECHO_Ops_Con_023 Version: 2.
REST API OVERVIEW ECHO Technical Interchange Meeting April 30 & May 1, 2013 Raytheon EED Program | ECHO Technical Interchange 2013.
What is ECHO? HTTP-based Search and Ordering Using ECHOs REST and OpenSearch APIs How Can.
EOSDIS Common Metadata Repository (CMR) Unified Metadata Model for Collections (UMM-C) Meeting June 12, 2014.
NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
Support for Client Partners Eugene G. Yu Lingjun Kang Archie Warnock
Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.
Thomas Huang PO.DAAC Software System Engineer Jet Propulsion Laboratory California Institute of Technology These activities were carried out at the Jet.
ECHO For International Partners March 8, 2005 Robin Pfister Yonsook Enloe.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
SCADM MEETING, SEPTEMBER 7, 2011 STATUS OF THE ANTARCTIC MASTER DIRECTORY.
Status of the Antarctic Master Directory SCADM Meeting, August 22, 2014.
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.
Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.
EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC
Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.
What is CWIC? Authors: Doug Newman Andrew Mitchell
Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.
WGISS-40: IDN Report Michael Morahan WGISS-40 Fall meeting / Harwell, United Kingdom
Retrieving and Transforming ISO Metadata ESIP Summer 2014.
COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – ESIP Winter ESIP Winter Meeting | Washington DCJanuary Dan Pilone
NASA Perspectives on Data Quality July Overall Goal To answer the common user question, “Which product is better for me?”
ESDIS METADATA ARCHITECTURE STUDY DISCUSSION Presented by Kevin Murphy and the Metadata Architecture Study Team Members 2013 ESIP Summer Meeting | Chapel.
EOSDIS User Registration System (URS) 1 GES DISC User Working Group May 10, 2011 GSFC, NASA.
DM_PPT_NP_v01 UTC Participant Survey Results Kathleen L Carr October 13, 2015.
ASDC Ingest Automation Efforts through Collaboratory for quAlity Metadata Preservation (CAMP) Presented by: Aubrey Beach (Booz Allen Hamilton, NASA ASDC)
CWIC Developers Meeting January 28 th 2014 Calin Duma CSW and OpenSearch from the CWIC Start client perspective.
ECHO AND ISO ESO SIG June 18, 2013 Raytheon EED Program | ESO SIG: ECHO and ISO.
DM_PPT_NP_v01 Using the Earthdata Service Desk December 8, 2015 Kathleen L Carr.
LPDAAC/USGS_EROS CMR Metadata Reconciliation Meeting March 4-5, 2015.
NSIDC CMR Metadata Reconciliation Meeting December 10-11, 2014.
The Proliferation of Metadata Standards and the Evolution of NASA’s Global Change Master Directory (GCMD) Standard for Uses in Earth Science Data Discovery.
Science Review Panel Meeting Biosphere 2, Tucson, AZ - January 4-5, 2011 Vegetation Phenology and Vegetation Index Products from Multiple Long Term Satellite.
What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.
1 ECHO ECHO 9.0 for Data Partners Rob Baker January 23, 2007.
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
1 Raytheon EED Program | ECHO Technical Interchange 2013.
ECHO AND ISO ECHO Technical Interchange Meeting April 30 & May 1, 2013 Raytheon EED Program | ECHO Technical Interchange 2013.
DM_PPT_NP_v01 Configuration Management of UMM Models January 2016.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.
Location Keyword Analysis and Approach to Fixing Records: A Case Study GCMD Science Coordinators CGSync Technical Tag Up Meeting
Rule-Based Approach for Earth Science Metadata Quality Assurance (QA) Tyler Stevens and Ellen Neff NASA’s Global Change Master Directory (GCMD) WYLE Information.
1 Retirement of Legacy Features Why? –Improved usability and performance for Access Controls, Order Option Definitions, etc. through MMT GUI instead of.
ESDIS Standards Office Yonsook Enloe, CTSI 3/2/ FGDC Meeting1.
GHRC Dashboard *** work in progress *** Ajinkya Kulkarni Rahul Ramachandran Helen Conover.
ESDRs Distribution and User Support – Miscellaneous Topics
NASA Earth Science Data Stewardship
CWIC Status Report Yonsook Enloe yonsook. k.
Activities in a nutshell
Michael Morahan CEOS WGISS-43 Meeting
CAP-378 and “Conhecer para não ignorar”
Big Earth Data Initiative (BEDI) Metadata Improvement: Case Studies
ESIP Discovery – Show & Tell ESIP Summer Meeting 2011 Matt Cechini
Metadata Evaluation & Improvement, Case Studies
EOSDIS Data Preservation Archive (EDPA)
Amanda Leon ESIP Summer 2017
OpenSearch: the data search API for everyone
WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting
WGISS-45 International Directory Network (IDN) Report
CWIC Status Report Yonsook Enloe yonsook. k.
Unified Metadata Model- WIGOS/CGMS Mapping
Health Ingenuity Exchange - HingX
WGISS Connected Data Assets Client Guide Oct 23, 2018 Archie Warnock
Programmatic interaction with the Invenio-based NADRE Repository
Federated Earth Observation (FedEO)
Presentation transcript:

DAAC Roles with Common Metadata Repository (CMR) ESDIS System Engineering Technical Interchange November 2014 Copyright © 2014 Raytheon Company. All Rights Reserved

What we’ve covered so far… /

Micro-service Based Architecture

Sub-second Search

Multiple Metadata Concepts Services Metadata Parameter Metadata Visualization Metadata Future Metadata Concepts Science Metadata Meta-Metadata (Collections and Granules)

Unified Metadata Model ECHO 10GCMD DIFEMS ISO Atom JSON … Ingest Adapter UMM-C … … UMM-G ECHO 10 UMM-S GCMD SERF UMM-V Visualization (GIBS) UMM-P Parameters/Variables (Giovanni AESIR) UMM-? Future Concepts

UMM-* Development Outline Stakeholder Interviews Surveying Existing Implementations Defining and Crosswalking Fields Defining Relationships Identifying Subsystem Interactions Tailoring Lifecycle ESDIS Standards Office (ESO) review

What’s ahead… ok … maybe a little more bumpy /

METADATA RECONCILIATION IS COMING

Collections (UMM-C) UMM-C GCMD DIF Model ECHO10 Collection Model ESDIS Metrics Model

Reconciliation What is it? When should I expect it? What do I need to do to prepare? What problems should I expect? How long will it take? ECHO + GCMD + EMS

What it is ECHO + GCMD + EMS One submission per product/collection – ECHO or GCMD DIF record CMR as the authoritative source Short Name + Version/Entry ID Unification UMM Compliant (Collections and Granules) – Provisional UMM-C May include products not in EMS/ECHO/GCMD BEDI/CDI Datasets are High Priority

What it is PlanMergeClean

When you should expect it “Soon” First 4 DAACs identified for reconciliation – NSIDC – LP DAAC / USGS EROS – LARC – PO.DAAC Preliminary data collection is well underway We are looking at your holdings and will help you make informed decisions

What you should do to prepare Know your data and empower your points of contact Identify POCs for current systems – DIF Authors – ECHO/EMS contacts – Other Stakeholders Are you still using FTP? Do ECHO/EMS/GCMD have all your data? Do you know what your ECHO additional attributes are? Know the list of required fields for UMM-C

What problems you could expect Controlled vocabulary mismatch, Entry ID issues … Do your Entry IDs and Short Names align? Are your Science Keywords correct/current? Do you have different teams preparing data for ECHO/EMS/GCMD? Are there UMM-C required fields you can’t provide for some collections? How are your granules referring back to parent collections?

The Process Initial Contact & Stakeholder Identification Tailored Reconciliation Package Package Review Period Facilitated Stakeholder Meeting Plan & Timeline

The Process Initial Contact & Stakeholder Identification Tailored Reconciliation Package Package Review Period Facilitated Stakeholder Meeting Plan & Timeline Reconciliation Package Contents: Metadata holdings report Submission process report Options for future submission Potential pain points identified Reconciliation Package Contents: Metadata holdings report Submission process report Options for future submission Potential pain points identified

The Process Initial Contact & Stakeholder Identification Tailored Reconciliation Package Package Review Period Facilitated Stakeholder Meeting Plan & Timeline Example activities might include: REST API migration Metadata merge working meetings Adapter development CMR Resources may be available if needed Example activities might include: REST API migration Metadata merge working meetings Adapter development CMR Resources may be available if needed

Each DAAC’s process will be unique. One size does not fit all. Each DAAC’s process will be unique. One size does not fit all.

Other DAAC Roles Participating in UMM review process Suggesting improvements and enhancements Requesting new concepts

Where can I get help? How can I help? Process Help & API Support – Katie Baynes Metadata Quality & Keyword Support – Scott Ritz ESO Review and Requests – General Questions –

Metadata Quality Assurance ©iStock.com/BrianAJackson

Made with wurdle.com Questions?

Earthdata Search Client