NASA Earthdata Knowledge Base

Slides:



Advertisements
Similar presentations
BEDI -Big Earth Data Initiative
Advertisements

NASA COMMON METADATA REPOSITORY (CMR) Update and Near Term Plans – CEOS WGISS 37 1 Andrew Mitchell Earth Science Data and Information Systems (ESDIS) National.
IAEA International Atomic Energy Agency INIS Collection Search: Introduction and main features INIS Training Seminar 7-11 October 2013, Vienna Domenico.
Validation and Conformity testing - Status and planning (Carlo Cipolloni)
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
The HDF Group July 8, 2014HDF 2014 ESIP Summer Meeting HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann The.
Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September
DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.
Get Connected Autodesk Revit MEP Connectors Demystified Shawn C. Zirbes Chief Technical Officer Image courtesy of Hobart, Yañez, Ramos, Maguey, and Martínez.
Mr. Gopi Nair Defense Technical Information Center Briefing at Board on Research Data and Information (BRDI) Meeting September 24, 2009 Approved for Public.
SESIP_0715_DN1 OpenSearch Standards ESIP Summer Meeting 2015 Doug Newman (NASA Earthdata – Raytheon) Andrew Mitchell (NASA Earthdata) This work was supported.
© 2012 Autodesk The Devil Is In The Workflow Module 1: Successfully Plan and Implement BIM Luis Rojas Building Design Product Line Manager, Eagle Point.
Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.
Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.
Experts Workshop on the IPT, v. 2, Copenhagen, Denmark The Pathway to the Integrated Publishing Toolkit version 2 Tim Robertson Systems Architect Global.
NASA Perspectives on Data Quality July Overall Goal To answer the common user question, “Which product is better for me?”
DM_PPT_NP_v01 UTC Participant Survey Results Kathleen L Carr October 13, 2015.
© 2011 Autodesk Popular Design Patterns and How to Implement Them in.NET Gopinath Taget Senior Developer Consultant.
GET CONNECTED Information Technology Career Cluster.
25th CEOS Plenary | Lucca, Italy| 8-9 November 2011 CEOS Support to GCI Agenda Item 8 Ivan Petiteville, ESA.
Slide: 1 CWIC Status Report Yonsook Enloe WGISS-40, Harwell UK Oct 1, 2015.
What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.
CWIC Open Search Best Practices Doug Newman (NASA ECHO) CEOS WGISS-37 April 15th 2014 Presenter: Archie Warnock (A/WWW Enterprises)
ESO and the CMR Life Cycle Process Winter ESIP, Jan 2015 ESDIS Standards Office (ESO) Yonsook Enloe Allan Doyle Helen Conover.
© 2012 Autodesk AB1851 Optimizing the Design Development Stage using Revit Architecture Douglas Bowers, AIA, LEED AP BD+C Doug Bowers Consulting, LLC.
© 2011 Autodesk AC2182 P - Autodesk 3ds Max for Starters Create Stunning Renderings For All Situations Christopher Fernandez Senior Applications Specialist,
Discovery Best Practices ESIP Winter Meeting, 10:30am January 8, 2015 Doug Newman (NASA Earthdata – Raytheon) This work was supported by NASA/GSFC under.
1 Raytheon EED Program | ECHO Technical Interchange 2013.
TWC Adoption* of RDA DTR and PIT in the Deep Carbon Observatory Data Portal Xiaogang Ma, John Erickson, Patrick West, Stephan Zednik, Peter Fox, & the.
”Smart Containers” Charles F. Vardeman II, Da Huo, Michelle Cheatham, James Sweet, and Jaroslaw Nabrzyski
International Planetary Data Alliance Registry Project Update September 16, 2011.
HDF Product Designer: Using Templates to Achieve Interoperability
GEOSS Component and Service Registry (CSR)
Data Are from Mars, Tools Are from Venus
PROTECT | OPTIMIZE | TRANSFORM
Developing Criteria to Establish Trusted Digital Repositories
Giuseppina Inserra INFN Catania
Repository Cross-Linking
New GES DISC Services Shortening the Path in Science Data Discovery
Big Earth Data Initiative (BEDI) Metadata Improvement: Case Studies
Brunel University (United Kingdom)
NASA Langley Research Center, Hampton VA
AGU Paper Number: IN43B-1697 Evolving a NASA Digital Object Identifiers System with Community Engagement Lalit Wanchoo1 and Nathan.
Data Mining 101 with Scikit-Learn
Metadata Management Tool
WGISS-45 International Directory Network (IDN) Report
INPE, São José dos Campos (SP), Brazil
CWICSmart A programmatically-derived user interface for Open Search implementations WGISS-39 Doug Newman (NASA EOSDIS – Raytheon) This work was supported.
SAS and all other SAS Institute Inc
A platform for Linked Data publishing
[draft] Conclusions, actions & next steps
Incorporating ISO Metadata Using HDF Product Designer
NSDL Data Repository (NDR)
MARINE STRATEGY FRAMEWORK DIRECTIVE (MSFD) COMMON IMPLEMENTATION STRATEGY Capturing metadata: Implementation of MSFD art – via a metadata catalogue.
Presented to the CEOS WGISS October 22, 2018
CEOS OpenSearch conformance testing
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
ESIP Winter Meeting 2016 January 2016
Chris Lynnes with contributions from Katie Baynes NASA/GSFC
About Thetus Thetus develops knowledge discovery and modeling infrastructure software for customers who: Have high value data that does not neatly fit.
Hierarchical Data Format (HDF) Status Update
A Case Study for Synergistically Implementing the Management of Open Data Robert R. Downs NASA Socioeconomic Data and Applications.
HDF-EOS Workshop XXI / The 2018 ESIP Summer Meeting
Data(trans)forming Roberto Barcellan European Commission NTTS2019
[draft] Conclusions, actions & next steps
Christopher C. Brown Reference Librarian
Introduction Dataset search
Presented to the CEOS WGISS October 10, 2019
Adapting an existing web server to S3
Data Discovery and Access Session Summary of Actions
Presentation transcript:

NASA Earthdata Knowledge Base WGISS-48 October 9th 2019 Doug Newman NASA EED-2 Data Use Architect douglas.j.newman@nasa.gov Dr. Christopher Lynnes NASA EOSDIS System Architect christopher.s.lynnes@nasa.gov This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C. This document does not contain technology or Technical Data controlled under either the U.S. International Traffic in Arms Regulations or the U.S. Export Administration Regulations.

First, an introduction to EOSDIS and NASA Earthdata.

Rationale ‘Connect together the main elements of Earth Observation knowledge AND context in a way that is: machine-readable, human- usable and curatable’ Chris Lynnes, WGISS-47

Use Cases As an earth data scientist, I want to determine the datasets used in an article/report/paper As an earth data scientist, I want to determine the articles/reports/papers that cite a dataset

APPROACH

Graph Technologies Implementations AWS Neptune Neo4J APIs SPARQL Gremlin Cypher

AWS Neptune + Gremlin Amazon Web Services and the “Powered by AWS” logo are trademarks of Amazon.com, Inc. or its affiliates in the United States and/or other countries. Apache Gremlin are either registered trademarks or trademarks of the Apache Software Foundation

Collections and documentation The common metadata repository contains dataset metadata records and references to their respective documentation. We used this inventory to create a graph of datasets and documentation vertices and ‘documents’ edges:

Recommendations g.V().hasLabel('dataset') .has('conceptid',conceptId) .inE('documents') .outV() .hasLabel('documentation') .outE('documents') .inV() .hasLabel('dataset') AIRS3STD

CONCLUSION In conclusion

If you build it... 10 minutes looking at a visualization of two CMR concepts gave me the inspiration for the recommendation engine. Imagine what an expert could do? Providing a read-only traversal API over a knowledge base like this could open the floodgates for novel discovery techniques

NEXT STEPS In conclusion

Articles The motivation for dataset -> documentation edges was to get to articles. A lot of articles reference dataset documentation. The next step is to bridge that gap. Google scholar OpenCitations Google and the Google logo are registered trademarks of Google LLC.

Approved for Public Release Thank you for your time. Questions? QUESTIONS? Approved for Public Release  

This work was supported by NASA/GSFC under Raytheon Co This work was supported by NASA/GSFC under Raytheon Co. contract number NNG15HZ39C. in partnership with