Interoperability = Leverage + Collaboration  Chris Lynnes  GES DISC.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

Earth Science Data: Why So Chris Lynnes.

The Model Output Interoperability Experiment in the Gulf of Maine: A Success Story Made Possible By CF, NcML, NetCDF-Java and THREDDS Rich Signell (USGS,

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

Best Practices to Promote Data Interoperability Chris Lynnes Joe Glassy Technology Infusion Working Group.

Web 2.0 in Air Quality Analysis and Management Rudolf B. Husar and Erin M. Robinson Washington University, St. Louis, MO 2007 National Environmental Information.

Enhancing Data Discovery, Understanding and Usage through an Air Quality Metadata System ISRSE, 6 May 2009 The Palazzo dei Congressi di Stresa Stresa,

Why you need McIDAS-V Steve Ackerman Tom Achtor. Introduction What is McIDAS-V? Why I want it? Why you will want it!

Implementation of a Data Node in China's Spatial Information Grid Based on NWGISS Dengrong Zhang, Le Yu, Liping Di Institute of Spatial.

InSAR Data and GeoServer IU QuakeSim Team October 26, 2011.

Crossing the Digital Divide

Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.

Discovering Earth Science Tools, Software, and Models through the CEOS IDN Tyler Stevens IDN GIS/Services Coordinator

The HDF Group HDF/HDF-EOS Workshop XIV1 Easy Access of NASA HDF data via OPeNDAP Kent Yang and Joe Lee The HDF Group September 28,2010.

Unidata TDS Workshop THREDDS Data Server Overview October 2014.

Crossing the Digital Divide Presented by: Fernando R. Salas David Maidment, Enrico Boldrini, Stefano Nativi, Ben Domenico OGC Technical Meeting – Met/Occean.

Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.

Unidata’s TDS Workshop TDS Overview – Part II October 2012.

GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.

Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.

1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.

Portal & Interoperability -share ESG Portlets to support EIE through JSR 1/268 & WSRP Chaowei Yang, Zhenlong Li, Wenwen Li Joint Center for Intelligent.

1 Maintaining the momentum of OpenSearch in Earth Science data discovery Doug Newman (NASA ECHO) & Dr Chris Lynnes (GES DISC) 12/11/13 10:50am PT IN32A-03.

Community Based Initiatives GES DISC UWG 2011 Meeting.

Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew

EARTH SCIENCE MARKUP LANGUAGE Why do you need it? How can it help you? INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.

Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.

1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1HDF and HDF-EOS Workshop XII10/17/2008.

NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.

Unidata TDS Workshop THREDDS Data Server Overview

1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.

Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.

Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.

Geospatial Interoperability Jeff de La Beaujardière, PhD NASA Geospatial Interoperability Office.

Air Quality Data Services: Application of OGC specifications Air Quality Data: Multi-dimensional, multi-source, multi-format Point observations are collected.

GEOSS Air Quality Community Infrastructure ESIP, 23 July 2010 Knoxville, TN E.M. Robinson, R.B. Husar, S.R. Falke, E.T. Habermann, A. Warnock, M. Hogeweg,

Unidata’s TDS Workshop TDS Overview – Part I July 2011.

HDF4 OPeNDAP Project Progress Report MuQun Yang and Hyo-Kyung Lee 1 HDF Developers' Meeting11/24/2015.

1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe

HDF5 OPeNDAP Project Update and Demo MuQun Yang and Hyo-Kyung Lee (The HDF Group) James Gallagher (OPeNDAP, Inc.) 1 HDF and HDF-EOS Workshop XII10/17/2008.

Using a Friendly OPeNDAP Client Library to Access HDF5 Data MuQun Yang and Hyo-Kyung Lee (The HDF Group) 1 25th IIPS Conference01/14/2009.

The HDF Group Data Interoperability The HDF Group Staff Sep , 2010HDF/HDF-EOS Workshop XIV1.

A Menagerie of ESIP OpenSearch Clients C. Lynnes, NASA/GSFC K. Keiser, U. Alabama--Huntsville.

Federated Space-Time Query for Earth Science Data Using OpenSearch Conventions ESIP Federated Search Cluster Chris Lynnes Bruce Beaumont Ruth Duerr Hook.

CWIC Developers Meeting January 28 th 2014 Calin Duma CSW and OpenSearch from the CWIC Start client perspective.

ESIP AQ Cluster Community Components for the Air Quality SBA in AIP-2.

GES DISC Services Push Harder? Be Careful? Change Direction? What about adding ______?

ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.

Application of NASA ESE Data and Tools to Air Quality Management Stefan Falke and Rudolf Husar (Co-PIs) Washington University in St. Louis Project Period:

What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.

CWIC Open Search Best Practices Doug Newman (NASA ECHO) CEOS WGISS-37 April 15th 2014 Presenter: Archie Warnock (A/WWW Enterprises)

ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.

The Earth Information Exchange. Portal Structure Portal Functions/Capabilities Portal Content ESIP Portal and Geospatial One-Stop ESIP Portal and NOAA.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Update on Unidata Technologies for Data Access Russ Rew

NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Reuse Working Group Earth Science Data Systems Reuse Working Group Case Study: SHAirED Services for.

The Arctic Observing Network and its Data Management Challenges Florence Fetterer (NSIDC/CIRES/CU), James A. Moore (NCAR/EOL), and the CADIS team Photo.

Sea Surface Temperature Distribution from the Physical Oceanography DAAC Ed Armstrong JPL PO.DAAC MODIS Science Team Meeting.

Data Browsing/Mining/Metadata

MERRA Data Access and Services

Common Framework for Earth Observation Data

ESIP Federated Search Cluster

The CEOS WGISS Atmospheric Composition Portal

Introduction to the ESIP Discovery Cluster

GEOSS Air Quality Community Infrastructure

OpenSearch: the data search API for everyone

WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe

ESIP Winter Meeting 2016 January 2016

ExPLORE Complex Oceanographic Data

Presentation transcript:

Interoperability = Leverage + Collaboration  Chris Lynnes  GES DISC

Types of Interoperability CatalogFind... Datasets / Granules AccessGet...Files / Subsets UsageOpen...File / URL

Interoperability Frameworks Catalog Access Usage ECHO GCMD / DIF OpenSearch Catalog Svcs for Web HTTP FTP OPeNDAP Web Coverage Service netCDF/ CF-1 Web Map Service HDF-EOS Semantic Web

Hype vs. Reality Interoperability in Earth Sciences Technology Trigger Peak of Inflated Expectations Trough of Disillusionment Slope of Enlightenment Plateau of Productivity Semantic Web OpenSearch Catalog Services for the Web Web Coverage Services ECHO HDF-EOS OPeNDAP GCMD DIF Web Map Service netCDF CF-1 http ftp

We are currently working to improve interoperability  ESIP Federated OpenSearch  OPeNDAP for HDF4 and Level 2 Data  Web Map Service and Web Coverage Service for ACP

ESIP Federated Search with OpenSearch  Problem: find datasets and files from a diverse collection of providers  Space-time region  Keywords  Solution: Federated (distributed) search following a simple protocol  OpenSearch: developed/used by Amazon; supported in most browsers  ESIP Conventions to extend and constrain OpenSearch 

The Federated OpenSearch Two-Step Client Dataset Query Engine Granule Query Engine granule query granule results OpenSearch Description Request Granule Search Dataset Discovery OpenSearch Description Document Store OpenSearch Description Document dataset query dataset results

OPeNDAP for Distributed Data Access  Open-source Project for a Network Data Access Protocol   Formerly Distributed Oceanographic Data System  Remote access via HTTP  Supports subsetting  Supports HDF4, HDF5, netCDF, ASCII, binary

OPeNDAP can make data easier to both get AND use AIRS Surface Air Temperature read via OPeNDAP with experimental HDF4 handler

Open Geospatial Consortium  Web Map Server (WMS)  Request and receive maps (pictures)  Easy, widely used  Web Coverage Server  Request and receive coverages (data)  More complicated, not so widely used  Catalog Services for the Web  Search for (?)  Even more complicated, less widely used

Atmospheric Composition Portal Joint effort with DLR and DataFed Joint effort with DLR and DataFed Relies on OGC WMS + WCS (as far as we can push them) Relies on OGC WMS + WCS (as far as we can push them)

What good is interoperability?

Interoperability helps leverage other resources S4PAarchive MapServermaps Giovannianalysis Miradorsearch OPeNDAP WMS WCS OPeNDAP OpenSearch

Interoperability fosters collaboration MODAPS GES DISC Univ. Alabama Huntsville Talkoot DQSS

Interoperability Network

Why so difficult?  Technical challenges  Semantic differences  Provenance  Psychological and sociological challenges  Got to give up control (vs. self-reliance)  Got to share the credit  But credit is NOT a zero-sum game

Someday…  A user should be able to start from her analysis tool of choice, outline a spatial area, set a time frame, type keywords in a search box…  …and the tool would then search the web for the data, obtain just the relevant subsets and load them directly into the tool.  We have the technology…