1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell NASA/GSFC

Encouraging Partners and Brokers ECHO is EOSDIS’s middleware layer between EOS data and science data users via a service- oriented architecture. Designed to improve the discovery and access of NASA data. Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their EOS data holdings and other Earth science-related data holdings. User-defined specialized “clients” can be easily developed to give science data users of their community access to EOS data and services using ECHO’s open APIs. 2 Developed as a part of NASA’s core data systems but fully adaptable to the needs/requirem ents of science communities.

3 Current ECHO Data Partners Data currently accessible in ECHO: Collections:3,186 Granules:89 million Browse images:43 million EOSDIS Data Centers participating in ECHO ASDC: Radiation Budget, Clouds, Aerosols and Tropospheric Chemistry ASF: Synthetic Aperture Radar (SAR), Sea Ice, Polar Processes, Geophysics GES DISC: Atmospheric Composition and Dynamics, Global Precipitation, Model Output, Solar Irradiance GHRC: Global Hydrology, Global Temperatures, and Lightning LP-DAAC: Land Processes NSIDC: Snow and Ice, Cryosphere and Climate ORNL: Biogeochemical Dynamics, Ecological Data, Environmental Processes PO-DAAC: Oceanic Processes, Air-Sea Interactions SEDAC: Population, Sustainability Other EO Data Centers USGS: Landsat

Metadata 4

5 ECHO Client Partner Status Current ECHO Clients Variety of client types Web-based clients, Installed applications User interactive, machine-to-machine Variety of purposes General purpose geospatial and temporal searching Customized user interfaces to facilitate specific communities and tasks Additional value-added processing by clients (e.g. subset, stitch, resample, reproject, reformat) Middleware components Client Partner metrics (May 2011) Operational Public: 7 Active Development:3

Warehouse Inventory Search Tool (WIST) Provides search and order capabilities across the full set of data provider holdings in the ECHO catalogue. One of the primary access points to EOSDIS and other Earth science data holdings Users are able to submit cross-discipline queries using spatial and temporal criteria, examine search results for relevancy using built-in tools, and submit orders via ECHO to the appropriate data provider(s). Based on the EOS Data Gateway (EDG) user interface 6

Next Generation Client - REVERB Provides search and order functionality built on the ECHO API that improves end user experience of the WIST client in user satisfaction and performance. Exposes the ECHO service registry with relevant ECHO metadata and incorporate a modern dynamic user interface using current web development technology. Leverages newer technologies (Ruby on Rails web application framework) and performance enhancements Operational Release May

Reverb Overview New Paradigm Utilize modern technology to provide an enhanced look & feel & improved sustainability Utilize modern web standards including a new REST-based ECHO API Provide an extendible platform that will allow for simpler incorporation of new user interfaces capabilities. Requirements Derived from WIST functionality, previous NCRs, and new enhancements. Tracked entirely in TestTrack Pro Improved Client Features Enhance Dataset Discovery Improve Search Criteria Entry & Validation Utilize of Cloud Cover metadata value Facilitate Bulk Download Facilitate Service Discovery & Invocation Utilize new Calendar API configured through PUMP Utilize enhanced Data Quality Summaries configured through PUMP Provide browse thumbnail images during browsing

ESA’s eoPortal Catalogue - ECHO Client  Similar to WIST, the eoPortal Catalogue Client allows users to query Earth Science products from diverse data providers using spatial and temporal boundaries. Some of the catalogs currently represented in their client are NASA (via ECHO), German Space Agency (DLR), Korea Aerospace Research Institute (KARI), and the European Space Agency (ESA). 9

ECHO and GCMD Interoperability The GCMD ECHO Portal offers the users a virtual subset of the GCMD to gain direct access to granule-level data in ECHO. The GET DATA link sends a search to WIST based on the search criteria selected in the GCMD and automatically pre- populates the WIST form but does not execute the query. ECHO adopted the GCMD Science Keyword structure for use in the ECHO metadata model WIST and the ECHO-OpenSearch client reference GCMD Dataset Definitions. 10

Recent ECHO Improvements ECHO was re-architected to provide full redundancy of all critical components, virtually eliminating need for preventive maintenance downtime, and increased stability. Operational availability has been dramatically improved: Average operational availability over past 6 months: 99% ECHO search performance has been significantly improved in the past 2 years: Average query time now 7 seconds (from 30 seconds) Average Ingest performance improved by a factor of 10 ECHO is working to simplify efforts of Client developers: Added 2 new API formats: OpenSearch and REST ECHO’s Ingest functionality is being enhanced to support multiple metadata formats including ISO and allowing the discovery of the catalog query results in these formats; Reverb will be able to output data in the ISO metadata standard. 11

ECHO and the GES DISC Reverb supports batch download of online data (w/o ordering) The critical ingredient for ECHO to be relevant to GES DISC users Also looks and works better than WIST GES DISC is working on several clients through ECHO’s OpenSearch interface Mirador external search Simple Subset Wizard Community-based Giovanni Giovanni for YOTC Also cooperating (with EED) on EOSDIS Service Interface Generalization of the Simple Subset Wizard agent interface 12