1 Interoperability Among EOS Data Gateway, ECHO and CEOS’ INFEO Systems CEOS WGISS Subgroup Meeting May 9, 2002 Frascati Italy Chao-Hsi Chang NASA/EDG.

Slides:

Advertisements

Similar presentations

MODIS Data at NSIDC MODIS Collection 5/Long Term Data Record Workshop Molly McAllister & Terry Haran January

Advertisements

NASA Agency Report Ken McDonald NASA May 2002

LinkSceem High Performance Computing for the Eastern Mediterranean * Most research requires computers, and, in a growing number.

SMOS SAG, Villafranca November 2-3, 2006 Development of a Global In-Situ Soil Moisture Network: A SMOS Project Contribution P.J. van Oevelen.

02/07/2001 EOSDIS Core System (ECS) COTS Lessons Learned Steve Fox

The NASA Modeling, Analysis and Prediction (MAP) Modeling Environment Don Anderson NASA HQ Sience Mission Directorate Earth-Sun Division Manager, Modeling,

Explore. Discover. Understand. Providing data services for over 42 Projects In 2007, 275 Terabytes of data distributed to 34,000 customers in 110 countries.

1 EDG Valids Activities Patrick Agbu & Frank Corprew EOS Data Gateway Science and Operations CEOS Subgroup Meeting – CINTEX.

What is HDF-EOS? Information compiled from HDF-EOS Workshop II HDF-EOS Workshop III, 1999 ESDIS Project, Code 423 NASA/Goddard Space Flight Center Greenbelt.

Lesson 2 Earth System Observation: NASA’s Earth Observation System (EOS) Satellites NOAA’s Polar Orbiting and Geostationary Satellites.

Satellite Imagery and Remote Sensing NC Climate Fellows June 2012 DeeDee Whitaker SW Guilford High Earth/Environmental Science & Chemistry.

Summary of 2008 EOSDIS User Survey & EOSDIS Outreach HDF & HDF-EOS Workshop Aurora, CO 10/16/2008 HDF.

Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.

1 OPeNDAP/ECHO Demo Integrating and Chaining services September, 2006 CEOS WGISS 22 Annapolis, MD.

DIF Metadata GCMD GOFC Portal JRC MSU TRFIC NOAA NGDC ESA UWM NASDA CCRS UMD GLCF MAFF MAFF/NASDA WMS CCRS/CubeWerx WMS CCRS/CubeWerx Map Client Server.

1 EOS Clearinghouse Robin Pfister, NASA/GSFC CEOS WGISS May 10-14, 2004.

Getting Ready for the Future Woody Turner Earth Science Division NASA Headquarters May 7, 2014 Biodiversity and Ecological Forecasting Team Meeting Sheraton.

1 Aura DSWG Meeting ESDIS Status 09/27/10 Alfreda Hall ESDIS DAAC Engineer NASA GSFC Code

1Managed by UT-Battelle for the Department of Energy ORNL DAAC Overview for ESIP Carbon Cluster Environmental Data Science & Systems Objective:

Global Earth Observation System of Systems (GEOSS) Cold Region - Needs and Support Yubao Qiu GEO Secretariat Boarding Meeting,

MODIS Workshop An Introduction to NASA’s Earth Observing System (EOS), Terra, and the MODIS Instrument Michele Thornton

Translation to the New TCO Panel Beverly Law Prof. Global Change Forest Science Science Chair, AmeriFlux Network Oregon State University.

U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,

1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell.

1 ECHO and EDG Status Sept 12, 2006 Beth Weinstein, Yonsook Enloe,

Slide 1 WGISS CEOS WGISS 21, Budapest 8-12 May 2006 WGISS Contribution to GEO WGISS Contribution to GEO Ivan Petiteville.

Development of a Long- Term Interdisciplinary Data Archive with the Columbia University Library System 24 October 2006 Robert S. Chen, Robert R. Downs,

EOSDIS Status 9/29/2010 Dan Marinelli, NASA GSFC

ResEau: A Water Portal SensorWeb Implementation National Information Strategies Division Strategic Information Integration Directorate Environment Canada.

EOS Terra MODIS Land Processing and Distribution Overview Joseph M Glassy, Director, MODIS Software Development at NTSG School of Forestry, Numerical Terradynamics.

September 4, 2003MODIS Ocean Data Products Workshop, Oregon State University1 Goddard Earth Sciences (GES) Distributed Active Archive Center (DAAC) MODIS.

NASA’s EOSDIS Clearinghouse - ECHO - WGISS – 24. Status ECHO 9 is operational ECHO 10 Focused on a re-architecture of Ingest services.

What is CWIC? Authors: Doug Newman Andrew Mitchell

EOSDIS Status 10/16/2008 Dan Marinelli, Science Systems Development Office.

Using the Global Change Master Directory (GCMD) to Promote and Discover ESIP Data, Services, and Climate Visualizations Presented by GCMD Staff January.

Recommendations from the GEO TASK AG Community of Practice Image: NASA, ASTER Science Team Minnesota Kansas Germany Bolivia Thailand Brazil.

Section 3 Remote sensing of global change 5. Carbon cycle Global Change Instructor: Dr. Cheng-Chien LiuCheng-Chien Liu Department of Earth Sciences National.

2005 ARM Science Team Meeting, March 14-18, Daytona Beach, Florida Canada Centre for Remote Sensing - Centre canadien de télédétection Geomatics Canada.

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.

ECHO: Foundational Middleware for a Science Cyberinfrastructure Robin Pfister Keith Wichmann Beth Weinstein.

1 ECHO and EDG Status May 9, 2006 Beth Weinstein, Yonsook Enloe,

Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 The Influences of Changes.

WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.

Cyberinfrastructure to promote Model - Data Integration Robert Cook, Yaxing Wei, and Suresh S. Vannan Oak Ridge National Laboratory Presented at the Model-Data.

7/13/04 Shaida Johnston MODIS Science Team Meeting 1 Current MODIS Data System: Processing, Archiving and Distribution Shaida Johnston July 13, 2004.

Update on NASA’s Earth Observing Data and Information System (EOSDIS) Presented to the CEOS WGISS September 29, 2015 Dawn Lowe, ESDIS Project Goddard Space.

Evolving a Legacy System Evolution of the Earth Observing Data and Information System M. Esfandiari 1, H. Ramapriyan 1, J. Behnke 1, E. Sofinowski 2 1.

Land Product Validation subgroup activity in support of LAI inter-comparison.

Science of the Aqua Mission By: Michael Banta ESS 5 th class Ms. Jakubowyc December 7, 2006.

Vision of an Integrated Global Observing System Gregory W. Withee Assistant Administrator for Satellite and Information Services National Oceanic and Atmospheric.

Land and Atmosphere Capability for EOS (LANCE) User Working Group Meeting Kevin Murphy LANCE User Working Group Meeting February 7-8, Washington.

Long Term Archival of ECS Data Held at the National Snow and Ice Data Center.

Advertising your data Alecia Aleman 1, Ruth Duerr 2 1 National Aeronautics and Space Administration (NASA) 2 National Snow and Ice Data Center, University.

1 ECHO ECHO 9.0 for Data Partners Rob Baker January 23, 2007.

UWG 2013 Meeting Introduction Andrew Bingham, Project Manager

1 J. Ranson NASA’s Earth Observing System Terra Mission Update Jon Ranson, Terra Project Scientist Si-Chee Tsay, Terra Deputy Project Scientist NASA’s.

1 Current Plans for Long Term Archiving of MODIS Data Martha Maiden Program Executive Earth Science Data Systems NASA Headquarters MODIS Meeting November.

SeaWiFS Highlights July 2002 SeaWiFS Celebrates 5th Anniversary with the Fourth Global Reprocessing The SeaWiFS Project has just completed the reprocessing.

ESRIN – Frascati, Italy September 20, 2013 NASA Report GEOSS Vision and Architecture Meeting ESRIN – Frascati, Italy September 20, 2013 Andrew Mitchell.

LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.

09 May 2002 Brief Review of INFEO INFEO is a distributed system for search of EO and related data Catalogue Search.

CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.

UWG Meeting 2012 WELCOME!!. Rob Raskin

Earth Science Data and Information System (ESDIS) Project Update Jeanne Behnke, Deputy Project Manager for Operations NASA Earth Science Data & Information.

Presented to the CEOS WGISS

EOS ClearingHOuse Robin Pfister Code 423, NASA/GSFC

Persistent Identifiers Implementation in EOSDIS

Andrew Mitchell São Paulo, Brazil 12th of April 2018

WGISS Connected Data Assets April 9, 2018 Yonsook Enloe

WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe

Presentation transcript:

1 Interoperability Among EOS Data Gateway, ECHO and CEOS’ INFEO Systems CEOS WGISS Subgroup Meeting May 9, 2002 Frascati Italy Chao-Hsi Chang NASA/EDG

2 Overview EOSDIS/EDG Review ECHO Operation Overview Interoperability Issues Conclusions

3 EOSDIS Manages Data from EOS missions Landsat-7, QuikSCAT, Terra ACRIMSAT and Aqua Pre-EOS missions (UARS, SeaWIFS, TOMS-EPm, TOPEX/Poseidon and TRMM) All of the Earth Science Enterprise legacy data (e.g., Pathfinder and field experiments data sets)

4 EOS Data Gateway (EDG) Provides easy/centralized access to EOSDIS Products Started as EOSDIS V0 IMS (1994) 7 Core, plus Extended Attributes

5 EDG Core Attributes DATA_CENTER_ID DATASET_ID SOURCE SENSOR PARAMETER CAMPAIGN PROCESSING_LEVEL

6 EDG Access Currently: 9 U.S. DAACs 4 ECS Data Centers 7 International Data Centers Future: Link to INFEO? Other Data Providers through ECHO

7 US DAACs ASF – sea ice, polar processes EDC (LP) – land processes GHRC – hydrologic cycle, lighting GSFC –atmospheric dynamics, global biosphere JPL – ocean circulation, air-sea interaction LaRC – radiation, clouds, aerosols NSIDC – snow, ice, cryosphere and climate ORNL – biogeochemical dynamics SEDAC – human interaction with environment

8 International Data Centers BOM - Bureau of Meteorology (Australia) CCRS - Canadian Centre for Remote Sensing DLR_DFD - Deutsche Forschungsanstalt fur Luft-und Raumfahrt (Germany) DSRS - Dundee Satellite Receiving Station (Scotland) HEOC - Hatoyama Earth Observation Center (Japan) IRE_CPSSI - IRE RAS Center of Processing and Storing the Space Information (Russia) ISA_MEIDA - Israel Space Agency Middle East Interactive Data Archive

9 EOSDIS Core System (ECS) Four ECS Data Centers EDC-ECS – Landsat 7, ASTER, MODIS (land) GSFC-ECS – MODIS (atmospheric) LaRC-ECS – ACRIM, CERES, MISR, MOPITT NSIDC-ECS – MODIS (ice/snow)

10 EOSDIS Data Volume Terra spacecraft produces 194 gigabytes raw data per day. It exceeds 850 GB When processed to higher levels In Aug EOSDIS’ data totaled 284 terabytes. Within less than a year, Terra data have double EOSDIS total holdings In addition, Landsat 7 is producing 150 MG of data per day

11 ECS Data Model Comprehensive and complex 127 Classes (tables) 297 Attributes 8 categories Data Originator, Collection, Granule, Spatial, Temporal, Contact, Algorithm, Document Product Specific Attributes: PSA

12 ECHO Operational Roles Database administrator Scheduler Metadata knowledge-base expert Valids coder

13 ECHO Operation Activities Account setup support Data ingest support Catalog maintenance Order brokering support Database table/oracle maintenance System operations

14 Account Set Up Support Provider registration Provider policy establishment & update Access control management Client initialization User registration Account status check

15 Data Ingest Support Metadata mapping Provider testing Metadata ingest Metadata update

16 Catalog Maintenance Catalog service maintenance Subscription service maintenance

17 System Operations System monitoring System backups Disaster recovery

18 CINTEX/ECHO Link Link through INFEO/EDG Valids mapping for MissionId vs. SOURCE (84/52%; 166 vs. 415) ProcessingLevelId vs PROCESSING_LEVEL (8/62%; 13 vs. 9) SensorId vs. SENSOR (140/47%; 294 vs. 672) ThemeKeyword vs. PARAMETER (100% ?; 1135)

19 CINTEX/ECHO Link (Cont.) INFEO as ECHO Client? Data centers join as ECHO data providers Data centers’ client connects to ECHO Link trough other regional metadata clearing-houses (e.g., CNES’ Metadata Office)

20 Enhance Interoperability Implement GCMD fourth level (Variable) science keywords in INFEO Map existing valids regularly Adapt each other’s un-matched valids Reconcile valids naming guideline

21 Conclusions ECHO, a next generation framework for interoperability Metadata quality is still the key to its success Efforts like CIP is essential to bridge systems down the road