Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

Slides:



Advertisements
Similar presentations
High level summary and recommendations from AIP-3 George Percivall Open Geospatial Consortium Task lead AR-09-01B ADC-16, May 2011.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
1 GEOSS Architecture Implementation Pilot (AIP) Phase 2 Air Quality and Health Working Group Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe, Erin.
GEOSS Common Infrastructure (GCI): status and evolution EC Side Event - GEO Plenary IX Foz do Iguacu, November 2012 Mirko Albani Earth Observation.
GCI Research Activity Stefano Nativi, Mattia Santoro.
Enhancing Data Discovery, Understanding and Usage through an Air Quality Metadata System ISRSE, 6 May 2009 The Palazzo dei Congressi di Stresa Stresa,
Crossing the Digital Divide
ESIP Air Quality Workgroup and the GEO Air Quality Community of Practice collaboratively building an air quality community network for finding, accessing,
Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
GEOSS Common Infrastructure: A practical tour Doug Nebert U.S. Geological Survey September 2008.
NOAA Data Management Activities Deirdre Jones, EDMC Chair Jeff de La Beaujardière, DM Architect Prepared for DAARWG
WGISS CNES SIT-30 Agenda Item 10 CEOS Action / Work Plan Reference 30 th CEOS SIT Meeting CNES Headquarters, Paris, France 31 st March – 1 st April 2015.
A Global Agriculture Drought Monitoring and Forecasting System (GADMFS) Meixia Deng and Liping Di.
Slide: 1 CWIC Status Report Yonsook Enloe WGISS-39, Tsukuba May 13, 2015.
1 Closing Report on WTF-CEOP Project Team Satoko Horiyama MIURA/JAXA.
Implementation of Model Data Interoperability for IOOS: Successes and Lessons Learned Rich Signell USGS Woods Hole, MA / NOAA Silver Spring USA Model Data.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
U.S. Department of the Interior U.S. Geological Survey Web Services Interest Group WGISS #28 September, 2009 Pretoria, South Africa Lyndon R. Oleson U.S.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Registration and Harvest IIB Presentation May 1,
Tools in Support of a National DMAC Derrick Snowden NERACOOS/ODP Annual Meeting 26 Sep 2012.
Page 1 CSISS Center for Spatial Information Science and Systems WGISS-37 meeting,2014 CWIC OpenSearch Implementation Yuanzheng Shao, Lingjun Kang, Archie.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
ENV proposal meeting, Geneva, Sep. 24, GCI Presentation Joost van Bemmelen, ESA
NODC ↔ Data Consumers Steve Rutz NOAA/NESDIS National Oceanographic Data Center NODC Observing Systems Team Leader June 21, 2011.
IOOS Modeling Testbed Cyberinfrastructure Rich Signell, USGS, Woods Hole, MA IOOS-RA-Briefing, Feb 14, 2012.
GEOSS Clearinghouse GEO Web Portal GEOSS Common Infrastructure Components & Services Standards and Interoperability Best Practices Wiki User Requirements.
WGISS-40, Harwell, Oxfordshire, UK, Sept. 28-Oct. 2, 2015 GEO/CWIC Interactions Ken McDonald/NOAA CWIC Session, WGISS–40 October 1, 2015.
ESIP & Geospatial One-Stop (GOS) Registering ESIP Products and Services with Geospatial One-Stop.
What is CWIC? Authors: Doug Newman Andrew Mitchell
WGISS Technology Subgroup Report WGISS-29 Bonn, 2010 Nataliia Kussul WGISS.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
GEOSS Air Quality Community Infrastructure ESIP, 23 July 2010 Knoxville, TN E.M. Robinson, R.B. Husar, S.R. Falke, E.T. Habermann, A. Warnock, M. Hogeweg,
® GEOSS AIP 5 Water SBA Update HDWG June 2012 Matt Austin NOAA Stefan Fuest KISTERS Jochen Schmidt NIWA.
UAF/OSMC Presenters: Kevin O’Brien and Eugene Burger Abstract: Kevin O’Brien and Eugene Burger are from NOAA’s Pacific Marine Environmental Laboratory.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
The Unified Access Framework (UAF) Building NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) one step at a time Steve Hankin (PMEL),
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
Improving Data Catalogs with Free and Open Source Software Kevin O’Brien University of Washington Joint Institute for the Study of the Atmosphere and Ocean.
The Unified Access Framework for Gridded Data … the 1 st year focus of NOAA’s Global Earth Observation Integrated Data Environment (GEO-IDE) Steve Hankin,
25th CEOS Plenary | Lucca, Italy| 8-9 November 2011 CEOS Support to GCI Agenda Item 8 Ivan Petiteville, ESA.
Report of the Architecture and Data Committee (ADC) R.Shibasaki (ADC, Japan)
Task IN-03 GEO Work Plan Symposium 2014 GEOSS Common Infrastructure IN-03.
ESIP AQ Cluster Community Components for the Air Quality SBA in AIP-2.
2009 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP link to cop site ) Rudolf Husar (Point of Contact, Washington.
1 ISO WAF Community Catalog Product Access Servers Registry Clearinghouse(s) GEO Portals Community Portals Users Client Apps GetCapabilities ISO
Page 1 CSISS Center for Spatial Information Science and Systems CWIC Development Team Meeting, 2014 CWIC Server-Client Interactions Yuanzheng Shao, Lingjun.
1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
GEOSS Common Infrastructure Access to Priority Earth Observations Data “ Sprint to Plenary” Group on Earth Observations Eighth Plenary Session - GEO-VIII.
The NOAA Operational Model Archive and Distribution System NOMADS CEOS-Grid Application Status Report Glenn K. Rutledge NOAA NCDC CEOS WGISS-19 Cordoba,
GEOSS Common Infrastructure: A Practical Tour Doug Nebert U.S. Geological Survey AIP-3 Kickoff March 2010.
Update on Unidata Technologies for Data Access Russ Rew
ISWG / SIF / GEOSS OOS - August, 2008 GEOSS Interoperability Steven F. Browdy (ISWG, SIF, SCC)
GCI Overview Steve Browdy with input from Doug Nebert May 2012.
GEOSS Common Infrastructure (GCI) The GEOSS Common Infrastructure allows Earth Observations users to search, access and use the data, information, tools.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
CAP-378 and “Conhecer para não ignorar”
WGISS Connected Data Assets
WGISS Connected Data Assets Sept 26, 2017 Yonsook Enloe
GEOSS Air Quality Community Infrastructure
WGISS Connected Data Assets April 5, 2017 Yonsook Enloe
Topics NOAA support for: CWIC Infrastructure NOAA as a Data Provider
WGISS Connected Data Assets April 9, 2018 Yonsook Enloe
Prepared by: Jennifer Saleem Arrigo, Program Manager
CEOS WGISS INTEGRATED CATALOG (CWIC)
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
CWIC Community Client Development Martin Yapur & Ken McDonald WGISS-41
4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy
WGISS Connected Data Assets Session Today
Presentation transcript:

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration for Observations Office Erth

Aligning NOAA’s mission with GEOSS Promoting Global Environmental Stewardship – Describing assessing, monitoring and predicting the Earth’s environment – Weather, Climate, Ocean, Coasts, Satellites Management of data information services – Acquisition, archive, access, integration and dissemination of environmental data

What is the Unified Access Framework? NOAA-wide effort to make complex environmental datasets easier to find and use Many of NOAA datasets that have been derived from Ocean Models, Climate, Weather, Satellites, HF Radar have not been easily accessible to broader user communities in the past Provides data access using open standards

UAF interoperability domains and data management functions

NOAA’s Unified Access Framework Unique access point to federated data services for NOAA Priority Earth Observation Data A standards based architecture – Data Format and dataset vocabulary: NetCDF-CF – Catalog: THREDDS – Data Access Protocol :Opendap, WCS, WMS – Metadata: ISO User friendly tools to access data that are web and desktop based

Projects: (too many to name) Data formats: netCDFGRIBHDF Service stack: netCDF-CF-DAP-THREDDS-WMS-WCS Applications: MatlabArcGISFerret GrADS Google Earth IDV LAS ERDDAP… Users: (too many to name) …

UAF High Level Architecture Multiple Analysis and Visualization Clients ERDDAPWCSWMS THREDDS Catalog DAP Metadata Gridded Datasets Capabilities

netCDF Java Tools LAS ERDDAP GODIVA From the THREDDS catalog “viewers” may also be called up

9 Access in ArcGIS using the Environmental Data Connector (EDC)

Model 1: UMASS-ECOM Model 2: UMAINE-POM Data: SST 2008-Sep-08 07:32 Desktop access in Matlab

11 Browser access using ERDDAP … and from there …

Dec mat REST URL access to data subsets in several simple formats (accessible through home-grown scripting of many types).kml.mat.nc NOAA/UAF-grid

Number of datasets available in UAF ERDDAP by searching SBAs categories Water 1602 Climate 347 Weather 196

NOAA’s contribution to AIP-4 Activity #1: Access to Priority EO Data – A Collection of datasets UAF THREDDS Catalog and WAF of ISO metadata Activity #2: Clients and Mediated Access enablers – A Collection of tools and services UAF web services and desktop clients that can access the UAF THREDDS Catalog

UAF in the GEOSS GCI WAF of ISO GEOSS Clearinghouse GEOSS CSR Registered Community Resources Components UAF Clients that can connect to THREDDS web services or OpenDAP -Web Server Clients -ERDDAP, LAS Desktop- Matlab, ArcGIS Services NOAA wide THREDDS Catalog Registry – Data access via OpenDAP, WMS, WCS – Metadata- THREDDS Catalog level+ NetCDF –CF file level output as ISO Source Data Input: NOAA Earth Observ ation Data in NetCDF -CF User Access: GEO Web Portal

NOAA UAF Project Integration Issues and Challenges: UAF is a volunteer effort which makes it hard to achieve goals on a set schedule UAF THREDDS catalog contains sparse inconsistent metadata ncISO generated metadata does not include links to access data….yet (coming soon) Defining granularity for data and metadata Many NOAA datasets need to be integrated

GEOSS Interoperability Challenges Registering data and services in the GCI is a manual data entry driven process GEOSS tasks that are interdependent such as Ontology, AIP and GCI development need to be better coordinated GEOSS Clearinghouse needs to be kept current – Old metadata – GEOSS standards not updated frequently

How better metadata can simplify integrating data into GEOSS The relationship between data, services, products and clients can be described using metadata Publishing this metadata in a Web Accessible Folder recognized by the GCI could automate the registration process for data and services resulting improved usability for GEOSS providers and users

CEOS WGISS CWIC IDN Collection-level Discovery Inventory Search Collection Metadata Registration Enabling Satellite Data Discovery for GEO thru CWIC CWIC is: a standards-compliant gateway to the individual CEOS agency satellite data catalog systems providing a door to door non- stop shuttle service from the CEOS to the GEO, and from the WGISS to the GEOSS

Legend CWIC 1.0 Design CWIC Mediator Service Interface Mediator Core Wrapper OGC Interface Wrapper OGC Interface Wrapper OGC Interface Connector NOAA CLASS USGS Landsat Catalog USGS Landsat Catalog NASA ECHO IDN China FengYun, BJ-1 Data Catalog INPE Wrapper OGC Interface Connector Mediator Wrapper OGC CSW Protocol Java API Partner’s Native Protocol