1 Key Results from GALEON John Caron Ben Dominico UCAR/Unidata.

Slides:



Advertisements
Similar presentations
1 GALEON Phase 1 Reports, Phase 2 Plans Ben Domenico (coordinating reports for the GALEON team) March 2006.
Advertisements

GALEON :: OGC Huntsville, 2006-mar-08 IUB GALEON Status Update Huntsville, 2006-mar-08 Peter Baumann, Ivan Delchev International University Bremen, rasdaman.
1 WCS Encoding Format Profiles netCDF Example Stefano Nativi, Lorenzo Bigagli, Ben Domenico, John Caron March 2006 Draft based mainly on presentations.
OGC Technical Committee Huntsville, GALEON – NERC/CCLRC experience Andrew Woolf e-Science Centre, CCLRC Rutherford.
WCS Data Exchange at the DataFed Server/Client Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO OGC TC.
WCS :: OGC Bonn 2005-nov-09 Some GALEON Results for WCS OGC, Bonn, 2005-nov-09 Peter Baumann International University Bremen, rasdaman GmbH
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
EURO4M Project Kick-Off, April 2010 OGC Web Services Data visualization using OGC web services Maarten Plieger Wim Som de Cerff Royal Netherlands Meteorological.
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
Streaming NetCDF John Caron July What does NetCDF do for you? Data Storage: machine-, OS-, compiler-independent Standard API (Application Programming.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
THREDDS, CDM, OPeNDAP, netCDF and Related Conventions John Caron Unidata/UCAR Sep 2007.
Best Practices to Promote Data Interoperability Chris Lynnes Joe Glassy Technology Infusion Working Group.
Development of a Prototype Web GIS Server for HDF-EOS Data based on OGC Web Map Specifications Liping Di, Zhangshi Yin, Wenli Yang, Meixia Deng, and R.
Implementation of a Data Node in China's Spatial Information Grid Based on NWGISS Dengrong Zhang, Le Yu, Liping Di Institute of Spatial.
Planned Title: Review of Evaluation of Geospatial Search Allan Doyle.
Context for Semantic Interoperability: GALEON, OPeNDAP, WCS, etc Ben Domenico with material borrowed from GALEON team For OOSSI Workshop November 2008,
THREDDS Data Server, OGC WCS, CRS, and CF Ethan Davis UCAR Unidata 2008 GO-ESSP, Seattle.
OGC Liaison Report WGISS-20 Allan Doyle, EOGEO
THREDDS Data Server, OGC WCS, CRS, and CF Ethan Davis UCAR Unidata 2008 GO-ESSP, Seattle.
OPeNDAP and the Data Access Protocol (DAP) Original version by Dave Fulker.
Interoperability ERRA System.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
Using python client libraries to access remote servers via Web Coverage Services Dominic Lowe, BADC Ben Domenico, Unidata/UCAR* and the GALEON Team * Work.
© Crown copyright Met Office WCSplus Making the Web Coverage Service work for the Fluid Earth Sciences Community Bruce Wright (Senior IT Architect), 7.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
CEOS WGISS May 2006 NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.
OGC "Geo-interface for Atmosphere, Land, Earth, and Ocean netCDF" (GALEON) Interoperability Experiment 7 th September 2005 Norman Barker (RSI)
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
1 The NERC DataGrid DataGrid The NERC DataGrid DataGrid AHM 2003 – 2 Sept, 2003 e-Science Centre Metadata of the NERC DataGrid Kevin O’Neill CCLRC e-Science.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
Unidata’s TDS Workshop TDS Overview – Part II Unidata July 2011.
Data Scrounging 101 Steve Signell, Instructor Robert Poirier, TA School of Science Rensselaer Polytechnic Institute Monday,
CEOS WGISS & Subgroup Meeting, Beijing, September, 2004 BNSC WCS Activities Wyn Cudlip BNSC/QinetiQ Presentation at Joint WGISS/Subgroup Meeting Beijing,
Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew
DELIVERING ENVIRONMENTAL WEB SERVICES (DEWS) Partners: UK Met Office (Lead Partner), British Atmospheric Data Centre (BADC), British Maritime Technology.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
1 International Standards for Data Interoperability GALEON Geo-interface for Air, Environment, Land, Ocean NetCDF Ben Domenico Unidata Program Center*
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
Work Group Meeting on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed Experience and Perspectives Rudolf B. Husar CAPITA, Washington University,
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
Recent developments with the THREDDS Data Server (TDS) and related Tools: covering TDS, NCML, WCS, forecast aggregation and not including stuff covered.
Unidata’s Common Data Model and the THREDDS Data Server John Caron Unidata/UCAR, Boulder CO Jan 6, 2006 ESIP Winter 2006.
Geospatial Interoperability Jeff de La Beaujardière, PhD NASA Geospatial Interoperability Office.
Air Quality Data Services: Application of OGC specifications Air Quality Data: Multi-dimensional, multi-source, multi-format Point observations are collected.
THREDDS Catalogs Ethan Davis UCAR/Unidata NASA ESDSWG Standards Process Group meeting, 17 July 2007.
Page 1 CSISS Center for Spatial Information Science and Systems Access HDF-EOS data with OGC Web Coverage Service - Earth Observation Application Profile.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
AUKEGGSWorkshop ANU, Canberra, 29 November 2006 Implementing CSML Feature Types in applications within the NERC DataGrid Dominic Lowe, British Atmospheric.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
Managing WMS and WCS on multidimensional NetCDF Datasets with Geoserver Martin Desruisseaux, Geomatys Mickael Treguer, Ifremer.
Interoperability = Leverage + Collaboration  Chris Lynnes  GES DISC.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Grids and Beyond: netCDF-CF and ISO/OGC Features and Coverages Ethan Davis, John Caron, Ben Domenico UCAR/Unidata AMS IIPS, 23 January 2008.
UC 2006 Tech Session 1 NetCDF in ArcGIS 9.2. UC 2006 Tech Session2 Overview Introduction to Multidimensional DataIntroduction to Multidimensional Data.
ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.
Application of NASA ESE Data and Tools to Air Quality Management Stefan Falke and Rudolf Husar (Co-PIs) Washington University in St. Louis Project Period:
ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
NetCDF: Data Model, Programming Interfaces, Conventions and Format Adapted from Presentations by Russ Rew Unidata Program Center University Corporation.
Standards-based Access to Air Quality Data: Application of OGC WMS and WCS Protocols Client Server Std. Interface GetCapabilities GetData Capabilities,
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
OGC Live Demo at GEOSS Workshop July 30 - Denver, CO Demo Scripts Liping Di, Peisheng Zhao, George Mason University Rudolf Husar,
ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.
The OPeNDAP/OGC Gateway
Common Framework for Earth Observation Data
Presentation transcript:

1 Key Results from GALEON John Caron Ben Dominico UCAR/Unidata

2 Background Open GIS Consortium (OGC) –Industry/government consortium for creating interoperable standards for GIS –Commercial, not open source Web Coverage Service (WCS) –Client-server protocol for “coverage” data (satellite data seems to be their main use case) –XML over HTTP / SOAP –Specification version 1.0 (1.1 almost ready) GALEON: OGC “interoperability experiment” for WCS clients and servers

3 GALEON Objectives 1.Determine suitability of WCS interface for serving model data to GIS community (4D vs 2D) 2.Examine possibility of extending WCS to add netCDF to current blessed encodings: –GeoTIFF (TIFF with geospatial tags) –HDF-EOS (HDF4 plus NASA metadata) –DTED (NIMA/DOD digital elevation) –NITF (NIMA/DOD images) –GML (OGC XML data encoding) 3.Experiment with GML (Geography Markup Language) dialects and netCDF files 4.Make recommendations to WCS 1.1 spec

4 Active Participants Unidata/UCAR (Ben Domenico, John Caron) U of Florence and IMAA-CNR (Stefano Nativi, Lorenzo Bigagli) International University Bremen (Peter Baumann) George Mason University (Liping DI, Wenli Yang) CadCorp (Martin Daly, Frank Warmerdam (GDAL)) Research Systems International UK Ltd (David Burridge, Norman Barker) (IDL) NCDC, National Climatic Data Center (Glenn Rutledge, Dan Swank) NERC Natural Environment Research Council/ British Atmospheric Data Center (Dominic Lowe, Andrew Woolf) Washington University St. Louis (Stefan Falke, Rudolf B. Husar) Providing Specialized Expertise –Interactive Instruments (Clemens Portele) –NASA Geospatial Interoperability Office (John Evans)

5 TDS GALEON Development 1.Process WCS GET requests (not SOAP) 2.Generate WCS XML documents 3.Map bounding boxes to index ranges 4.No regridding, no reprojection, want “raw” data 5.Create GeoTIFF images –Greyscale: min/max -> –DataSample: Floating point (optional for readers) –No standards for missing data, time/vertical –Only implemented a few projections 6.Create subsetted netCDF/CF files 7.OPeNDAP WCS service

6 NERC DataGrid Development Created prototype WCS server (with TPAC) Reads from various “backend providers” –Currently OPeNDAP –DataExtractor tool (NDG), GADS (Univ Reading), CSML (NDG) Serves subsetted NetCDF/CF Recommendations to clarify WCS Investigate CSML as potential format, referencing netCDF through xlink or gml:File.

7 Other WCS/netCDF Servers Univ Florence (Nativi et al) –Also experiment with NcML-GML Intl Univ Bremen (Baumann et al) –Import netCDF data into PostgreSQL database –Aggregate multiple files into a single database object –Rasdaman maps raster data to relational tuples, SQL variant queries. Wash Univ St Louis (Husar et al) –Also tried to serve collection of irregularly located points George Mason University (Liping DI et al)

8 WCS/NetCDF clients DataFed (Wash Univ St Louis) George Mason University SIS/GDAL, CadCorp (Martin Daly, Frank Warmerdam (GDAL)) IDL, Research Systems International Non-WCS: –ESRI (local NetCDF/CF files) ArcGIS 9.2

9 Accomplishments Recommendation for NetCDF as a WCS encoding (1.0) Recommendations for changes to WCS 1.1 specification –Peter Baumann –Andrew Wolfe –Stefano Nativi Develop netCDF “application profile” (1.1) Investigation of GML applications profiles for explicit netCDF semantics (ncML-GML, CSML)

10 Plans for Phase 2 For continued experimentation with WCS implementation, use GALEON OGCnetwork –Additional client & implementations –New datasets For WCS and GML specifications, continue as OGC GALEON Interoperability Experiment Collaborate closely with: –OGC GEOSS Services Network (GSN) –GMLJP2 (GML JPEG2000)

11 CF-netCDF WCS 1.1 Profile Brief Description Documentation –Standard names –Units –Coordinate types –Coordinate systems –Grid mappings –Time coordinate(s) Code for Implementing netCDF Interface Support CF-netCDF and Coverage (ISO 19123) Data Model Mapping Limitations Compliance Testing

12 Changes Proposed in WCS 1.1 WCS encoding “profiles” instead of fixed list of encoding formats Multiple “variables” or “parameters” or “fields” in a coverage (e.g., pressure, temperature, etc.) Coverages with 3 spatial dimensions Coverages with multiple time dimensions (e.g. forecast time in model output) Non-spatial “height” dimension, (e.g., atmospheric pressure, ocean density) Irregularly-spaced grids Are collections of point observations and trajectories coverages or features?

13 Summary A handful of clients and servers have demonstrated feasibility Commercial vendors are actively participating (RSI, ESRI, CADCORP) GEOSS demonstrations involve WMS clients getting data from GALEON WCS servers Finished netCDF profile is key; other profiles are needed (e.g., OPeNDAP, HDF-EOS, GeoTIFF) Most WCS limitations are being addressed in 1.1 With proposed changes, WCS should be viable for model datasets