Managing WMS and WCS on multidimensional NetCDF Datasets with Geoserver Martin Desruisseaux, Geomatys Mickael Treguer, Ifremer.

Slides:



Advertisements
Similar presentations
Conversion of CPC Monitoring and Forecast Products to GIS Format Viviane Silva Lloyd Thomas, Mike Halpert and Wayne Higgins.
Advertisements

OGC Technical Committee Huntsville, GALEON – NERC/CCLRC experience Andrew Woolf e-Science Centre, CCLRC Rutherford.
A Roadmap of Open Source components for GI Web Services and Clients A Paul R Cooper MAGIC.
1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
EURO4M Project Kick-Off, April 2010 OGC Web Services Data visualization using OGC web services Maarten Plieger Wim Som de Cerff Royal Netherlands Meteorological.
The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
DataTools Models Data, models and tools: Dealing with any complex hydraulic engineering problem invariable use is made of: data, models and tools.
1 OGC Web Services Kai Lin San Diego Supercomputer Center
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
Best Practices to Promote Data Interoperability Chris Lynnes Joe Glassy Technology Infusion Working Group.
2014 ESIP Summer Meeting July 8–11, 2014 | Frisco, Colorado Advancing Scientific Data Support in ArcGIS Nawajish Noman.
Dynamic Quick View, interoperability and the future Jon Blower, Keith Haines, Chunlei Liu, Alastair Gemmell Environmental Systems Science Centre University.
Exploring large marine datasets using an interactive website and Google Earth Jon Blower, Dan Bretherton, Keith Haines, Chunlei Liu, Adit Santokhee Reading.
Christine White, Esri Growing OPeNDAP Support: Current ArcGIS Workflows and Future Directions Christine White, Esri
Активное распределенное хранилище для многомерных массивов Дмитрий Медведев ИКИ РАН.
Marine GIS Applications using ArcGIS Global Classroom training course Marine GIS Applications using ArcGIS Global Classroom training course By T.Hemasundar.
Rebecca Boger Earth and Environmental Sciences Brooklyn College.
Open Earth Team, Deltares Data sharing Sharing data, tools and thoughts A brief overview of possibilities recently conducted by Deltares.
THREDDS Data Server, OGC WCS, CRS, and CF Ethan Davis UCAR Unidata 2008 GO-ESSP, Seattle.
THREDDS Data Server, OGC WCS, CRS, and CF Ethan Davis UCAR Unidata 2008 GO-ESSP, Seattle.
Tools for accessing distributed in-situ data collections Donald W. Denbo, NOAA/PMEL-JISAO Jason E. Fabritz, NOAA/PMEL-JISAO Bernard J. Kilonsky, Sea Level.
Geospatial Data Abstraction Library (GDAL) Enhancement for ESDIS (GEE) Increasing Accessibility and Interoperability of NASA Data Products with GIS Tools.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
© Crown copyright Met Office WCSplus Making the Web Coverage Service work for the Fluid Earth Sciences Community Bruce Wright (Senior IT Architect), 7.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
CEOS WGISS May 2006 NASA Support for WTF-CEOP Sept 11, 2006 Ken McDonald, NASA Yonsook Enloe, SGT Inc.
STOQS: The Spatial Temporal Oceanographic Query System Mike McCann Abstract Monterey Bay Aquarium Research Institute Architecture Postgres.
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
Web mapping interoperability in practice, a Java approach guided by the OpenGis Web Map Server Interface Specification Pedro Fernández, R. Béjar, M.A.
Mid-Course Review: NetCDF in the Current Proposal Period Russ Rew
WCS Data Exchange at the DataFed Server/Client Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University, St. Louis, MO OGC TC.
DELIVERING ENVIRONMENTAL WEB SERVICES (DEWS) Partners: UK Met Office (Lead Partner), British Atmospheric Data Centre (BADC), British Maritime Technology.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
Esri UC 2014 | Demo Theater | Working with Scientific Data using Mosaic Dataset Hong Xu, Dan Zimble.
Second workshop on the use of GIS/OGC standards in meteorology, Toulouse 2009 © Geomatys, 2009 Adrian Custer 25 November 2009 Three libraries, one platform,
NcBrowse A Graphical netCDF/OPeNDAP Browser Donald Denbo 1 & John Osborne 2 1 UW/JISAO-NOAA/PMEL, 2 OceanAtlas Software
A.Batchimeg GDAL Geospatial Data Abstraction Library GDAL Geospatial Data Abstraction Library
1 International Standards for Data Interoperability GALEON Geo-interface for Air, Environment, Land, Ocean NetCDF Ben Domenico Unidata Program Center*
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
OceanBrowser viewing service, overview and upgrades Alexander Barth (1), Charles Troupin (2), Aida Alvera Azcárate (1), Jean-Marie Beckers (1) (1) University.
Documentation from NcML to ISO Ted Habermann, NOAA NESDIS NGDC.
1 NASA CEOP Status & Demo CEOS WGISS-24 Oberpfaffenhofen, Germany October 15, 2007 Yonsook Enloe.
A GeoSpatial Mapping Architecture
1 DAPPER: An OPENDAP Server for In-Situ Data Joe Sirott Donald W. Denbo, Willa H Zhu University of Washington PMEL/NOAA.
IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.
Page 1 CSISS Center for Spatial Information Science and Systems Access HDF-EOS data with OGC Web Coverage Service - Earth Observation Application Profile.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
RSISIPL1 SERVICE ORIENTED ARCHITECTURE (SOA) By Pavan By Pavan.
John Pickford IBM H11 Wednesday, October 4, :30. – 14:30. Platform: Informix Practical Applications of IDS Extensibility (Part 2 of 2)
GeoServer: Past, Present, Future Justin Deoliveira.
1 NASA CEOP Final Summary CEOS WGISS-26 Boulder, Colorado September 23, 2008 Yonsook Enloe
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
00/XXXX 1 Data Processing in PRISM Introduction. COCO (CDMS Overloaded for CF Objects) What is it. Why is COCO written in Python. Implementation Data Operations.
UC 2006 Tech Session 1 NetCDF in ArcGIS 9.2. UC 2006 Tech Session2 Overview Introduction to Multidimensional DataIntroduction to Multidimensional Data.
IOOS Sea Surface Temperatures: Realizing Truly Distributed Data with Open Standards Presenter Kyle Draganov.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
Uploading Data Matthew Hanson  GeoNode made up of several components  Web Framework – Django  OGC Server – GeoServer  Database – PostGIS.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
Update on Unidata Technologies for Data Access Russ Rew
NcBrowse: A Graphical netCDF File Browser Donald Denbo NOAA-PMEL/UW-JISAO
GeoServer Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
SSE WebMapViewer Recent Developments Steven Smolders SSE Workshop ESA - ESRIN, Frascati, Rome.
Concept Demonstration: Implementing GEOSS Architecture using Open Standards and Open Source Software “The User and GEOSS Architecture” Workshop, 30 Oct.
The Next Generation Network Enabled Weather (NNEW) SWIM Application
Presentation transcript:

Managing WMS and WCS on multidimensional NetCDF Datasets with Geoserver Martin Desruisseaux, Geomatys Mickael Treguer, Ifremer

Ocean physics Ifremer  National institute of marine research, the French public institute for marine research, Ifremer contributes, through studies and expert assessments, to knowledge about the ocean and its resources, monitoring of marine and coastal zones and the sustainable development of maritime activities. To these ends, it designs and operates observational, experimental and monitoring tools and facilities. Ifremer manages the ocean research fleet for the French scientific community. Fisheries and aquacultureOcean floors

Example of gridded datasets  Physical Oceonography Temperature and Salinity Sea Surface Temperature Current Wave …  Biological Oceanography Ocean color (chlorophyll)  Digital Elevation Model (DEM)  …

NetCDF (Common Data Form)  Binary format suitable for lots of different data types portable self-describing binary data format. NetCDF is used extensively in the atmospheric and oceanic science communities.  Climate and Forecast conventions should be applied to environmental data if possible for correct labelling of axes (latitude, longitude, time, pressure, etc) for standard naming of variables (sea_water_potential_temperature etc)  Can also be dissiminated via the protocol OPeNDAP you access data using a URL  Allow GIS clients to access NetCDF/OPeNDAP datasets via standards-based interface (WMS, WCS)

4-D web mapping  A number of mapping systems are now available on the web Most mapping software assumes two- dimensional data (x-y)  Environmental science data is dynamic and four- dimensional (x-y-z-t)  OGC WMS/WCS support 4(plus)-D data (elevation, time) But not many servers or clients support the full specification

OGC NetCDF architecture Client Application (Mapbuilder) WCS NetCDF Interface (Unidata) OpenDAP netCDF files WMS GeoServer / GeoTools

SeaGrid “SeaGrid” website provides very quick visualisations of gridded data Images generated dynamically on the server

Selection of depth depth levels available on the data geom:coriolis... 5,10,20,...,1850,1900,

Selection of time time available on the data animation geom:coriolis T14:00:00Z, T14:00:00Z, T14:00:00Z...

WCS Draw a bbox to extract raw raster data GetCoverage WCS specification

Future enhancements  It is planned to improve : Extraction WCS –Official supported format : GeoTiff, HDF-EOS, DTED, NITF, GML –Add Netcdf output (convention CF)  It is planned to provide : Access to opendap (distributed datasets) WMS GetFeatureInfo to retreive geophysical data Display wind/current fields as vectors (directions and intensities)

Past work  In GeoTools –Wrote initial referencing module –Wrote initial coverage module Strong focus on geophysics data Some processing capabilities No raster input/output  On SourceForge –Created SeaGIS in 2002 –Raster input/output performed there, requiring database –Initially designed for a specific problematic (fisheries...)‏ –Running since 2002, trying to generalize since that time

Topics  PostGrid as a coverage catalog  Geographic Image I/O

Coverage catalog  « PostGrid » is a schema in a PostGIS database  Contains coverage metadata, not pixel values  Used as an index for fast coverage lookup –Which data are available (what, where, when…)‏ –How to get the data (filename, format…)‏ –What the pixel values means (categories…)‏ Images stay files in their native format (NetCDF, PNG…)‏

Current PostGrid scope  Envelope up to 4 dimensions ( x, y, z, t )‏ –Mandatory horizontal ( x, y )‏ The SRID must be supported by PostGIS The « grid to CRS » transform must be affine –Optional vertical ( z )‏ SRID must be provided, but doesn't need to be supported Ordinates as an array of values –Optional temporal ( t )‏ Set of time ranges Horizontal slices in arbitrary files for different ( z, t )‏

Current PostGrid scope  Envelope up to 4 dimensions ( x, y, z, t )‏ –Mandatory horizontal ( x, y )‏ The SRID must be supported by PostGIS The « grid to CRS » transform must be affine

Affine transform versus envelope  Can compute one from the other... grid range affine transform envelope coordinate reference system... but envelopes are ambiguous! –Do we reverse y axis direction? –Do we swap axes ( x, y ) → ( y, x )? –What about oblique grids? Always specify Transform rather than Envelope when possible...but envelopes are still valuable for indexing!

Database schema overview identifier layer path format Series series filename startTime endTime extent GridCoverage s identifier width, height scaleX, scaleY,... horizontalSRID horizontalExtent verticalSRID verticalOrdinates GridGeometries 1∞1∞∞1∞1 An indexed geometry column Always in WGS84 (not image CRS)‏ Automatically generated by trigger FormatsSampleDimensions Categories 1∞1∞1∞1∞ ∞ 1

Pixel values↔Geophysics values 0=no data↔NaN 0 1=clouds↔NaN 1 2=land↔NaN =temperature↔ °C  Tell what the pixel values means  Convert to and from geophysics values  They are not styling  Required even if the data are already geophysics –Relationship to pixel values is typically fixed for a data set –What this NaN value is? (clouds, land...)‏

PostGrid library GeoServer PostGrid Image I/O PostGrid GeoServer

Evaluation at a direct position Data OperationInterpolations Spatial (bicubic)‏ Temporal (linear)‏ Final value

Geographic Image I/O Image I/O Geographic Image I/OGeographic Image Metadata Coverage I/OGrid Coverage GeoServerPostGrid NETCDF GML in JPEG2000 Rendered Image

ImageReader specializations ImageReader GeographicImageReader FileImageReader NetcdfImageReader Convenience class only; ignore if you want Creates IndexColorModel from (min,max) and data type Support for implementations that can't read a stream 3 th dimension (often z ) as bands, but doesn't have to

Geographic Image Metadata  Subclass of IIOMetadataFormat  Almost the only committed API

Demo

Questions?