Integrating the Climate Science Modelling Language with geospatial software and services Dominic Lowe British Atmospheric Data

Slides:



Advertisements
Similar presentations
Page 1 © Crown copyright 2005 Workshop on Metadata Beijing27-29 September Report on Metadata Gil Ross (Met Office UK) WIS Working Group Geneva.
Advertisements

The Next Generation Network Enabled Weather (NNEW) SWIM Application Asia/Pacific AMHS/SWIM Workshop Chaing Mai, Thailand March 5-7, 2012 Tom McParland,
Page 1 © Crown copyright 2005 Workshop on Metadata Beijing27-29 September WMO Interoperability – the vision Gil Ross (Met Office UK) Metadata workshop;
Information Modelling MOLES Metadata Objects for Linking Environmental Sciences S. Ventouras Rutherford Appleton Laboratory.
® OGC Web Services Initiative, Phase 9 (OWS-9): Innovations Thread - OPeNDAP James Gallagher and Nathan Potter, OPeNDAP © 2012 Open Geospatial Consortium.
© MarineXML 2006 Slide 1 of 16 MOTIIVE : RISE HAC-PB EC, Brussels, 6 th June 2007 MOTIIVE:RISE Harmonisation Advisory Committee and Project Board European.
1 NODC, Russia GISC & DCPC developers meeting Langen, 29 – 31 March E2EDM technology implementation for WIS GISC development S. Sukhonosov, S. Belov.
Development of a database of intensively monitored groundwater systems in Australia Barry Croke National Centre for Groundwater Research and Training Australian.
Geospatial standards Beyond FGDC Geog 458: Map Sources and Errors March 3, 2006.
New ways to geo-reference and classify spatial data in Annex II & III data specifications Clemens Portele interactive instruments GmbH Drafting Team „Data.
Information Requirements for Integrating Spatially Discrete, Feature- Based Earth Observations Jeffery S. Horsburgh Anthony Aufdenkampe, Kerstin Lehnert,
Interoperability ERRA System.
Interoperability A simple case for standards Kim Finney JCADM – Rome 2007.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
1 NODC, Russia SeaDataNet TTG meeting Paris, May Overview and potential use of E2EDM technology for SeaDataNet Sergey Belov, Nick Mikhailov.
GADS: A Web Service for accessing large environmental data sets Jon Blower, Keith Haines, Adit Santokhee Reading e-Science Centre University of Reading.
NERC DataGrid and CSML NDG Team. CSML: Context NERC DataGrid: the integration problem –multiple organisations, formats, storage mechanisms (file, relational)
EuroMISS, EuroDSS and DMS Update of Progress Keiran Millard Keiran Millard
WXXM-1 OJN 5/14/09 MIT Lincoln Laboratory WXXM, JMBL, CAP Discussion NNEW Data Format Meeting 17 November, 2009.
© MarineXML 2006 Slide 1 of 14 AGI Marine and Coastal Zone SIG – Oceans of Change ExCeL, London 22 nd March 2006, Developments in Marine Standards Keiran.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Bryan Lawrence on behalf of BADC, BODC, CCLRC, PML and SOC An Introduction to NDG concepts [ ]=
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NOAA/NGDC ESIP Meeting January 7 th, 2009 Simple NOAA Archive Access Portal.
INSPIRE, EC Water Standards and WaterML Workshop Keiran Millard Keiran Millard
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
THREDDS Data Server Ethan Davis GEOSS Climate Workshop 23 September 2011.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
1 NESC workshop Grid and Geospatial Standards 7-Sep-2005 Data integration with the Climate Science Modelling Language Andrew Woolf 1, Bryan Lawrence 2,
ET-ADRS-1, April ISO 191xx series of geographic information standards.
NOCS, PML, STFC, BODC, BADC The NERC DataGrid = Bryan Lawrence Director of the STFC Centre for Environmental Data Archival (BADC, NEODC, IPCC-DDC.
What is Information Modelling (and why do we need it in NEII…)? Dominic Lowe, Bureau of Meteorology, 29 October 2013.
EARTH SCIENCE MARKUP LANGUAGE Why do you need it? How can it help you? INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Copyright © 2009, Open Geospatial Consortium, Inc. Time issue : Meteo Domain needs and WMS present means Meteorology DWG Frédéric Guillaud, Marie-Françoise.
Accomplishments and Remaining Challenges: THREDDS Data Server and Common Data Model Ethan Davis Unidata Policy Committee Meeting May 2011.
The netCDF-4 data model and format Russ Rew, UCAR Unidata NetCDF Workshop 25 October 2012.
1 International Standards for Data Interoperability GALEON Geo-interface for Air, Environment, Land, Ocean NetCDF Ben Domenico Unidata Program Center*
Integrated Grid workflow for mesoscale weather modeling and visualization Zhizhin, M., A. Polyakov, D. Medvedev, A. Poyda, S. Berezin Space Research Institute.
1 NOAA IOOS Program Data Integration Framework (DIF) Project Overview Adapted from a brief to the NOAA Data Management Committee August 6, 2008 by Jeff.
Roberto Lucchi Esri INSPIRE Discovery, View and Download and OGC standards.
Making Geological Map Data for the Earth Accessible OneGeology: assisting Geological Surveys worldwide to interoperate seamlessly on the Next Generation.
© MarineXML 2006 Slide 1 of 16 RISE / MOTIIVE HAB+PB Brussels, Belgium, 4 th October 2006 MOTIIVE 12 Month Summary Keiran Millard 1, Andrew Woolf 2, Jeremy.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
IOOS Data Services with the THREDDS Data Server Rich Signell USGS, Woods Hole IOOS DMAC Workshop Silver Spring Sep 10, 2013 Rich Signell USGS, Woods Hole.
Unidata’s TDS Workshop TDS Overview – Part I July 2011.
AUKEGGSWorkshop ANU, Canberra, 29 November 2006 Implementing CSML Feature Types in applications within the NERC DataGrid Dominic Lowe, British Atmospheric.
The Geographic Information System of the European Commission (GISCO) By Albrecht Wirthmann, GISCO, Eurostat ESPON.
Observations & Measurements & SWE in Inspire OGC Hydro DWG Workshop – Reading – Sylvain Grellet Office International de l’Eau.
WIGOS Data model – standards introduction.
© MarineXML 2005 Slide 1 of 19 Geospatial Standards for Earth System Science Data Edinburgh, Scotland, 6 th -8 th September 2005 MarineXML & MOTIIVE Keiran.
© University of Reading 2008www.reading.ac.uk Reading e-Science Centre 9 September 2008 Harmonization of environmental data using the Climate Science Modelling.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Implementing Marine XML for NOAA Observing Data Nazila Merati and Eugene Burger NOAA/Pacific Marine Environmental Laboratory Seattle, WA.
GIS for Atmospheric Sciences and Hydrology By David R. Maidment University of Texas at Austin National Center for Atmospheric Research, 6 July 2005.
GO-ESSP LLNL, June 2006 CSML – Stocktake and Forward Look Andrew Woolf Dominic CCLRC Rutherford Appleton Laboratory.
UC 2006 Tech Session 1 NetCDF in ArcGIS 9.2. UC 2006 Tech Session2 Overview Introduction to Multidimensional DataIntroduction to Multidimensional Data.
WaterML 2.0 Part 1 - Time Series Hydro Informatics Conference Workshop *Standardization of Water Data Exchange: WaterML2.0 and Beyond* Presented by : Open.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
OGC Web Services with complex data Stephen Pascoe How OGC Web Services relate to GML Application Schema.
COMPASS09 Annual Conference of Compass Informatics.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
Update on Unidata Technologies for Data Access Russ Rew
Bavarian Agency for Surveying and Geoinformation AAA - The contribution of the AdV in an increasing European Spatial Data Infrastructure - the German Way.
ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.
European Monitoring Platform for Mapping of QoS and QoE
or some relevant web services
Ocean Data View Reiner Schlitzer
Ocean Data View Reiner Schlitzer
BADC, BODC, CCLRC, PML and SOC
Presentation transcript:

Integrating the Climate Science Modelling Language with geospatial software and services Dominic Lowe British Atmospheric Data A.Woolf, B.N. Lawrence, S. Pascoe

Context Developed and deployed a metadata schema with associated services for the Atmospheric/Oceanographic application domain. Summary of issues encountered Almost exactly the process INSPIRE is mandating.

INSPIRE Data Specifications: 34 themes including Atmospheric Conditions, Oceanography, Meteorology “standardisation of formats and nomenclatures so that the data sets can be combined seamlessly and without manual intervention” “Interoperability is the ability of two or more autonomous entities, like web services or applications, to communicate and co-operate with each other in a meaningful way. This interaction should not require special efforts by the data producer or consumer -be it human or machine.(

Aim to engage with GIS standards... NetCDF, HDF, PP, GRIB, NASAAmes, ASCII, Databases... ? DataCentre WMS WCS WFS Metadata ISO TC211 for Geographic Information GML Application Schema CSML – Climate Science Modelling Language OGC

Climate Science Modelling Language UML model & GML Application Schema

CSML Feature Types AVHRR satellite imageryTwo-dimensional grid of data along a satellite ground-path SwathFeature numerical weather prediction model, ocean general circulation model Time-series of gridded parameter fieldsGridSeriesFeature gridded analysis fieldSingle time-snapshot of a gridded field.GridFeature weather radarBackscatter profiles along a look direction at fixed elevation but rotating in azimuth ScanningRadarFeature marine CTD measurements along a ship’s cruise track Series of profiles of unequal length along a trajectory in time and space RaggedSectionFeature shipborne ADCPSeries of profiles from positions along a trajectory in time and space. SectionFeature repeat daily balloon soundings of atmospheric temperature from the same location Time-series of unequal-length profiles, but on fixed vertical levels, at a fixed location RaggedProfileSeriesFeature vertical radar timeseries, thermistor chain timeseries Time-series of profiles on fixed vertical levels at a fixed location ProfileSeriesFeature wind sounding, XBT, CTD, radiosondeSingle ‘profile’ of some parameter along a vertical line in space. ProfileFeature 2m temperatures measured at weather stations across the UK at 0600z. Collection of distributed single datum measurements at a particular time PointCollectionFeature surface salinity along a ship’s cruise track; atmospheric aerosols along an aircraft’s flight path Measurement along a discrete path in time and space. TrajectoryFeature tidegauge, rainfall timeseriesTime-series of single datum measurements at a fixed location in space. PointSeriesFeature raingauge measurementSingle point measurement.PointFeature ExampleDescriptionFeature type

Problem solved? NetCDF, HDF, PP, GRIB, NASAAmes, ASCII, Databases... DataCentre WMS WCS WFS CSML Application Schema OGC ? ?

Infrastructure components

XML Handling Custom parser built for CSML Application Schema to read and write instance documents. Investment needed in generic GML Application Schema parsers CSML Documents... Python Classes class GridFeature:... toXML() fromXML() Provides API to CSML documents

Creating instance documents CSML Scanner PointSeries GridSeries Profile Section Radar Swath.... Features Which feature type? which files? which file type? which variables? which coordinate reference system...?

References to stored data CSML contains FileExtracts – pointers to data. Goes beyond current GML practice of inline storage. Essential for large volume data. Extensible for different formats Data access schema development in parallel with application schema development.

Harmonised data access layer Sensible handling of multiple data formats requires robust plug-in data interface architecture. CSML Code Prototype developed, but more generic/robust system needed for other application domains. Harmonised Data Interface layer CDMS NaPP Y PIL SQL Data APIs

Xlink in GML Application Schema Describes the nature of the remote resource in relation to the referring GML element (“local resource”) Describes the nature of the remote resource <gmlElement xlink:arcrole="urn:ogc:def:contentprovider:OGC:1.0:direct" xlink:href="file:///myfile.nc#temperature" xlink:role="urn:ogc:def:fileformat:OGC:1.0:netcdf" xlink:show="embed"/> See OGC Document: Proposal to OGC – using XLINK to reference data. Requires more research. Beyond current GML practice for App. Schemas.

Vocabularies/Catalogues/Standard Terms Coordinate Reference Sytems in our application domain are not well catalogued. Hybrid Sigma Pressure Levels, etc. Catalogues and tools required to assist with identifying Coordinate Reference systems Ongoing work with standard vocabularies e.g. CF Standard Names. Assist greatly with axis identification. All these things aid automation and reduce human intervention. Using common vocabularies and catalogues is critical for interoperability.

Summary Followed rules for application schema development Problem only partly solved! Many implementation issues to consider Opportunities for development of re-useable component INSPIRE is coming!