NERC DataGrid and CSML NDG Team. CSML: Context NERC DataGrid: the integration problem –multiple organisations, formats, storage mechanisms (file, relational)

Slides:



Advertisements
Similar presentations
1 WCS Encoding Format Profiles netCDF Example Stefano Nativi, Lorenzo Bigagli, Ben Domenico, John Caron March 2006 Draft based mainly on presentations.
Advertisements

Page 1 © Crown copyright 2005 Workshop on Metadata Beijing27-29 September Report on Metadata Gil Ross (Met Office UK) WIS Working Group Geneva.
Information Modelling MOLES Metadata Objects for Linking Environmental Sciences S. Ventouras Rutherford Appleton Laboratory.
CEN/TC 287 general presentation 1 CEN/TC 287 Standardization of Geographic information general presentation Annet van der Horn secretary CEN/TC 287 Arnold.
© MarineXML 2006 Slide 1 of 16 MOTIIVE : RISE HAC-PB EC, Brussels, 6 th June 2007 MOTIIVE:RISE Harmonisation Advisory Committee and Project Board European.
1 NODC, Russia GISC & DCPC developers meeting Langen, 29 – 31 March E2EDM technology implementation for WIS GISC development S. Sukhonosov, S. Belov.
1 1 Atmospheric Conditions And Meteorological Geographical Features (TWG – AC+MF) Spiros Ventouras (Editor) CEDA – RAL Space - STFC Edinbrough 29 June.
1 Fourth GO-ESSP Meeting Rutherford Appleton Lab Chilton, UK 7 June, 2005 Data integration with the Climate Science Modelling.
Geospatial standards Beyond FGDC Geog 458: Map Sources and Errors March 3, 2006.
New ways to geo-reference and classify spatial data in Annex II & III data specifications Clemens Portele interactive instruments GmbH Drafting Team „Data.
1 TECO-WIS, 6-8 November 2006 TECHNICAL CONFERENCE ON THE WMO INFORMATION SYSTEM Seoul, Republic of Korea, 6-8 November 2006 ISO 191xx series of geographic.
BADC, BODC, CCLRC, PML and SOC The NERC Metadata Gateway: a product of the NERC DataGrid [ ]= Bryan Lawrence (on behalf of a big team)
Martin Doerr, Gerald Hiebel, Institute of Computer Science
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Information modelling – standards context Simon Cox.
Interoperability A simple case for standards Kim Finney JCADM – Rome 2007.
A Liaison Report from ISO TC211 to CEOS WGISS Dr. Liping Di
1 NODC, Russia SeaDataNet TTG meeting Paris, May Overview and potential use of E2EDM technology for SeaDataNet Sergey Belov, Nick Mikhailov.
Controlled Vocabularies (Term Lists). Controlled Vocabs Literally - A list of terms to choose from Aim is to promote the use of common vocabularies so.
EuroMISS, EuroDSS and DMS Update of Progress Keiran Millard Keiran Millard
WXXM-1 OJN 5/14/09 MIT Lincoln Laboratory WXXM, JMBL, CAP Discussion NNEW Data Format Meeting 17 November, 2009.
© MarineXML 2006 Slide 1 of 14 AGI Marine and Coastal Zone SIG – Oceans of Change ExCeL, London 22 nd March 2006, Developments in Marine Standards Keiran.
Unidata’s TDS Workshop TDS Overview – Part II October 2012.
Metadata templates and patterns Sergey Sukhonosov, Dr. Sergey Belov National Oceanographic Data Centre, Russia Training course on establishment of the.
INSPIRE, EC Water Standards and WaterML Workshop Keiran Millard Keiran Millard
® The sampled feature of hydrologic observation Hydrology Domain Working Group at the OGC/TC Meeting, Austin, 2012, Mar Irina Dornblut, Global Runoff.
1 The NERC DataGrid DataGrid The NERC DataGrid DataGrid AHM 2003 – 2 Sept, 2003 e-Science Centre Metadata of the NERC DataGrid Kevin O’Neill CCLRC e-Science.
Grid-enabling OGC Web Services Andrew Woolf, Arif Shaon STFC e-Science Centre Rutherford Appleton Lab.
Mapping between SOS standard specifications and INSPIRE legislation. Relationship between SOS and D2.9 Matthes Rieke, Dr. Albert Remke (m.rieke,
1 NESC workshop Grid and Geospatial Standards 7-Sep-2005 Data integration with the Climate Science Modelling Language Andrew Woolf 1, Bryan Lawrence 2,
ET-ADRS-1, April ISO 191xx series of geographic information standards.
NOCS, PML, STFC, BODC, BADC The NERC DataGrid = Bryan Lawrence Director of the STFC Centre for Environmental Data Archival (BADC, NEODC, IPCC-DDC.
What is Information Modelling (and why do we need it in NEII…)? Dominic Lowe, Bureau of Meteorology, 29 October 2013.
Copyright © 2009, Open Geospatial Consortium, Inc. Time issue : Meteo Domain needs and WMS present means Meteorology DWG Frédéric Guillaud, Marie-Françoise.
® GRDC Hydrologic Metadata - core concepts - 5 th, WMO/OGC Hydrology DWG New York, CCNY, August 11 – 15, 2014 Irina Dornblut, GRDC of WMO at BfG Copyright.
1 International Standards for Data Interoperability GALEON Geo-interface for Air, Environment, Land, Ocean NetCDF Ben Domenico Unidata Program Center*
Environmental Data - Web APIs Current practice and future directions DATA61 Peter Taylor HydroDWG Workshop, 21 st Sept 2015.
AUKEGGS Architecturally Significant Issues (that we need to solve)
© MarineXML 2006 Slide 1 of 16 RISE / MOTIIVE HAB+PB Brussels, Belgium, 4 th October 2006 MOTIIVE 12 Month Summary Keiran Millard 1, Andrew Woolf 2, Jeremy.
Rupa Tiwari, CSci5980 Fall  Course Material Classification  GIS Encyclopedia Articles  Classification Diagram  Course – Encyclopedia Mapping.
Integrating the Climate Science Modelling Language with geospatial software and services Dominic Lowe British Atmospheric Data
ESDI Workshop on Conceptual Schema Languages and Tools
Observations & Measurements & SWE in Inspire OGC Hydro DWG Workshop – Reading – Sylvain Grellet Office International de l’Eau.
OGC ® ® Suite of Water Information Standards HIC-11 Tutorial: Standardization of Water Data Exchange WMO/OGC Hydrology Domain Working Group Irina Dornblut,
WIGOS Data model – standards introduction.
Slide 1 SDTSSDTS FGDC CWG SDTS Revision Project ANSI INCITS L1 Project to Update SDTS FGDC CWG September 2, 2003.
© MarineXML 2005 Slide 1 of 19 Geospatial Standards for Earth System Science Data Edinburgh, Scotland, 6 th -8 th September 2005 MarineXML & MOTIIVE Keiran.
AUKEGGS Canberra, Exposing legacy file-based data (interop-for-files) Andrew Woolf CCLRC Rutherford Appleton Laboratory
Dominic Lowe, British Atmospheric Data Centre, STFC OGC TC, Boulder.
GO-ESSP LLNL, June 2006 CSML – Stocktake and Forward Look Andrew Woolf Dominic CCLRC Rutherford Appleton Laboratory.
Grids and Beyond: netCDF-CF and ISO/OGC Features and Coverages Ethan Davis, John Caron, Ben Domenico UCAR/Unidata AMS IIPS, 23 January 2008.
® Hosted and Sponsored by Observed Observable Properties - from HY_Features perspective - OGC Hydrology Domain Working Group 3 rd Meeting, Reading, UK,
® Sponsored by OGC TimeseriesML Domain Range Web Service Use Case for The National Weather Service's National Digital Forecast Database 95th OGC Technical.
ESA UNCLASSIFIED – For Official Use INSPIRE Orthoimagery TWG Status Report Antonio Romeo ESRIN 15/02/2012.
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
NOAA IOOS SOS Implementations in 2008 Jeff de La Beaujardière, PhD NOAA IOOS Program DIF Sr Systems Architect.
Bavarian Agency for Surveying and Geoinformation AAA - The contribution of the AdV in an increasing European Spatial Data Infrastructure - the German Way.
WMO GRIB Edition 3 Enrico Fucile Inter-Program Expert Team on Data Representation Maintenance and Monitoring IPET-DRMM Geneva, 30 May – 3 June 2016.
OGC TC Washington – HydroDWG meeting – Inspire O&M & SWE requirements - profile BRGM – S.Grellet 52N – S.Jirka.
ECMWF 24 th November 2008 Deploying secure OGC services in front of a heterogeneous data archive. Bryan Lawrence, Phil Kershaw, Dominic Lowe, and Stephen.
Geospatial metadata Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
U.S. Department of the Interior U.S. Geological Survey WaterML Presentation to FGDC SWG Nate Booth January 30, 2013.
or some relevant web services
The NERC Metadata Gateway: a product of the NERC DataGrid
Modelling approaches for EO application schema
BADC, BODC, CCLRC, PML and SOC
S-121 Maritime Limits and Boundaries
S-121 Maritime Limits and Boundaries
S-121 Maritime Limits and Boundaries
Session 2: Metadata and Catalogues
BADC, BODC, CCLRC, PML and SOC
Presentation transcript:

NERC DataGrid and CSML NDG Team

CSML: Context NERC DataGrid: the integration problem –multiple organisations, formats, storage mechanisms (file, relational) –only commonality is data semantics

CSML – benefits of explicit semantics Aim is to be as explicit as possible about semantics of information classes Offer significant potential for advanced processing workflows Reduce representation errors (e.g. omitting key attributes) ‘Conventions’ approach is fragile

CSML – benefits of geospatial standards Interoperability!! Expanded user-base Enhanced ROI Compliance to emerging SDI infrastructures

e.g. SDI – EU INSPIRE Directive of EU, passed EP this month –10-year+ program, €1bn –Based on standards

The potential CSML CDM O&M ??? GEOSSWISINSPIRE

Background: ‘feature types’ Emerging ISO standards –TC211 – around 40 standards for geographic information –Cover activity spectrum: discovery  access  use A geospatial dataset… …consists of features and related objects… …in a defined logical structure… …delivered through services… …and described by metadata. ISO Domain Reference Model

[from ISO “Geographic information – Rules for Application Schema”] Background: ‘feature types’ Geographic ‘features’ –“abstraction of real world phenomena” [ISO 19101] –Type or instance –Encapsulate important semantics in universe of discourse Application schema –Defines semantic content and logical structure of datasets –ISO standards provide toolkit: spatial/temporal referencing geometry (1-, 2-, 3-D) topology dictionaries (phenomena, units, etc.) –GML – canonical encoding

Standards-based modelling The standards-based approach –“Conceptual modelling is the process of creating an abstract description of some portion of the real world and/or a set of related concepts.” (ISO 19101) Universe of discourse Feature types ISO Application schema ISO ISO The taxon name taxon 'ANTHOZOA',63.1,missing 'Scoloplos armiger',66.1,missing 'Spio filicornis',10,missing 'Spiophanes bombyx',60.3,missing 'Capitellidae',131.8,missing 'Pholoe',10,missing 'Owenia fusiformis',23.4,missing 'Hypereteone lactea',6.8,missing 'Anaitides groenlandica',13.2,missing 'Anaitides mucosa',6.8,missing ISO 19118

The “general feature model”

Governance in standards-based modelling The importance of governance –Information community defined by shared semantics –Need community process to manage those semantics (definitions, models, vocabularies, taxonomies, etc.) –e.g. CF conventions for netCDF files –Role of Feature Type Catalogues [ISO 19110] and registers [ISO 19135] Governance as driver for granularity –Remit / interest determines appropriate granularity –e.g. IOC, IHO, WMO abstractgenerichighly specialised feature types spectrum

CSML ambition The CSML ‘niche’ –set of base feature types for specialising or using as-is

What is CSML? British Oceanographic Data Centre British Atmospheric Data Centre ISO standards ‘Governance Principle’ Climate Science Modelling Language CSML application schema Conceptual model Schemas Tooling

CSML Version Two CSML v2 –More explicit/expanded feature types: Swath ProfileSeries  {Radar, Section, ProfileSeries} Lost ‘composite domain pattern’ –GML 3.2 (  ISO 19136) –removed ‘storage descriptors’ from core CSML schema –‘affordance’ (i.e. FT behaviour) –O&M

CSML and O&M OGC ‘Observations and Measurements’ An Observation is an Event whose result is an estimate of the value of some Property of the Feature-of-interest, obtained using a specified Procedure CSML

CSML AbstractFeature Provides common model for all CSML feature types Supports OGC Observations and Measurements model Each CSML feature: –has a type (with operations and required attributes), the ‘affordance’ concept –represents some physical ‘parameter’ (Phenomenon) –has a ‘value’ property which is a coverage (with domain and range) – the domain is often a subclass of ReferenceableGrid –may have additional attributes providing ‘reference’ spatio-temporal location parameters

CSML Abstract Feature

CSML ReferenceableGrid Implementation of ISO CV_ReferenceableGrid, missing from GML Subject of OGC GML Change Request (doc ) Analagous to CF – grid locations specified for each axis of CRS Efficiency allowed when CRS axis aligned with grid axis Supports both spatial and temporal (and compound) CRS

ReferenceableGrid subclasses

CSML v2 Feature Types Feature typeDescriptionExample PointFeatureSingle point measurement.raingauge measurement PointSeriesFeatureTime-series of single datum measurements at a fixed location in space. tidegauge, rainfall timeseries TrajectoryFeatureMeasurement along a discrete path in time and space. surface salinity along a ship’s cruise track; atmospheric aerosols along an aircraft’s flight path PointCollectionFeatureCollection of distributed single datum measurements at a particular time 2m temperatures measured at weather stations across the UK at 0600z. ProfileFeatureSingle ‘profile’ of some parameter along a vertical line in space. wind sounding, XBT, CTD, radiosonde ProfileSeriesFeatureTime-series of profiles on fixed vertical levels at a fixed location vertical radar timeseries, thermistor chain timeseries RaggedProfileSeriesFeatureTime-series of unequal-length profiles, but on fixed vertical levels, at a fixed location repeat daily balloon soundings of atmospheric temperature from the same location SectionFeatureSeries of profiles from positions along a trajectory in time and space. shipborne ADCP RaggedSectionFeatureSeries of profiles of unequal length along a trajectory in time and space marine CTD measurements along a ship’s cruise track ScanningRadarFeatureBackscatter profiles along a look direction at fixed elevation but rotating in azimuth weather radar GridFeatureSingle time-snapshot of a gridded field.gridded analysis field GridSeriesFeatureTime-series of gridded parameter fieldsnumerical weather prediction model, ocean general circulation model SwathFeatureTwo-dimensional grid of data along a satellite ground-path AVHRR satellite imagery

PointFeature

PointSeriesFeature

ProfileFeature

PointCollectionFeature

ProfileSeriesFeature

RaggedProfileSeriesFeature

SectionFeature

RaggedSectionFeature

SwathFeature

GridFeature

GridSeriesFeature

TrajectoryFeature

ScanningRadarFeature

CSML instances – semantic wrapper to persisted file-based data xlink recommended in GML for linking to external content, but no best practice established CSML wants to use this for linking to storage desriptor for coverage domain/range ‘simple xlink’ properties: –role: indicates a property of remote resource –arcrole: describes meaning of remote resource <someGMLElement xlink:arcrole="hasRemoteContentEmbeddedAt#localXpath" xlink:href="storageDescriptor#portion" xlink:role="storageSchemaIdentifier" xlink:show="embed" xlink:actuate="onRequest | onLoad"/>

CSML instances – xlink example Geodetic longitude x Linear <csml:coordAxisValues xlink:arcrole=“ xlink:href=“file://myfile.nc#lon” xlink:role=“ xlink:show=“embed”> <csml:coordAxisValues xlink:arcrole=“ xlink:href="CSMLStorageDescriptorExample.xml#coapec_u_2" xlink:role= " xlink:show=“embed”>

CSML Storage Descriptor