Water Quality Data Publishing from an OGC Web Feature Service Jonathan Doig NSW Department of Natural Resources

DIMWG SDISC - 22 May 2006 Context From CANRI program NRAtlas web portal, catalogue, WMSwebportalWMS WFS pilot with ESRI and Social Change Online Toward NSW SDI Initial focus on NRM indicator reporting

DIMWG SDISC - 22 May 2006 Standards...what we're using and why Web Feature Service (WFS) WFS Mandatory: Optional: GetCapabilitiesFeature Types, GML Object Types, Filter Capabilities DescribeFeatureTypeGML schema GetFeature [WithLock] (queries) Feature Collection Transaction (Insert, Update, Delete) Status LockFeatureLock ID, Features Locked GetGmlObject (by ID) GML element RequestResponse

DIMWG SDISC - 22 May 2006 Standards...what we're using and why For graphs, download, thematic maps Other agencies can use our data in their reporting (local, catchment, state, national SoE,...) Already supported by GIS vendors Web Feature Service (WFS)

DIMWG SDISC - 22 May 2006 Observations & Measurements framework Based on Measurement Theory Application profile of GML, from WFS Standard patterns (where, when, how, etc) Just insert the bits we need Support by SCOTS software Minimal customisation and maintenance Integrate with other systems (semantic web) Standards...what we're using and why

DIMWG SDISC - 22 May 2006 Observations & Measurements framework Standards...what we're using and why

Observations & Measurements framework - detail ESCAWRI TWG - 12 Oct 2005

DIMWG SDISC - 22 May 2006 Geoserver WFS software Used in Australian SEEGRID geochemistry demonstrator – all geoscience agenciesSEEGRID Supports complex data & maps from internal tables to community schema Open source WFS reference implementation geoserver.sourceforge.net Standards...what we're using and why

Deployed components IntranetDMZInternet Config Geoserver WFS 3rd-party Application WFS Test Harness NRAtlas Portal SDI Registry Database SDI Registry 3rd-party Application End userApplication developer Feature Types Queries Style sheets DatasetsContextsServices Water quality operational database Export script Water quality distribution database

DIMWG SDISC - 22 May Select map from home page [Live demo – test.nratlas.nsw.gov.au][Skip slides]Live demo – test.nratlas.nsw.gov.auSkip slides

DIMWG SDISC - 22 May Click feature on map

DIMWG SDISC - 22 May Choose/confirm query

DIMWG SDISC - 22 May View time-series graph

DIMWG SDISC - 22 May Change query

DIMWG SDISC - 22 May View graph

DIMWG SDISC - 22 May Download data

Contexts Water quality distribution database Geoserver WFS 3rd-party Application WFS Test Harness NRAtlas Portal SDI Registry Database SDI Registry 3rd-party Application End userApplication developer Feature Types Queries Style sheets Datasets Services Walk-through: Select map from home page IntranetDMZInternet Config Water quality operational database Export script Config

DIMWG SDISC - 22 May 2006 Catalogue-driven WFS workflow Why use a WFS? To get related or more detailed data for a selected feature To download data to user To generate a report for an area To use a WFS Need to generate a query Do something with results

DIMWG SDISC - 22 May 2006 Overview of main workflow 1.Map locations (using mappable feature type) 2.Select site 3.“Chain” Mode (graph/download/report) Target feature (e.g. time-series feature type) Configuration 4.Where configuration not specified in request, look up catalogue for feature type Query Portrayal configuration Data transform (e.g. to graph syntax)

DIMWG SDISC - 22 May 2006 Views into data Related Feature Types Stations (map) Station id Time-series (graph) Time-series (download)

DIMWG SDISC - 22 May 2006 Information model Retro-fitted to existing catalogue: all just METADATA & CLASSIFICATIONS Heterogeneous XML documents in catalogue (type=DAQM – Data Access Query Model) 1:N Classifications: FEATURE_TYPE (“relevant to”) ROLE – what part of binding process RESULT_TYPE (for download – to control browser handling of results) m Text/html m Text/xml m KML (etc)

DIMWG SDISC - 22 May 2006 Existing catalogue/registry design CLASSIFICATION CodeSpace Value Readable_Term FK_ID 1 METADATA ID Title Description ResourceURL Type X, Y, X1, Y1 BeginDate, EndDate Creator, CreateDate PreviewURL MetadataHTMURL XML_CharStream n

DIMWG SDISC - 22 May Click feature on map

DIMWG SDISC - 22 May 2006 Discovered Data Service Catalogue Form DAQM Query Vocab Catalogued Metadata Document Process Data transfer (standard format)

DIMWG SDISC - 22 May View time-series graph Graph Config Graph Defn XSLT Data Query Data Access Service Discovered Data Service

DIMWG SDISC - 22 May Download data Discovered Data Service (Feature Type) Catalogue XSL Transform (XSL) Download Format Viewer

DIMWG SDISC - 22 May 2006 Key to detailed information model Catalogue Query: Classifier.X=Y CODESPACE=X And VALUE=Y XML doc queryTemplate=URL HTTP query parameters override defaults This provides information to set up catalogue contents and bookmarkable query forms

DIMWG SDISC - 22 May 2006 Discovered Data Service Catalogue Form DAQM Query Vocab 1. Initiate query (eg click feature on map) MapContext/Layer or catalogued service (feature_type) Type=DAQM Classifier.ROLE=modeQuery (graphQuery | reportQuery | downloadQuery) Classifier.FEATURE_TYPE=feature_type Referenced by DAQM queryTemplate=URL mode=graph | download | report

DIMWG SDISC - 22 May 2006 Catalogue contents Detail from Catalogue Maintenance utility

DIMWG SDISC - 22 May View time-series graph Graph Config Graph Defn XSLT Data Query Data Access Service Discovered Data Service Default: same as original service (extension – search for services) Type=DAQM Classifier.ROLE=graphConfig Classifier.FEATURE_TYPE=feature_type Data Reformat graphConfig=URL graphPackage=URL service=URL Type=DAQM Classifier.ROLE=graphPackage Classifier.FEATURE_TYPE=feature_type

DIMWG SDISC - 22 May Download data DAQM Catalogue XSL Transform (XSL) Download Format Viewer Type=DAQM Classifier.ROLE=downloadPackage Classifier.FEATURE_TYPE=feature_type Mime-type = Classifier.RESULT_TYPE downloadStylesheet=URL downloadFeatureType=feature_type downloadQueryModel=DAQM

DIMWG SDISC - 22 May 2006 Water quality data publishing–other outputs DNR Web Feature Service Developer doco - for standards-based data models Project website (below) > Architecture > OandMCookbookArchitectureOandMCookbook National demonstration Project website > NRInfo > WaterML > WQDPWQDP

DIMWG SDISC - 22 May 2006 National alignment Commonwealth Observer on our project Co-sponsored standards doco Native veg reporting pilot Funded project completion, pilot with NSW & SA Developing Australian water data infrastructure Northern Territory Co-sponsored Geoserver software development

DIMWG SDISC - 22 May 2006 Indicator governance–who owns what? Indicator definition Monitoring results  Name  Analyte  Units  Frequency  Sampling method  Summary method  Rationale  Issue background Target  Baseline date  Target date  Target value Summarise  Analyte  Date/time  Site  Value Indicator results  Indicator  Time period  Region  Value/rating Interpret Interpretation  Trend  Pressure  Response Dataset  Name  Custodian  Other metadata…

DIMWG SDISC - 22 May 2006 Questions? Project website > NRInfo > WaterML Contact Jonathan Doig