Australian Bureau of Meteorology Water Information Program - Building a national water database Tony Boston Assistant Director Water Data Services

Outline Bureau of Meteorology - Water Information ProgramBureau of Meteorology - Water Information Program Water Act 2007 and RegulationsWater Act 2007 and Regulations Water data transfer standardsWater data transfer standards Ingestion of water observations dataIngestion of water observations data Australian Water Resources Information System (AWRIS)Australian Water Resources Information System (AWRIS) Australian Hydrological Geospatial Fabric (Geofabric)Australian Hydrological Geospatial Fabric (Geofabric)

Bureau of Meteorology functions National Weather Service National Tsunami Alert Service National Tidal Centre National Flood Warning and Forecasting Service National Climate Monitoring System National Ocean Current Prediction National Water Information Service Climate and Meteorological Research (with CSIRO) Climate and Meteorological Research (with CSIRO) DATA

Rainfall Deciles – 1 November 2001 to 31 October 2008 Distribution based on Gridded Data Product of the National Climate Centre

The water information value ladder Measurement Quality assurance Archiving in house Integration Analysis Reporting Forecasting Distribution Rarely done Generally done poorly Generally done well, by over 100 groups, but could be vastly improved with new technology >>> Increasing value >>> Data >>> Information >>> Insight

Bureau of Meteorology - Water Information Program 10-year Commonwealth program, started July 07 $450m funding – –110 new staff + systems + R&D – –support for data providers Legislative backing – –Water Act 2007 – –Water Regulations 2008 Relies on collaboration with data providers The Bureau will become Australia’s leading water information provider

Provider data Streamflow Groundwater Water quality Water use Entitlements and Trades Storage Diversions Various spatial data layers AWRIS Water Data Geofabric Hydro DB Climate DB Information products Information products REPORTING SERVICES FORECASTING SERVICES Browser, PDA, RSS, XML Dynamic NATIONAL WATER RESOURCE ASSESSMENT NATIONAL WATER ACCOUNT Rolling annual reports Static

Water Regulations 2008 Specify a complex matrix of categories of data, types of organisation and timeframes for delivery to the BureauSpecify a complex matrix of categories of data, types of organisation and timeframes for delivery to the Bureau Initial Regulations ask for any data in electronic formatInitial Regulations ask for any data in electronic format => lots of ‘CSV’ with no schema! => lots of ‘CSV’ with no schema! Bureau can define National Water Information StandardsBureau can define National Water Information Standards Data transfer standards will be mandated in future versions of the Water RegulationsData transfer standards will be mandated in future versions of the Water Regulations

Categories of water information 1. 1.surface water resources 2. 2.groundwater resources 3. 3.information on major and minor storages 4. 4.meteorological information 5. 5.water use 6. 6.rights, allocations and trades 7. 7.urban water management 8. 8.water restrictions 9. 9.water quality metadata for the above

Types of Organisation A. A.Lead State/Commonwealth water agencies B. B.Other State/Commonwealth agencies C. C.Hydroelectricity generators D. D.Owners or operators of major storages E. E.Rural water utilities F. F.Urban water utilities G. G.CMAs and like organisations H. H.Flood level information providers

Data Transfer to Bureau of Meteorology Canberra Source: David Maidment 2009

Water Regulations data delivery ten primary categories of data (~65 variables) eight categories of person (246 persons in total) observation points with time series entire historical archive provided at first updated thereafter real time, daily, weekly, monthly or yearly Oct 08Feb 09Apr 09Jul 09

Water data transfer standards Under WIRADA research alliance, CSIRO and the Bureau have developed the Water Data Transfer Format (WDTF)Under WIRADA research alliance, CSIRO and the Bureau have developed the Water Data Transfer Format (WDTF) –Version 0.2 September 2008 –Version 0.3 February 2009 –Version 1.0 October 2009 Developed through the Bureau’s Water Information Research and Development Alliance (WIRADA) with CSIRODeveloped through the Bureau’s Water Information Research and Development Alliance (WIRADA) with CSIRO –$50M over 5 years

Water Data Transfer Format (WDTF) XML formatXML format Based on standards stack from Open Geospatial Consortium (OGC):Based on standards stack from Open Geospatial Consortium (OGC): –Geography Markup Language (GML) –Observations and Measurements (O&M) –Simple features profile => compatible with WFS and SOS => compatible with other environmental data

Development of WaterML 2.0 Aim: – –Harmonize Australian WDTF and CUAHSI WaterML 1.X – –Link to more hydrologic feature-types. not just point monitoring sites – –Improved vocabulary/ontology management, mapping, publication   international standard for water observations data, interoperable with other domains in environmental sciences – –CSIRO – –CUAHSI – –OGC Hydrology Domain Working Group – –WMO Commission for Hydrology – BoM

WaterML 2.0 evolution

AWRIS Core Solution Overview

AWRIS: Receive Regulations Data

File statistics

The Australian Hydrological Geospatial Fabric (the Geofabric) The Geofabric will be a suite of authoritative spatial data products forming a consistent, national geospatial framework for hydrological features. It will contain a consistent representation of water features and their connectivity in the Australian Water System. The Geofabric will become the geospatial information framework for Australia’s water information activities.

AWRIS: Present web products Web User

AWRIS products Find – –Map interface and text searching Get – –Data download, plots, dashboards, maps Web services for SpatioTemporalKeyword searching – –WFS or SOS from holdings catalogue – –WDTF or WaterML 2.0 for time series observations data Customisation – –MyAWRIS and mobile applications Static content – –National Water Accounts – –Water Resource Assessments

Australian Dam Storage and Level Information (ADSLI)

Licensing of data and information products Australian governments have traditionally applied Crown Copyright: ©Commonwealth of AustraliaAustralian governments have traditionally applied Crown Copyright: ©Commonwealth of Australia Movement towards open access to public sector informationMovement towards open access to public sector information –National Government Information Licensing Framework –Built on Creative Commons (mainly Attribution) licensing The Bureau would like to use Creative Commons for water data and information productsThe Bureau would like to use Creative Commons for water data and information products –Requires agreement from data suppliers –Phased implementation

Thank you Tony Boston