Agenda item #7 SoE data flows

WISE SoE data flows River water quality Lake water quality [WG DIS 2014-10] River water quality + biology Lake water quality + biology Groundwater quality Water quantity * Quick list of the data flows: this are the traditional WISE SoE data flows. Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances. These have been running since around 2000. http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquality Biology data is also reported here (except groundwater for obvious reasons). Water Quantity – including water use (abstraction and returns per sector of economic activity) WISE-SoE dataflow since 2009 http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquantity Emissions to water – including point sources, but also diffuse sources WISE-SoE dataflow since 2008 (test reporting) http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-wateremissions Emissions to water *

WISE SoE data flows Content review of the WISE SoE data flows against upcoming WFD reporting in 2016 Data specifications review Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

WISE SoE data flows Content review of the WISE SoE data flows against upcoming WFD reporting in 2016 Data specifications review Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

Prioritisation of the data collection (determinands) according to EEA products & requirements (assessments, indicators, reports, maps…) Step Criteria Value Decision 1  Priority Substance according to relevant Directive ? Yes Must No Go to #2 2  Required for current EEA products (indicators, assessments, reports, etc.) ? Go to #3 3  Required for future planned assessments (i.e. complementing WFD with relevant time series) ? Go to #4 4  Frequently monitored and reported information ? Go to #5 Go to #6 5  Information that can be derived from other reliable data sources currently available to the EEA ? Won't 6  Useful and usable ancillary information for current EEA products, including QC of other "Must" parameters ? Should Go to #7 7 Useful and usable ancillary information for planned EEA products ? Could As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

Pollution from oxygen consuming substances Example: Pollution from oxygen consuming substances Determinant #Countries Proposal Existing EEA products Ammonium Total 18 must CSI19, WISE maps Ammonium 27 BOD5 28 BOD7 5 CODCr 23 should CSI19 CODMn 14 Total Organic Carbon (TOC) 25   Dissolved Organic Carbon (DOC) 12 won’t Dissolved Oxygen 31 could Oxygen saturation 26 Non-ionised Ammonia 9 Invertebrate EQR_G

Content review followed an adapted approach… Water quantity Content review followed an adapted approach… # In SoE? In another data source? Needed by EEA? Decision Criteria a 1 Must Because it is needed. b Won't Because it is not needed. Also applies for variables that can be derived. c1 If there is an agreement between the EEA and the other institution. c2 Should If the spatial and/or temporal resolution of the other data source is not adequate. c3 If the other data source can be used. d1 If, and only if, there is an agreement between the EEA and e.g. Eurostat, DG ENV. d2 Because it's not needed. e1 If, and only if, there is an agreement between the EEA and the other institution. e2 Could e3 f1 f2 Won´t g h (additional line…for completeness sake…) Because it is not needed.

Water quantity i a a a b b c c c c1 c c2 c3 d d d1 d d2 e e e1 e e2 e3 1. Start with the current WISE SoE Water Quantity data collection 2. Check against Eurostat JQ-IW or REQ {and do the same for the 2016 WFD} data collection 3. Check against EEA end-products data requirements Future WISE SoE Water Quantity Future “prefilling” of JQ or WFD a a a b b c c c c1 c c2 c3 d d d1 d d2 e e e1 e Regional Environmental Questionnaire (REQ) e2 e3 f f1 f f2 Water quantity g g e e e i f f f f g g h h h i i

WISE SoE data flows Content review of the WISE SoE data flows against upcoming WFD reporting in 2016 Data model review Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

Concepts & vocabularies WFD Rivers + biology Standardise, document and reuse: Concepts & vocabularies Data models Code lists Spatial units Processes Formats Services Floods Lakes + biology Groundwater BWD Water Quantity UWWTD Emissions DWD

WISE SoE data flows Data model review Consolidation of the determinant code lists Unique common code list of determinands for SoE data flows (EIONET workshop 2015-06-18) As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing. Harmonization with (and for) the WFD Annexes 8b-j, 8p (in progress)

Common code lists? Consolidated code list for EIONET review (2015-06-18) Consolidated code list also with/for WFD Annexes 8b-j, 8p ? Quick list of the data flows: this are the traditional WISE SoE data flows. Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances. These have been running since around 2000. http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquality Biology data is also reported here (except groundwater for obvious reasons). Water Quantity – including water use (abstraction and returns per sector of economic activity) WISE-SoE dataflow since 2009 http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquantity Emissions to water – including point sources, but also diffuse sources WISE-SoE dataflow since 2008 (test reporting) http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-wateremissions

Common code lists: current status Consolidated list for EIONET review Harmonisation of/with WFD annexes Rivers nutrients completed in progress hazardousSubst completed in progress biology completed Lakes nutrients completed in progress hazardousSubst completed in progress biology completed Quick list of the data flows: this are the traditional WISE SoE data flows. Water Quality – in rivers, lakes and groundwater, including nutrients & hazardous substances. These have been running since around 2000. http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquality Biology data is also reported here (except groundwater for obvious reasons). Water Quantity – including water use (abstraction and returns per sector of economic activity) WISE-SoE dataflow since 2009 http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-waterquantity Emissions to water – including point sources, but also diffuse sources WISE-SoE dataflow since 2008 (test reporting) http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-wateremissions Groundwater nutrients completed verified hazardousSubst completed verified Emissions pointSources completed completed diffuseSources completed completed

WISE SoE data flows Data model review Consolidation of the determinant code lists Consolidation of the overall structure As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

“On-update”? Spatial data Ongoing discussion… The ActionType enumeration is used to specify the action that a receiving system should take when processing the content […]: Append Data or metadata is an incremental update for an existing data/metadata set or the provision of new data or documentation (attribute values) formerly absent. If any of the supplied data or metadata is already present, it will not replace that data or metadata. This corresponds to the “Update” value found in version 1.0 of the SDMX Technical Standards. Replace Data/metadata is to be replaced, and may also include additional data/metadata to be appended. Delete Data/Metadata is to be deleted. Information Data and metadata are for information purposes. [SDMX 2.0]

Emissions Minor changes to the data structure One table dropped (on spatial data) One metadata table added (on procedures) Changes are proposed to the current code lists (maintaining backward compatibility): for point sources (http://dd.eionet.europa.eu/dataelements/46749) for diffuse sources (http://dd.eionet.europa.eu/dataelements/63572) Emissions to water – including point sources, but also diffuse sources WISE-SoE dataflow since 2008 (test reporting) http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-wateremissions

To be merged? To be removed? To be added? Metadata on the procedures and emission sources category schema

Water quantity Water Quantity is a “hybrid data flow” Data structures Water quantity part: Two options open for discussion with EIONET: n Data cubes (as before) ? or normalised tables (as in Emissions)? Time series + monitoring sites: will follow the same approach as the water quality data flows. Emissions to water – including point sources, but also diffuse sources WISE-SoE dataflow since 2008 (test reporting) http://rod.eionet.europa.eu/contacts?roleId=eionet-nrc-wateremissions

WISE SoE data flows Remove inconsistencies Water quality Harmonised data model Single reporting flow for water quality ? Rivers + biology Lakes + biology Groundwater Water quantity Emissions

Time series

Time series

WISE SoE data flows Water quality Spatial data Spatial data (or ancillary data related to the sampled unit) repeatedly reported. Water quantity Emissions

WISE SoE data flows Water quality Spatial data Time-series reporting (annual). Spatial data reporting (“on-update”). Water quantity Emissions

Spatial data in SoE Groundwater

Spatial data in SoE rivers and lakes

From WFD ?

WISE SoE data flows Spatial data WFD 2016 Spatial data Monitoring Sites Rivers Lakes Groundwater SUs RBDs

WISE SoE data flows Spatial data Needs to be in place to collect: data from countries not reporting under WFD EIONET sites not used in WFD monitoring & reporting hydrographic features that are not WFD WaterBodies (e.g. very small lakes) Monitoring Sites Rivers Lakes Groundwater SUs RBDs

INSPIRE Environmental Monitoring Facilities Rivers Lakes GW TCM WQ Monitoring sites INSPIRE Environmental Monitoring Facilities  [2015-2016 Project] Characterisation of the spatial unit Nutrients ISO 19156:2011 Observations and Measurements  Hazardous substances Biology Pressures

result Why not use ISO 19156 O&M ? when where what how …why Observation + phenomenonTime WaterBody PropertyType Result ObservationProcess MonitoringSite +result +observedProperty +procedure +featureOfInterest +sampledFeature what how …why

Why not use ISO 19156 O&M just yet? The conceptual model is adequate, but the encoding is more complex than needed in this specific reporting context. Should be used, in a “INSPIREd” reporting, but… Technical review of QA/QC of data flows to develop more efficient processes between EEA and Member Countries, including feedback mechanisms As was present in the Freshwater EIONET workshop in June, there will be a content review of the WISE SoE data flows to try and harmonise the content against the next 2016 water framework directive reporting. There have been substantial change to the WFD Guidance documents, so – as happened in 2010 – there will need to be adjustments in the WISE SoE dataflow so that the two reporting obligation can complement each other. Also for the WFD reporting, the Commission is putting a major emphasis on improving the quality of data deliveries and reducing the time from reporting to dissemination and availability of data for compliance assessment. Again requires automation, but it also requires a major shift on the way we take data quality issues – namely what needs to be done at member state level and what can be done at European leven during data processing.

Questions? Agenda item #7a - SoE fernanda.nery@eea.europa.eu, olaf.buettner@ufz.de