January Harmonising Quality Assurance in model based catchment and river basin management: The HarmoniQuA approach Dr Gareth Old CEH Wallingford, UK

January HarmoniQuA partners  WU, The Netherlands  GEUS, Denmark  NTUA, Athens, Greece  CEH-Wallingford, UK  WL | Delft Hydraulics, The Netherlands  Cemagref, France  BfG, Germany  SMHI, Sweden  VITUKI Plc, Hungary  Uni Dortmund, Germany  LNEC, Portugal  DHI Hydroinform a.s., Czech Republic

January Structure  Modelling in the UK  Modelling problems and existing Quality Assurance  The HarmoniQuA approach: Modelling Support Tool (MoST)  Evaluation of the benefits of using MoST

January Modelling in the UK  Modelling is widely used in UK river management  Commissioned by EA/SEPA or the WSCs/SW  Conducted by both large ‘framework consultants’ and small companies  Domains: Groundwater; precipitation-runoff; hydrodynamics; flood forecasting; surface water quality; ecology (socio- economics)  Quality Assurance: Technical audit; Problems often identified

January Modelling problems  Ambiguous Terminology: lack of mutual understanding between key-players. Multidisciplinary projects!  Malpractice : input data; model set-up; calibration and validation; uncertainty; scope  Data: poor documentation of quality and source  Process knowledge : Insufficient; users and clients unaware of assumptions and conceptualisation  Communication: Miscommunication between modelling team and stakeholders

January Modelling Problems  Using results for decision making: Discarding uncertainty, credibility of modelling  Transparency of the modelling process: Lack of documentation  Socio-economic and political issues: Fail to integrate domains, socio-economic issues and stakeholders

January Existing Quality Assurance  Existing guidance: WaPUG Code of Practice – UK Groundwater Resources Modelling Guidance Note - UK Good Modelling Practice Handbook - Netherlands Murray-Darling groundwater flow modelling - Australia Bay-Delta modelling protocol - USA  Contract specification Many UK modelling study contracts have associated detailed specifications of tasks, procedures and standards.  Quality Assurance ‘Tools’ None identified. However, some modelling packages provide internal audit trails Existing Guidance :Paper based, Regional/National and domain specific

January The HarmoniQuA Approach Developed the Modelling Support Tool (MoST) to provide a user friendly Quality Assurance framework for modelling teams Guide: to ensure a model has been properly applied; Monitor: to record decisions, methods and data used in these tasks; Report: to provide reports suitable for managers/clients, modellers, auditors, stakeholder and the general public.

January The HarmoniQuA Approach  Support for modelling 7 domains ( groundwater, precipitation- runoff, river hydrodynamics, flood forecasting, water quality, ecology and socio-economics ). Also, multi-domain studies  For several user types ( water managers, modellers, auditors, stakeholders and members of the public )  Modelling with different levels of complexity  Modelling by teams  Glossary

Step 1 Model Study Plan Step 2 Data and Conceptualisation Step 3 Model Setup Step 4 Calibration and Validation Step 5 Simulation and Evaluation

January HarmoniQuA MoST overview

January The HarmoniQuA WorkPackages

January Using HarmoniQuA MoST  Project Initiation: Options available  Conducting and monitoring tasks, activities and methods  Consulting guidance  The interactive glossary  Reporting

January Evaluation of the benefits of using MoST  MoST supports key user types through the modelling process  Standardised european guidance for 7 domains (plus generic)  Supports integrated multi-domain studies of various levels of complexity  Supports modelling in teams  Flexible system: List of tasks and activities can be customised Can de-select strictly follow guidance

January Evaluation of the benefits of using MoST  MoST provides users with guidance: Synthesised from published documents and expert consultations  MoST monitors and records the actions of users: Providing an auditable trail that is reproducible  MoST provides standard reports customised to specific requirements

January Evaluation of the benefits of using MoST  Remaining problems: Model code selection (see BMW project: Coupling of models (see HarmonIT project:

January Conclusion  MoST enhances the credibility of modelling studies by making user friendly Quality Assurance procedures readily available to its users  Modelling Support Tool (MoST) and integrated ‘Knowledge Base’ Available from public website  First release of MoST: Expect it to be developed  Training material is available on the public website: It includes presentations, computer screen movies and case studies  Please Download, Experiment and Comment!

January HarmoniQuA MoST Public Website: