QUALITY ASSURANCE OF MODELS FAIRMODE WG2 QUALITY ASSURANCE OF MODELS Outcome from the meeting 17thNovember 2009 P. Dilara and L. Tarrasón and the FAIRMODE WG2 meeting participants

FAIRMODE is steered by the air quality legislation To provide a permanent European Forum for Air Quality Modellers and model users To produce guidance on the use of air quality models (including fitness for purpose) for assessing current and future air quality for the purposes of implementation of the Air Quality Directive and in preparation to the revision of this Directive To study and set-up a system on the quality assurance and the continuous improvements of air quality models (WG2) To make recommendations for further research and other relevant improvements, such as improvements on emission inventories, meteorology, boundary conditions, temporal and geographic scale

FAIRMODE EEA’s data centre AirBase GMES observations EU projects FP6, FP7 COST actions Other Interested Modelling experts EEA EC-JRC DG-ENV ETC/ACC FAIRMODE Invited experts EIONET Model Users CLRTAP UNECE/EMEP AQMEII WG2 Quality assurance WG1 Guidance on modelling Best modelling practices Protocols for QA of models Input to legislation

Protocols for quality assessment Benchmarking tools FAIRMODE WG2 Its main goal is to develop a user friendly system (protocols and tools) to assess the quality of air quality models used under the implementation of the Air Quality Directive: Protocols for quality assessment Benchmarking tools Best practice guidelines Dialogue and exchange

WG2 meeting 17th november (IN) SG1 Representativeness of air quality stations SG3 Emission Inventories and Scenarios SG7 Integrated Assessment Modelling SG1 Representiveness of stations’ SG4 Protocols and Tools for benchmarking of air quality models Guidance documents WG1 SG2 Combination of monitoring and modelling (data assimilation) SG5 Contribution of natural sources and source apportionment

WG2 meeting 17th november (OUT) SG(2) + SG(1) Combination of monitoring and modelling (data assimilation) SG(5) Contribution of natural sources and Source apportionment SG (3) Emission inventories and scenarios Benchmarking SG (4) Protocols and Tools for benchmarking of AQ models Urban Agglomeration Best practice guidelines WG1

SG7 on Integrated Assessment Modelling WG2 2010 – Comment on SG7 SG7 on Integrated Assessment Modelling The meeting agreed that the proposal for evaluation of IAM uncertainties was very interesting and recommended to pursue the activity under NIAM /TFIAM FAIRMODE will work in first instance with ”What if” approaches. Therefore, the recommendation was to keep the scenario activities in SG (2) on emissions

Protocol for quality assessment of models Model/Method documentation (Good practice guide, identification of models fit for purpose, MDS, peer review) Database documentation: Emissions, Meteorology, Land use, Boundary Conditions, Scenarios (Protocol for QA) Model validation: (MQI: model performance indicators) Model benchmarking: Including both Model vs Model comparisons and DELTAS: Model Responses to emission changes

Protocol for quality assessment of models WG2 contribution Model/Method documentation Good pratice guidance, for the combination of models and observations (SG2) Protocol for assessment of methods for source allocation (SG5) Input data documentation: Focus on emission/projection compilation at urban scale (SG3) Model validation: Evaluation of appropriate MQI model performance indicators and identification of response indicators Interactions with AQMEII, TFMM, EURODELTA) Model benchmarking: Elaboration of a prototype for benchmarking models in urban agglomeration (SG4) Protocol for quality assessment of models WG2 contribution

1. Identification of current initiatives 2. Available data and methods WG2 –WORK PLAN FOR 2010 1. Identification of current initiatives 2. Available data and methods 3. Identification of Model Quality Indicators Input to Guidance Documents 4. Preparation of Protocols for QA of models 5. Design of tools for benchmarking QA

WG2 – DELIVERABLES FOR 2010 Best practice guidelines on data assimilation and on source apportionment Prototype tool for benchmarking urban scale models Background document on need for emission data and guidance in local/urban scale Workshop on emissions with local authorities Framework proposal Presentation of progress at HarmoConference

WG2 – DELIVERABLES 2010

WG2 2010 - Main activities – SG(2) SG(1+2) Combining monitoring and modelling Collecting information about groups and their methods and applications (data assimilation) Provide an assessment concerning the ‘fitness for purpose’. Identify objectives and indicators. Provide basic recommendations for applications relevant to the directive (forecasting and compliance assessment) Links to Air4EU, MACC, PASODOBLE, COST 602

WG2 2010 - Main activities – SG(2) SG(2) Combining monitoring and modelling (II) Evaluation of nesting procedures and capabilities will be carried out by the work in PASODOBLE, links are to be ensured Representativeness of observations (SG1). The relevant work of this subgroup is now to be included in SG(2). Need to evaluate station evaluation criteria Recommendations on position of monitoring stations Needs for new monitoring data

WG2 2010 - Main activities – SG(5) SG (5) Contribution of natural sources and source apportionment Extended review of the guidance from the WG on Implementation Review of experiences from the members states reporting under Art.20 and 21 Best practice guideline for model uses beyond receptor modelling for Winter sanding Wind-blown dust Sea salt Wild open fires Links to MACC, PASODOBLE ,MEGACITIES And TFMM

WG2 2010 - Main activities – SG(3) SG(3) on urban emissions and projections (I) Background document on the emission needs at local scale Needs for guidance on emission compilation at urban level Consistency with national inventories Top down vs bottom up approches Use of GIS tools

WG2 2010 - Main activities – SG(3) SG(3) on urban emissions and projections (II) Urban emission compilation is a key issue at European level Both guidance and relevant exchange fora are needed Workshop with city authorities in 2010 Proposal for a framework for the development of emission inventories at local scale Links to TFEIP/EIONET, GEIA, JRC-EDGAR Funding will be needed!

WG2 2010 – Benchmarking COST Action 732 QUALITY ASSURANCE AND IMPROVEMENT OF MICROSCALE METEOROLOGICAL MODELS Results from MUST experiment benchmarking of CFD models CFD models are not used in the AQD DIrective

MODELS USED FOR AQD Applications for the AQD Local-Hot spot (dx ~ m) Urban/Agglom (dx ~ 1- 5 km) Regional (dx ~ 10 – 50 km) Compliance / Assessment Gaussian*** Lagrangian*’ Semi empirical * Hybrid models Gaussian Lagrangian** Eulerian ******* Eulerian**** Mitigation & Planning Semi-Empirical** Gaussian** Eulerian******* Lagrangian* Lagrangian Source Apportionment Semi-empirical Eulerian*** Eulerian** Public information Gaussian* Statistical* Eulerian***** Statistical

Overview of AQD applications & scale in on-going projects Applications for the AQD Local-Hot spot (dx ~ m) Urban/Agglom (dx ~ 1- 5 km) Regional (dx ~ 10 – 50 km) Compliance / Assessment Data Assimilation Fusion Mitigation & Planning Emission scenarios Source Apportionment Public information AQ near real time forecast TRANSPHORM EURODELTA AQMEII COST 732 CITYZEN MEGAPOLI MACC PASODOBLE MEGAPOLI TRANSPHORM EC4MACS EURODELTA CITYZEN PASODOBLE MEGAPOLI TRANSPHORM MACC PASODOBLE MACC COST 602 Chemical Weather FAIRMODE Nov. 19, 2009

WG2 2010 - Main activities – SG(4) SG 4 Tools for benchmarking of models Development of a prototype tool for benchmarking models used under the AQD directive Focus on urban agglomeration Open to Lagrangian and Eulerian models, first Prototype flexibility requirements Emission dissagragation to allow local scale models contribution line sources Open source code Allows multiscale applications *regional first Links to MACC, TFMM, EURODELTA, MEGAPOLI, CITYZEN, AQMEII

Fairmode WG2 / Way forward Fairmode WG2 workplan description to be finalised by 31.JANUARY 2010 Basic input for evaluating funding perspectives Contact SG leaders for contributions SG (2) - Bruce Denby bde@nilu.no SG (3) - Julio Lumbreras jlumbreras@etsii.upm.es SG (4) - Philippe Thunis philippe.thunis@jrc.ec.europa.eu SG( 5) - John Douros john.douros@aix.meng.auth.gr

Thank you for your attention !