1. QUALITY ASSURANCE OF MODELS
FAIRMODE WG2
QUALITY ASSURANCE OF MODELS
Outcome from the meeting
17thNovember 2009
P. Dilara and L. Tarrasón
and the FAIRMODE WG2 meeting participants

2. FAIRMODE is steered by the air quality legislation
To provide a permanent European Forum for Air Quality Modellers and model users
To produce guidance on the use of air quality models (including fitness for purpose) for assessing current and future air quality for the purposes of implementation of the Air Quality Directive and in preparation to the revision of this Directive
To study and set-up a system on the quality assurance and the continuous improvements of air quality models (WG2)
To make recommendations for further research and other relevant improvements, such as improvements on emission inventories, meteorology, boundary conditions, temporal and geographic scale

3. FAIRMODE EEA’s data centre AirBase GMES observations EU projects
FP6, FP7
COST actions
Other
Interested
Modelling
experts
EEA
EC-JRC
DG-ENV
ETC/ACC
FAIRMODE
Invited
experts
EIONET
Model Users
CLRTAP
UNECE/EMEP
AQMEII
WG2
Quality assurance
WG1
Guidance on modelling
Best modelling practices
Protocols for QA of models
Input to legislation

4. Protocols for quality assessment Benchmarking tools
FAIRMODE WG2
Its main goal is to develop a user friendly system (protocols and tools) to assess the quality of air quality models used under the implementation of the Air Quality Directive:
Protocols for quality assessment
Benchmarking tools
Best practice guidelines
Dialogue and exchange

5. WG2 meeting 17th november (IN)
SG1 Representativeness of air quality stations
SG3
Emission Inventories and Scenarios
SG7
Integrated Assessment Modelling
SG1 Representiveness of stations’
SG4
Protocols and Tools for benchmarking of air quality models
Guidance documents
WG1
SG2
Combination of monitoring and modelling (data assimilation)
SG5
Contribution of natural sources and source apportionment

6. WG2 meeting 17th november (OUT)
SG(2) + SG(1)
Combination of monitoring and modelling (data assimilation)
SG(5)
Contribution of natural sources and Source apportionment
SG (3)
Emission inventories and scenarios
Benchmarking
SG (4)
Protocols and Tools for benchmarking of AQ models
Urban Agglomeration
Best practice guidelines
WG1

7. SG7 on Integrated Assessment Modelling
WG – Comment on SG7
SG7 on Integrated Assessment Modelling
The meeting agreed that the proposal for evaluation of IAM uncertainties was very interesting and recommended to pursue the activity under NIAM /TFIAM
FAIRMODE will work in first instance with ”What if” approaches. Therefore, the recommendation was to keep the scenario activities in SG (2) on emissions

8. Protocol for quality assessment of models
Model/Method documentation (Good practice guide, identification of models fit for purpose, MDS, peer review)
Database documentation: Emissions, Meteorology, Land use, Boundary Conditions, Scenarios (Protocol for QA)
Model validation: (MQI: model performance indicators)
Model benchmarking: Including both Model vs Model comparisons and DELTAS: Model Responses to emission changes

9. Protocol for quality assessment of models WG2 contribution
Model/Method documentation
Good pratice guidance, for the combination of models and observations (SG2)
Protocol for assessment of methods for source allocation (SG5)
Input data documentation:
Focus on emission/projection compilation at urban scale (SG3)
Model validation:
Evaluation of appropriate MQI model performance indicators and identification of response indicators Interactions with AQMEII, TFMM, EURODELTA)
Model benchmarking:
Elaboration of a prototype for benchmarking models in urban agglomeration (SG4)
Protocol for quality assessment of models WG2 contribution

10. 1. Identification of current initiatives 2. Available data and methods
WG2 –WORK PLAN FOR 2010
1. Identification of current initiatives
2. Available data and methods
3. Identification of Model Quality Indicators
Input to Guidance Documents
4. Preparation of Protocols for QA of models
5. Design of tools for benchmarking QA

11. WG2 – DELIVERABLES FOR 2010
Best practice guidelines on data assimilation and on source apportionment
Prototype tool for benchmarking urban scale models
Background document on need for emission data and guidance in local/urban scale
Workshop on emissions with local authorities
Framework proposal
Presentation of progress at HarmoConference

12. WG2 – DELIVERABLES 2010

13. WG2 2010 - Main activities – SG(2)
SG(1+2) Combining monitoring and modelling
Collecting information about groups and their methods and applications (data assimilation)
Provide an assessment concerning the ‘fitness for purpose’.
Identify objectives and indicators.
Provide basic recommendations for applications relevant to the directive (forecasting and compliance assessment)
Links to Air4EU, MACC, PASODOBLE, COST 602

14. WG2 2010 - Main activities – SG(2)
SG(2) Combining monitoring and modelling (II)
Evaluation of nesting procedures and capabilities
will be carried out by the work in PASODOBLE,
links are to be ensured
Representativeness of observations (SG1). The relevant work of this subgroup is now to be included in SG(2).
Need to evaluate station evaluation criteria
Recommendations on position of monitoring stations
Needs for new monitoring data

15. WG2 2010 - Main activities – SG(5)
SG (5) Contribution of natural sources and source apportionment
Extended review of the guidance from the WG on Implementation
Review of experiences from the members states reporting under Art.20 and 21
Best practice guideline for model uses beyond receptor modelling for
Winter sanding
Wind-blown dust
Sea salt
Wild open fires
Links to MACC, PASODOBLE ,MEGACITIES
And TFMM

16. WG2 2010 - Main activities – SG(3)
SG(3) on urban emissions and projections (I)
Background document on the emission needs at local scale
Needs for guidance on emission compilation at urban level
Consistency with national inventories
Top down vs bottom up approches
Use of GIS tools

17. WG2 2010 - Main activities – SG(3)
SG(3) on urban emissions and projections (II)
Urban emission compilation is a key issue at European level
Both guidance and relevant exchange fora are needed
Workshop with city authorities in 2010
Proposal for a framework for the development of emission inventories at local scale
Links to TFEIP/EIONET, GEIA, JRC-EDGAR
Funding will be needed!

18. WG2 2010 – Benchmarking COST Action 732
QUALITY ASSURANCE AND IMPROVEMENT OF
MICROSCALE METEOROLOGICAL MODELS
Results from MUST experiment benchmarking of CFD models
CFD models are not used in the AQD DIrective

19. MODELS USED FOR AQD Applications for the AQD Local-Hot spot (dx ~ m)
Urban/Agglom
(dx ~ km)
Regional
(dx ~ 10 – 50 km)
Compliance / Assessment
Gaussian***
Lagrangian*’
Semi empirical *
Hybrid models
Gaussian
Lagrangian**
Eulerian *******
Eulerian****
Mitigation & Planning
Semi-Empirical**
Gaussian**
Eulerian*******
Lagrangian*
Lagrangian
Source Apportionment
Semi-empirical
Eulerian***
Eulerian**
Public information
Gaussian*
Statistical*
Eulerian*****
Statistical

20. Overview of AQD applications & scale in on-going projects
Applications for the AQD
Local-Hot spot (dx ~ m)
Urban/Agglom
(dx ~ km)
Regional
(dx ~ 10 – 50 km)
Compliance / Assessment
Data Assimilation
Fusion
Mitigation & Planning
Emission scenarios
Source Apportionment
Public information
AQ near real time forecast
TRANSPHORM
EURODELTA
AQMEII
COST 732
CITYZEN
MEGAPOLI
MACC
PASODOBLE
MEGAPOLI
TRANSPHORM
EC4MACS
EURODELTA
CITYZEN
PASODOBLE
MEGAPOLI
TRANSPHORM
MACC
PASODOBLE
MACC
COST 602 Chemical Weather
FAIRMODE
Nov. 19, 2009

21. WG2 2010 - Main activities – SG(4)
SG 4 Tools for benchmarking of models
Development of a prototype tool for benchmarking models used under the AQD directive
Focus on urban agglomeration
Open to Lagrangian and Eulerian models, first
Prototype flexibility requirements
Emission dissagragation to allow local scale
models contribution line sources
Open source code
Allows multiscale applications *regional first
Links to MACC, TFMM, EURODELTA, MEGAPOLI, CITYZEN, AQMEII

22. Fairmode WG2 / Way forward
Fairmode WG2 workplan description to be finalised by 31.JANUARY 2010
Basic input for evaluating funding perspectives
Contact SG leaders for contributions
SG (2) - Bruce Denby
SG (3) - Julio Lumbreras
SG (4) - Philippe Thunis
SG( 5) - John Douros

23. Thank you for your attention !