2. 2 WP9/JRA3: ESM Evaluation: Developing an Infrastructure Participants: WP Leader: George Tselioudis, Academy of Athens Co-leader: Michael Schulz, IPSL WP Partners: Veronika Eyring, DLR Pierre Friedlingstein – U. of Exeter Stefan Bakan, MPI-M Ralph Doscher, SMHI

3. 3 OBJECTIVE Create an interdisciplinary infrastructure that will facilitate the scientific evaluation of complex ESMs TASKS Task 1. Survey of methods and problems in ESM evaluation work Task 2. Creation of support structure to facilitate model evaluation tests Task 3. Provision of cataloguing and access services to observational datasets and evaluation tools Task 4. Pilot study on the implementation of evaluation toolkits on ESM output

4. 4 FIRST YEAR PROGRESS T.1 Survey of methods and problems in ESM evaluation work Questionnaires were sent to all major European ESM groups. ESM evaluation areas have been divided among the partners as follows: AA: Clouds, radiation and precipitation CNRS-IPSL: Aerosols and paleoclimate MPI-MET: Surface fluxes DLR: Atmospheric chemistry U. Exeter: Carbon cycle 87% of questionnaires have been received

6. Some preliminary remarks Aerosol and carbon cycle properties are evaluated using primarily ground based observations Cloud, radiation, and chemistry properties are evaluated using primarily satellite observations Precipitation and surface flux properties are evaluated using a mix of the two dataset types

8. Frequently reported problems Diversity of observational data formats reported as the main problem HDF format of satellite data not compatible with model output analysis tools NetCDF (CMOR comliant if possible) preferred data format

9. 9 FUTURE STEPS Task 2. Creation of support structure to facilitate model evaluation tests – Put emphasis on process-based evaluation Task 3. Provision of cataloguing and access services to observational datasets and evaluation tools – Include peripheral datasets and tools not commonly used by ESMs Task 4. Pilot study on the implementation of evaluation toolkits on ESM output

10. 10 ESM Evaluation Portal

11. 26th, 27th & 28th May 2010 IS-ENES General Assembly Barcelona, Spain 11

12. A Framework for Process-Oriented Evaluation of Earth System Models V. EYRING, P. Friedlingstein, O. Boucher, W. J. Collins, C. JONES, N. de Noblet-Ducoudre, H. DRANGE, T. Fichefet, C. Heinze, W. Knorr, J.-F. Lamarque, M. G. Lawrence, I. C. Prentice, M. Scholze, M. Schulz, J. TEIXEIRA, G. Tselioudis, M. Vancoppenolle, AND P. F. J. van Velthoven AFFILATIONS: EYRING – Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany; Friedlingstein – University of Exeter, Exeter, U.K.; BOUCHER – Met Office Hadley Centre, Exeter, U.K.; COLLINS – Met Office Hadley Centre, Exeter, U.K.; JONES – Swedish Meteorological and Hydrological Institute (SMHI), Norrköping, Sweden; de Noblet-Ducoudre - Commissariat à l'Énergie Atomique (CEA), Gif-sur-Yvette, France; DRANGE – University of Bergen, Norway; Fichefet - Université catholique de Louvain, Louvain-la-Neuve, Belgium; Heinze - University of Bergen, Geophysical Institute and Bjerknes Centre for Climate Researc, Norway; Knorr - University of Bristol, U.K.; Lamarque - NCAR, Boulder, USA; Lawrence - Max Planck Institut für Chemie, Mainz, Germany; Prentice - University of Bristol, U.K.; Scholze - University of Bristol, U.K.; Schulz - Commissariat à l'Énergie Atomique (CEA), Gif-sur-Yvette, France; TEIXERA – NASA Jet Propulsion Laboratory (JPL), USA; Tselioudis – University of Athens, Greece; M. Vancoppenolle - Université catholique de Louvain, Louvain-la-Neuve, Belgium; van Velthoven - Koninklijk Nederlands Meteorologisch Instituut (KNMI), Netherlands. CORRESPONDING AUTHOR: Veronika Eyring, Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany, Phone: +49-8153-28-2533, E-mail: Veronika.Eyring@dlr.de.Veronika.Eyring@dlr.de Capsule. Evaluating ESMs with the presented framework will increase our confidence in climate projections. J. Climate Paper in Preparation

13. 13 ESM Evaluation Portal

14. 14 ESM Evaluation Portal

15. 15 ESM Evaluation Portal

16. 16 ESM Evaluation Portal

17. 17 ESM Evaluation Portal

18. 18 ESM Evaluation Portal

19. 19 ESM Evaluation Portal

20. 20 ESM Evaluation Portal

21. 21 ESM Evaluation Portal

22. 22 ESM Evaluation Portal

23. 23 ESM Evaluation Portal