1. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report

2. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report phase1 OPEN POINTS: VERSUS was not planned to cover all the existing verification methods, as well as all the possible products from a NWP and not all types of observation implementation of probabilistic and ensemble forecasts verification; implementation of obj-based and fuzzy verification methods applied to precipitation; New scores for extreme events (e.g. extreme dependency score); Statistical features like Confidence intervals and Bootstrap method; Use of non conventional obs (e.g. radar, satellite, raingauges) and gridded observations (precipitation analysis);....................and so on-----  VERSUS2!!!

3. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report phase1 PHASE 1: COSMO year 2009 Task 0: Requirements specification for VERSUS and accepted review Main Activities (or subtasks) Preparation of a “forum” and start of a survey Survey analysis: Delivery of System Design Overview (SDO)) Review of System Design Overview Drawing up the project Final acceptance of the System Design Overview and SAD Deliverables : Ok. Some updates on SAD doc still pending

4. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report phase1 PHASE 1: COSMO year 2009 Task 1a: Implementation of a multiplatform RDBMS version of VERSUS Main Activities Analysis, design, development, and implementation of DB classes; GUI, R package and front-end integration with the above DB classes Test phase Deliverables: This task has been deleted. No requirement from any Cosmo countries All will install VERSUS package with the present software architecture

5. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report phase1 PHASE 1: COSMO year 2009 Task 1b: Installation of multiplatform DB version of VERSUS at every service within COSMO The installation and the use at every service should be reached before the implementation of the any other requirements and functionalities from phase 2. Main Activities Installation and use of VERSUS package original version at every service within COSMO Functionality tests, configuration and production of verification scores Installation of updated multiplatform DB version of VERSUS at every service within COSMO Help Desk by PL team

6. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Report phase1 PHASE 1: COSMO year 2009 Task 1b: Installation of multiplatform DB version of VERSUS at every service within COSMO Deliverables : Installation and use of VERSUS Poland, Greece Romania: ok. They installed and used VERSUS to produce plots. Operational use is the next step in few months. MCH, DWD and Russia: partially installed, but still few problems setting up the system. Hopefully after GM the installation (and use) will be completed.

7. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 autumnwinter spring 2m Temperature summer

8. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 autumn winter springsummer 10m Wind Speed

9. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 summerspring winterautumn 12h FBI - range: 0 to ∞, unbiased score=1 Indicates tendency to underforecast (BIAS<1) or overforecast (BIAS>1) events.

10. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009

12. VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 RULES - Any single phase should be concluded in just one COSMO year - Delay in the realisation of one single phase will result in a delayed start of the next one - Every year, based on the real deliverables produced, the plan will be updated accordingly along with a quick review of the requirements of the next phase,

13. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Priorities from VERSUS workshop in Langen in march.ù 3 groups of priorities: A, B,C 2010: some selected “A” priorities by WG5 2011: remaining A and B+C priorities If not enough or need for more requirements  extension 2012 ?

14. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 0: Help Desk, bugs fixing activities and release of VERSUS update Main Activities Help Desk activities for VERSUS users Software maintenance Activity of bugs fixings and test/release of package updates to be delivered to the users through ftp Patches test on at least another Installed package Deliverables :Package updates. Estimated resources 0,4 FTEs for PL and PL team 0,1 FTEs for Greece (?) Expected Start: October 2009

15. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 1: Implementation of COSI global Index Main Activities (or subtasks) Task 1a: Preparation of a technical reference document for COSI index: deadline end of October Task1b: Implementation of the index: deadline mid December 2009 Deliverables Update of VERSUS package will include COSI index calculation and graphical/text presentation. Deadline: December 2009. Estimated resources 0,15 FTEs for PL and PL team for the preparation of the document and implementation/test of the index; 0,21 FTEs (total amount) for all the other members for preparation and review of the document (0.03 each) Expected Start: October 2009

16. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 2: Implementation of weather type dependent verification and improvement of CV.. Main Activities Task 2a: Preparation of a Guidelines document (WDV); Task 2b: Conditional verification on different space/time Task 2c: Development of VERSUS software modules Deliverables Update of VERSUS package to include WDV and CV improvement. Deadline: March 2010. Estimated resources 0,14 FTEs for all the COSMO countries to prepare and review the Guidelines document (0.02 each) 0,03 FTE Guidelines for CV on different space/time (MCH) 0,25 FTE PL and PL team for the implementation and test Expected Start: October 2009 for Guidelines; December 2009 for implementation.

17. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 3: Use of new Observation data Main Activities Task 3a: Identification and analysis of Observations to be loaded following SDO priorities: Airep, Amdar, Windprofiler, TEMP (non standard pressure level), Metar; Task3b: Implementation of Loader module (msgs coded in BUFR format) and creation of tables in DB; Task3c: Integration of the new Upper air observation with the existing ones for production of Upper air verification Task3d: Implementation of verification of Wind gusts using Metar; Task3e: Analysis and description of Radar wind data for use in VERSUS system(VAD, radial); Task3f: Implementation of loader for radar wind data;

18. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 3: Use of new Observation data Deliverables Update of VERSUS package with the new functionalities. Deadline: June 2010 Estimated resources 0,05 FTE for COSMO member (DWD,MCH?) for detailed requirements for upper air verification and wind gusts verification 0,05 FTE for detailed description and requirement on use of radar wind data for verification 0,30 FTE for the implementation of new modules by PL team Expected Start: November 2009 for requirements. February 2010 for implementation..

19. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 4: Use of gridded observation (analysis fields) The use of gridded observation (analysis field) is crucial to check the performance of a model compared to an objective analysis (model oriented verification) and to apply special verification methods for very high-resolution models, as Fuzzy verification (through the use of Fuzzy toolbox) and later object oriented verification (MODE and SAL). Radar precipitation data, raingauges and synop data as well as satellite precipitation estimation should be used in a gridded precipitation analysis. Gridded observation will have to be given to the system for external procedure as input data. Interpolation on the same grid (model on analysis or vice versa) could be provided by VERSUS system (TBD)

20. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 4: Use of gridded observation (analysis fields) Main Activities Task4a: Individuation of some aggregation methods for standard scores. Task4b: Implementation of Loader module for gridded observation (GRIB coded); Task4c: Detailed documentation of Fuzzy verification toolbox for its integration and implementation in VERSUS package Task4d: Re-writing Fuzzy IDL code in a more manageable C or Fortran code (TBD) Task4e: Implementation of Fuzzy toolbox and updating of WEB GUI accordingly

21. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 4: Use of gridded observation (analysis fields) Deliverables Update of VERSUS package with the new functionalities. Deadline: March 2010 Estimated resources 0,03 FTE for COSMO member (DWD) for detailed description of Fuzzy toolbox 0,02 FTE aggregation method for standard scores 0,15 FTE for Fuzzy toolbox C or Fortran version (TBD, MCH?) : as IDL is not available for any COSMO member and the spirit of free-licensing software of VERSUS should be respected, this subtask 0,2 FTE for the implementation of new modules and GUI in VERSUS by PL team Expected Start: October 2009 description of toolbox and rewriting of package, February 2010 for implementation.

22. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 5: Identification of scores for Ensemble and probabilistic forecasts This task is a prerequisite for Phase3 where loader module for probabilistic forecasts and probabilistic scores verification will be implemented. Main Activities Task 5: Identification and full description of probabilistic scores to be implemented with description and example plots to be implemented for these probabilistic score. Deliverables Guidelines document on probabilistic scores and plots to be implements in Phase 3. Example of algorithm to be implemented. Analysis of new techniques. Deadline: June 2010. Estimated resources 0,25 FTE for the responsible member.(Greece?) Expected Start: February 2010.

23. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 6: Production of common statistical scores and scores graphic Requirements for Common scores plots from WG5 Coordinator Main Activities Task6a: Preparation of data to be sent to the responsible member; Task6b: Production of seasonal common scores plots and preparation of presentation for GM;

24. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 6: Production of common statistical scores and scores graphic Deliverables A complete set of common plots following specifications of WG5 Coordinator. Deadline: end of July for SON, DJF and MAM seasons. Beginning of September 2010 for JJA 2010 (depending of the beginning of next GM). Estimated resources 0,12 FTE for all the COSMO member (0.02 each) to prepare data to be collected by the responsible member) 0,3 FTE for Poland for collection and loading of observations and forecasts data, production of statistical scores and graphics, following the specifications of WG5 coordinator and preparation of presentation for GM. Expected Start: December 2009.

25. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 7: Preparatory work on feedback files implementation Feedback files contain the observation and their deviation from forecasts for analysis and whole model runs. They do not contain only traditional observation and include information on data quality and status. Their implementation will result really useful for verification purposes, provided that all COSMO member will be able to carry out feedback files from their operational and experimental runs. This task is a prerequisite for Phase 3 implementation of FB files. Main Activities Task7a: Fully description of feedback files; Task7b: Implementation of loader module for feedback files in VERSUS system (creation of tables, php modules...) to be integrated in VERSUS_FE loader.

26. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 7: Preparatory work on feedback files implementation Deliverables A front end loader for feedback files integrated in VERSUS_FE module and DB tables where data for FB files will be stored. Deadline: September 2010. Estimated resources 0,30 FTE for DWD 0,05 FTE for PL team for support of the activity. Expected Start: March 2010.

27. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 Task 8: Statistical features like confidence intervals and the Bootstrap method (to be approved) Main activities: Implementation of CI and BM and others possibly using “R” Verification package. Analysis of the package and inclusion in VERSUS or development of a new modules (Fort coding or C coding) Deliverables Software modules integrated in VERSUS and update of WEB GUI Deadline: September 2010. Estimated resources 0,25 FTE for Russia 0,05 FTE for PL team Expected Start: January 2010.

28. 11° COSMO General Meeting – Offenbach 07-11 Sept 2009 VERSUS2 Priority Project Highlights of phase2 PHASE 2: COSMO year 2010 FTEs for 2010 Cosmo year 3.15 Task Contributing scientist(s)FTE- yearStartDeliverablesDate of deliveryPreceding tasks Task 0 PL team – Italy Patches and new vers. test – Greece (?) Total 0.5 0,4 0,1 01.10.2009 Help Desk, bugs fixing activities and release of VERSUS update01.09.2010none Task 1.1a.1b All Cosmo members PL team - Total 0.36 0,21(0,03e.) 0,15 1.10.2009 Implementation of COSI global Index31.12. 2009none Task 2.2a.2b.2c All COSMO member MCH (?) PL team Total 0.42 0.14 (0.02e.) 0.03 0.25 01.10.2009Implementation of weather type dependent verification and improvement of CV. 31.03.2010none Task 3.3a.3b,c,d,f.3e DWD (?) PL team MCH (?) Total 0.40 0.05 0.30 0.05 01.11.2009Use of new Observation data30.06.2010none Task 4.4a.4b,e.4c.4d (?) PL Team DWD(?) Rumania (?) Total 0.40 0.02 0.2 0.03 0.15 01.10.2009Use of gridded observation (analysis fields)31.05.2010none Task 5Greece (?)0.2501.02.2010Identification of scores for Ensemble and probabilistic forecasts31.05.2010none Task 6.6a.6b All COSMO member Poland (?) Total 0.42 0.12 0.3 01.12.2009Production of common statistical scores and scores graphicGM 2010Phase 1 completed Task 7.7a.7b DWD DWD, Total 0.40 0.05 0.30 – 0..05 01.03.2010Preparatory work on feedback files implementationGM 2010none Task 8 Russia Italy Total 0,3 0.25 0.05 01.01.2010Statistical features like confidence intervals and the Bootstrap method (to be approved) July 2010none