1. Verification using VERSUS at RHM
Alexander Kirsanov
and others
WG5 session, COSMO GM, 3-7 Sept 2018, Saint Petersburg

2. VERSUS IMPLEMENTATION AT RHM: APPLICATIONS
1) Common Plots
2) Operational model implementations:
COSMO-Ru7
COSMO-Ru13-ENA
COSMO-Ru2-CFO
Operational model runs:
00 UTC
06 UTC
12 UTC
18 UTC
3) Case studies/tuning
4) Research and custom model implementations
5) Ensemble verification
Automatic scores
for Operational
model runs
T2M, TD2M, MSLP, WSPD
ME and RMSE
1835 monthly score files
VERSUS can not calculate TCC (30 km) and Precipitation (12H) scores

3. VERSUS AUTOMATIC SCORE CALCULATION: INITIALIZATION
date_start=...
date_end=...
rm .../VERSUS/log/...
DELETE FROM versus.log_score WHERE id_select_criteria
UPDATE versus.select_criteria
SET start_date =..., end_date =...
INSERT INTO versus.log_score
wget ScoreExecNumericMulti.php
Queue

4. VERSUS AUTOMATIC SCORE CALCULATION: COMPUTATION
wget ScoreExecNumericMulti.php
Queue
mkdir RESULTS/...
while((ready<...));do
if grep .../VERSUS/log/...
sleep
wget php
createContinuousGraphic
SELECT step, index_value, number_value FROM versus.index_output
mv ...VERSUS/html/versus/data/.../...png
RESULTS/...

5. VERSUS AUTOMATIC SCORE CALCULATION:
RESULTS
Images
Text data
STEP ME NUMBER VALUE
STEP RMSE NUMBER VALUE
zip
mail
check your inbox

6. OPERATIONAL SCORES – TEMPERATURE AT 2M, °C
DAY
NIGHT

7. VERSUS SCORES – TEMPERATURE AT 2M, °C
DAY
NIGHT

8. VERSUS SCORES – TEMPERATURE AT 2M, °C
DAY
DAY

9. VERSUS SCORES – TEMPERATURE AT 2M, °C
NIGHT
NIGHT

10. VERSUS SCORES – DEW POINT TEMPERATURE AT 2M, °C
DAY
DAY

11. VERSUS SCORES – DEW POINT TEMPERATURE AT 2M, °C
NIGHT
NIGHT

12. VERSUS SCORES – PRESSURE REDUCED TO MEAN SEA LEVEL , hPa
DAY
DAY

13. VERSUS SCORES – PRESSURE REDUCED TO MEAN SEA LEVEL , hPa
NIGHT
NIGHT

14. VERSUS SCORES – WIND SPEED AT 10 M, m/s
DAY
DAY

15. VERSUS SCORES – WIND SPEED AT 10 M, m/s
NIGHT
NIGHT

16. VERSUS SCORES – ZERO LEAD TIME

17. VERSUS SCORES – TCC (30KM) SCORE PROBLEM

18. VERSUS SCORES – 12H PRECIPITATION SCORE PROBLEM

19. CONCLUSIONS
VERSUS is used at RHM not only to prepare the data for Common Plots, there is an algorithm to calculate scores automatically and send them by , but…
VERSUS cannot work with Russian 12 hour precipitation data, there are other problems like error during calculation of 30 km method continuous scores.
When VERSUS does work, it produces results similar to Operational verification at RHM, differences compared to other verification software at RHM are being clarified.
Scores are getting better from 2013 to 2018 year.
Temperature at 2 m height has the highest RMSE during spring, with negative ME related to unstable snow cover. ME amplitude in seasonal cycle is decreasing.
Dew point temperature at 2 m height has no significant RMSE trend, but ME is increasing.
For Temperature at 2 m height and Dew point temperature at 2 m height RMSE and ME decreased the most for 00 lead time. This can be related to changes in driving model, data assimilation system, initial data correction algorithm at RHM.

20. Thank you for your attention!