Presentation is loading. Please wait.

Presentation is loading. Please wait.

Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath.

Published byReynold Preston Modified over 8 years ago

Similar presentations

Presentation on theme: "Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath."— Presentation transcript:

1 Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath

2 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Overview  Verification using „Fuzzy“ methods  Example for the FSS and he upscaling HSS for January and July  Time series for special thresholds and window sizes  Consisency of precipitation forecasts using the CRA method (update)  current state

3 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2008: Accumulated frequency distribution of precipitation, observation and GME

4 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2008: Accumulated frequency distribution of precipitation, observation and CEU

5 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2008: Accumulated frequency distribution of precipitation, observation and CDE

6 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2008: FSS Monthly average of precipitation: 68 mm

7 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2009: FSS Monthly average of precipitation: 30 mm

8 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2010: Frequency distribution of precipitation Observation, GME, CEU and CDE

9 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2010: FSS Monthly average of precipitation: 44 mm

10 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Accumulated frequency distribution of precipitation July 2007 (Observation and GME)

11 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Accumulated frequency distribution of precipitation July 2007 (Observation and CEU)

12 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Accumulated frequency distribution of precipitation July 2007 (Observation and CDE)

13 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2007: FSS Monthly average of precipitation: 120 mm

14 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2008: FSS Monthly average of precipitation: 88 mm

15 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2009: FSS Monthly average of precipitation: 108 mm

16 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2010: Frequency distribution of precipitation Observation, GME, CEU and CDE

17 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2010: FSS Monthly average of precipitation: 78 mm

18 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2008: HSS(UPS) Monthly average of precipitation: 68 mm

19 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2009: HSS(UPS) Monthly average of precipitation: 30 mm

20 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2010: Frequency distribution of precipitation Observation, GME, CEU and CDE

21 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification January 2010: HSS(UPS) Monthly average of precipitation: 44 mm

22 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2007: HSS(UPS) Monthly average of precipitation: 120 mm

23 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2008: HSS(UPS) Monthly average of precipitation: 88 mm

24 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2009: HSS(UPS) Monthly average of precipitation: 108 mm

25 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2010: Frequency distribution of precipitation Observation, GME, CEU and CDE

26 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification July 2010: HSS(UPS) Monthly average of precipitation: 78 mm

27 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, choice of windows and thresholds

28 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, ETS UPS GME VV:06-30

29 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, ETS UPS CEU VV:06-30

30 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, ETS UPS GME VV:06-18

31 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, ETS UPS CEU VV:06-18

32 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, ETS UPS CDE VV:06-18

33 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, FSS GME VV:06-30

34 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, FSS CEU VV:06-30

35 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, FSS GME VV:06-18

36 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, FSS CEU VV:06-18

37 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Fuzzy verification: Time series, FSS CDE VV:06-18

38 Entity-based QPF verification (rain “blobs”) by E. Ebert (BOM Melbourne) Verify the properties of the forecast rain system against the properties of the observed rain system: location rain area rain intensity (mean, maximum) ObservedForecast CRA error decomposition The total mean squared error (MSE) can be written as: MSE total = MSE displacement + MSE volume + MSE pattern Configuration for the current study: - “Observations”: forecasts: 06-30 hours - Forecasts : forecasts: 30-54 hours and forecasts: 54-78 hours

39 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Consistency of precipitation forecasts: Parts of error decomposition Autumn 2009 Dark :forecasts 30-54 h Light:forecasts 54-78 h

40 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Consistency of precipitation forecasts: Parts of error decomposition Winter 2009/10 Dark :forecasts 30-54 h Light:forecasts 54-78 h

41 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Consistency of precipitation forecasts: Parts of error decomposition Spring 2010 Dark :forecasts 30-54 h Light:forecasts 54-78 h

42 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Consistency of precipitation forecasts: Parts of error decomposition Summer 2010 Dark :forecasts 30-54 h Light:forecasts 54-78 h

43 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Consistency of precipitation forecasts: Parts of error decomposition Summer 2010 Dark :forecasts 30-54 h Light:forecasts 54-78 h

44 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow Summary  Fraction skill score and upscaling ETS are considered. Both scores are relatively high correlated.  Fuzzy verification in general shows best results for low precipitation values and large window sizes  For some months best results can be seen for precipitation amounts around 2 mm (12 h) -1  CEU and CDE models have nearly the same quality and are better than GME especially during summer times.  A positive long term trend of precipitation quality can be seen for low precipitation values and large window sizes. No clear trend is visible for high precipitation values for any window size.  Results for the check of consistency of precipitation forecasts lead to the expected (but proved) results that for high thresholds the inconsistency is most obvious. During winter time pattern errors are dominant. During summer times displacement errors are prevailing.

45 Long-term Trends of Precipitation Verification Results for COSMO-EU: Ulrich Damrath COSMO GM 2010 @ Moscow One conclusion  Forecasters sometimes really like CDE.  But the future is CDE-EPS!

Download ppt "Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath."

Similar presentations

Slide 1ECMWF forecast User Meeting -- Reading, June 2006 Verification of weather parameters Anna Ghelli, ECMWF.

Slide 1ECMWF forecast User Meeting -- Reading, June 2006 Verification of weather parameters Anna Ghelli, ECMWF.
Slide 1ECMWF forecast products users meeting – Reading, June 2005 Verification of weather parameters Anna Ghelli, ECMWF.

Slide 1ECMWF forecast products users meeting – Reading, June 2005 Verification of weather parameters Anna Ghelli, ECMWF.
Experiences concerning fuzzy-verification and pattern recognition methods Ulrich Damrath.

Experiences concerning fuzzy-verification and pattern recognition methods Ulrich Damrath.
VERIFICATION Highligths by WG5. 9° General MeetingAthens 18-21 September Working package/Task on “standardization” The “core” Continuous parameters: T2m,

VERIFICATION Highligths by WG5. 9° General MeetingAthens September Working package/Task on “standardization” The “core” Continuous parameters: T2m,
COSMO Workpackage No. 5.1.8 13.04.2015 - 1 - First Results on Verification of LMK Test Runs Basing on SYNOP Data Lenz, Claus-Jürgen; Damrath, Ulrich

COSMO Workpackage No First Results on Verification of LMK Test Runs Basing on SYNOP Data Lenz, Claus-Jürgen; Damrath, Ulrich
6th WMO tutorial Verification Martin GöberContinuous 1 Good afternoon! नमस्कार नमस्कार Guten Tag! Buenos dias! до́брый день! до́брыйдень Qwertzuiop asdfghjkl!

6th WMO tutorial Verification Martin GöberContinuous 1 Good afternoon! नमस्कार नमस्कार Guten Tag! Buenos dias! до́брый день! до́брыйдень Qwertzuiop asdfghjkl!
Validation of Satellite Precipitation Estimates for Weather and Hydrological Applications Beth Ebert BMRC, Melbourne, Australia 3 rd IPWG Workshop / 3.

Validation of Satellite Precipitation Estimates for Weather and Hydrological Applications Beth Ebert BMRC, Melbourne, Australia 3 rd IPWG Workshop / 3.
Statistical Postprocessing of LM Weather Parameters Ulrich Damrath Volker Renner Susanne Theis Andreas Hense.

Statistical Postprocessing of LM Weather Parameters Ulrich Damrath Volker Renner Susanne Theis Andreas Hense.
Statistical Postprocessing of Weather Parameters for a High-Resolution Limited-Area Model Ulrich Damrath Volker Renner Susanne Theis Andreas Hense.

Statistical Postprocessing of Weather Parameters for a High-Resolution Limited-Area Model Ulrich Damrath Volker Renner Susanne Theis Andreas Hense.
Assessment of Tropical Rainfall Potential (TRaP) forecasts during the 2003-04 Australian tropical cyclone season Beth Ebert BMRC, Melbourne, Australia.

Assessment of Tropical Rainfall Potential (TRaP) forecasts during the Australian tropical cyclone season Beth Ebert BMRC, Melbourne, Australia.
Monitoring the Quality of Operational and Semi-Operational Satellite Precipitation Estimates – The IPWG Validation / Intercomparison Study Beth Ebert Bureau.

Monitoring the Quality of Operational and Semi-Operational Satellite Precipitation Estimates – The IPWG Validation / Intercomparison Study Beth Ebert Bureau.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.
Verification of DWD Ulrich Damrath & Ulrich Pflüger.

Verification of DWD Ulrich Damrath & Ulrich Pflüger.
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,

COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,
Long-term trends of the quality of COSMO-EU forecast expressed as the universal score COSI and others scores for temperature 2 m and wind 10 m - related.

Long-term trends of the quality of COSMO-EU forecast expressed as the universal score COSI and others scores for temperature 2 m and wind 10 m - related.
COSMO General Meeting – Moscow 06-10 Sept 2010 Some results from operational verification in Italy Angela Celozzi - Federico Grazzini Massimo Milelli -

COSMO General Meeting – Moscow Sept 2010 Some results from operational verification in Italy Angela Celozzi - Federico Grazzini Massimo Milelli -
Verification Precipitation verification (overestimation): a common view of the behaviour of the LM, aLMo and LAMI Francis Schubiger and Pirmin Kaufmann,

Verification Precipitation verification (overestimation): a common view of the behaviour of the LM, aLMo and LAMI Francis Schubiger and Pirmin Kaufmann,
4th Int'l Verification Methods Workshop, Helsinki, 4-6 June 2009 1 Methods for verifying spatial forecasts Beth Ebert Centre for Australian Weather and.

4th Int'l Verification Methods Workshop, Helsinki, 4-6 June Methods for verifying spatial forecasts Beth Ebert Centre for Australian Weather and.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistical Characteristics of High- Resolution COSMO.

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistical Characteristics of High- Resolution COSMO.
Verification methods - towards a user oriented verification WG5.

Verification methods - towards a user oriented verification WG5.

Similar presentations

Ads by Google