Deutscher Wetterdienst Fuzzy and standard verification for COSMO-EU and COSMO-DE Ulrich Damrath (with contributions by Ulrich Pflüger) COSMO GM Rome 2011.

Slides:

Advertisements

Similar presentations

Slide 1ECMWF forecast products users meeting – Reading, June 2005 Verification of weather parameters Anna Ghelli, ECMWF.

Advertisements

COSMO General Meeting Zürich, Sept Stefan Klink, Klaus Stephan and Christoph Schraff and Daniel.

Mei Xu, Jamie Wolff and Michelle Harrold National Center for Atmospheric Research (NCAR) Research Applications Laboratory (RAL) and Developmental Testbed.

COSMO Workpackage No First Results on Verification of LMK Test Runs Basing on SYNOP Data Lenz, Claus-Jürgen; Damrath, Ulrich

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss The Latent Heat Nudging Scheme of COSMO EWGLAM/SRNWP Meeting,

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Institut für Physik der Atmosphäre On the Value of.

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.

Verification of DWD Ulrich Damrath & Ulrich Pflüger.

COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,

Long-term trends of the quality of COSMO-EU forecast expressed as the universal score COSI and others scores for temperature 2 m and wind 10 m - related.

WWOSC 2014 Assimilation of 3D radar reflectivity with an Ensemble Kalman Filter on a convection-permitting scale WWOSC 2014 Theresa Bick 1,2,* Silke Trömel.

Verification Precipitation verification (overestimation): a common view of the behaviour of the LM, aLMo and LAMI Francis Schubiger and Pirmin Kaufmann,

Numerical Weather Prediction at DWD COSMO-EU Grid spacing: 7 km Layers: 40 Forecast range: 78 h at 00 and 12 UTC 48 h at 06 and 18 UTC 1 grid element:

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Parametrization of Subgrid-Scale Orographic Drag in the.

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistical Characteristics of High- Resolution COSMO.

Introducing the Lokal-Modell LME at the German Weather Service Jan-Peter Schulz Deutscher Wetterdienst 27 th EWGLAM and 12 th SRNWP Meeting 2005.

ISDA 2014, Feb 24 – 28, Munich 1 Impact of ensemble perturbations provided by convective-scale ensemble data assimilation in the COSMO-DE model Florian.

The fear of the LORD is the beginning of wisdom 陳登舜 ATM NCU Group Meeting REFERENCE : Liu., H., J. Anderson, and Y.-H. Kuo, 2012: Improved analyses.

Review of TERRA developments within COLOBOC J. Helmert, H. Asensio, G. Vogel, M. Lange, B. Ritter.

On Improving GFS Forecast Skills in the Southern Hemisphere: Ideas and Preliminary Results Fanglin Yang Andrew Collard, Russ Treadon, John Derber NCEP-EMC.

Verification methods - towards a user oriented verification WG5.

SEASONAL COMMON PLOT SCORES A DRIANO R ASPANTI P ERFORMANCE DIAGRAM BY M.S T ESINI Sibiu - Cosmo General Meeting 2-5 September 2013.

COSMO General Meeting, Offenbach, 7 – 11 Sept Dependance of bias on initial time of forecasts 1 WG1 Overview

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Priority project « Advanced interpretation and verification.

Evaluation of the Latent heat nudging scheme for the rainfall assimilation at the meso- gamma scale Andrea Rossa* and Daniel Leuenberger MeteoSwiss *current.

Deutscher Wetterdienst Bootstrapping – using different methods to estimate statistical differences between model errors Ulrich Damrath COSMO GM Rome 2011.

Nudging Radial Velocity, OPERA, LHN for COSMO-EU COSMO GM, Sibiu, 2 September Recent developments at DWD

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecast in the Alps Verification.

Verification Verification with SYNOP, TEMP, and GPS data P. Kaufmann, M. Arpagaus, MeteoSwiss P. Emiliani., E. Veccia., A. Galliani., UGM U. Pflüger, DWD.

10 th COSMO General Meeting, Krakow, September 2008 Recent work on pressure bias problem Lucio TORRISI Italian Met. Service CNMCA – Pratica di Mare.

Introduction of temperature observation of radio-sonde in place of geopotential height to the global three dimensional variational data assimilation system.

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistics of COSMO Forecast Departures in View of.

U. Damrath, COSMO GM, Athens 2007 Verification of numerical QPF in DWD using radar data - and some traditional verification results for surface weather.

MSG cloud mask initialisation in hydrostatic and non-hydrostatic NWP models Sibbo van der Veen KNMI De Bilt, The Netherlands EMS conference, September.

Page 1© Crown copyright 2005 DEVELOPMENT OF 1- 4KM RESOLUTION DATA ASSIMILATION FOR NOWCASTING AT THE MET OFFICE Sue Ballard, September 2005 Z. Li, M.

Overview of WG5 activities and Conditional Verification Project Adriano Raspanti - WG5 Bucharest, September 2006.

Verification A first attempt to WP Preliminary results of one test case Matteo Buzzi, Pirmin Kaufmann, Dominique Ruffieux, Francis Schubiger MeteoSwiss.

VERIFICATION Highligths by WG5. 2 Outlook Some focus on Temperature with common plots and Conditional Verification Some Fuzzy verification Long trends.

MODIS Winds Assimilation Impact Study with the CMC Operational Forecast System Réal Sarrazin Data Assimilation and Quality Control Canadian Meteorological.

Comparison of LM Verification against Multi Level Aircraft Measurements (MLAs) with LM Verification against Temps Ulrich Pflüger, Deutscher Wetterdienst.

COSMO General Meeting 2008, Krakow Modifications to the COSMO-Model Cumulus Parameterisation Scheme (Tiedtke 1989): Implementation and Testing Dimitrii.

Verification methods - towards a user oriented verification The verification group.

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Weather type dependant fuzzy verification of precipitation.

The presence of sea ice on the ocean’s surface has a significant impact on the air-sea interactions. Compared to an open water surface the sea ice completely.

Deutscher Wetterdienst FE VERSUS 2 Priority Project Meeting Langen Use of Feedback Files for Verification at DWD Ulrich Pflüger Deutscher.

Assimilating Cloudy Infrared Brightness Temperatures in High-Resolution Numerical Models Using Ensemble Data Assimilation Jason A. Otkin and Rebecca Cintineo.

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Experiments at MeteoSwiss : TERRA / aerosols Flake Jean-Marie.

VERIFICATION Highligths by WG5. 2 Outlook The COSMO-Index COSI at DWD Time series of the index and its DWD 2003.

© Crown copyright Met Office Review topic – Impact of High-Resolution Data Assimilation Bruce Macpherson, Christoph Schraff, Claude Fischer EWGLAM, 2009.

Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath.

Deutscher Wetterdienst VERSUS at DWD Ulrich Damrath & Ulrich Pflüger COSMO GM Rome, September 2011.

WG5 COSMO General Meeting, Rome 2011 Authors: ALL Presented by Adriano Raspanti.

Joint MAP D-PHASE Scientific Meeting - COST 731 mid-term seminar, May 2008, Bologna. ErgebnissErgebniss : Long-Term Evaluation of COSMO-DE and COSMO-EU.

New results in COSMO about fuzzy verification activities and preliminary results with VERSUS Conditional Verification 31th EWGLAM &16th SRNWP meeting,

Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Statistics of COSMO Forecast Departures in View of.

Introducing the Lokal-Modell LME at the German Weather Service

Operational Verification at HNMS

Studies with COSMO-DE on basic aspects in the convective scale:

Current verification results for COSMO-EU and COSMO-DE at DWD

aLMo from GME and IFS boundary conditions: A comparison

Tuning the horizontal diffusion in the COSMO model

Recent developments in Latent Heat Nudging at DWD

WG5-Report from Switzerland: Verification of aLMo in the year 2005

Daniel Leuenberger1, Christian Keil2 and George Craig2

COSMO General Meeting 2009 WG5 Parallel Session 7 September 2009

A. Topographic radiation correction in COSMO: gridscale or subgridscale? B. COSMO-2: convection resolving or convection inhibiting model? Matteo Buzzi.

Impact of aircraft data in the MSC forecast systems

Ulrich Pflüger & Ulrich Damrath

Seasonal common scores plots

Verification of forecasts against analysis - some problems

Presentation transcript:

Deutscher Wetterdienst Fuzzy and standard verification for COSMO-EU and COSMO-DE Ulrich Damrath (with contributions by Ulrich Pflüger) COSMO GM Rome 2011

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 General outlook  Upper air verification for COSMO-EU and COSMO-DE  Fuzzy verification  DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 error structure in upper troposphere and above smoother, reduced error amplitude C-EU verification against radiosondes since July 2010: analysis in lower troposphere warmer  Temperature BIAS, 00 UTC RK, new vertical coord., new reference atm. V=48 V=24 V=00 summer: troposphere always too warm

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 since July 2010: reduced bias at height of tropopause and above V=00 V=48 V=24 C-EU verification against radiosondes  Geopotential BIAS, 00 UTC (and 12 UTC) RK, new vertical coord.,, new reference atm.

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 since July 2010: reduced rmse at height of tropopause and above V=00 V=48 V=24 C-EU verification against radiosondes  Geopotential RMSE, 00 UTC (and 12 UTC) RK, new vertical coord.,, new reference atm.

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 C-EU verification against radiosondes  Wind speed, RMSE 00 UTC V=48 Since July 2010: reduced RMSE of wind speed in upper troposhere RK, new vertical coord., new reference atm. wind speed, RMSE Dec 2010/2009 solid: 2010 dashed: h 24 h00 h

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 C-DE verification against radiosondes lower troposphere in summer clearly too warm  Temperature BIAS 00 UTC modifications to mixing length and subgrid scale cloud scheme V=00 V=18 no change compared to years before

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 V=00 V=12 C-DE verification against radiosondes  Temperature BIAS 12 UTC modifications to mixing length and subgrid scale cloud scheme boandary layer and lower troposphere too warm especially in summer

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 V=12 boandary layer and lower troposhere too dry, above too wet  00 UTC  12 UTC pos. bias in rel. humidity decreases in 2011 C-DE verification against radiosondes  Rel. humidity BIAS modifications to mixing length and subgrid scale cloud scheme pos. bias in rel. humidity slight increase in spr/sum 2011

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Results of verification against radiosondes 2010/2011  COSMO-EU:  amplitude of temperature bias between troposphere and above has been reduced  reduced bias and rmse of gepotential at tropopause and above  slightly reduced error in wind speed at upper troposphere  COSMO-DE:  already since 2009 boundary layer too warm (except analysis 00 UTC)  slighty increased humidity bias at 00 UTC but reduced bias at 12 UTC  Modification of radiosonde measurements lead also to the change of RH bias (better results for noon, worse for midnight)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Outlook for fuzzy verification  Motivation for fuzzy verification  State at DWD (until May 2011)  Are the properties of COSMO 2 compared to COSMO 7 other than the properties of CDE compared to CEU?  Quality of CEU- and CDE-forecasts for different regions  Current application of Fuzzy-methods  Operational implementiation

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Traditional point-to-point verification for CEU and CDE

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Fuzzy-Verification in DWD till May 2011

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 ahhdfkfflflflflflfkfkfkjdjdddnbdnnnd Weusthoff, Tanja, Felix Ament, Marco Arpagaus, Mathias W. Rotach, 2010: Assessing the Benefits of Convection-Permitting Models by Neighborhood Verification: Examples from MAP D-PHASE. Mon. Wea. Rev., 138, 3418– mm/12 h

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Configuration of precipitation verification with FUZZY- methods  Up to May 2011:  Observation data: Radar data prepared by assimilation scheme  Model data: GME-, CEU- and CDE-GRIBS interpolated to CDE-grid (nearest gridpoint)  Run: 00 UTC  Forecast times: GME, CEU: 06-18, 06-30, CDE: hours  Verification area: part of CDE that is covered by radar data  Since May 2011:  Observation data as before, modell data: CEU- and CDE-GRIBS interpolated to CDE-grid (nearest gridpoint)  Run: 00, 03, 06, 09, 12, 15, 18, 21  Forecast times: 01-04, 03-06, 06-12, 12-15, 15-18, hours  Verification aread : CDE, Northern part of Germany, Southern part of Germany, North- Western part of Germany, North-Eastern part of Germany, South-Western part of Germany, South-Eastern part of Germany

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Application of Fuzzy-methods  Calculation of all Fuzzy-scores with the IDL-Program by Beth Ebert.  Monthly evaluation of data for Fractions Skill Score and Upscaling ETS  Generation of results for  8 (forecast runs)  * 7 (forecast intervals)  * 3 (2 models and one difference)  * 7 (regions)  * 2 (scores) Plots per time interval  Necessity to have a fast access to the data

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples: ETS upscaling July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples : FSS July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples : ETS upscaling July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples : FSS July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples : ETS upscaling July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some examples : FSS July 2011, Run: 00 UTC, forecast time hours

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: FSS July 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (NW-Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (NE-Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (SW-Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (SE-Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling May 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling June 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Principle of boundary conditions for COSMO-DE and latent heat nudging LHN (RH=const) U, V, T, p‘, QV, QC, QI, QR, QS, T_SNOW, W_SNOW

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Some aggregated results: ETS Upscaling July 2011 for different runs and forecast intervals (Germany)

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 Summary concerning Fuzzy-Verification  The application of Fuzzy-verification for 3h-intervals allows a more detailed insight on the differences between the quality of precipitation forecast of CDE and CEU.  The results got by MeteoSwiss could be reproduces at least in a qualitative way.  Fractions Skill Score and ETS upscaling give for special cases notable different results. But the aggregated results are relatively good correlated.  The effect of LHN is especially for the whole region of Germany and for runs between sun rise and sun set relatively clear pronounced.  Also for parts of Germany this can be stated – but not with the same degree as for the whole region.  For some forecast intervals the effect of threee hour old boundar values of the CEU can be seen.

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD

Ulrich Damrath: Fuzzy and standard verification for COSMO-EU and COSMO-DE, COSMO GM, Rome September 2011 DWD