QPF verification of the 4 model versions at 7 km res. (COSMO-I7, COSMO-7, COSMO-EU, COSMO-ME) with the 2 model versions at 2.8 km res. (COSMO- I2, COSMO-IT)

Slides:



Advertisements
Similar presentations
VERIFICATION Highligths by WG5. 9° General MeetingAthens September Working package/Task on “standardization” The “core” Continuous parameters: T2m,
Advertisements

Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Improving COSMO-LEPS forecasts of extreme events with.
QPF verification of DWD-LM and LAMI model using high resolution non-GTS data in Piedmont region and Northern Italy Working Group 5: Verification and Case.
Estimation of Rainfall Areal Reduction Factors Using NEXRAD Data Francisco Olivera, Janghwoan Choi and Dongkyun Kim Texas A&M University – Department of.
COSMO General Meeting – Roma Sept 2011 Some results from operational verification in Italy Angela Celozzi – Giovanni Favicchio Elena Oberto – Adriano.
1 COSMO GM, Athens/2007 | E. Zala; D. Leuenberger Update on Weather-Situation Dependent COSMO-7 Verification against Radar Data Results of 2006 Emanuele.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,
HSAF Training on Precipitation Products, Rome, December 2009 Precipitation Computed by COSMO-ME model (PR ASS1) Lucio TORRISI Italian Met. Service.
COSMO General Meeting – Moscow Sept 2010 Some results from operational verification in Italy Angela Celozzi - Federico Grazzini Massimo Milelli -
Verification Precipitation verification (overestimation): a common view of the behaviour of the LM, aLMo and LAMI Francis Schubiger and Pirmin Kaufmann,
Verification methods - towards a user oriented verification WG5.
SEASONAL COMMON PLOT SCORES A DRIANO R ASPANTI P ERFORMANCE DIAGRAM BY M.S T ESINI Sibiu - Cosmo General Meeting 2-5 September 2013.
COSMO General Meeting, Offenbach, 7 – 11 Sept Dependance of bias on initial time of forecasts 1 WG1 Overview
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Final PP QPF meeting COSMO General Meeting, 18 September.
We carried out the QPF verification of the three model versions (COSMO-I7, COSMO-7, COSMO-EU) with the following specifications: From January 2006 till.
Verification of the distributions Chiara Marsigli ARPA-SIM - HydroMeteorological Service of Emilia-Romagna Bologna, Italy.
SOME EXPERIENCES ON SATELLITE RAINFALL ESTIMATION OVER SOUTH AMERICA. Daniel Vila 1, Inés Velasco 2 1 Sistema de Alerta Hidrológico - Instituto Nacional.
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
The latest results of verification over Poland Katarzyna Starosta Joanna Linkowska COSMO General Meeting, Cracow September 2008 Institute of Meteorology.
VALIDATION OF HIGH RESOLUTION PRECIPITATION PRODUCTS IN THE SOUTH OF BRAZIL WITH A DENSE GAUGE NETWORK AND WEATHER RADARS – FIRST RESULTS Cesar Beneti,
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecast in the Alps Verification.
PP QPF Workshop, Langen, 8 March 2007 Simulations of the Piedmont test case: PP QPF WP 3.2 M. Milelli*, E. Oberto*, A. Parodi** *ARPA Piemonte,
Evaluation of gridded multi-satellite precipitation (TRMM -TMPA) estimates for performance in the Upper Indus Basin (UIB) Asim J Khan Advisor: Prof. Dr.
1 Validation for CRR (PGE05) NWC SAF PAR Workshop October 2005 Madrid, Spain A. Rodríguez.
Alan F. Hamlet Andy Wood Dennis P. Lettenmaier JISAO Center for Science in the Earth System Climate Impacts Group and the Department.
General Meeting Moscow, 6-10 September 2010 High-Resolution verification for Temperature ( in northern Italy) Maria Stefania Tesini COSMO General Meeting.
Operational verification system Rodica Dumitrache National Metorogical Administration ROMANIA.
Overview of WG5 activities and Conditional Verification Project Adriano Raspanti - WG5 Bucharest, September 2006.
VERIFICATION Highligths by WG5. 2 Outlook Some focus on Temperature with common plots and Conditional Verification Some Fuzzy verification Long trends.
10th COSMO General Meeting, Cracow, Poland Verification of COSMOGR Over Greece 10 th COSMO General Meeting Cracow, Poland.
Latest results in the precipitation verification over Northern Italy Elena Oberto, Marco Turco, Paolo Bertolotto (*) ARPA Piemonte, Torino, Italy.
DOWNSCALING GLOBAL MEDIUM RANGE METEOROLOGICAL PREDICTIONS FOR FLOOD PREDICTION Nathalie Voisin, Andy W. Wood, Dennis P. Lettenmaier University of Washington,
Verification methods - towards a user oriented verification The verification group.
Predicting Intense Precipitation Using Upscaled, High-Resolution Ensemble Forecasts Henrik Feddersen, DMI.
Data Analysis of GPM Constellation Satellites-IMERG and ERA-Interim Precipitation Products over West of Iran Ehsan Sharifi 1, Reinhold Steinacker 1, and.
VERIFICATION Highligths by WG5. 2 Outlook The COSMO-Index COSI at DWD Time series of the index and its DWD 2003.
11 Short-Range QPF for Flash Flood Prediction and Small Basin Forecasts Prediction Forecasts David Kitzmiller, Yu Zhang, Wanru Wu, Shaorong Wu, Feng Ding.
Application of the CRA Method Application of the CRA Method William A. Gallus, Jr. Iowa State University Beth Ebert Center for Australian Weather and Climate.
VALIDATION OF HIGH RESOLUTION SATELLITE-DERIVED RAINFALL ESTIMATES AND OPERATIONAL MESOSCALE MODELS FORECASTS OF PRECIPITATION OVER SOUTHERN EUROPE 1st.
WG5 COSMO General Meeting, Rome 2011 Authors: ALL Presented by Adriano Raspanti.
Evaluation of TRMM satellite precipitation product in hydrologic simulations of La Plata Basin Fengge Su 1, Yang Hong 2, and Dennis P. Lettenmaier 1 1.
Assessment of high-resolution simulations of precipitation and temperature characteristics over western Canada using WRF model Asong. Z.E
Multi-Site and Multi-Objective Evaluation of CMORPH and TRMM-3B42 High-Resolution Satellite-Rainfall Products October 11-15, 2010 Hamburg, Germany Emad.
Operational Verification at HNMS
AMPHORE - Interreg III B Medocc
Studies with COSMO-DE on basic aspects in the convective scale:
The Evaluation of Precipitation Information from Satellites and Models
M.-E. Demory, P.L. Vidale, J. Donners, M. Roberts, A. Clayton
LEPS VERIFICATION ON MAP CASES
Current verification results for COSMO-EU and COSMO-DE at DWD
QPF sensitivity to Runge-Kutta and Leapfrog core
Verification of LAMI: QPF over northern Italy and vertical profiles
COSMO Priority Project ”Quantitative Precipitation Forecasts”
(Elena Oberto, Massimo Milelli - ARPA Piemonte)
Application of satellite-based rainfall and medium range meteorological forecast in real-time flood forecasting in the Upper Mahanadi River basin Trushnamayee.
Analysis of NASA GPM Early 30-minute Run in Comparison to Walnut Gulch Experimental Watershed Rain Data Adolfo Herrera April Arizona Space Grant.
Focus of analysis – reason for using PRECIS RCM
Verification Overview
Thomas Gastaldo, Virginia Poli, Chiara Marsigli
Verification of COSMO-LEPS and coupling with a hydrologic model
Simulations of the Piedmont test case:
Preliminary test for the development of a 2.8km ensemble over Italy
Evaluation of the TRMM Multi-satellite Precipitation Analysis (TMPA) and its utility in hydrologic prediction in La Plata Basin Dennis P. Lettenmaier and.
Erin Robinson, Alan Pinkert June, 2010
Some Verification Highlights and Issues in Precipitation Verification
Verification Overview
Seasonal common scores plots
Short Range Ensemble Prediction System Verification over Greece
VERIFICATION OF THE LAMI AT CNMCA
Presentation transcript:

QPF verification of the 4 model versions at 7 km res. (COSMO-I7, COSMO-7, COSMO-EU, COSMO-ME) with the 2 model versions at 2.8 km res. (COSMO- I2, COSMO-IT) Specifications: Dataset: high resolution network of rain gauges coming from COSMO dataset and Civil Protection Department  1300 stations Method: 24h/6h averaged cumulated precipitation value over 90 meteo-hydrological basins Model selection: run 00UTC, D+1 Precipitation verification comparison in 2008/2009 among the several COSMO-Model versions (Elena Oberto, Massimo Milelli - ARPA Piemonte)

The aims Long period verification (seasonal trend) (from djf’04 to mam’09)  1.Statistical indices for low thres (0.2mm/24h) 2.Statistical indices for high thres (20mm/24h) Verification ovest last year ( )  1. Cosmo-7/Cosmo-EU comparison 2. Cosmo-I7/Cosmo-ME comparison 3. Driving model comparison: ecmwf/Cosmo-I7/Cosmo-I2 4. Driving model comparison: ecmwf/Cosmo-ME/Cosmo-IT 5. Diurnal cycle for all the model 6. Spatial error distribution (latest season: MAM’09)

% correctly forecasted not- events (specificity)

Seasonal trend (low thres) Bias reduction trend Seasonal cycle: big peak during summertime Biggest overestimation peak for cosmo-I7 Underestimation for cosmo-7 during latest seasons

Seasonal trend (low thres) Stable trend/slightly worsening in time Best performance during spring/summertime Worsening for Cosmo-7 during latest seasons

Seasonal trend (low thres) False alarm number reduction esp. in wintertime Worse performance during summertime, esp. for Cosmo-I7

Seasonal trend (low thres) Slightly improvement trend Seasonal cycle: better during moist seasons, worse during dry seasons

Seasonal trend (high thres) Bias reduction trend, at least during last year Seasonal cycle: big peak during spring-summertime (convective period)  seems to disappear during last summer (… why?) General good performance during last year Pronounced underestimation for Cosmo-7 during last seasons

Seasonal trend (high thres) Slightly improvement in time Worse performance during summertime (except 2007) Worsening for Cosmo-7 during last seasons

Seasonal trend (high thres) False alarm number reduction Worse performance during summertime

Seasonal trend (high thres) Slightly improvement trend Worse performance during summertime (except 2007)

Last year verif.: Cosmo-7/Cosmo-EU vs. thres Good performance for Cosmo-EU Underestimation for Cosmo-7 More correctly forecasted non-events for Cosmo-7

Last year verif.: Cosmo-7/Cosmo-EU fixed thres, seasonal Good performance for Cosmo-EU Underestimation for Cosmo-7 Positive trend for both the models

Last year verif.: Cosmo-I7/Cosmo-ME vs. thres Similar (good) performance: slightly better for Cosmo-ME

Last year verif.: Cosmo-I7/Cosmo-ME fixed thres, seasonal Similar (good) performance: slightly better for Cosmo-ME Positive trend for both the models

Driving model comp: Ecmwf/Cosmo-I7/Cosmo-I2 vs. thres Big gap between Ecmwf and Cosmo-model Cosmo-I7  slightly overestimation; Cosmo-I2  underestimation; Ecmwf  overest. for low thres/ underest. for high thres. I7 equivalent or slightly better then I2 (even if less false alarm for I2)

Driving model comp: ecmwf/Cosmo-I7/Cosmo-I2 fixed thres, seasonal Big gap between Ecmwf and Cosmo-model Positive trend for both I7 and I2 I2  Underestimation tendency I7 is generally better

Driving model comp: Ecmwf/Cosmo-ME/Cosmo-IT vs. thres Big gap between Ecmwf and Cosmo-model IT and ME –> quite similar, it is difficult to decide the winner IT  tendency to overestimation

Driving model comp: ecmwf/Cosmo-ME/Cosmo-IT fixed thres, seasonal Big gap between Ecmwf and Cosmo-model IT and ME –> quite similar, it is difficult to decide the winner IT  tendency to overestimation

Last year verif.: diurnal cycle for all the versions Low thresHigh thres Bias overestimation peak during midday Spin-up problem for all the models especially COSMO-I7 and COSMO-I2 General worsening with forecast time The spin-up seems to disappear, underestimation during the first 6h Bias overestimation peak during midday COSMO-7 underestimates In general: slight improvement with respect to the previous year

To sum up Long period verification (seasonal trend) (from djf’04 to mam’09)  1.General improvement trend 2.For low thres (rain/no rain): overestimation during spring/summertime with more probability of detection but also more false alarms 3.For high thres: the worse skills during spring/summertime (convective period) 4.General Cosmo-7 worsening during last year Verification over last year ( )  1.Good performance for Cosmo-EU 2.Similar performance Cosmo-I7/ Cosmo-ME (slightly better Cosmo-ME) 3. Cosmo-I7/ Cosmo-I2 comparison: similar skill, underestimation I2 4.Cosmo-ME/Cosmo-IT comparison: similar skill, overestimation IT 5.Diurnal cycle: bias overestimation peak during midday, in general slight improvement with respect to previous year

COSMO-7COSMO-ME COSMO-EU COSMO-I2COSMO-IT COSMO-I7 BIAS mm/24H

COSMO-7COSMO-MECOSMO-I7 Rel Error MAM ‘09 COSMO-EUCOSMO-IT COSMO-I2

COSMO-7COSMO-ME COSMO-I2 COSMO-I7 POD mm/24H COSMO-ITCOSMO-EU