PP INSPECT is finished, but the work is going on

Slides:



Advertisements
Similar presentations
EURANDOM & KNMI, May 2009 Analysis of extremes in a changing climate in support of informed decisions for adaptation
Advertisements

Assessing High-Impact Weather Variations and Changes Utilizing Extreme Value Theory NCAR Earth System Laboratory National Center for Atmospheric Research.
Hydrologic Statistics
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Improving COSMO-LEPS forecasts of extreme events with.
Creating probability forecasts of binary events from ensemble predictions and prior information - A comparison of methods Cristina Primo Institute Pierre.
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
Assessment of Tropical Rainfall Potential (TRaP) forecasts during the Australian tropical cyclone season Beth Ebert BMRC, Melbourne, Australia.
19. September 2003 Int.Conference Earth Systems Modelling1 Climatic Extremes and Rare Events: Statistics and Modelling Andreas Hense, Meteorologisches.
Department of Meteorology and Geophysics University of Vienna since 1851 since 1365 TOWARDS AN ANALYSIS ENSEMBLE FOR NWP-MODEL VERIFICATION Manfred Dorninger,
Assessment of Extreme Rainfall in the UK Marie Ekström
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
COSMO General Meeting Zurich, 2005 Institute of Meteorology and Water Management Warsaw, Poland- 1 - Verification of the LM at IMGW Katarzyna Starosta,
13 ° COSMO General Meeting Rome VERSUS2 Priority Project Report and Plan Adriano Raspanti.
FULL EARTH HIGH-RESOLUTION EARTHQUAKE FORECASTS Yan Y. Kagan and David D. Jackson Department of Earth and Space Sciences, University of California Los.
SPC for Real-World Processes William A. Levinson, P.E. Intersil Corporation Mountaintop, PA.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
9° General Meeting Adriano Raspanti - WG5. 9° General MeetingAthens September Future plans CV-VerSUS project future plans COSI “The Score” new package.
On the spatial verification of FROST-2014 precipitation forecast fields Anatoly Muraviev (1), Anastasia Bundel (1), Dmitry Kiktev (1), Nikolay Bocharnikov.
Improving Ensemble QPF in NMC Dr. Dai Kan National Meteorological Center of China (NMC) International Training Course for Weather Forecasters 11/1, 2012,
Latest results in verification over Poland Katarzyna Starosta, Joanna Linkowska Institute of Meteorology and Water Management, Warsaw 9th COSMO General.
The latest results of verification over Poland Katarzyna Starosta Joanna Linkowska COSMO General Meeting, Cracow September 2008 Institute of Meteorology.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Accounting for Change: Local wind forecasts from the high-
Probabilistic Forecasting. pdfs and Histograms Probability density functions (pdfs) are unobservable. They can only be estimated. They tell us the density,
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Local Probabilistic Weather Predictions for Switzerland.
For information contact H. C. Koons 30 October Preliminary Analysis of ABFM Data WSR 11 x 11-km Average Harry Koons 30 October.
Intercomparison of Spatial Verification Methods for COSMO Terrain (INSPECT): Preliminary Results Dmitry Alferov (1), Elena Astakhova (1), Dimitra Boukouvala.
GLOBAL EARTHQUAKE FORECASTS Yan Y. Kagan and David D. Jackson Department of Earth and Space Sciences, University of California Los Angeles Abstract We.
Verification of Precipitation Areas Beth Ebert Bureau of Meteorology Research Centre Melbourne, Australia
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss A more reliable COSMO-LEPS F. Fundel, A. Walser, M. A.
Evaluating the ability of climate models to simulate extremes Eric Robinson Natalie McLean Christine Radermacher Ross Towe Yushiang Tung Project 6.
New approaches in extreme-value modeling A.Zempléni, A. Beke, V. Csiszár (Eötvös Loránd University, Budapest) Flood Risk Workshop,
Trials of a 1km Version of the Unified Model for Short Range Forecasting of Convective Events Humphrey Lean, Susan Ballard, Peter Clark, Mark Dixon, Zhihong.
Overview of WG5 activities and Conditional Verification Project Adriano Raspanti - WG5 Bucharest, September 2006.
Diagnostic verification and extremes: 1 st Breakout Discussed the need for toolkit to build beyond current capabilities (e.g., NCEP) Identified (and began.
WRF Verification Toolkit Workshop, Boulder, February 2007 Spatial verification of NWP model fields Beth Ebert BMRC, Australia.
VERIFICATION Highligths by WG5. 2 Outlook Some focus on Temperature with common plots and Conditional Verification Some Fuzzy verification Long trends.
Eidgenössisches Departement des Innern EDI Bundesamt für Meteorologie und Klimatologie MeteoSchweiz Weather type dependant fuzzy verification of precipitation.
WG4 Oct 2006 – Sep 2007 plans COSMO General Meeting, 21 September 2006 Pierre Eckert.
1 Application of MET for the Verification of the NWP Cloud and Precipitation Products using A-Train Satellite Observations Paul A. Kucera, Courtney Weeks,
Application of the CRA Method Application of the CRA Method William A. Gallus, Jr. Iowa State University Beth Ebert Center for Australian Weather and Climate.
1Deutscher WetterdienstMärz 2005 April 2005: 19 NWS/ 21 forecast products (1) AustriaALADIN-LACE (9.6 km) ARPEGE (2) Czech Repub ALADIN-LACE (9 km) ARPEGE.
Deutscher Wetterdienst Long-term trends of precipitation verification results for GME, COSMO-EU and COSMO-DE Ulrich Damrath.
New results in COSMO about fuzzy verification activities and preliminary results with VERSUS Conditional Verification 31th EWGLAM &16th SRNWP meeting,
Application of object-oriented verification techniques to ensemble precipitation forecasts William A. Gallus, Jr. Iowa State University June 5, 2009.
LEPS VERIFICATION ON MAP CASES
Systematic timing errors in km-scale NWP precipitation forecasts
Verifying and interpreting ensemble products
Arpae Hydro-Meteo-Climate Service, Bologna, Italy
PP INSPECT report Dmitry Alferov (1), Elena Astakhova (1), Petra Baumann (4), Dimitra Boukouvala (2), Anastasia Bundel (1), Ulrich Damrath (3), Pierre.
Log Linear Modeling of Independence
Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier
WG5 Verification and Case studies Overview of activities Flora Gofa
Hydrologic Statistics
forecasts of rare events
Dr. Cleveland, This file contents 4 tracks poster slides
COSMO General Meeting 2009 WG5 Parallel Session 7 September 2009
Verification Overview
Statistical Analysis Error Bars
20th COSMO General Meeting, 3-7 September 2018, St. Petersburg, Russia
Thomas Gastaldo, Virginia Poli, Chiara Marsigli
Christoph Gebhardt, Zied Ben Bouallègue, Michael Buchhold
Continuous Statistical Distributions: A Practical Guide for Detection, Description and Sense Making Unit 3.
SRNWP-PEPS COSMO General Meeting September 2005
Verification of Tropical Cyclone Forecasts
Some Verification Highlights and Issues in Precipitation Verification
COSMO PP QPF workshop 8 March 2006 Langen Marco Arpagaus.
Guidelines for future developments Tiziana Paccagnella, ARPA-SIM
Preparing a new Model Version according to Source Code Management
Overview of WG4 Users Survey responses
WG4 activities. Discussion
Presentation transcript:

PP INSPECT is finished, but the work is going on Anastasia Bundel RHM COSMO GM in Saint Petersburg, 04 September 2018

INSPECT final report The report is prepared and sent to the SMC members for eventual comments, critics, or suggestions. No comments so far. When it’s approved, it will be published on the COSMO web-site.

Feedback from MesoVICT BAMS paper: Dorninger, M., E. Gilleland, B. Casati, M. Mittermaier, E. Ebert, B. Brown, and L. Wilson, 2018: The set-up of the Mesoscale Verification Inter-Comparison over Complex Terrain (MesoVICT) Project. Bull. Amer. Meteor. Soc. doi:10.1175/BAMS-D-17-0164.1, in press.

Feedback from MesoVICT, cont. Regular participation of COSMO people in MesoVICT webinars once a month MesoVICT final meeting 2019, variants: - ICAM International Conference on Alpine Meteorology - COSMO GM in Rome: “since the COSMO community has been so active in the project, having it joint with the COSMO community would be a fitting acknowledgement of COSMO contribution” (from organizers’ letter) - Special meeting

One of the INSPECT outcomes: Several ways of compact visualization of neighborhood, CRA, and SAL methods (DWD, MCH, RHM, HNMS). Especially for neighborhood scores, such a cumulative framework can be implemented as part of COSMO Verification activity (possibly using VAST)

Processing large volumes of data: CRA for STEPS nowcasting at Roshydromet (Anatoly Muraviev) The core of the system is the statistical STEPS scheme (Short Term Ensemble Prediction System) (Bowler N. et al., 2006) Verification period: May-September 2017 9 radars in Central Russia Forecasts for intense precipitation areas only were analyzed (169 situations) 10 min time step until 3 h Grid size of about 2 km SpatialVx was used to indentify objects and to calculate CRA scores. The objects with areas less than 35*35 grid points (about 70х70 km) and lager than 128х128 grid points (about 250х250 km) were excluded from analysis using min.size and max.size option in FeatureFinder function. The radius of averaging for convolution smoothing was chosen empirically as 9 grid points (18 km) Precipitation threshold for object recognition showed here is 1 mm/h

SpatialVx: first и last objects, 17 May 2017 RADAR STEPS RADAR STEPS The radar object splitted in two by the end of the forecast period 7

R-SpatialVx, CRA STEPS forecast: Radar RAKU 20170517_1120 Such CRA tables are aggregated over the whole period May-September 2017 8

Statistics of CRA object centroid longitude shift: mean, median, quartiles, max, and min. Critical shift value empirically defined as 35 grid points (radius of a smallest round object) Red : shifts for all objects don’t exceed the critical value Green : shifts for not less than 50% of objects don’t exceed the critical value (until 90 min lead time) Systematic shifts and other CRA error components can be determined in such a way.

Analysis of object sizes Analysis of object sizes. Extreme value analysis: Introductory study Motivation: to understand what are our objects (features/contiguous areas/entities) statistically

Distribution histograms of object sizes One radar (RAKU) data Number of objects (>=1 mm) in winter is twice less than in summer, but the relative frequencies of sizes are comparable Upper row for warm period, Lower row, cold period Red : number of objects, Blue: relative frequencies OBJECT SIZE in GRID POINTS*1000

Estimating the distribution of extreme values : R fevd module R extRemes package( E.Gilleland) Module fevd – fitting extreme value distributions to data, plotting histograms, parameter estimation, distribution densities, fitting of tails, quantile-quantile (QQ) plots, statistical significance, … Distributions and parameters: GEV – Generalized Extreme Value distribution is a family of continuous probability distributions developed within extreme value theory to combine the Gumbel, Fréchet and Weibull families GP – Generalized Pareto PP – Poisson Process Gumbel: a type of GEV Exponential Methods for estimating parameters: MLE (Maximum Likelihood Estimation), GMLE (Generalized MLE) Bayesian Lmoments Some verification specifics

Gumbel distribution doesn’t fit well, as well as Poisson (not shown) Fitting object size distribution using fevd : QQ-plots and probability density functions (pdf) for warm period (RAKU radar) for a threshold of 1600 grid points Heavy tail Heavy tail Light tail Light tail Some verification specifics Gumbel distribution doesn’t fit well, as well as Poisson (not shown) Q-Q plots: GEV and GР-Pareto, acceptable up to 13000 grid points area Here, the serial correlation (development of the same object in time) was not taken into account. Now, the study is ongoing to decimate the series of forecasts based on mesoscale time-space structure

What was not completely fulfilled within INSPECT and needs development Explicitly introducing orography factor Applications to wind and other variables besides precipitation will be continued Focus on HIW and more user-specific variables, exploration of non-standard observations – link to WG4 and WG7! Further applications to ensembles and introducing observation uncertainty Processing large volumes of rapidly updating data from NWP and nowcasting systems (“terabytes of data”), calculation efficiency will be of utmost importance!

Plans As this is a cross-cutting approach among different working groups, maybe, it is not necessary to initiate a special PP about the spatial methods, but better to have dedicated tasks in new joint projects, in the first place, the project focusing in HIW. INTERP and INSPECT knowhow is used in COSMO Research on spatial methods is going on Conclusion

THANK YOU FOR YOUR ATTENTION!

Distribution parameters of object sizes (1 mm/h) identified by FeatureFinder (size is the number of contiguous grid points) R-summary: min, q25, med, mean,q75,max,IQR,std 1600 grid points is higher than q75 for all radars -> Threshold of 1600 grid points was chosen for extreme value analysis Some verification specifics Different radars 17