DIAMET meeting 7 th-8th March 2011 “New tools for the evaluation of convective scale ensemble systems” Seonaid Dey Supervisors: Bob Plant, Nigel Roberts.

Slides:



Advertisements
Similar presentations
Medium-range Ensemble Streamflow forecast over France F. Rousset-Regimbeau (1), J. Noilhan (2), G. Thirel (2), E. Martin (2) and F. Habets (3) 1 : Direction.
Advertisements

Slide 1ECMWF forecast User Meeting -- Reading, June 2006 Verification of weather parameters Anna Ghelli, ECMWF.
30 th September 2010 Bannister & Migliorini Slide 1 of 9 High-resolution assimilation and weather forecasting Ross Bannister and Stefano Migliorini (NCEO,
Gridded OCF Probabilistic Forecasting For Australia For more information please contact © Commonwealth of Australia 2011 Shaun Cooper.
Using geospatial analysis techniques to investigate the spatial properties of tropical cyclone rain fields Corene J. Matyas Department of Geography, University.
NWP Verification with Shape- matching Algorithms: Hydrologic Applications and Extension to Ensembles Barbara Brown 1, Edward Tollerud 2, Tara Jensen 1,
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Quantitative precipitation forecasts in the Alps – first.
ISRO / UKSA Joint Working Group University of Reading29 March 2011 Use of observational information for convective-scale predictions Stefano Migliorini.
The Consideration of Noise in the Direct NWP Model Output Susanne Theis Andreas Hense Ulrich Damrath Volker Renner.
The 10th annual Northeast Regional Operational Workshop, Albany, NY Verification of SREF Aviation Forecasts at Binghamton, NY Justin Arnott NOAA / NWS.
Ensemble Post-Processing and it’s Potential Benefits for the Operational Forecaster Michael Erickson and Brian A. Colle School of Marine and Atmospheric.
Using Short Range Ensemble Model Data in National Fire Weather Outlooks Sarah J. Taylor David Bright, Greg Carbin, Phillip Bothwell NWS/Storm Prediction.
WWOSC 2014 Assimilation of 3D radar reflectivity with an Ensemble Kalman Filter on a convection-permitting scale WWOSC 2014 Theresa Bick 1,2,* Silke Trömel.
4th Int'l Verification Methods Workshop, Helsinki, 4-6 June Methods for verifying spatial forecasts Beth Ebert Centre for Australian Weather and.
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
NREL is a national laboratory of the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy operated by the Alliance for Sustainable.
How can LAMEPS * help you to make a better forecast for extreme weather Henrik Feddersen, DMI * LAMEPS =Limited-Area Model Ensemble Prediction.
“High resolution ensemble analysis: linking correlations and spread to physical processes ” S. Dey, R. Plant, N. Roberts and S. Migliorini Mesoscale group.
“High resolution ensemble analysis: linking correlations and spread to physical processes ” S. Dey, R. Plant, N. Roberts and S. Migliorini NWP 4: Probabilistic.
STEPS: An empirical treatment of forecast uncertainty Alan Seed BMRC Weather Forecasting Group.
© Crown copyright Met Office Preliminary results using the Fractions Skill Score: SP2005 and fake cases Marion Mittermaier and Nigel Roberts.
“Spatial ensemble characterisation for summer convective cases” S. Dey Supervisors: R. Plant, N. Roberts and S. Migliorini Mesoscale group 03/06/2014.
On the spatial verification of FROST-2014 precipitation forecast fields Anatoly Muraviev (1), Anastasia Bundel (1), Dmitry Kiktev (1), Nikolay Bocharnikov.
“New tools for the evaluation of convective scale ensemble systems” Seonaid Dey Supervisors: Bob Plant, Nigel Roberts and Stefano Migliorini.
“A view of the 2 nd and 3 rd August COPE cases using storm-permitting ensemble MOGREPS-UK” S. Dey Supervisors: R. Plant, N. Roberts and S. Migliorini COPE.
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss Priority project « Advanced interpretation and verification.
Meteorological Data Analysis Urban, Regional Modeling and Analysis Section Division of Air Resources New York State Department of Environmental Conservation.
Page 1© Crown copyright Scale selective verification of precipitation forecasts Nigel Roberts and Humphrey Lean.
Refinement and Evaluation of Automated High-Resolution Ensemble-Based Hazard Detection Guidance Tools for Transition to NWS Operations Kick off JNTP project.
“High resolution ensemble analysis: linking correlations and spread to physical processes ” S. Dey Supervisors: R. Plant, N. Roberts and S. Migliorini.
EMS 2013 (Reading UK) Verification techniques for high resolution NWP precipitation forecasts Emiel van der Plas Kees Kok Maurice.
DIAMET meeting 7 th-8th March 2011 “New tools for the evaluation of convective scale ensemble systems” Seonaid Dey Supervisors: Bob Plant, Nigel Roberts.
Feature-based (object-based) Verification Nathan M. Hitchens National Severe Storms Laboratory.
Page 1© Crown copyright 2004 WP5.3 Assessment of Forecast Quality ENSEMBLES RT4/RT5 Kick Off Meeting, Paris, Feb 2005 Richard Graham.
Spatial Verification Methods for Ensemble Forecasts of Low-Level Rotation in Supercells Patrick S. Skinner 1, Louis J. Wicker 1, Dustan M. Wheatley 1,2,
Strategic Intervention A novel use of Ensembles in Forecast Guidance
Generate ξ m,i for each direction i given H, σ 1 and m (Eq. 2) calculate X’ m,i for each direction i (Eq. 1) given ξ m,i and X m, which corresponds for.
Page 1© Crown copyright 2004 Development of a stochastic precipitation nowcast scheme for flood forecasting and warning Clive Pierce 1, Alan Seed 2, Neill.
Exploring Multi-Model Ensemble Performance in Extratropical Cyclones over Eastern North America and the Western Atlantic Ocean Nathan Korfe and Brian A.
Page 1© Crown copyright 2005 Met Office Verification -status Clive Wilson, Presented by Mike Bush at EWGLAM Meeting October 8- 11, 2007.
On the Challenges of Identifying the “Best” Ensemble Member in Operational Forecasting David Bright NOAA/Storm Prediction Center Paul Nutter CIMMS/Univ.
COMPARISONS OF NOWCASTING TECHNIQUES FOR OCEANIC CONVECTION Huaqing Cai, Cathy Kessinger, Nancy Rehak, Daniel Megenhardt and Matthias Steiner National.
WRF Verification Toolkit Workshop, Boulder, February 2007 Spatial verification of NWP model fields Beth Ebert BMRC, Australia.
NCAR, 15 April Fuzzy verification of fake cases Beth Ebert Center for Australian Weather and Climate Research Bureau of Meteorology.
Extracting probabilistic severe weather guidance from convection-allowing model forecasts Ryan Sobash 4 December 2009 Convection/NWP Seminar Series Ryan.
Overview of SPC Efforts in Objective Verification of Convection-Allowing Models and Ensembles Israel Jirak, Chris Melick, Patrick Marsh, Andy Dean and.
Predicting Intense Precipitation Using Upscaled, High-Resolution Ensemble Forecasts Henrik Feddersen, DMI.
1Deutscher WetterdienstMärz 2005 April 2005: 19 NWS/ 21 forecast products (1) AustriaALADIN-LACE (9.6 km) ARPEGE (2) Czech Repub ALADIN-LACE (9 km) ARPEGE.
UERRA user workshop, Toulouse, 3./4. Feb 2016Cristian Lussana and Michael Borsche 1 Evaluation software tools Cristian Lussana (2) and Michael Borsche.
Characteristics of precipitating convection in the UM at Δx≈200m-2km
Xuexing Qiu and Fuqing Dec. 2014
Nigel Roberts Met Reading
Intensity-scale verification technique
Fuzzy verification using the Fractions Skill Score
Spatial Verification Intercomparison Meeting, 20 February 2007, NCAR
Multi-scale validation of high resolution precipitation products
A New Method for Evaluating Regional Air Quality Forecasts
Convective Scale Modelling Humphrey Lean et. al
Quantifying uncertainty in volcanic ash forecasts
Arpae Hydro-Meteo-Climate Service, Bologna, Italy
Ingredients approach for severe weather
A. Topographic radiation correction in COSMO: gridscale or subgridscale? B. COSMO-2: convection resolving or convection inhibiting model? Matteo Buzzi.
WMO NWP Wokshop: Blending Breakout
Comparison of different combinations of ensemble-based and variational data assimilation approaches for deterministic NWP Mark Buehner Data Assimilation.
Numerical Weather Prediction Center (NWPC), Beijing, China
Lightning Assimilation Techniques
Verification of Tropical Cyclone Forecasts
AGREPS – ACCESS Global and Regional EPS
Short Range Ensemble Prediction System Verification over Greece
Presentation transcript:

DIAMET meeting 7 th-8th March 2011 “New tools for the evaluation of convective scale ensemble systems” Seonaid Dey Supervisors: Bob Plant, Nigel Roberts and Stefano Migliorini

Introduction Project aims Case study of 08/07/2011 Current work Future plans

Project aims Link statistical measures such as multivariate covariances with physical processes and spatial verification measures Investigate how deterministic techniques can be extended to ensembles Look into meteorological aspects and scales that are useful for determining predictability

Work so far 1: 08/07/2011 Convective precipitation Flooding MOGREPS-UK 2.2km 12 member ensemble

Work so far 2: Spatial measures All member pairs Member-radar pairs Fractions skill score (FSS) 1- perfect match 0- totally different

Work so far 3: correlations Vertical (spatial) correlations 3D Fields: Horizontal Divergence Horizontal wind speed Rain rates Wind shear Field 1 Field 2 z

Work so far 4: example correlation 09:00- Before precipitation12:00 - During precipitation

Next steps Spatial horizontal correlations Relate correlations to spatial measures Spatially varying FSS Other cases Large scale forcing (DIAMET) Local forcing (COPE)

Fractions skill score 1.Select threshold 2.Convert field to binary 3.Count fractions within neighbourhood 4.Compare fractions to calculate MSE, compare with reference forecast Courtesy of Nigel Roberts