Composite Method Results Artificial Cases April 2008

Slides:



Advertisements
Similar presentations
DYnamical and Microphysical Evolution of Convective Storms Thorwald Stein, Robin Hogan, John Nicol DYMECS.
Advertisements

Verification of GEOM and FAKE cases with SAL Contribution from U Mainz Christiane Hofmann, Matthias Zimmer, Heini Wernli Kindly presented by Christian.
Method for Object-based Diagnostic Evaluation (MODE) Fake forecasts.
Improving Excessive Rainfall Forecasts at HPC by using the “Neighborhood - Spatial Density“ Approach to High Res Models Michael Eckert, David Novak, and.
Five-Number Summary 1 Smallest Value 2 First Quartile 3 Median 4
MEASURES OF SPREAD – VARIABILITY- DIVERSITY- VARIATION-DISPERSION
Exploring the Use of Object- Oriented Verification at the Hydrometeorological Prediction Center Faye E. Barthold 1,2, Keith F. Brill 1, and David R. Novak.
Using Short Range Ensemble Model Data in National Fire Weather Outlooks Sarah J. Taylor David Bright, Greg Carbin, Phillip Bothwell NWS/Storm Prediction.
Ways to Describe Data Sets
ESA DA Projects Progress Meeting 2University of Reading Advanced Data Assimilation Methods WP2.1 Perform (ensemble) experiments to quantify model errors.
Chapter 3 Descriptive Measures
A P STATISTICS LESSON 2 – 2 STANDARD NORMAL CALCULATIONS.
Streamflow Predictability Tom Hopson. Conduct Idealized Predictability Experiments Document relative importance of uncertainties in basin initial conditions.
How can LAMEPS * help you to make a better forecast for extreme weather Henrik Feddersen, DMI * LAMEPS =Limited-Area Model Ensemble Prediction.
Event-based Verification and Evaluation of NWS Gridded Products: The EVENT Tool Missy Petty Forecast Impact and Quality Assessment Section NOAA/ESRL/GSD.
Verification of the distributions Chiara Marsigli ARPA-SIM - HydroMeteorological Service of Emilia-Romagna Bologna, Italy.
Model dependence and an idea for post- processing multi-model ensembles Craig H. Bishop Naval Research Laboratory, Monterey, CA, USA Gab Abramowitz Climate.
Feature-based (object-based) Verification Nathan M. Hitchens National Severe Storms Laboratory.
Object-oriented verification of WRF forecasts from 2005 SPC/NSSL Spring Program Mike Baldwin Purdue University.
1 ARPA-SIM, Bologna, Italy and CIMA, Savona, Italy. Improving the radar data mosaicking procedure by means of a quality descriptor Fornasiero, A., Alberoni,
Do the NAM and GFS have displacement biases in their MCS forecasts? Charles Yost Russ Schumacher Department of Atmospheric Sciences Texas A&M University.
Diagnostic Evaluation of Mesoscale Models Chris Davis, Barbara Brown, Randy Bullock and Daran Rife NCAR Boulder, Colorado, USA.
1 Probability and Statistics Confidence Intervals.
3 rd EULAG Workshop CAM-EULAG June 2012 West African Extreme Daily Precipitation in Observations and Stretched-Grid Simulations by CAM-EULAG William J.
NCAR, 15 April Fuzzy verification of fake cases Beth Ebert Center for Australian Weather and Climate Research Bureau of Meteorology.
Nowcasting Convection Fusing 0-6 hour observation- and model-based probability forecasts WWRP Symposium on Nowcasting and Very Short Range Forecasting.
Using FAO NewClim to Build Climatologies Primary attempt – May a. verdin 08/20/2010.
Application of the CRA Method Application of the CRA Method William A. Gallus, Jr. Iowa State University Beth Ebert Center for Australian Weather and Climate.
Roger A. Stocker 1 Jason E. Nachamkin 2 An overview of operational FNMOC mesoscale cloud forecast support 1 FNMOC: Fleet Numerical Meteorology & Oceanography.
Measures of Variation. Variation Variation describes how widely data values are spread out about the center of a distribution.
Lecture 14 CS5661 Neighbor Joining Generates unrooted tree, allowing for unequal branches Given: Distance matrix for sequences Steps: Repeat 1-3 till all.
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course Mar 2016.
Xuexing Qiu and Fuqing Dec. 2014
Chapter 16: Exploratory data analysis: numerical summaries
04/10/
CHAPTER 2 Modeling Distributions of Data
Fuzzy verification using the Fractions Skill Score
Procrustes Shape Analysis Verification Tool
Systematic timing errors in km-scale NWP precipitation forecasts
University of Washington Ensemble Systems for Probabilistic Analysis and Forecasting Cliff Mass, Atmospheric Sciences University of Washington.
Verifying Precipitation Events Using Composite Statistics
Sections 2.1 and 2.2 Problems.
Composite-based Verification
Storm Surge Forecasting Practices, Tools for Emergency Managers, A Probabilistic Storm Surge Model Based on Ensembles and Past Error Distributions.
Nathalie Voisin, Andy W. Wood and Dennis P. Lettenmaier
Unit 4 Statistics Review
MOS Developed by and Run at the NWS Meteorological Development Lab (MDL) Full range of products available at:
Naval Research Laboratory
Chapter 3 Variability Variability – how scores differ from one another. Which set of scores has greater variability? Set 1: 8,9,5,2,1,3,1,9 Set 2: 3,4,3,5,4,6,2,3.
2 METOC Consulting, Monterey, CA 93943,
Using statistics to evaluate your test Gerard Seinhorst
Common Core State Standards:
Numerical Weather Prediction Center (NWPC), Beijing, China
CHAPTER 2 Modeling Distributions of Data
CHAPTER 2 Modeling Distributions of Data
SWFDP Key Issues for GIFS-TIGGE
CHAPTER 2 Modeling Distributions of Data
NOAA Objective Sea Surface Salinity Analysis P. Xie, Y. Xue, and A
CHAPTER 2 Modeling Distributions of Data
CHAPTER 2 Modeling Distributions of Data
Quantitative Data Who? Cans of cola. What? Weight (g) of contents.
CHAPTER 2 Modeling Distributions of Data
CHAPTER 2 Modeling Distributions of Data
Module 10.
Facultad de Ingeniería, Centro de Cálculo
Advanced Algebra Unit 1 Vocabulary
CHAPTER 2 Modeling Distributions of Data
Tukey Box Plots Review.
CHAPTER 2 Modeling Distributions of Data
Presentation transcript:

Composite Method Results Artificial Cases April 2008 Jason Nachamkin Naval Research Laboratory Monterey, CA

Geometric Cases CASE I Composite Centered on All Predicted Events Composite Centered on All Observed Events Grid centered on ‘forecast’ Grid centered on ‘observation’ Compositing displays average distributions for predicted and observed events. Composites of single cases are very simple. The only difference between the forecast-based and observation-based composite is the location of the grid origin. Composites for all geometric cases are centered on the 50 mm(?) ovoid. Composite grids are 501x501 points in size.

Geometric Cases CBD Conditional bias difference (CBD) = bias of forecast-based composite minus bias of obs-based composite. Case I generally performed best, though poor scores existed close to the event center. Case III had the worst score at intermediate distances from the event. Case V scored best close in, but worst at large distances. Errors weighted lower with increasing distance - larger averaging area is more generous.

Perturbed Cases CASE III Composite Centered on All Predicted Events Composite Centered on All Observed Events mm hr-1 Composited all events with precip rates of 11 mm/hr or greater (convective cores), minimum event size = 50 grid points, composite grid size = 201x201 points. Each case contained 7 events ranging in size from 51 to 530 points. Covariance drops very rapidly with distance as indicated by the small area of coherent averages. Lower thresholds produce larger coherent areas.

Geometric Cases CBD Case I performed the best at all box sizes. Case V performed the worst at large distance. As displacement distance increased, error rapidly maxed out close to the events due to their small size.