The Shape-Slope Relation in Observed Gamma Raindrop Size Distributions: Statistical Error or Useful Information?* Shaunna Donaher MPO 531 February 28,

Slides:



Advertisements
Similar presentations
Robin Hogan, Chris Westbrook University of Reading Lin Tian NASA Goddard Space Flight Center Phil Brown Met Office Why it is important that ice particles.
Advertisements

Robin Hogan, Chris Westbrook University of Reading Lin Tian NASA Goddard Space Flight Center Phil Brown Met Office The importance of ice particle shape.
POLARIMETRIC RADAR IMPROVEMENTS
Relationship of the Reflectivity Factor to other Meteorological Quantities Precipitation content (W): The mass of condensed water substance (water or ice)
7. Radar Meteorology References Battan (1973) Atlas (1989)
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Retrieval and Application of Raindrop Size Distributions From Polarimetric Radar and Disdrometer Data for Sub-synoptic Scale Systems Petar Bukovčić 1,3,4,
DUAL-POLARIZATION OF WSR-88D NETWORK
Equation for the microwave backscatter cross section of aggregate snowflakes using the Self-Similar Rayleigh- Gans Approximation Robin Hogan ECMWF and.
Rainfall Monitioring Using Dual-polarization Radars Alexander Ryzhkov National Severe Storms Laboratory / University of Oklahoma, USA.
CHAPTER 7 Sampling Distributions
The Simple Linear Regression Model: Specification and Estimation
Contrasting Tropical Rainfall Regimes Using TRMM and Ground-Based Polarimetric Radar by S. A. Rutledge, R. Cifelli, T. Lang and S. W. Nesbitt EGU 2009.
1 Simple Linear Regression Chapter Introduction In this chapter we examine the relationship among interval variables via a mathematical equation.
REGRESSION AND CORRELATION
What can Dual-Polarization Doppler Radar Do for You? Neil Fox Department of Atmospheric Science University of Missouri - Columbia.
Chapter 12 Section 1 Inference for Linear Regression.
Chapter 6 Random Error The Nature of Random Errors
Review Doppler Radar (Fig. 3.1) A simplified block diagram 10/29-11/11/2013METR
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 7 Sampling Distributions 7.1 What Is A Sampling.
STATISTICS: BASICS Aswath Damodaran 1. 2 The role of statistics Aswath Damodaran 2  When you are given lots of data, and especially when that data is.
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
1 Chapter 3: Examining Relationships 3.1Scatterplots 3.2Correlation 3.3Least-Squares Regression.
BPS - 3rd Ed. Chapter 211 Inference for Regression.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 7 Sampling Distributions.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 6 Sampling Distributions.
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
Random Sampling, Point Estimation and Maximum Likelihood.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
Physics 114: Exam 2 Review Lectures 11-16
Measurements of raindrop-size distributions from dual-polarization spectral observations Dmitri Moisseev and V. Chandrasekar Colorado State University.
PIEZOELECTRIC VAISALA RAINCAP  RAIN SENSOR APPLIED TO DROP SIZE DISTRIBUTION MONITORING Atte Salmi, Lasse Elomaa, Panu Kopsala and Emmi Laukkanen Vaisala.
The Role of Polarimetric Radar for Validating Cloud Models Robert Cifelli 1, Timothy Lang 1, Stephen Nesbitt 1, S.A. Rutledge 1 S. Lang 2, and W.K. Tao.
Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter 7 Sampling Distributions.
 Comparison of predicted radar reflectivity (Z) with observations, such as e.g. from the W-band ARM Cloud Radar (WACR), is an essential part of verifying.
National Lab for Remote Sensing and Nowcasting Dual Polarization Radar and Rainfall Nowcasting by Mark Alliksaar.
6 - 1 © 1998 Prentice-Hall, Inc. Chapter 6 Sampling Distributions.
Ping Zhu, AHC5 234, Office Hours: M/W/F 10AM - 12 PM, or by appointment M/W/F,
RAdio Detection And Ranging. Was originally for military use 1.Sent out electromagnetic radiation (Active) 2.Bounced off an object and returned to a listening.
June 11, 2008Stat Lecture 10 - Review1 Midterm review Chapters 1-5 Statistics Lecture 10.
Looking for deterministic behavior from chaos GyuWon LEE ASP/RAL NCAR.
Dual-Polarization and Dual-Wavelength Radar Measurements Vivek National Center for Atmospheric Research Boulder, Colorado I.Polarization and dual- wavelength.
Remote Sensing of Precipitation A Look at Radar Now and in the Future Western South Dakota Hydrology Conference 23 April 2009 Darren R. Clabo Institute.
LECTURE 3: ANALYSIS OF EXPERIMENTAL DATA
Rain Detection & Attenuation for Remote sensing; & auxiliary sensors
Precipitation Precipitation refers to any product of the condensation of atmospheric water vapour that is deposited on the Earth's surface. Precipitation.
WEATHER SIGNALS Chapter 4 (Focus is on weather signals or echoes from radar resolution volumes filled with countless discrete scatterers---rain, insects,
Correlation & Regression Analysis
What does radar measure? Hydrometeors: rain drops, ice particles Other objects: e.g. birds, insects.
Chapter 8: Simple Linear Regression Yang Zhenlin.
1 Data Analysis Linear Regression Data Analysis Linear Regression Ernesto A. Diaz Department of Mathematics Redwood High School.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 7 Sampling Distributions 7.1 What Is A Sampling.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
Copyright © Cengage Learning. All rights reserved. 5 Joint Probability Distributions and Random Samples.
6 - 1 © 2000 Prentice-Hall, Inc. Statistics for Business and Economics Sampling Distributions Chapter 6.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 7 Sampling Distributions 7.1 What Is A Sampling.
BPS - 5th Ed. Chapter 231 Inference for Regression.
Observations of Specific Differential Phase, KDP Chris Collier Acknowledgements: Lindsay Bennett, Alan Blyth and David Dufton.
The simple linear regression model and parameter estimation
Inference for Regression
AP Biology Intro to Statistics
Sampling Distributions
Behavioral Statistics
Statistical Methods For Engineers
CHAPTER 26: Inference for Regression
Introduction to Instrumentation Engineering
CHAPTER 7 Sampling Distributions
Product moment correlation
CHAPTER 7 Sampling Distributions
CHAPTER 7 Sampling Distributions
Presentation transcript:

The Shape-Slope Relation in Observed Gamma Raindrop Size Distributions: Statistical Error or Useful Information?* Shaunna Donaher MPO 531 February 28, 2008 *Zhang, G., J. Vivekanandan and E.A. Brandes, JAS, 20,

Background: Disdrometer The disdrometer detects and discriminates the different types of precipitation as drizzle, rain, hail, snow, snow grains, graupel (small hail / snow pellets), and ice pellets with its Laser optic. The disdrometer calculates the intensity (rain rate), volume and the spectrum of the different kinds of precipitation. The main purpose of the disdrometer is to measure drop size distribution, which it captures over 20 size classes from 0.3mm to 5.4mm, and to determine rain rate. Disdrometer results can also be used to infer several properties including drop number density, radar reflectivity, liquid water content, and energy flux. Two coefficients, N 0 and Λ, are routinely calculated from an exponential fit between drop diameter and drop number density. Rain that falls on the disdrometer sensor moves a plunger on a vertical axis. The disdrometer transforms the plunger motion into electrical impulses whose strength is proportional to drop diameter. Data are collected once a minute.

Background: Polarimetric Radar Most weather radars, such as the National Weather Service NEXRAD radar, transmit radio wave pulses that have a horizontal orientation. Polarimetric radars (also referred to as dual-polarization radars), transmit radio wave pulses that have both horizontal and vertical orientations. The horizontal pulses essentially give a measure of the horizontal dimension of cloud (cloud water and cloud ice) and precipitation (snow, ice pellets, hail, and rain) particles while the vertical pulses essentially give a measure of the vertical dimension. Since the power returned to the radar is a complicated function of each particles size, shape, and ice density, this additional information results in improved estimates of rain and snow rates, better detection of large hail location in summer storms, and improved identification of rain/snow transition regions in winter storms. Principle of measurement is based on drops being oblate (bigger the drop= more oblate)

Terminology DSD parameters – Λ: slope of droplets – μ: shape of droplets – N o : number of droplets Rain parameters/physical parameters – R: rain rate – D o : median volume diameter Errors (δμ), estimators (μ est ) and expected values (μ)

Background: Marshall-Palmer Need an accurate mapping of DSD to get rain rate Previously thought an exponential distribution with two parameters was enough to characterize rain DSD n(D)= N o e (-ΛD) But research has shown that this does not capture instantaneous rain DSDs

Gamma distribution Ulbrich (1983) suggested using the gamma function with 3 parameters which is capable of describing a broader range of DSDs Each parameter can be derived from three estimated moments of a radar retrieval n(D) = N o D μ e (- Λ D) Λ= slope of droplets μ= shape of droplets (=0 for M-P) N o = number of droplets

A parameter problem But… the problem is the radar only measures reflectivity (Z HH ) and differential reflectivity (Z DR ) at each gate, so we only have two parameters We need a relation between Λ, μ, and N o so we can use the gamma distribution

Zhang et. al (2001) Using disdrometer observations from east- central FL Best results come from μ- Λ correlation μ vs. ΛN o vs. μN o vs. Λ

Zhang et. al (2001) Little correlation between R and either parameter Large values of μ and Λ (>15) correspond to low rain rate (< 5 mm/hr) *Polarimetric measurements are more sensitive to heavy rain than light rain

Zhang et. al (2001) RR>5 mm/hr Good correlation Correlation only OK Fit line for this paper Λ = μ μ (2)

Zhang et. al (2001) So now we have a relationship for μ- Λ that allows us to retrieve 2 parameters from the radar and find the third so we can use the gamma dist to get DSDs

Zhang et. al (2003) Results from Florida retrieved from S-Pol radar Retrieved using 2 nd, 4 th and 6 th radar moment Fit curve similar to that observed in Oklahoma and Australia (varies slightly for season and location)

Zhang et. al (2003) The μ-Λ relationship suggests that a characteristic size parameter and the shape of the raindrop spectrum are related GOAL: To see if μ-Λ relationship is due to natural phenomena or if it only results from statistical error.

2. Theoretical analysis of error propagation Can calculate the three parameters from any three moment estimators Done here for 2 nd, 4 th and 6 th moments Where the ratio of moments is

2. Theoretical analysis of error propagation Moment estimators have measurement errors due to noise or finite sampling, so estimated gamma parameters will also have errors Even if moment estimators were precise, parameter estimates would have error since DSDs do not exactly follow gamma distribution

2. Theoretical analysis of error propagation They look at var (μ est ), var (Λ est ), and cov (μ est, Λ est ) Conclusions are that var (μ est ) is the dominant term in var (Λ est ), due to the sensitivity of μ to changes in η due to errors in the moment estimators  μ est and Λ est are highly correlated (less error)

Standard deviations of est. parameters vs. relative standard error of moment estimators Fixed correlation coeffs Std of μ est and Λ est increase as moment errors increase Errors for large values of μ and Λ can be many times larger than errors for small values (reason for more scatter in Fig. 1a)

Standard errors in parameter estimators decrease as correlation between moment estimators increases, due to the fact that correlated moment errors tend to cancel each other out in the retrieval process. Still have more error in higher values (low rain rates)

High correlation between μ est and Λ est leads to a linear relation between their std The approximate relation between the estimation errors is Start with Λ =(μ )/D o, differentiate and neglect D o since errors are small to get

Replace errors of μ and Λ (δμ, δΛ) in (10) with the differences of their estimators (μ est, Λ est ) and expected values (μ, Λ )to get an artifact linear relationship between μ est and Λ est There are differences between (11) and (2)

Once the three parameters are known, rain rate and median volume diameter can easily be calculated with: But errors in DSD parameters from moment estimators lead to errors in R est and D o est So they look at variance of each estimator. The last term is negative, which means that a positive correlation between μ est and Λ est reduces errors in R est and D o est

Putting in (10) gives Minimizes standard deviation of D o est  The artifact linear relation between μ est and Λ est is the requirement of unbiased moments and it leads to minimum error in rain parameters

3. Numerical Simulations Goal: To study the standard errors in the estimates of μ est and Λ est Adding back on a random deviation, then recalculate estimated DSD from randomized moments Look at agreements

Difference between lines due to approximation in (11) Errors in moments are small, but errors in of μ est and Λ est are large and highly correlated- fortunately these do not cause large errors in R est and D o est Independent random errors introduced into moment estimators One input point: (μ,Λ)=(0,1.935)0) Errors of moment estimators are correlated, still same 5% relative std Standard errors of μ est and Λ est are reduced  Correlated moment errors cause smaller errors in estimated DSD parameter and have less effect on the μ– Λ relationship than uncorrelated errors 5% std induced, 5.21% std outcome

In the previous figure, there is a high correlation between μ est and Λ est due to the added errors in the estimated moments. This leads to an artifact linear relationship as seen in (11). This is not the same as derived relationship between μ and Λ in (2). Slope and intercept of line depends on input values. They only used one point rather than a dataset of many pairs. This is why relation in Fig.5 is different than (2) derived from quality controlled data

So they test 100 random (μ,Λ) pairs -2< μ est <10 0< Λ est <15 Relative random errors are added to each set of moments to generate 50 sets of moment and DSD parameters

Figure 6

6a: The scattered points show little correlation between estimators, even when errors are added to moment estimators. 6b: Using a threshold, estimators are in a confined region. This shoes that physical constraints (not only errors) determine the pattern of estimated DSD parameters. Still scatter at large values.

Fig. 6c 6c: Generated pairs of μ-Λ in steps. The larger the input values, the broader the variation in estimated parameters. This means that μ est and Λ est depend on the input values of μ and Λ rather than the added errors in the moment estimators. The moment errors have little effect on the estimates μ est and Λ est for heavy rains. This is different from Fig. 1b which did not have variations in that increased as the mean values increased.  The relation in Fig. 1b is believed to represent the actual physical nature of the rain DSD rather than pure statistical error.

Each pair has its own error-induced linear relation, so the overall relation between μ est and Λ est remains unknown The μ-Λ relation derived in (2) represents the actual physical nature of rain DSD rather than purely statistical error – (2) is quadratic rather than linear – Moment errors are linear and have little effect on μ-Λ relationship at RR> 5 mm/hr and when >1000 drops (seen in high values in Fig. 6) – (2) does not exhibit increased spreading at high values

More on why (2) is “good” It predicts a wide raindrop spectrum when large drops are present (agrees with disdrometer) In practice, μ and Λ are somewhat correlated due to small range in naturally occurring D o (1 mm<D o <3 mm) in heavy rain events, the correlation in Fig. 6b does not lead to (2)  therefore (2) is partially due to physical nature of rain DSDs Retrieved μ est and Λ est from remote measurements will contain some spurious correlation (instrument bias), but produce almost no bias in mean values of DSD parameters or in rain rate or median volume diameter

4. Retrieval of DSD parameters from two moments Traditionally only two statistical moments are measured in remote sensing, so the problem is how to retrieve unbiased physical parameters- need a third DSD parameter to use gamma distribution Sometimes μ is fixed so Λ and N o can be retrieved from reflectivity and attenuation, but scatter in Fig. 1 seems to rule this out  This is why μ-Λ relationship is useful!

Dual-Polarization Moment pair of 5 th (close to vertical polarization) and 6 th (close to horizontal polarization) We have Which can be solved by either 1)μ-Λ relationship 2)μ =2

μ-Λ relationship is better, but fixed μ results are OK It is true that the bias of N o and Λ depend on μ bias. But the bias of rain parameter should be comparable, and they are smaller when μ-Λ relationship is used.

Dual-Wavelength Moment pair of 3 rd (attenuation coefficient is proportional to the 3 rd moment for Rayleigh scattering) and 6 th Again write DSD parameter as a function of the estimated moments Still using 2 methods: – Solve with (2) to use μ-Λ relationship and estimate N o from (19) – μ =2, solve for Λ and N o from (19) and (20)

Again μ-Λ relationship is better Since standard errors are a function of μ, the error could be larger and retrieved parameters could be biased significantly. In contrast, rain parameters are almost unbiased when μ-Λ relationship is used.

FL rain- 9/17/98 Using process in Zhang (2001) paper, μ and Λ are determined from Z DR, Z HH and the μ-Λ relation Comparison of disdrometer vs. μ-Λ relation vs. fixed μ Fixed μ overestimates rain (by a factor of 2 for μ=0) μ-Λ relationship derived from radar retrieval agrees well with disdrometer

5. Summary and discussion The μ-Λ relationship captures a mean physical characteristic of raindrop spectra and is useful for retrieving unbiased rain and DSD parameters when only two remote measurements exist. Moment errors have little effect on μ-Λ relation for most rain events. Compared to a fixed μ, the μ-Λ relationship is more flexible at representing a wide range of DSD shapes observed from an in-situ disdrometer. This relation should be extendable to smaller rain rates, but may vary slightly depending on climatology and rain type.

It is difficult to separate statistical errors and physical variations, so the errors in DSD parameter estimates should not be considered meaningless. They should be studied further – Linked to functional relations between DSD parameters and moments – Natural rain DSD may not follow gamma dist 5. Summary and discussion

“Fluctuation” is a better term than “error” since it is difficult to separate nature from statistical errors Measurements always contain errors and as a results the correlation between μ est and Λ est may be strengthened. This could reduce bias and std and improve retrieval process. 5. Summary and discussion