For information contact H. C. Koons 30 October 2003 1 Preliminary Analysis of ABFM Data WSR 11 x 11-km Average Harry Koons 30 October.

Slides:



Advertisements
Similar presentations
Introduction to modelling extremes
Advertisements

Introduction to modelling extremes Marian Scott (with thanks to Clive Anderson, Trevor Hoey) NERC August 2009.
Hydrologic Statistics Reading: Chapter 11, Sections 12-1 and 12-2 of Applied Hydrology 04/04/2006.
Challenge the future Delft University of Technology Blade Load Estimations by a Load Database for an Implementation in SCADA Systems Master Thesis.
Hydrologic Statistics
Probability and Statistics Mat 271E
Modeling Process Quality
For information contact H. C. Koons 25 May Preliminary Analysis of ABFM Data WSR “11 x 11 Volume Integral” Harry Koons 25.
Probability distribution functions Normal distribution Lognormal distribution Mean, median and mode Tails Extreme value distributions.
F (x) - PDF Expectation Operator x (fracture stress) Nomenclature/Preliminaries.
Statistical Review for Chapters 3 and 4 ISE 327 Fall 2008 Slide 1 Continuous Probability Distributions Many continuous probability distributions, including:
Visual Recognition Tutorial
Quantile Estimation for Heavy-Tailed Data 23/03/2000 J. Beirlant G. Matthys
Model Fitting Jean-Yves Le Boudec 0. Contents 1 Virus Infection Data We would like to capture the growth of infected hosts (explanatory model) An exponential.
Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics, 9e Managerial Economics Thomas Maurice.
Continuous Random Variables and Probability Distributions
Simulation Modeling and Analysis
1 Engineering Computation Part 6. 2 Probability density function.
Basics of Statistical Estimation. Learning Probabilities: Classical Approach Simplest case: Flipping a thumbtack tails heads True probability  is unknown.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Continuous Random Variables Chap. 12. COMP 5340/6340 Continuous Random Variables2 Preamble Continuous probability distribution are not related to specific.
Maximum Likelihood We have studied the OLS estimator. It only applies under certain assumptions In particular,  ~ N(0, 2 ) But what if the sampling distribution.
October 26, 2001MED Classification1 Major Event Day Classification Rich Christie University of Washington Distribution Design Working Group Webex Meeting.
Analysis of Simulation Input.. Simulation Machine n Simulation can be considered as an Engine with input and output as follows: Simulation Engine Input.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Continuous Random Variables and Probability Distributions.
Paul Cornwell March 31,  Let X 1,…,X n be independent, identically distributed random variables with positive variance. Averages of these variables.
Flood Frequency Analysis
Chapter Two Probability Distributions: Discrete Variables
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
(c) 2007 IUPUI SPEA K300 (4392) Outline: Numerical Methods Measures of Central Tendency Representative value Mean Median, mode, midrange Measures of Dispersion.
Probability distribution functions
February 3, 2010 Extreme offshore wave statistics in the North Sea.
SPC for Real-World Processes William A. Levinson, P.E. Intersil Corporation Mountaintop, PA.
1 Statistical Distribution Fitting Dr. Jason Merrick.
JMB Ch6 Lecture2 Review EGR 252 Spring 2011 Slide 1 Continuous Probability Distributions Many continuous probability distributions, including: Uniform.
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Fundamentals of Data Analysis Lecture 3 Basics of statistics.
Extreme values and risk Adam Butler Biomathematics & Statistics Scotland CCTC meeting, September 2007.
Extreme Value Theory: Part II Sample (N=1000) from a Normal Distribution N(0,1) and fitted curve.
Chapter 12 Continuous Random Variables and their Probability Distributions.
EAS31116/B9036: Statistics in Earth & Atmospheric Sciences Lecture 3: Probability Distributions (cont’d) Instructor: Prof. Johnny Luo
Maximum Likelihood Estimation
New approaches in extreme-value modeling A.Zempléni, A. Beke, V. Csiszár (Eötvös Loránd University, Budapest) Flood Risk Workshop,
Probability distributions
Extreme Value Analysis
Chapter 20 Statistical Considerations Lecture Slides The McGraw-Hill Companies © 2012.
Statistics Sampling Distributions and Point Estimation of Parameters Contents, figures, and exercises come from the textbook: Applied Statistics and Probability.
Chapter 31Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012 John Wiley & Sons, Inc.
Probability and Statistics 12/11/2015. Statistics Review/ Excel: Objectives Be able to find the mean, median, mode and standard deviation for a set of.
Density Curves Frequency histogram- uses counts of items in each class Relative frequency histogram- uses percent of observations in each class Density.
Choosing A Distribution Risk Analysis for Water Resources Planning and Management Institute for Water Resources May 2008.
MEGN 537 – Probabilistic Biomechanics Ch.5 – Determining Distributions and Parameters from Observed Data Anthony J Petrella, PhD.
Fundamentals of Data Analysis Lecture 3 Basics of statistics.
A major Hungarian project for flood risk assessment A.Zempléni (Eötvös Loránd University, Budapest, visiting the TU Munich as a DAAD grantee) Technical.
Modeling and Simulation CS 313
Statistical Methods Michael J. Watts
Probability and Statistics for Computer Scientists Second Edition, By: Michael Baron Chapter 8: Introduction to Statistics CIS Computational Probability.
Probability Theory and Parameter Estimation I
Chapter 4 Continuous Random Variables and Probability Distributions
Statistical Methods Michael J. Watts
Modeling and Simulation CS 313
Parameter Estimation 主講人:虞台文.
Flood Frequency Analysis
Statistics & Flood Frequency Chapter 3 – Part 1
Hydrologic Statistics
Stochastic Hydrology Hydrological Frequency Analysis (I) Fundamentals of HFA Prof. Ke-Sheng Cheng Department of Bioenvironmental Systems Engineering.
Extreme Value Theory: Part I
Continuous Statistical Distributions: A Practical Guide for Detection, Description and Sense Making Unit 3.
HYDROLOGY Lecture 12 Probability
Maximum Likelihood We have studied the OLS estimator. It only applies under certain assumptions In particular,  ~ N(0, 2 ) But what if the sampling distribution.
Presentation transcript:

For information contact H. C. Koons 30 October Preliminary Analysis of ABFM Data WSR 11 x 11-km Average Harry Koons 30 October 2003

For information contact H. C. Koons 30 October Scatter Plot of dBZ vs Emag WSR 11 x 11-km Average

For information contact H. C. Koons 30 October Approach Objective is to determine the probability of an extreme electric field intensity for a given radar return Use the statistics of extreme values to estimate the extreme electric field intensities –Reference: Statistical Analysis of Extreme Values, Second Edition, R. -D. Reiss and M. Thomas, Birkhäuser Verlag, Boston, 2001 As an example analyze WSR 11x11- km Average data Use both Peaks over Threshold (POT) and Maximum out of Blocks (MAX) methods Determine extreme value distribution functions for two-dBZ wide bins –For example the 0-dBZ bin is defined to be the range:  1 < dBZ < +1

For information contact H. C. Koons 30 October Extreme Value Methods Parametric models –  n,  n,  n,  n Parameters strictly hold only for the sample set analyzed Basic assumption is that the samples, x i, come from independent, identically distributed (iid) random variables –In our experience the techniques are very robust, as verified by the Q-Q plots, when this assumption is violated Analysis Methods –Peaks Over Threshold (POT) Take all samples that exceed a predetermined, high threshold, u. Exceedances over u fit by Generalized Pareto (GP) distribution functions –Maxima Out of Blocks (MAX) Take the maximum value within a pass, Anvil, etc. Tail of distribution is fit by extreme value (EV) distribution functions

For information contact H. C. Koons 30 October Generalized Pareto (GP) Distribution Functions (Peaks-over-Threshold Method) Exponential (GP0,  = 0): Pareto(GP1,  > 0): Beta (GP2,  < 0): The  – Parameterization:

For information contact H. C. Koons 30 October Standard EV Distribution Functions (Maximum out of Blocks Method) Gumbel (EV0,  = 0): Fréchet (EV1,  > 0): Weibull (EV2,  < 0): The  – Parameterization:

For information contact H. C. Koons 30 October Tutorial Example Based on a Manufactured Gaussian (Normal) Distribution Function Select 100 random samples uniformly from a normal distribution –Mean value,  = 5 –Standard deviation,  = 1 Maximum Likelihood Estimates for a normal model are the sample mean and sample standard deviation –  = –  = In general you maximize the likelihood function by taking appropriate partial derivates

For information contact H. C. Koons 30 October Distribution function, F, of a real- valued random variable X is given by F (X) = P{ X  x } Histogram The density function, f, is the derivative of the distribution function –Sample Density –Model Density –Kernel Density Distribution and Density Functions

For information contact H. C. Koons 30 October Quantile Functions and the Q-Q Plot

For information contact H. C. Koons 30 October T-Year Values T-year level is a higher quantile of the distribution function T-year threshold, u(T), is the threshold such that the mean first exceedance time is T years –u(T) = F -1 (1-1/T) –1-1/T quantile of the df The T-year threshold also is exceeded by the observation in a given year with the probability of 1/T

For information contact H. C. Koons 30 October Scatter Plot of dBZ vs Emag WSR 11 x 11-km Average; 0 dBZ bin

For information contact H. C. Koons 30 October Cumulative Frequency Curve for Emag –1 < dBZ < +1

For information contact H. C. Koons 30 October Sample Statistics -1 < dBZ < +1 Sample Size, N = 271 Minimum = 0.02 kV/m Maximum = 2.41 kV/m Median = 0.6 kV/m Mean = 0.67 kV/m Choose Peaks Over Threshold (POT) Method for Extreme Value Analysis u = 1.0 kV/m (high threshold) n = 57 (samples over threshold) k = 32 (mean value of the stability zone)

For information contact H. C. Koons 30 October Gamma Diagram Point of stability is on The plateau between 30 and 40

For information contact H. C. Koons 30 October Kernel Density Function and Model Density Function Peaks Over Threshold Method (POT) –N = 271 samples between –1 and +1 dBZ –u = 1.0 kV/m (high threshold) –n = 57 (samples over threshold) MLE (GP0) – k = 32 (mean zone of stability) –  = 0.0 –  = (~left end point) –  =

For information contact H. C. Koons 30 October Sample and Model Distribution Functions

For information contact H. C. Koons 30 October Sample and Model Quantile Functions

For information contact H. C. Koons 30 October Q – Q Plot Sample Model

For information contact H. C. Koons 30 October T-Sample Electric Field Intensity -1 < dBZ < +1 T, SamplesProbability, p Quantile,  p kV/m , , , ,000, ,000,

For information contact H. C. Koons 30 October Extend Analysis to Other Bins Use bins centered at –2, 0, +2, and +4 dBZ Kernel Density Plot Sample Statistics Model Parameters T-Sample Electric Field Intensity

For information contact H. C. Koons 30 October Sample Kernel Densities for Exceedances Blk: -2 dBZ Red: 0 dBZ Grn: +2 dBZ Blu: +4 dBZ Emag kV/m

For information contact H. C. Koons 30 October Sample Statistics and Model Parameters -2 dBZ0 dBZ+2 dBZ+4 dBZ u, kV/m N k  0.0  

For information contact H. C. Koons 30 October T-Sample Electric Field Intensity, kV/m T-Sample-2 dBZ0 dBZ+2 dBZ+4 dBZ , , , ,000, ,000,

For information contact H. C. Koons 30 October Maximum Out of Blocks Method #1 One Block is One Pass Analyze the 0 dBZ bin 38 Blocks (unique pass numbers) Maximum Emag for each block shows a slight dependence on sample-count per block –We will ignore this MLE (EV) Model Parameters  =  =  = 0.322

For information contact H. C. Koons 30 October Sample Count vs. Pass Number Max for Passes

For information contact H. C. Koons 30 October Number of Occurrences vs. Sample Count Max for Passes

For information contact H. C. Koons 30 October Plot of Maximum Emag vs. Sample Count MAX for Passes

For information contact H. C. Koons 30 October Density Functions MAX for Passes

For information contact H. C. Koons 30 October Q-Q Plot MAX for Passes

For information contact H. C. Koons 30 October T-Pass Electric Field Intensity -1 < dBZ < +1 TEmag, kV/m , , , ,

For information contact H. C. Koons 30 October Maximum Out of Blocks Method #2 One Block is One Anvil Analyze the 0 dBZ bin 21 Blocks (unique anvil numbers) MLE (EV) Model Parameters  =  =  = Right End Point = 10.5 kV/m

For information contact H. C. Koons 30 October Density Functions MAX for Anvils

For information contact H. C. Koons 30 October Distribution Functions MAX for Anvils

For information contact H. C. Koons 30 October Q-Q Plot MAX for Anvils

For information contact H. C. Koons 30 October T-Anvil Electric Field Intensity -1 < dBZ < +1 TEmag, kV/m , , , ,