Extreme value statistics Problems of extrapolating to values we have no data about Question: Question: Can this be done at all? unusually large or small.

Slides:



Advertisements
Similar presentations
Lecture 15: Capillary motion
Advertisements

Characterizing Non- Gaussianities or How to tell a Dog from an Elephant Jesús Pando DePaul University.
Bare Surface Tension and Surface Fluctuations of Clusters with Long–Range Interaction D.I. Zhukhovitskii Joint Institute for High Temperatures, RAS.
Hydrologic Statistics
Outline/Coverage Terms for reference Introduction
Lecture 14: Spin glasses Outline: the EA and SK models heuristic theory dynamics I: using random matrices dynamics II: using MSR.
STAT 497 APPLIED TIME SERIES ANALYSIS
Optical Tweezers F scatt F grad 1. Velocity autocorrelation function from the Langevin model kinetic property property of equilibrium fluctuations For.
Engineering Fundamentals II
Energy. Simple System Statistical mechanics applies to large sets of particles. Assume a system with a countable set of states.  Probability p n  Energy.
Probing interacting systems of cold atoms using interference experiments Harvard-MIT CUA Vladimir Gritsev Harvard Adilet Imambekov Harvard Anton Burkov.
Transport Equations and Flux Laws Basic concepts and ideas 1.A concept model of Diffusion 2.The transient Diffusion Equation 3.Examples of Diffusion Fluxes.
Critical Scaling at the Jamming Transition Peter Olsson, Umeå University Stephen Teitel, University of Rochester Supported by: US Department of Energy.
Some standard univariate probability distributions
Probing phases and phase transitions in cold atoms using interference experiments. Anatoli Polkovnikov, Boston University Collaboration: Ehud Altman- The.
Thermal Properties of Crystal Lattices
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 8 Analyzing and Interpreting Quantitative.
1 Study of order parameters through fluctuation measurements by the PHENIX detector at RHIC Kensuke Homma for the PHENIX collaboration Hiroshima University.
The Lognormal Distribution
1 10. Joint Moments and Joint Characteristic Functions Following section 6, in this section we shall introduce various parameters to compactly represent.
Ch 9 pages ; Lecture 21 – Schrodinger’s equation.
9.6 Other Heat Conduction Problems
The Air-Sea Momentum Exchange R.W. Stewart; 1973 Dahai Jeong - AMP.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Introduction to (Statistical) Thermodynamics
Critical behaviour and dynamics of Ising spin glasses Ian Campbell LCVN Universite Montpellier II Collaborations with - Helmut Katzgraber, ETH Zurich and.
Free energies and phase transitions. Condition for phase coexistence in a one-component system:
Lecture 11: Ising model Outline: equilibrium theory d = 1
F.F. Assaad. MPI-Stuttgart. Universität-Stuttgart Numerical approaches to the correlated electron problem: Quantum Monte Carlo.  The Monte.
Biological Modeling of Neural Networks Week 8 – Noisy input models: Barrage of spike arrivals Wulfram Gerstner EPFL, Lausanne, Switzerland 8.1 Variation.
Constant-Volume Gas Thermometer
Galaxy clustering II 2-point correlation function 5 Feb 2013.
STRING PERCOLATION AND THE GLASMA C.Pajares Dept Particle Physics and IGFAE University Santiago de Compostela CERN The first heavy ion collisions at the.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
1 Three views on Landau damping A. Burov AD Talk, July 27, 2010.
Extreme value statistics Problems of extrapolating to values we have no data about Question: Question: Can this be done at all? unusually large or small.
Problem: 1) Show that is a set of sufficient statistics 2) Being location and scale parameters, take as (improper) prior and show that inferences on ……
Scaling functions for finite-size corrections in EVS Zoltán Rácz Institute for Theoretical Physics Eötvös University Homepage:
3.The Canonical Ensemble 1.Equilibrium between a System & a Heat Reservoir 2.A System in the Canonical Ensemble 3.Physical Significance of Various Statistical.
STATISTICS AND OPTIMIZATION Dr. Asawer A. Alwasiti.
Scaling functions for finite-size corrections in EVS Zoltán Rácz Institute for Theoretical Physics Eötvös University Homepage:
Transverse optical mode in a 1-D chain J. Goree, B. Liu & K. Avinash.
EE3010_Lecture3 Al-Dhaifallah_Term Introduction to Signal and Systems Dr. Mujahed Al-Dhaifallah EE3010: Signals and Systems Analysis Term 332.
1/18/2016Atomic Scale Simulation1 Definition of Simulation What is a simulation? –It has an internal state “S” In classical mechanics, the state = positions.
Assignment for the course: “Introduction to Statistical Thermodynamics of Soft and Biological Matter” Dima Lukatsky In the first.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Joint Moments and Joint Characteristic Functions.
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Kensuke Homma / Hiroshima Univ. from PHENIX collaboration
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Lecture 8: Measurement Errors 1. Objectives List some sources of measurement errors. Classify measurement errors into systematic and random errors. Study.
Initial conditions for N-body simulations Hans A. Winther ITA, University of Oslo.
6/11/2016Atomic Scale Simulation1 Definition of Simulation What is a simulation? –It has an internal state “S” In classical mechanics, the state = positions.
Computational Physics (Lecture 10) PHY4370. Simulation Details To simulate Ising models First step is to choose a lattice. For example, we can us SC,
CLASSIFICATION OF ECG SIGNAL USING WAVELET ANALYSIS
Fluctuation relations in Ising models G.G. & Antonio Piscitelli (Bari) Federico Corberi (Salerno) Alessandro Pelizzola (Torino) TexPoint fonts used in.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
Introduction to the Turbulence Models
Diffusion over potential barriers with colored noise
Computational Physics (Lecture 10)
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
                                                                                                                                                                                                  
Hydrologic Statistics
Statistics of Extreme Fluctuations in Task Completion Landscapes
Thermal Energy & Heat Capacity:
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and 2 Now, we need procedures to calculate  and 2 , themselves.
3.7. Two Theorems: the “Equipartition” & the “Virial”
Presentation transcript:

Extreme value statistics Problems of extrapolating to values we have no data about Question: Question: Can this be done at all? unusually large or small ~100 years (data) ~500 years (design) winds How long will it stand?

Extreme value paradigm is measured: Question: Question: What is the distribution of the largest number? Logics: Assume something about Use limit argument: Slightly suspicious but no alternatives exist at present. E.g. independent, identically distributed Family of limit distributions (models) is obtained Calibrate the family of models by the measured values of

An example of extreme value statistics The 1841 sea level benchmark (centre) on the `Isle of the Dead', Tasmania. According to Antarctic explorer, Capt. Sir James Clark Ross, it marked mean sea level in Figures are from Stuart Coles: An Introduction to Statistical Modeling of Extreme Values

F F 1.5cm 63 fibers The weakest link problem F

Problem of trends I Figures are from Stuart Coles: An Introduction to Statistical Modeling of Extreme Values

Problem of trends II

Problem of correlations

Problem of second-, third-, …, largest values

Problem of information loss

Problem of deterministic background processes

Problem of trends and variables

Problem of spatial correlations

Problem of trends

is measured: Fisher-Tippett-Gumbel distribution I Assumption: Independent, identically distributed random variables with parent distribution 1 st question: 1 st question: Can we estimate ? Note: 2 nd question: 2 nd question: Can we estimate ? Homework: Carry out the above estimates for a Gaussian parent distribution !

is measured: Fisher-Tippett-Gumbel distribution II Assumption: Independent, identically distributed random variables with parent distribution Question: Question: Can we calculate ? Probability of : Expected that this result does not depend on small details of but there is more generality to this result. FTG distribution

Fisher-Tippett-Gumbel distribution III parent distribution Question: Question: What is the fitting to FTG procedure? We do not know it! is measured. is not known! The shift is not known! The scale of can be chosen at will. Fitting to: Asymptotics: -1 largest smallest

FTG function and fitting

FTG function and fitting: Logscale See example on fitting.

is measured: Finite cutoff: Weibull distribution Assumption: Independent, identically distributed random variables with parent distribution 1 st question: 1 st question: Can we estimate ? 2 nd question: 2 nd question: Can we estimate ?

Weibull distribution II parent distribution Question: Question: Can we calculate ? Probability of : Weibull distribution is measured: Assumption: Independent, identically distributed random variables with

Weibull distribution III parent distribution is measured. is not known! in is not known! The scale of can be chosen at will. Fitting to

Weibull function and fitting

Notes about the Tmax homework Introduce scaled variables common to all data sets Find Average and width of distribution so all data can be analyzed together. ? ? ? ? ? ? ? ? What kind of conclusions can be drawn?

Györgyi Géza előadásai

Critical order-parameter fluctuations in the d=3 dimensional Ising model L Delamotte, Niedermayer, Tissier or how does an informative figure look like

Example of EVS in action: P(v) of the rightmost atom in an expanding gas D=1 ideal, elastic gas in equilibrium at T: Box is opened, wait for a long time. Questions: (1)What is the expected velocity of the rightmost particle? (2) What is P(v) of the rightmost particle? (3) Estimate the expected velocity. Elastic collisions: velocities are exchanged always increases

Nontrivial EVS distributions (1) What are the reasons for any other extreme satistics to emerge? Analogous question in statistical physics: What are the reasons for nongaussian statistics of macroscopic (additive) quantities? (2) What are the simplest calculable examples? Independent, nonidentically distributed variables. (3) What can we say about interacting systems? Question of weak or strong correlations (finite- or infinite correlation length). FTG, Weibull, FTF : High-temperature fixed point. Are there critical EVS distributions with universality classes? Questions:

Gaussian and nongaussian distributions I Extensive quantity in a noncritical system L d d/2 L P(M) M Small Gaussian fluctuations around the mean central limit theorem Example: Ising model above and below Tc. P(M) M L d d/2 L L Ising model at Tc:

Gaussian and nongaussian distributions II Extensive quantity in a critical system nongaussian fluctuations around the mean no central limit theorem Example: Ising model at Tc: Scaling variable: Scaling func.: d=2 d=3 Emergence of universal scaling functions

Edwards-Wilkinson (EW) interface Surface tension driven growth Noise in the arrival (Gaussian, white is assumed) average growth velocity Long wavelength (gradient) expansion: Vertical growth velocity can depend only on the spatial derivatives of. In the system moving with : surface tension Steady state distribution function: Fourier modes: Independent modes

Nongaussian distributions - Edwards-Wilkinson (EW) interface Surface tension driven dynamics Stationary state: diverging fluctuations Independent Fourier modes: sum of independent variables Reason for the failing of the central limit theorem nonidentical, singular fluctuations ?

Derivation of the width distribution for EW interface (1) Stationary state: Independent Fourier modes Width distribution: In terms of Fourier modes: Normalization: Generating function (Laplace transform): Path integral of harmonic oscillator

Derivation of the width distribution for EW interface (2) Width distribution in scaling form: Generating function: Average width: Scaling function: Simple poles at

Nongaussianity - width distribution of interfaces Picture gallery KPZ EW MH PRE50, 639, 3589 (1994)PRE50, 3530 (1994)PRE65, (2002) Stationary distribution: Ag on glass width

Example of nontrivial EVS: Nonidentically distributed independent variables Probability of being less than z: A given configuration Parent distribution provides a set of Action: (looking for the max of N variables)

Example of nontrivial EVS: Nonidentically distributed independent variables Probability of being between z and z+dz

Distribution of extremal intensity fluctuations Find : the probability of Drawing from N independent, nonidentically distributed numbers ( ) with singular Math: PRE68, (2003) Result:

1/f noise - voltage fluctuations in resistors Example: M.B. Weissman, Rev.Mod.Phys.60, 537(1988)

Turbulence and the d=2 EW model S. Bramwell et al. Nature 396, 552 (1998 ) Experiment Critical Distribution of energy dissipation Distribution of d=2 XY magnetization below Tc. (finite-size) Aji & Goldenfeld, PRL86, 1007 (2001) dissipation is mainly on the fluctuations of the shear pancake Possible connection to extreme statistics?

Width distributions for signals Stationary distribution for Fourier modes Integrated power spectrum Question: Is there an for which extreme statistics distribution emerges? PRE65, (2002) Does it have an internal structure?

 Extreme statistics for. new scaling variable integrated power spectrum Fisher-Tippett-Gumbel extreme value distribution Central limit theorem is restored for PRL87, (2001) 1   y ey ey    1  2 ~ y ey    2/1    n~h 2 n T T y    22 ww T ww TT   yP T   )w( 2 1  2/1 

Homeworks 1.See slide Fisher-Tippett-Gumbel distribution I. 2.Show that FTG distribution becomes the Weibull distribution in the limit. 3.Determine the Tmax distribution for temperatures measured at the Amistad Dam. Try fits with both the FTG and the Weibull functions. 4.What is the velocity distribution of the rightmost particle in a one-dimensional, freely expanding gas?