Diverging Moments Paulo Gonçalvès INRIA Rhône-Alpes Rolf Riedi Rice University IST - ISR january 2004.

Slides:



Advertisements
Similar presentations
Min-Plus Linear Systems Theory and Bandwidth Estimation Min-Plus Linear Systems Theory and Bandwidth Estimation TexPoint fonts used in EMF. Read the TexPoint.
Advertisements

Wavelets: a versatile tool
Linear Regression.
The Multiple Regression Model.
Chain Rules for Entropy
Familiar Properties of Linear Transforms
Chapter 7: Statistical Applications in Traffic Engineering
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
Model Fitting Jean-Yves Le Boudec 0. Contents 1 Virus Infection Data We would like to capture the growth of infected hosts (explanatory model) An exponential.
The Mean Square Error (MSE):. Now, Examples: 1) 2)
Point estimation, interval estimation
Evaluating Hypotheses
Parametric Inference.
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
Lattices for Distributed Source Coding - Reconstruction of a Linear function of Jointly Gaussian Sources -D. Krithivasan and S. Sandeep Pradhan - University.
Template for KyaTera presentations Nelson L. S. da Fonseca Optical Internet Laboratory - OIL Unicamp – IC, Campinas, SP, Brazil
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM.
Relationships Among Variables
Differential Equations
Chapter 3 Limits and the Derivative
Ch. 8 & 9 – Linear Sorting and Order Statistics What do you trade for speed?
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
References for M/G/1 Input Process
Computational Methods in Physics PHYS 3437 Dr Rob Thacker Dept of Astronomy & Physics (MM-301C)
CENTRE FOR INNOVATION, RESEARCH AND COMPETENCE IN THE LEARNING ECONOMY Session 2: Basic techniques for innovation data analysis. Part I: Statistical inferences.
Ch 8.1 Numerical Methods: The Euler or Tangent Line Method
Chapters 5 and 6: Numerical Integration
Calculus and Analytic Geometry II Cloud County Community College Spring, 2011 Instructor: Timothy L. Warkentin.
Correlation testing for affine invariant properties on Shachar Lovett Institute for Advanced Study Joint with Hamed Hatami (McGill)
MA2213 Lecture 4 Numerical Integration. Introduction Definition is the limit of Riemann sums I(f)
Chapter 1 Infinite Series, Power Series
Asymptotics Data Structures & OO Development I 1 Computer Science Dept Va Tech June 2006 ©2006 McQuain & Ribbens Big-O Analysis Order of magnitude analysis.
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM CISE301_Topic1.
CISE301_Topic11 CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4:
Quantitative Skills 1: Graphing
Lecture Notes Dr. Rakhmad Arief Siregar Universiti Malaysia Perlis
Edge-disjoint induced subgraphs with given minimum degree Raphael Yuster 2012.
Fourier Series. Introduction Decompose a periodic input signal into primitive periodic components. A periodic sequence T2T3T t f(t)f(t)
Learning Objectives for Section 13.4 The Definite Integral
Cusp turbulence as revealed by POLAR magnetic field data E. Yordanova Uppsala, November, 2005.
§10.2 Infinite Limits and Limits at Infinity
Expectation for multivariate distributions. Definition Let X 1, X 2, …, X n denote n jointly distributed random variable with joint density function f(x.
Lecture 4: Statistics Review II Date: 9/5/02  Hypothesis tests: power  Estimation: likelihood, moment estimation, least square  Statistical properties.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Sequences Lesson 8.1. Definition A __________________ of numbers Listed according to a given ___________________ Typically written as a 1, a 2, … a n.
THE LAPLACE TRANSFORM LEARNING GOALS Definition
Optimal Sampling Strategies for Multiscale Stochastic Processes Vinay Ribeiro Rolf Riedi, Rich Baraniuk (Rice University)
1 Summarizing Performance Data Confidence Intervals Important Easy to Difficult Warning: some mathematical content.
12 INFINITE SEQUENCES AND SERIES. In general, it is difficult to find the exact sum of a series.  We were able to accomplish this for geometric series.
ECE 8443 – Pattern Recognition Objectives: Jensen’s Inequality (Special Case) EM Theorem Proof EM Example – Missing Data Intro to Hidden Markov Models.
Chapter 7 The Laplace Transform
Dynamic Models, Autocorrelation and Forecasting ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Discrete Random Variables. Introduction In previous lectures we established a foundation of the probability theory; we applied the probability theory.
Advanced Residual Analysis Techniques for Model Selection A.Murari 1, D.Mazon 2, J.Vega 3, P.Gaudio 4, M.Gelfusa 4, A.Grognu 5, I.Lupelli 4, M.Odstrcil.
Copyright © Cengage Learning. All rights reserved.
Machine Learning 5. Parametric Methods.
ECE-7000: Nonlinear Dynamical Systems 2. Linear tools and general considerations 2.1 Stationarity and sampling - In principle, the more a scientific measurement.
Chapter 6 Integration Section 4 The Definite Integral.
Abstractions Eric Feron. Outline Principles of abstraction Motivating example Abstracting variables Abstracting functions Abstracting operators Recommended.
Chapter 4 Basic Estimation Techniques
Chapter 8 Infinite Series.
UNIT II Analysis of Continuous Time signal
Chapter 1 Infinite Series, Power Series
Statistical Methods For Engineers
Modelling data and curve fitting
RS – Reed Solomon List Decoding.
The Curve Merger (Dvir & Widgerson, 2008)
Testing for Multifractality and Multiplicativity using Surrogates
CISE-301: Numerical Methods Topic 1: Introduction to Numerical Methods and Taylor Series Lectures 1-4: KFUPM CISE301_Topic1.
Presentation transcript:

Diverging Moments Paulo Gonçalvès INRIA Rhône-Alpes Rolf Riedi Rice University IST - ISR january 2004

IST-ISR, January 2004 Importance of multiscale analysis General: –LRD –Self-similarity –Multi-fractal, multiplicative structure –Economics, Networking, Biology, Physics Turbulence –K41 –K62 –Intermittency

IST-ISR, January 2004 The typical question Are these signals multifractal?

IST-ISR, January 2004 Black box scaling analysis Easy… Choose a wavelet:  (t) Compute wavelet decomposition: –T(a,b) = Compute partition sum: –S(a,q) =  b | T(a,b) | q Compute partition function  –log S(a,q) ~  (q) log a Compute Legendre transform: –f(a) = inf q (qa-  (q))

IST-ISR, January 2004 The wavelet transform Challenge: Choice of wavelet

IST-ISR, January 2004 The Lines of Maxima Challenge: Finding local maxima is difficult

IST-ISR, January 2004 The Partition Sum Challenges: All coefficients/only maxima? Which q’s? S(a,q), q>0 S(a,q), q<0

IST-ISR, January 2004 The Partition Function Challenges: Range of scaling. Quality of scaling.

IST-ISR, January 2004 The Legendre transform Challenge: Interpretation.

IST-ISR, January 2004 Black Box Scaling Analysis: Summary It could be easy, but it is not… Choose a “good” wavelet –How much regularity, localization Compute wavelet decomposition –Continuous or discrete? Compute partition sum –On all coefficients, or only along lines of maxima? –For which range of order q Compute partition function –Over which range of scales? –Is the scaling sufficiently close to a powerlaw Compute Legendre transform –Interpretation: is it a point or a curve?

IST-ISR, January 2004 Waking up to Reality Most essential difficulty: –Interpretation of  (q) and its Legendre transform To make the point: –One of the signals is “mono-fractal” with linear  (q) –The other signal is multifractal with strictly convex  (q) –We found no indication for linear  (q) What went wrong?

IST-ISR, January 2004 A Look into the Black Box All wavelets with sufficient regularity show the same Scaling is satisfactory for the partition sum –with all coefficients, (q > 0) –along the lines of maxima (q < 0) Indication for linear  (q) in one signal –but only over a finite range of q. S(a,q) is an estimator for the q-th moment –Are we measuring the scaling of moments, or –rather the rate of convergence/divergence of the estimator

Testing for Diverging Moments All software freely available at (

IST-ISR, January 2004 The Existence of Moments Random variable: X –Characteristic function:  (f)= E[exp(ifX)] Intuitive (well-known):  (n) (0)= i n E[ X n ] Rigorous: For >0 equivalent conditions are –E[ |X| r ] <  for all r< –P[|X| > u] = O(|u| -r ) for all r< as (u   ) –in the case <2: |  (f)| = O(|f| r ) for all r<  a s (f  0 )

IST-ISR, January 2004 Estimating the Regularity of  Motivation: exact regularity of  at zero provides the cutoff value for finite moments (as long as smaller than 2) Measuring tool: Wavelets! Simplified criterion: If the wavelet has regularity larger  and is maximal at 0 then the following are equivalent:.|  (f)-P(f)| = O(|f| r ) for some polynomial P as (f  0 ) for all r<.|T(a,0)| = O(|a| r ) as (a  0 ) for all r<

IST-ISR, January 2004 Wavelet Transform of  Assume Fourier Transform  is real. Parseval: T(a,b) = = = E  a,b (x) Corollary: |T(a,b)| <= |T(a,0)|, for all b W(a) := T(a,0) = E  a.x 

IST-ISR, January 2004 Extension to orders > 2 Consider fractional Wavelets:  (x) = c |x| exp(-x 2 ) Parseval: T(a,0) a - = a -   (f)  (f/a) df = a -   (ax) dF X (x) = c  |x| exp(-(ax) 2 ) dF X (x)  c  |x| dF X (x) Lemma: If either side exists then Sup a T(a,0) a -  = c E[ |X| ] Proof: Monotonous convergence (Beppo-Levy Thm)

IST-ISR, January 2004 Bounding the range of finite moments Hölder regularity of  at zero: h Theorem: –Moments are finite at least up to order h –Moment of order  h  +1 is infinite. Proof 1: –Lemma implies moments up to  h  exist –Thus derivatives of  exist up to order  h  Implies non degenerated Taylor expansion of  at zero (does not follow in general from wavelet analysis) –Kawata criterion: moments up to order h exist. Proof 2: –If the moment of order  h  +1 was finite, then derivatives of  would exist up to order  h  +1, in contradiction to regularity h.  h  is the largest integer <= h Note that  h  +1 is strictly larger than h

IST-ISR, January 2004 Numerical Implementation The estimator of T(a,0) of  is Simple (Parseval): T(a,0) =   (f)  (f/a) df =   (ax) dF X (x) = E[  (aX)] estimator: (1/N)  k  (aX k ) Unbiased –E[ (1/N)  k  (aX k )] = E[  (aX)] = T(a,0) Non-parametric! Robust

IST-ISR, January 2004 Practical Considerations Choose a wavelet –With high enough regularity –With real positive Fourier transform (ex: even derivatives of gaussian window) Cutoff scales –Shannon argument on max {x i } : lower bound –Body / Tail frontier : upper bound

IST-ISR, January 2004 Cutoff scales Compound process: x ~  (  ), x <  E |x| r -  x ~  -stable ( ,  =1), x >=  E |x| r < Inf, r <  Log W(a) Log a

IST-ISR, January 2004 Application to fat tail estimation  -      Gamma Laws Alpha-stable laws

IST-ISR, January 2004 Application to Multifractal Analysis We are now able to distinguish the mono- from the multi-fractal signal

IST-ISR, January 2004 Summary: Light in the Black Box Run several wavelets of increasing regularity –You should see  = min( +, N  ) Partition sum over all / only maximal coefficients –Scaling should improve for negative q over maxima –Report the scaling region (should be same for all q) Compute error of  (q) using several traces –To provide statistical significance Estimate the range of finite moments –Confine the Legendre transform to this range of q –Provides additional statistics on the process per se If desired test hypothesis of linear partition function

IST-ISR, January 2004 Traité Information - Commande - Communication Hermès Science Publications, Paris [ ] Lois d’Echelle, Fractales et Ondelettes – (vol. 1,2) (P. Abry, P. Gonçalvès, J. Lévy Véhel) Analyse multifractale et ondelettes (S. Jaffard) Analyse Multifractale : développements mathématiques (R. Riedi) Processus Auto-Similaires (J. Istas et A. Benassi) Processus Localement Auto-Similaires (S. Cohen) Calcul Fractionnaire (D. Matignon) Analyse fractale et multifractale en traitement du signal (J. Lévy Véhel et C. Tricot) Analyses en ondelettes et lois d'échelle (P. Flandrin, P. Abry et P. Gonçalvès) Synthèse fractionnaire - Filtres fractals (L. Bel, G. Oppenheim, L. Robbiano, M-C. Viano) IFS et applications en traitement d'images (J-.M. Chassery et F. Davoine) IFS, IFS généralisés et applications en traitement du signal (K. Daoudi) Lois d'échelles en télétrafic informatique (D. Veitch) Analyse fractale d'images (A. Saucier) Lois d'échelles en finance (C. Walter) Relativité d'échelle, nondifférentiabilité et espace-temps fractal (L. Nottale)