Time series power spectral density.

Slides:



Advertisements
Similar presentations
Change-Point Detection Techniques for Piecewise Locally Stationary Time Series Michael Last National Institute of Statistical Sciences Talk for Midyear.
Advertisements

General Linear Model With correlated error terms  =  2 V ≠  2 I.
Hypothesis testing and confidence intervals by resampling by J. Kárász.
Chap 8: Estimation of parameters & Fitting of Probability Distributions Section 6.1: INTRODUCTION Unknown parameter(s) values must be estimated before.
The General Linear Model. The Simple Linear Model Linear Regression.
STAT 497 APPLIED TIME SERIES ANALYSIS
Spectral analysis for point processes. Error bars. Bijan Pesaran Center for Neural Science New York University.
ELEC 303 – Random Signals Lecture 18 – Statistics, Confidence Intervals Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 10, 2009.
Lecture 6 Power spectral density (PSD)
1 The Bootstrap’s Finite Sample Distribution An Analytical Approach Lawrence C. Marsh Department of Economics and Econometrics University of Notre Dame.
Environmental Data Analysis with MatLab Lecture 17: Covariance and Autocorrelation.
Lecture 17 spectral analysis and power spectra. Part 1 What does a filter do to the spectrum of a time series?
The Empirical FT continued. What is the large sample distribution of the EFT?
Presenting: Assaf Tzabari
Parametric Inference.
The Lognormal Distribution
The Multivariate Normal Distribution, Part 2 BMTRY 726 1/14/2014.
1  The goal is to estimate the error probability of the designed classification system  Error Counting Technique  Let classes  Let data points in class.
Simulation Output Analysis
The paired sample experiment The paired t test. Frequently one is interested in comparing the effects of two treatments (drugs, etc…) on a response variable.
Borgan and Henderson:. Event History Methodology
Estimation of the spectral density function. The spectral density function, f( ) The spectral density function, f(x), is a symmetric function defined.
ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.
CHEE825 Fall 2005J. McLellan1 Spectral Analysis and Input Signal Design.
Estimation of the spectral density function. The spectral density function, f( ) The spectral density function, f(x), is a symmetric function defined.
The final exam solutions. Part I, #1, Central limit theorem Let X1,X2, …, Xn be a sequence of i.i.d. random variables each having mean μ and variance.
Confidence Interval & Unbiased Estimator Review and Foreword.
Review of Probability. Important Topics 1 Random Variables and Probability Distributions 2 Expected Values, Mean, and Variance 3 Two Random Variables.
Multivariate Time Series Analysis
Lecture 5,6,7: Random variables and signals Aliazam Abbasfar.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Power Spectral Estimation
Week 21 Order Statistics The order statistics of a set of random variables X 1, X 2,…, X n are the same random variables arranged in increasing order.
Chapter 3: Uncertainty "variation arises in data generated by a model" "how to transform knowledge of this variation into statements about the uncertainty.
Density Estimation in R Ha Le and Nikolaos Sarafianos COSC 7362 – Advanced Machine Learning Professor: Dr. Christoph F. Eick 1.
Week 21 Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Stochastic Process - Introduction
Multiple Random Variables and Joint Distributions
Inference for the Mean of a Population
Tatiana Varatnitskaya Belаrussian State University, Minsk
Why Stochastic Hydrology ?
Normal Distribution and Parameter Estimation
STATISTICAL INFERENCE
Estimation of the spectral density function
Simultaneous equation system
Sample Mean Distributions
Chapter 7 Sampling Distributions.
Filtering/smoothing. Use of A(,). bandpass filtering
The Empirical FT. What is the large sample distribution of the EFT?
Power spectral density. frequency-side, , vs. time-side, t
Alafia river: Autocorrelation Autocorrelation of standardized flow.
Autocorrelation.
Stochastic models - time series.
The Empirical FT. What is the large sample distribution of the EFT?
Stochastic models - time series.
Second order stationary p.p.
Chernoff bounds The Chernoff bound for a random variable X is
Summarizing Data by Statistics
Stat Oct 2008 D. R. Brillinger Chapter 7 - Spectral analysis 7.1 Fourier analysis Xt = μ + α cos ωt + βsin ωt + Zt Cases ω known versus.
Multivariate Time Series Analysis
FT makes the New Yorker, October 4, 2010 page 71
CHAPTER 6 Statistical Inference & Hypothesis Testing
Stat 223 Introduction to the Theory of Statistics
The Empirical FT. What is the large sample distribution of the EFT?
Autocorrelation.
Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution that produced.
Applied Statistics and Probability for Engineers
Probabilistic Surrogate Models
How Confident Are You?.
Presentation transcript:

Time series power spectral density. frequency-side, , vs. time-side, t X(t), t= 0, ±1, ±2,… Suppose stationary cXX(u) = cov{X(t+u),X(t)} u = 0, ±1, ±2, … lag f XX()= (1/2π) Σ exp {-iu} cXX(u) - < ≤  period 2π non-negative /2 : frequency (cycles/unit time) cXX(u) = ∫ -pi pi exp{iuλ} f XX() d 

The Empirical FT. Data X(0), …, X(T-1) dXT()= Σ exp {-iu} X(u) dXT(0)= Σ X(u) What is the large sample distribution of the EFT?

The complex normal.

Theorem. Suppose X is stationary mixing, then

Proof. Write Evaluate first and second-order cumulants Bound higher cumulants Normal is determined by its moments

Consider

Comments. Already used to study mean estimate Tapering, h(t)X(t). makes Get asymp independence for different frequencies The frequencies 2r/T are special, e.g. T(2r/T)=0, r 0 Also get asymp independence if consider separate stretches p-vector version involves p by p spectral density matrix fXX( )

Estimation of the (power) spectrum. An estimate whose limit is a random variable

Some moments. The estimate is asymptotically unbiased Final term drops out if  = 2r/T  0 Best to correct for mean, work with

Periodogram values are asymptotically independent since dT values are - independent exponentials Use to form estimates

Approximate marginal confidence intervals

More on choice of L

Approximation to bias

Indirect estimate

Estimation of finite dimensional . approximate likelihood (assuming IT values independent exponentials)

Bivariate case.

Crossperiodogram. Smoothed periodogram.

Complex Wishart

Predicting Y via X

Plug in estimates.

Large sample distributions. var log|AT|  [|R|-2 -1]/L var argAT  [|R|-2 -1]/L

Berlin and Vienna monthly temperatures

Recife SOI

Furnace data

Partial coherence/coherency. Mississipi dams RXZ|Y = (R XZ – R XZ R ZY )/[(1- |R XZ|2 )(1- |RZY | 2 )]

Advantages of frequency domain approach. techniques for many stationary processes look the same approximate i.i.d sample values assessing models (character of departure) time varying variant...

London water usage Cleveland, RB, Cleveland, WS, McRae, JE & Terpenning, I (1990), ‘STL: a seasonal-trend decomposition procedure based on loess’, Journal of Official Statistics Y(t) = S(t) + T(t) + E(t) Seasonal, trend. error

Dynamic spectrum, spectrogram: IT (t,). London water

Earthquake? Explosion?

Lucilia cuprina

nobs = length(EXP6) # number of observations wsize = 256 # window size overlap = 128 # overlap ovr = wsize-overlap nseg = floor(nobs/ovr)-1; # number of segments krnl = kernel("daniell", c(1,1)) # kernel ex.spec = matrix(0, wsize/2, nseg) for (k in 1:nseg) { a = ovr*(k-1)+1 b = wsize+ovr*(k-1) ex.spec[,k] = mvspec(EXP6[a:b], krnl, taper=.5, plot=FALSE)$spec } x = seq(0, 10, len = nrow(ex.spec)/2) y = seq(0, ovr*nseg, len = ncol(ex.spec)) z = ex.spec[1:(nrow(ex.spec)/2),] # below is text version filled.contour(x,y,log(z),ylab="time",xlab="frequency (Hz)",nlevels=12 ,col=gray(11:0/11),main="Explosion") dev.new() # a nicer version with color filled.contour(x, y, log(z), ylab="time", xlab="frequency(Hz)", main= "Explosion") dev.new() # below not shown in text persp(x,y,z,zlab="Power",xlab="frequency(Hz)",ylab="time",ticktype="detailed",theta=25,d=2,main="Explosion")