Stat Oct 2008 D. R. Brillinger Chapter 7 - Spectral analysis 7.1 Fourier analysis Xt = μ + α cos ωt + βsin ωt + Zt Cases ω known versus.

Slides:



Advertisements
Similar presentations
Statistical Time Series Analysis version 2
Advertisements

FINANCIAL TIME-SERIES ECONOMETRICS SUN LIJIAN Feb 23,2001.
Chapter 9: Simple Regression Continued
Test of (µ 1 – µ 2 ),  1 =  2, Populations Normal Test Statistic and df = n 1 + n 2 – 2 2– )1– 2 ( 2 1 )1– 1 ( 2 where ] 2 – 1 [–
Simple Linear Regression Analysis
DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 1 review: Quizzes 1-6.
Chapter 12 Inference for Linear Regression
Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
Simple Linear Regression
Spectral analysis for point processes. Error bars. Bijan Pesaran Center for Neural Science New York University.
The Empirical FT continued. What is the large sample distribution of the EFT?
Linear Regression Models Based on Chapter 3 of Hastie, Tibshirani and Friedman Slides by David Madigan.
NY Times 23 Sept time series of the day. Stat Sept 2008 D. R. Brillinger Chapter 4 - Fitting t.s. models in the time domain sample autocovariance.
Stat Oct 2008 D. R. Brillinger Chapter 6 - Stationary Processes in the Frequency Domain One model Another R: amplitude α: decay rate ω: frequency,
Chapter 11 Multiple Regression.
Correlation and spectral analysis Objective: –investigation of correlation structure of time series –identification of major harmonic components in time.
Traffic modeling and Prediction ----Linear Models
Inference for regression - Simple linear regression
STAT 497 LECTURE NOTES 2.
Time Series Spectral Representation Z(t) = {Z 1, Z 2, Z 3, … Z n } Any mathematical function has a representation in terms of sin and cos functions.
1 Chapter 10 Correlation and Regression 10.2 Correlation 10.3 Regression.
1Spring 02 First Derivatives x y x y x y dy/dx = 0 dy/dx > 0dy/dx < 0.
Stat 112: Notes 2 Today’s class: Section 3.3. –Full description of simple linear regression model. –Checking the assumptions of the simple linear regression.
CHEE825 Fall 2005J. McLellan1 Spectral Analysis and Input Signal Design.
TIME SERIES ANALYSIS Time series – collection of observations in time: x( t i ) x( t i ) discrete time series with Δt Deterministic process: Can be predicted.
Chapter 1 Random Process
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
Computational Finance II: Time Series K.Ensor. What is a time series? Anything observed sequentially (by time?) Returns, volatility, interest rates, exchange.
Geology 6600/7600 Signal Analysis 05 Oct 2015 © A.R. Lowry 2015 Last time: Assignment for Oct 23: GPS time series correlation Given a discrete function.
1 Autocorrelation in Time Series data KNN Ch. 12 (pp )
Chapter 11 Linear Regression and Correlation. Explanatory and Response Variables are Numeric Relationship between the mean of the response variable and.
Chapter 13 Simple Linear Regression
Fourier series With coefficients:.
Inference for the Mean of a Population
Computational Data Analysis
Time Series Spectral Representation
Regression.
Part 5 - Chapter
Dynamic Models, Autocorrelation and Forecasting
Basic Estimation Techniques
Forecasting Approaches to Forecasting:
Linear Regression and Correlation Analysis
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
Computational Data Analysis
Time series power spectral density.
Multiple Regression and Model Building
Statistics 153 Review - Sept 30, 2008
Laboratory in Oceanography: Data and Methods
Basic Estimation Techniques
The Empirical FT. What is the large sample distribution of the EFT?
CHAPTER 29: Multiple Regression*
Chapter 12 Curve Fitting : Fitting a Straight Line Gab-Byung Chae
Chapter 12 Regression.
Review of Chapter 2 Some Basic Concepts: Sample center
The Empirical FT. What is the large sample distribution of the EFT?
Second order stationary p.p.
TIME SERIES ANALYSIS Time series – collection of observations in time: x( ti ) x( ti ) discrete time series with Δt Deterministic process: Can be predicted.
Regression Chapter 8.
Simple Linear Regression
Regression.
Simple Linear Regression
Linear Regression and Correlation
The Spectral Representation of Stationary Time Series
The Empirical FT. What is the large sample distribution of the EFT?
Linear Regression and Correlation
TIME SERIES ANALYSIS Time series – collection of observations in time: x( ti ) x( ti ) discrete time series with Δt Deterministic process: Can be predicted.
Time Series introduction in R - Iñaki Puigdollers
Chapter 5 The Fourier Transform.
Applied Statistics and Probability for Engineers
BOX JENKINS (ARIMA) METHODOLOGY
Presentation transcript:

Stat 153 - 13 Oct 2008 D. R. Brillinger Chapter 7 - Spectral analysis 7.1 Fourier analysis Xt = μ + α cos ωt + βsin ωt + Zt Cases ω known versus ω unknown, "hidden frequency" Study/fit via least squares

Fourier frequencies ωp = 2πp/N, p = 0,...,N-1 Fourier components Σt=1N xt cos 2πpt/N Σt=1N xt sin 2πpt/N ap +i bp = Σt=1N xt exp{i2πpt/N}, p=0,...,N-1 = Σt=1N xt exp{iωpt/N}

7.3 Periodogram at frequency ωp I(ωp ) = |Σt=1N xt exp{iωpt/N}|2 /πN = N(ap2 + bp2)/4π basis for spectral density estimates Can extend definition to I(ω) Properties I(ω)  0 I(-ω) = I(ω) I(ω+2π) = I(ω) Cp. f(ω)

Correcting for the mean work with

dynamic spectrum

Relationship - periodogram and acv f(ω) = [γ0 + 2 Σk=1 γk cos ωk]/π I(ωp) = [c0 + 2 Σk=1N-1 ck cos ωpk]/π River height Manaus, Amazonia, Brazil daily data since 1902

Periodogram properties. Asymptotically unbiased Approximate distribution f(ω) χ22 /2 CLT for a, b χ22 /2 : exponential variate Var {f(ω) χ22/2} = f(ω)2 Work with log I(ω)

Periodogram poor estimate of spectral density inconsistent I(ωj), I(ωk) approximately independent Flexible estimate, χ22 + χ22 + ... + χ22 = χν2 , υ = 2 m E{ χν2} = v Var{χν2} = 2υ

Confidence interval. 100(1-α)% work with logs Might pick m to get desired stability, e.g. 2m = 10 degrees of freedom Employ several values, compute bandwidth m = 0: periodogram

Model. Yt = St + Nt seasonal St+s = St noise {Nt} Buys-Ballot stack years column average

General class of estimates Example. boxcar Its bandwidth is m2π/N

Bias-variance compromise m large, variance small, but m large, bias large (generally) Improvements prewhiten - work with residuals, e.g. of an autoregressive taper - work with {gt xt}

The partial correlation coefficient. 4-variate: (Y1 ,Y2 , Y3 , Y4 ) ε1|23 error of linear predicting Y1 using Y2 and Y3 ε4|23 error of linear predicting Y4 using Y2 and Y3 ρ14|23 = corr{ε1|23 , ε4|23} pacf(2) = 0 for AR(2) because Xt+1 , Xt+2 separate Xt+1 and Xt+4

For AIC see text p. 256

Forecasts

Elephant seal dives

Binary data X(t) = 0,1 nerve cells firing biological phenomenon refractory period

Continuous time series. X(t), -< t< Now Cov{X(t+τ),X(t)} = γ(τ), -< t, τ< and Consider the discrete time series {X(kΔt), k =0,±1,±2,...} It is symmetric and has period 2π/Δt Nyquist frequency: ωN = π/Δt One plots fd(ω) for 0  ω  π/Δt, BUT ...