Econometrics 2 - Lecture 3 Univariate Time Series Models.

Slides:



Advertisements
Similar presentations
FINANCIAL TIME-SERIES ECONOMETRICS SUN LIJIAN Feb 23,2001.
Advertisements

Autocorrelation Functions and ARIMA Modelling
Econometric Modeling Through EViews and EXCEL
Economics 20 - Prof. Anderson1 Stationary Stochastic Process A stochastic process is stationary if for every collection of time indices 1 ≤ t 1 < …< t.
Using SAS for Time Series Data
Model Building For ARIMA time series
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
STATIONARY AND NONSTATIONARY TIME SERIES
Nonstationary Time Series Data and Cointegration Prepared by Vera Tabakova, East Carolina University.
Non-stationary data series
Model specification (identification) We already know about the sample autocorrelation function (SAC): Properties: Not unbiased (since a ratio between two.
Financial Econometrics
Unit Roots & Forecasting
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 7: Box-Jenkins Models – Part II (Ch. 9) Material.
Regression with Time-Series Data: Nonstationary Variables
Time Series Building 1. Model Identification
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by means of inference statistical methods.
Economics 310 Lecture 25 Univariate Time-Series Methods of Economic Forecasting Single-equation regression models Simultaneous-equation regression models.
10 Further Time Series OLS Issues Chapter 10 covered OLS properties for finite (small) sample time series data -If our Chapter 10 assumptions fail, we.
STAT 497 APPLIED TIME SERIES ANALYSIS
Stationary Stochastic Process
Non-Seasonal Box-Jenkins Models
1 Ka-fu Wong University of Hong Kong Modeling Cycles: MA, AR and ARMA Models.
Economics Prof. Buckles1 Time Series Data y t =  0 +  1 x t  k x tk + u t 1. Basic Analysis.
Modeling Cycles By ARMA
Prediction and model selection
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Financial Econometrics
Economics 20 - Prof. Anderson
Modern methods The classical approach: MethodProsCons Time series regression Easy to implement Fairly easy to interpret Covariates may be added (normalization)
Non-Seasonal Box-Jenkins Models
AR- MA- och ARMA-.
STAT 497 LECTURE NOTES 2.
STAT 497 LECTURE NOTES 4 MODEL INDETIFICATION AND NON- STATIONARY TIME SERIES MODELS 1.
Linear Stationary Processes. ARMA models. This lecture introduces the basic linear models for stationary processes. Considering only stationary processes.
MODEL INDETIFICATION AND NON-STATIONARY TIME SERIES MODELS
Autoregressive Integrated Moving Average (ARIMA) Popularly known as the Box-Jenkins methodology.
Econometrics 2 - Lecture 4 Lag Structures, Cointegration.
FAME Time Series Econometrics Daniel V. Gordon Department of Economics University of Calgary.
K. Ensor, STAT Spring 2005 Model selection/diagnostics Akaike’s Information Criterion (AIC) –A measure of fit plus a penalty term for the number.
The Properties of Time Series: Lecture 4 Previously introduced AR(1) model X t = φX t-1 + u t (1) (a) White Noise (stationary/no unit root) X t = u t i.e.
K. Ensor, STAT Spring 2004 Memory characterization of a process How would the ACF behave for a process with no memory? What is a short memory series?
How do we identify non-stationary processes? (A) Informal methods Thomas 14.1 Plot time series Correlogram (B) Formal Methods Statistical test for stationarity.
Time Series Basics Fin250f: Lecture 8.1 Spring 2010 Reading: Brooks, chapter
3.Analysis of asset price dynamics 3.1Introduction Price – continuous function yet sampled discretely (usually - equal spacing). Stochastic process – has.
Auto Regressive, Integrated, Moving Average Box-Jenkins models A stationary times series can be modelled on basis of the serial correlations in it. A non-stationary.
Forecasting (prediction) limits Example Linear deterministic trend estimated by least-squares Note! The average of the numbers 1, 2, …, t is.
Dynamic Models, Autocorrelation and Forecasting ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
EC208 – Introductory Econometrics. Topic: Spurious/Nonsense Regressions (as part of chapter on Dynamic Models)
1 Chapter 5 : Volatility Models Similar to linear regression analysis, many time series exhibit a non-constant variance (heteroscedasticity). In a regression.
Previously Definition of a stationary process (A) Constant mean (B) Constant variance (C) Constant covariance White Noise Process:Example of Stationary.
TESTING FOR NONSTATIONARITY 1 This sequence will describe two methods for detecting nonstationarity, a graphical method involving correlograms and a more.
TESTING FOR NONSTATIONARITY 1 This sequence will describe two methods for detecting nonstationarity, a graphical method involving correlograms and a more.
Ch16: Time Series 24 Nov 2011 BUSI275 Dr. Sean Ho HW8 due tonight Please download: 22-TheFed.xls 22-TheFed.xls.
Univariate Time series - 2 Methods of Economic Investigation Lecture 19.
Introduction to stochastic processes
Time Series Analysis PART II. Econometric Forecasting Forecasting is an important part of econometric analysis, for some people probably the most important.
Stationarity and Unit Root Testing Dr. Thomas Kigabo RUSUHUZWA.
1 Lecture Plan : Statistical trading models for energy futures.: Stochastic Processes and Market Efficiency Trading Models Long/Short one.
Advanced Econometrics - Lecture 5 Univariate Time Series Models.
Review of Unit Root Testing D. A. Dickey North Carolina State University (Previously presented at Purdue Econ Dept.)
Analysis of Financial Data Spring 2012 Lecture 4: Time Series Models - 1 Priyantha Wijayatunga Department of Statistics, Umeå University
Financial Econometrics Lecture Notes 2
CHAPTER 16 ECONOMIC FORECASTING Damodar Gujarati
Unit Root & Augmented Dickey-Fuller (ADF) Test
Introduction to Time Series
Lecturer Dr. Veronika Alhanaqtah
BOX JENKINS (ARIMA) METHODOLOGY
Presentation transcript:

Econometrics 2 - Lecture 3 Univariate Time Series Models

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 2

Private Consumption April 6, 2012 Hackl, Econometrics 2, Lecture 3 3 Private consumption in EURO area (16 mem- bers), seasonally ad- justed, AWM database (in MioEUR)

Private Consumption, cont’d April 6, 2012 Hackl, Econometrics 2, Lecture 3 4 Yearly growth of private consumption in EURO area (16 members), AWM database (in MioEUR) Mean growth:

Disposable Income April 6, 2012 Hackl, Econometrics 2, Lecture 3 5 Disposable income in Austria (in Mio EUR)

Time Series April 6, 2012 Hackl, Econometrics 2, Lecture 3 6 Time-ordered sequence of observations of a random variable Examples: Annual values of private consumption Changes in expenditure on private consumption Quarterly values of personal disposable income Monthly values of imports Notation: Random variable Y Sequence of observations Y 1, Y 2,..., Y T Deviations from the mean: y t = Y t – E{Y t } = Y t – μ

Components of a Time Series April 6, 2012 Hackl, Econometrics 2, Lecture 3 7 Components or characteristics of a time series are Trend Seasonality Irregular fluctuations Time series model: represents the characteristics as well as possible interactions Purpose of modeling Description of the time series Forecasting the future Example: Y t = βt + Σ i γ i D it + ε t with D it = 1 if t corresponds to i-th quarter, D it = 0 otherwise for describing the development of the disposable income

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 8

9 Stochastic Process Time series: realization of a stochastic process Stochastic process is a sequence of random variables Y t, e.g., {Y t, t = 1,..., n} {Y t, t = -∞,..., ∞} Joint distribution of the Y 1,..., Y n : p(y 1, …., y n ) Of special interest Evolution of the expectation  t = E{Y t } over time Dependence structure over time Example: Extrapolation of a time series as a tool for forecasting April 6, 2012

Hackl, Econometrics 2, Lecture 3 10 White Noise Process White noise process x t, t = -∞,..., ∞ E{x t } = 0 V{x t } = σ² Cov{x t, x t-s } = 0 for all (positive or negative) integers s i.e., a mean zero, serially uncorrelated, homoskedastic process April 6, 2012

Hackl, Econometrics 2, Lecture 3 11 AR(1)-Process States the dependence structure between consecutive observations as Y t = δ + θY t-1 + ε t, |θ| < 1 with ε t : white noise, i.e., V{ε t } = σ² (see next slide) Autoregressive process of order 1 From Y t = δ + θY t-1 + ε t = δ+θδ +θ²δ +… +ε t + θε t-1 + θ²ε t-2 +… follows E{Y t } = μ = δ(1-θ) -1 |θ| < 1 needed for convergence! Invertibility condition In deviations from μ, y t = Y t –  : y t = θy t-1 + ε t April 6, 2012

Hackl, Econometrics 2, Lecture 3 12 AR(1)-Process, cont’d Autocovariances γ k = Cov{ Y t, Y t-k } k=0: γ 0 = V{Y t } = θ²V{Y t-1 } + V{ε t } = … = Σ i θ 2i σ² = σ²(1-θ²) -1 k=1: γ 1 = Cov{Y t,Y t-1 } = E{(θy t-1 +ε t )y t-1 } = θV{y t-1 } = θσ²(1-θ²) - 1 In general: γ k = Cov{Y t,Y t-k } = θ k σ²(1-θ²) - 1, k = 0, ± 1, … depends upon k, not upon t! April 6, 2012

Hackl, Econometrics 2, Lecture 3 13 MA(1)-Process States the dependence structure between consecutive observations as Y t = μ + ε t + αε t-1 with ε t : white noise, V{ε t } = σ² Moving average process of order 1 E{Y t } = μ Autocovariances γ k = Cov{Y t,Y t-k } k=0: γ 0 = V{Y t } = σ²(1+α²) k=1: γ 1 = Cov{Y t,Y t-1 } = ασ² γ k = 0 for k = 2, 3, … Depends upon k, not upon t! April 6, 2012

Hackl, Econometrics 2, Lecture 3 14 AR-Representation of MA- Process The AR(1) can be represented as MA-process of infinite order y t = θy t-1 + ε t = Σ ∞ i=0 θ i ε t-i given that |θ| < 1 Similarly, the AR representation of the MA(1) process y t = αy t-1 – α²y t-2 + … ε t = Σ ∞ i=0 (-1) i α i+1 y t-i-1 + ε t given that |α| < 1 April 6, 2012

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 15

Hackl, Econometrics 2, Lecture 3 16 Stationary Processes Refers to the joint distribution of Y t ’s, in particular to second moments A process is called strictly stationary if its stochastic properties are unaffected by a change of the time origin The joint probability distribution at any set of times is not affected by an arbitrary shift along the time axis Covariance function: γ t,k = Cov{Y t, Y t+k }, k = 0, ±1,… Properties: γ t,k = γ t,-k Weak stationary process: E{Y t } = μ for all t Cov{Y t, Y t+k } = γ k, k = 0, ±1, … for all t and all k Also called covariance stationary process April 6, 2012

Hackl, Econometrics 2, Lecture 3 17 AC and PAC Function Autocorrelation function (AC function, ACF) Independent of the scale of Y For a stationary process: ρ k = Corr{Y t,Y t-k } = γ k /γ 0, k = 0, ±1,… Properties:  |ρ k | ≤ 1  ρ k = ρ -k  ρ 0 = 1 Correlogram: graphical presentation of the AC function Partial autocorrelation function (PAC function, PACF): θ kk = Corr{Y t, Y t-k |Y t-1,...,Y t-k+1 }, k = 0, ±1, … θ kk is obtained from Y t = θ k0 + θ k1 Y t θ kk Y t-k Partial correlogram: graphical representation of the PAC function April 6, 2012

Hackl, Econometrics 2, Lecture 3 18 AC and PAC Function: Examples Examples for the AC and PAC functions White noise ρ 0 = θ 00 = 1 ρ k = θ kk = 0, if k ≠ 0 AR(1) process, Y t = δ + θY t-1 + ε t ρ k = θ k, k = 0, ±1,…  θ 00 = 1, θ 11 = θ, θ kk = 0 for k > 1 MA(1) process, Y t = μ + ε t + αε t-1  ρ 0 = 1, ρ 1  α/(  α 2 ), ρ k = 0 for k > 1 PAC function: damped exponential if α > 0, otherwise alternating and damped exponential April 6, 2012

Hackl, Econometrics 2, Lecture 3 19 AC and PAC Function: Estimates Estimator for the AC function ρ k : Estimator for the PAC function θ kk : coefficient of Y t-k in the regression of Y t on Y t-1, …, Y t-k April 6, 2012

Hackl, Econometrics 2, Lecture 3 AR(1) Processes, Verbeek, Fig. 8.1 April 6,

Hackl, Econometrics 2, Lecture 3 MA(1) Processes, Verbeek, Fig. 8.2 April 6,

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 22

Hackl, Econometrics 2, Lecture 3 23 The ARMA(p,q) Process Generalization of the AR and MA processes: ARMA(p,q) process y t = θ 1 y t-1 + … + θ p y t-p + ε t + α 1 ε t-1 + … + α q ε t-q with white noise ε t Lag (or shift) operator L (Ly t = y t-1, L 0 y t = Iy t = y t, L p y t = y t-p ) ARMA(p,q) process in operator notation θ(L)y t = α(L)ε t with operator polynomials θ(L) and α(L) θ(L) = I - θ 1 L - … - θ p L p α(L) = I + α 1 L + … + α q L q April 6, 2012

Hackl, Econometrics 2, Lecture 3 24 Lag Operator Lag (or shift) operator L Ly t = y t-1, L 0 y t = Iy t = y t, L p y t = y t-p Algebra of polynomials in L like algebra of variables Examples: (I - ϕ 1 L)(I - ϕ 2 L) = I – ( ϕ 1 + ϕ 2 )L + ϕ 1 ϕ 2 L 2 (I - θL) -1 = Σ ∞ i=0 θ i L i MA(∞) representation of the AR(1) process y t = (I - θL) -1 ε t the infinite sum defined only (e.g., finite variance) |θ| < 1 MA(∞) representation of the ARMA(p,q) process y t = [θ (L)] -1 α(L)ε t similarly the AR(∞) representations; invertibility condition: restrictions on parameters April 6, 2012

Hackl, Econometrics 2, Lecture 3 25 Invertibility of Lag Polynomials Invertibility condition for I - θL: |θ| < 1 Invertibility condition for I - θ 1 L - θ 2 L 2 : θ(L) = I - θ 1 L - θ 2 L 2 = (I - ϕ 1 L)(I - ϕ 2 L) with ϕ 1 + ϕ 2 = θ 1 and - ϕ 1 ϕ 2 = θ 2 Invertibility conditions: both (I – ϕ 1 L) and (I – ϕ 2 L) invertible; | ϕ 1 | < 1, | ϕ 2 | < 1 Characteristic equation: θ(z) = (1- ϕ 1 z) (1- ϕ 2 z) = 0 Characteristic roots: solutions z 1, z 2 from (1- ϕ 1 z) (1- ϕ 2 z) = 0 Invertibility conditions: |z 1 | > 1, |z 2 | > 1 Can be generalized to lag polynomials of higher order Unit root: a characteristic root of value 1 Polynomial θ(z) evaluated at z = 1: θ(1) = 0, if Σ i θ i = 1 Simple check, no need to solve characteristic equation April 6, 2012

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 26

Hackl, Econometrics 2, Lecture 3 27 Types of Trend Trend: The expected value of a process Y t increases or decreases with time Deterministic trend: a function f(t) of the time, describing the evolution of E{Y t } over time Y t = f(t) + ε t, ε t : white noise Example: Y t = α + βt + ε t describes a linear trend of Y; an increasing trend corresponds to β > 0 Stochastic trend: Y t = δ + Y t-1 + ε t or ΔY t = Y t – Y t-1 = δ + ε t, ε t : white noise  describes an irregular or random fluctuation of the differences ΔY t around the expected value δ  AR(1) – or AR(p) – process with unit root  “random walk with trend” April 6, 2012

Hackl, Econometrics 2, Lecture 3 28 Example: Private Consumption Private consumption, AWM database; level values (PCR) and first differences (PCR_D) Mean of PCD_D: 3740 April 6, 2012

Hackl, Econometrics 2, Lecture 3 29 Trends: Random Walk and AR Process Random walk: Y t = Y t-1 + ε t ; random walk with trend: Y t = 0.1 +Y t-1 + ε t ; AR(1) process: Y t = Y t-1 + ε t ; ε t simulated from N(0,1) April 6, 2012

Hackl, Econometrics 2, Lecture 3 30 Random Walk with Trend The random walk with trend Y t = δ + Y t-1 + ε t can be written as Y t = Y 0 + δt + Σ i≤t ε i δ: trend parameter Components of the process Deterministic growth path Y 0 + δt Cumulative errors Σ i≤t ε i Properties: Expectation Y 0 + δt is not a fixed value! V{Y t } = σ²t becomes arbitrarily large! Corr{Y t,Y t-k } = √(1-k/t) Non-stationarity April 6, 2012

Hackl, Econometrics 2, Lecture 3 31 Random Walk with Trend, cont’d From follows For fixed k,Y t and Y t-k are the stronger correlated, the larger t With increasing k, correlation tends to zero, but the slower the larger t (long memory property) Comparison of random walk with the AR(1) process Y t = δ + θY t-1 + ε t AR(1) process: ε t-i has the lesser weight, the larger i AR(1) process similar to random walk when θ is close to one April 6, 2012

Hackl, Econometrics 2, Lecture 3 32 Non-Stationarity: Consequences AR(1) process Y t = θY t-1 + ε t OLS Estimator for θ: For |θ| < 1: the estimator is  Consistent  Asymptotically normally distributed For θ = 1 (unit root)  θ is underestimated  Estimator not normally distributed  Spurious regression problem April 6, 2012

Hackl, Econometrics 2, Lecture 3 33 Spurious Regression Random walk without trend: Y t = Y t-1 + ε t, ε t : white noise Realization of Y t : is a non-stationary process, stochastic trend? V{Y t }: a multiple of t Specified model: Y t = α + βt + ε t Deterministic trend Constant variance Misspecified model! Consequences for OLS estimator for β t- and F-statistics: wrong critical limits, rejection probability too large R 2 indicates explanatory potential although Y t random walk without trend Granger & Newbold, 1974 April 6, 2012

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 34

Hackl, Econometrics 2, Lecture 3 35 How to Model Trends? Specification of Deterministic trend, e.g., Y t = α + βt + ε t : risk of wrong decisions Stochastic trend: analysis of differences ΔY t if a random walk, i.e., a unit root, is suspected Consequences of spurious regression are more serious Consequences of modeling differences ΔY t : Autocorrelated errors Consistent estimators Asymptotically normally distributed estimators HAC correction of standard errors April 6, 2012

Hackl, Econometrics 2, Lecture 3 36 Elimination of a Trend In order to cope with non-stationarity Trend-stationary process: the process can be transformed in a stationary process by subtracting the deterministic trend Difference-stationary process, or integrated process: stationary process can be derived by differencing Integrated process: stochastic process Y is called integrated of order one if the first differences yield a stationary process: Y ~ I(1) integrated of order d, if the d-fold differences yield a stationary process: Y ~ I(d) April 6, 2012

Hackl, Econometrics 2, Lecture 3 37 Trend-Elimination: Examples Random walk Y t = δ + Y t-1 + ε t with white noise ε t ΔY t = Y t – Y t-1 = δ + ε t ΔY t is a stationary process A random walk is a difference-stationary or I(1) process Linear trend Y t = α + βt + ε t Subtracting the trend component α + βt provides a stationary process Y t is a trend-stationary process April 6, 2012

Hackl, Econometrics 2, Lecture 3 38 Integrated Stochastic Processes Random walk Y t = δ + Y t-1 + ε t with white noise ε t is a difference- stationary or I(1) process Many economic time series show stochastic trends From the AWM Database ARIMA(p,d,q) process: d-th differences follow an ARMA(p,q) process April 6, 2012 Variabled YERGDP, real1 PCRConsumption, real1-2 PYRHousehold's Disposable Income, real1-2 PCDConsumption Deflator2

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 39

Hackl, Econometrics 2, Lecture 3 40 Unit Root Tests AR(1) process Y t = δ + θY t-1 + ε t with white noise ε t Dickey-Fuller or DF test (Dickey & Fuller, 1979) Test of H 0 : θ = 1 against H 1 : θ < 1 KPSS test (Kwiatkowski, Phillips, Schmidt & Shin, 1992) Test of H 0 : θ < 1 against H 1 : θ = 1 Augmented Dickey-Fuller or ADF test extension of DF test Various modifications like Phillips-Perron test, Dickey-Fuller GLS test, etc. April 6, 2012

Hackl, Econometrics 2, Lecture 3 41 Dickey-Fuller‘s Unit Root Test AR(1) process Y t = δ + θY t-1 + ε t with white noise ε t OLS Estimator for θ: Distribution of DF If |θ| < 1: approximately t(T-1) If θ = 1: Dickey & Fuller critical values DF test for testing H 0 : θ = 1 against H 1 : θ < 1 θ = 1: characteristic polynomial has unit root April 6, 2012

Hackl, Econometrics 2, Lecture 3 42 Dickey-Fuller Critical Values Monte Carlo estimates of critical values for DF 0 : Dickey-Fuller test without intercept DF: Dickey-Fuller test with intercept DF τ : Dickey-Fuller test with time trend April 6, 2012 T p = 0.01p = 0.05p = DF DF DF τ DF DF DF τ N(0,1)

Hackl, Econometrics 2, Lecture 3 43 Unit Root Test: The Practice AR(1) process Y t = δ + θY t-1 + ε t with white noise ε t can be written with π = θ -1 as ΔY t = δ + πY t-1 + ε t DF tests H 0 : π = 0 against H 1 : π < 0 test statistic for testing π = θ -1 = 0 identical with DF statistic Two steps: 1.Regression of ΔY t on Y t-1 : OLS-estimator for π = θ Test of H 0 : π = 0 against H 1 : π < 0 based on DF; critical values of Dickey & Fuller April 6, 2012

Hackl, Econometrics 2, Lecture 3 44 Example: Price/Earnings Ratio Verbeek’s data set PE: annual time series data on composite stock price and earnings indices of the S&P500, PE: price/earnings ratio  Mean 14.6  Min 6.1  Max 36.7  St.Dev. 5.1 Log(PE)  Mean 2.63  Min 1.81  Max 3.60  St.Dev April 6, 2012

Hackl, Econometrics 2, Lecture 3 45 Price/Earnings Ratio, cont’d Fitting an AR(1) process to the log PE ratio data gives: ΔY t = – 0.125Y t-1 with t-statistic (Y t-1 ) and p-value p-value of the DF statistic (-2.569):  1% critical value:  5% critical value:  10% critical value: H 0 : θ = 1 (non-stationarity) cannot be rejected for the log PE ratio Unit root test for first differences: DF statistic -7.31, p-value (1% critical value: -3.48) log PE ratio is I(1) However: for sample : DF statistic -3.65, p-value April 6, 2012

Hackl, Econometrics 2, Lecture 3 46 Unit Root Test: Extensions DF test so far for a model with intercept: ΔY t = δ + πY t-1 + ε t Tests for alternative or extended models DF test for model without intercept: ΔY t = πY t-1 + ε t DF test for model with intercept and trend: ΔY t = δ + γt + πY t-1 + ε t DF tests in all cases H 0 : π = 0 against H 1 : π < 0 Test statistic in all cases Critical values depend on cases; cf. Table on slide 42 April 6, 2012

Hackl, Econometrics 2, Lecture 3 47 KPSS Test A process Y t = δ + ε t with white noise ε t Test of H 0 : no unit root (Y t is stationary), against H 1 : Y t ~ I(1) Under H 0 :  Average ẏ is a consistent estimate of δ  Long-run variance of ε t is a well-defined number KPSS (Kwiatkowski, Phillips, Schmidt, Shin) test statistic with S t 2 = Σ i t e i and the variance estimate s 2 of the residuals e i =Y t - ẏ Bandwidth or lag truncation parameter m for estimating s 2 Critical values from Monte Carlo simulations April 6, 2012

Hackl, Econometrics 2, Lecture 3 48 ADF Test Extended model according to an AR(p) process: ΔY t = δ + πY t-1 + β 1 ΔY t-1 + … + β p ΔY t-p+1 + ε t Example: AR(2) process Y t = δ + θ 1 Y t-1 + θ 2 Y t-2 + ε t can be written as ΔY t = δ + (θ 1 + θ 2 - 1)Y t-1 – θ 2 ΔY t-1 + ε t the characteristic equation (1 - ϕ 1 L)(1 - ϕ 2 L) = 0 has roots θ 1 = ϕ 1 + ϕ 2 and θ 2 = - ϕ 1 ϕ 2 a unit root implies ϕ 1 = θ 1 + θ 2 =1: Augmented DF (ADF) test Test of H 0 : π = 0 against H 1 : π < 0 Needs its own critical values Extensions (intercept, trend) similar to the DF-test Phillips-Perron test: alternative method; uses HAC-corrected standard errors April 6, 2012

Hackl, Econometrics 2, Lecture 3 49 Price/Earnings Ratio, cont’d Extended model according to an AR(2) process gives: ΔY t = – 0.136Y t ΔY t ΔY t-2 with t-statistics (Y t-1 ), (ΔY t-1 ) and (ΔY t-2 ) and p-values 0.119, and p-value of the DF statistic  1% critical value:  5% critical value:  10% critical value: Non-stationarity cannot be rejected for the log PE ratio Unit root test for first differences: DF statistic -7.31, p-value (1% critical value: -3.48) log PE ratio is I(1) However: for sample : DF statistic -3.52, p-value April 6, 2012

Hackl, Econometrics 2, Lecture 3 50 Unit Root Tests in GRETL For marked variable: Variable > Unit root tests > Augmented Dickey-Fuller test Performs the  DL test (choose zero for “lag order for ADL test”) or the  ADL test  with or without constant, trend, squared trend Variable > Unit root tests > ADF-GLS test Performs the  DL test (choose zero for “lag order for ADL test”) or the  ADL test  with or without a trend, which are estimated by GLS Variable > Unit root tests > KPSS test Performs the KPSS test with or without a trend April 6, 2012

Contents Time Series Stochastic Processes Stationary Processes The ARMA Process Deterministic and Stochastic Trends Models with Trend Unit Root Tests Estimation of ARMA Models April 6, 2012 Hackl, Econometrics 2, Lecture 3 51

Hackl, Econometrics 2, Lecture 3 52 ARMA Models: Application Application of the ARMA(p,q) model in data analysis: Three steps 1.Model specification, i.e., choice of p, q (and d if an ARIMA model is specified) 2.Parameter estimation 3.Diagnostic checking April 6, 2012

Hackl, Econometrics 2, Lecture 3 53 Estimation of ARMA Models The estimation methods are OLS estimation ML estimation AR models: the explanatory variables are Lagged values of the explained variable Y t Uncorrelated with error term ε t OLS estimation April 6, 2012

Hackl, Econometrics 2, Lecture 3 54 MA Models: OLS Estimation MA models: Minimization of sum of squared deviations is not straightforward E.g., for an MA(1) model, S(μ,α) = Σ t [Y t - μ - αΣ j=0 (- α) j (Y t-j-1 – μ)] 2  S(μ,α) is a nonlinear function of parameters  Needs Y t-j-1 for j=0,1,…, i.e., historical Y s, s < 0 Approximate solution from minimization of S*(μ,α) = Σ t [Y t - μ - αΣ j=0 t-2 (- α) j (Y t-j-1 – μ)] 2 Nonlinear minimization, grid search ARMA models combine AR part with MA part April 6, 2012

Hackl, Econometrics 2, Lecture 3 55 ML Estimation Assumption of normally distributed ε t Log likelihood function, conditional on initial values log L(α,θ,μ,σ²) = - (T-1)log(2πσ²)/2 – (1/2) Σ t ε t ²/σ² ε t are functions of the parameters AR(1): ε t = y t - θ 1 y t-1 MA(1): ε t = Σ j=0 t-1 (- α) j y t-j Initial values: y 1 for AR, ε 0 = 0 for MA Extension to exact ML estimator Again, estimation for AR models easier ARMA models combine AR part with MA part April 6, 2012

Hackl, Econometrics 2, Lecture 3 56 Model Specification Based on the Autocorrelation function (ACF) Partial Autocorrelation function (PACF) Structure of AC and PAC functions typical for AR and MA processes Example: MA(1) process: ρ 0 = 1, ρ 1 = α/(1-α²); ρ i = 0, i = 2, 3, …; θ kk = α k, k = 0, 1, … AR(1) process: ρ k = θ k, k = 0, 1,…; θ 00 = 1, θ 11 = θ, θ kk = 0 for k > 1 Empirical ACF and PACF give indications on the process underlying the time series April 6, 2012

Hackl, Econometrics 2, Lecture 3 57 ARMA(p,q)-Processes Condition for AR(p) θ(L)Y t = ε t MA(q) Y t = α (L) ε t ARMA(p,q) θ(L)Y t = α (L) ε t Stationarity roots z i of θ(z)=0: | z i | > 1 always stationary roots z i of θ(z)=0: | z i | > 1 Invertibilityalways invertible roots z i of α (z)=0: | z i | > 1 AC functiondamped, infinite  k = 0 for k > q damped, infinite PAC function  θ kk = 0 for k > p damped, infinite April 6, 2012

Hackl, Econometrics 2, Lecture 3 58 Empirical AC and PAC Function Estimation of the AC and PAC functions AC ρ k : PAC θ kk : coefficient of Y t-k in regression of Y t on Y t-1, …, Y t-k MA(q) process: standard errors for r k, k > q, from √T(r k – ρ k ) → N(0, v k ) with v k = 1 + 2ρ 1 ² + … + 2ρ k ² test of H 0 : ρ 1 = 0: compare √Tr 1 with critical value from N(0,1), etc. AR(p) process: test of H 0 : ρ k = 0 for k > p based on asymptotic distribution April 6, 2012

Hackl, Econometrics 2, Lecture 3 59 Diagnostic Checking ARMA(p,q): Adequacy of choices p and q Analysis of residuals from fitted model: Correct specification: residuals are realizations of white noise Box-Ljung Portmanteau test: for a ARMA(p,q) process follows the Chi-squared distribution with K-p-q df Overfitting Starting point: a general model Comparison with a model with reduced number of parameters: choose model with smallest BIC or AIC AIC: tends to result asymptotically in overparameterized models April 6, 2012

Hackl, Econometrics 2, Lecture 3 60 Example: Price/Earnings Ratio Data set PE: PE = price/earnings, LOGPE = log(PE) Log(PE)  Mean 2.63  Min 1.81  Max 3.60  Std 0.33 April 6, 2012

Hackl, Econometrics 2, Lecture 3 61 PE Ratio: AC and PAC Function April 6, 2012 At level 0.05 significant values:  ACF: k = 4  PACF: k = 2, 4 suggests MA(4), but not very clear

PE Ratio: MA (4) Model MA(4) model for differences log PE t - log PE t-1 April 6, 2012 Hackl, Econometrics 2, Lecture 3 62 Function evaluations: 37 Evaluations of gradient: 11 Model 2: ARMA, using observations (T = 131) Estimated using Kalman filter (exact ML) Dependent variable: d_LOGPE Standard errors based on Hessian coefficient std. error t-ratio p-value const 0, , ,7725 0,4398 theta_1 0, , ,5539 0,5797 theta_2 -0, , ,053 0,0400 ** theta_3 -0, , ,4892 0,6247 theta_4 -0, , ,597 0,1104 Mean dependent var 0, S.D. dependent var 0, Mean of innovations -0, S.D. of innovations 0, Log-likelihood 42,69439 Akaike criterion -73,38877 Schwarz criterion -56,13759 Hannan-Quinn -66,37884

PE Ratio: AR(4) Model AR(4) model for differences log PE t - log PE t-1 April 6, 2012 Hackl, Econometrics 2, Lecture 3 63 Function evaluations: 36 Evaluations of gradient: 9 Model 3: ARMA, using observations (T = 131) Estimated using Kalman filter (exact ML) Dependent variable: d_LOGPE Standard errors based on Hessian coefficient std. error t-ratio p-value const 0, , ,7565 0,4493 phi_1 0, , ,7057 0,4804 phi_2 -0, , ,369 0,0178 ** phi_3 -0, , ,2675 0,7891 phi_4 -0, , ,429 0,0151 ** Mean dependent var 0, S.D. dependent var 0, Mean of innovations -0, S.D. of innovations 0, Log-likelihood 43,35448 Akaike criterion -74,70896 Schwarz criterion -57,45778 Hannan-Quinn -67,69903

Hackl, Econometrics 2, Lecture 3 64 PE Ratio: Various Models Diagnostics for various competing models: Δy t = log PE t - log PE t-1 Best fit for BIC: MA(2) model Δy t = e t – e t-2 AIC: AR(2,4) model Δy t = – Δy t-2 – Δy t-4 + e t April 6, 2012 ModelLagsAIC BICQ 12 p-value MA(4)  AR(4)  MA 2, AR 2, MA  AR

Hackl, Econometrics 2, Lecture 3 65 Time Series Models in GRETL Variable > Unit root tests > (a) Augmented Dickey-Fuller test, (b) ADL- GLS test, (c) KPSS test a)DF test or ADL test with or without constant, trend and squared trend b)DF test or ADL test with or without trend, GLS estimation for demeaning and detrending c)KPSS (Kwiatkowski, Phillips, Schmidt, Shin) test Model > Time Series > ARIMA Estimates an ARMA model, with or without exogenous regressors April 6, 2012

Hackl, Econometrics 2, Lecture 3 66 Your Homework 1.Use Verbeek’s data set INCOME (quarterly data for the total disposable income and for consumer expenditures for 1/1971 to 2/1985 in the UK) and answer the questions a., b., c., d., e., and f. of Exercise 8.3 of Verbeek. Confirm your finding in question c. using the KPSS test. 2.For the AR(2) model y t = θ 1 y t-1 + θ 2 y t-2 + ε t, show that (a) the model can be written as Δy t = δy t-1 - θ 2 Δy t-1 + ε t with δ = θ 1 + θ 2 – 1, and that (b) θ 1 + θ 2 = 1 corresponds to a unit root of the characteristic equation θ(z) = 1 - θ 1 z - θ 2 z 2 = 0. April 6, 2012