AR- MA- och ARMA-.

Slides:



Advertisements
Similar presentations
Autocorrelation Functions and ARIMA Modelling
Advertisements

Dates for term tests Friday, February 07 Friday, March 07
Model Building For ARIMA time series
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 7: Box-Jenkins Models – Part II (Ch. 9) Material.
Applied Business Forecasting and Planning
Time Series Building 1. Model Identification
R. Werner Solar Terrestrial Influences Institute - BAS Time Series Analysis by means of inference statistical methods.
Economics 310 Lecture 25 Univariate Time-Series Methods of Economic Forecasting Single-equation regression models Simultaneous-equation regression models.
How should these data be modelled?. Identification step: Look at the SAC and SPAC Looks like an AR(1)- process. (Spikes are clearly decreasing in SAC.
Tutorial for solution of Assignment week 40 “Forecasting monthly values of Consumer Price Index Data set: Swedish Consumer Price Index” sparetime.
Non-Seasonal Box-Jenkins Models
BABS 502 Lecture 9 ARIMA Forecasting II March 23, 2009.
ARIMA-models for non-stationary time series
Time series analysis - lecture 3 Forecasting using ARIMA-models Step 1. Assess the stationarity of the given time series of data and form differences if.
Modeling Cycles By ARMA
Some more issues of time series analysis Time series regression with modelling of error terms In a time series regression model the error terms are tentatively.
Data Sources The most sophisticated forecasting model will fail if it is applied to unreliable data Data should be reliable and accurate Data should be.
1 ECON 240C Lecture 8. 2 Outline: 2 nd Order AR Roots of the quadratic Roots of the quadratic Example: capumfg Example: capumfg Polar form Polar form.
BABS 502 Lecture 8 ARIMA Forecasting II March 16 and 21, 2011.
1 ECON 240C Lecture 8. 2 Outline: 2 nd Order AR Roots of the quadratic Roots of the quadratic Example: change in housing starts Example: change in housing.
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Modern methods The classical approach: MethodProsCons Time series regression Easy to implement Fairly easy to interpret Covariates may be added (normalization)
1 ECON 240C Lecture 8. 2 Part I. Economic Forecast Project Santa Barbara County Seminar Santa Barbara County Seminar  April 22, 2004 (April 17, 2003)
Non-Seasonal Box-Jenkins Models
Modern methods The classical approach: MethodProsCons Time series regression Easy to implement Fairly easy to interpret Covariates may be added (normalization)
BOX JENKINS METHODOLOGY
Box Jenkins or Arima Forecasting. H:\My Documents\classes\eco346\Lectures\chap ter 7\Autoregressive Models.docH:\My Documents\classes\eco346\Lectures\chap.
STAT 497 LECTURE NOTES 2.
The Box-Jenkins Methodology for ARIMA Models
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 8: Estimation & Diagnostic Checking in Box-Jenkins.
Linear Stationary Processes. ARMA models. This lecture introduces the basic linear models for stationary processes. Considering only stationary processes.
#1 EC 485: Time Series Analysis in a Nut Shell. #2 Data Preparation: 1)Plot data and examine for stationarity 2)Examine ACF for stationarity 3)If not.
Intervention models Something’s happened around t = 200.
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 2 review: Quizzes 7-12* (*) Please note that.
Tutorial for solution of Assignment week 39 “A. Time series without seasonal variation Use the data in the file 'dollar.txt'. “
Lecture 7: Forecasting: Putting it ALL together. The full model The model with seasonality, quadratic trend, and ARMA components can be written: Ummmm,
Autoregressive Integrated Moving Average (ARIMA) Popularly known as the Box-Jenkins methodology.
It’s About Time Mark Otto U. S. Fish and Wildlife Service.
John G. Zhang, Ph.D. Harper College
K. Ensor, STAT Spring 2005 Model selection/diagnostics Akaike’s Information Criterion (AIC) –A measure of fit plus a penalty term for the number.
Autocorrelation, Box Jenkins or ARIMA Forecasting.
1 Chapter 3:Box-Jenkins Seasonal Modelling 3.1Stationarity Transformation “Pre-differencing transformation” is often used to stablize the seasonal variation.
Time Series Basics Fin250f: Lecture 8.1 Spring 2010 Reading: Brooks, chapter
STAT 497 LECTURE NOTE 9 DIAGNOSTIC CHECKS 1. After identifying and estimating a time series model, the goodness-of-fit of the model and validity of the.
MULTIVARIATE TIME SERIES & FORECASTING 1. 2 : autocovariance function of the individual time series.
Auto Regressive, Integrated, Moving Average Box-Jenkins models A stationary times series can be modelled on basis of the serial correlations in it. A non-stationary.
Time Series Analysis Lecture 11
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Forecasting (prediction) limits Example Linear deterministic trend estimated by least-squares Note! The average of the numbers 1, 2, …, t is.
Case 2 Review Brad Barker, Benjamin Milroy, Matt Sonnycalb, Kristofer Still, Chandhrika Venkataraman Time Series - February 2013.
1 Chapter 5 : Volatility Models Similar to linear regression analysis, many time series exhibit a non-constant variance (heteroscedasticity). In a regression.
The Box-Jenkins (ARIMA) Methodology
Seasonal ARIMA FPP Chapter 8.
Ch16: Time Series 24 Nov 2011 BUSI275 Dr. Sean Ho HW8 due tonight Please download: 22-TheFed.xls 22-TheFed.xls.
Introduction to stochastic processes
Subodh Kant. Auto-Regressive Integrated Moving Average Also known as Box-Jenkins methodology A type of linear model Capable of representing stationary.
STAT 497 LECTURE NOTES 3 STATIONARY TIME SERIES PROCESSES
Analysis of financial data Anders Lundquist Spring 2010.
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
Advanced Forecasting Copyright (c) 2008 by The McGraw-Hill Companies. This material is intended solely for educational use by licensed users of LearningStats.
Case study 4: Multiplicative Seasonal ARIMA Model
Lecture 8 ARIMA Forecasting II
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
Model Building For ARIMA time series
Regression with Autocorrelated Errors
Quality In Manufacturing : US Minting and Nickel Weight
BOX JENKINS (ARIMA) METHODOLOGY
Chap 7: Seasonal ARIMA Models
Presentation transcript:

AR- MA- och ARMA-

First try: AR(1) Use MINITAB’s ARIMA-procedure

ARIMA Model ARIMA model for CPIChnge Final Estimates of Parameters Type Coef StDev T P AR 1 0,8247 0,1048 7,87 0,000 Constant 0,7634 0,3347 2,28 0,030 Mean 4,354 1,909 Number of observations: 33 Residuals: SS = 111,236 (backforecasts excluded) MS = 3,588 DF = 31 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 25,9 32,2 * * DF 10 22 * * P-Value 0,004 0,075 * *

ARIMA Model ARIMA model for CPIChnge Final Estimates of Parameters Type Coef StDev T P AR 1 0,8247 0,1048 7,87 0,000 Constant 0,7634 0,3347 2,28 0,030 Mean 4,354 1,909 Number of observations: 33 Residuals: SS = 111,236 (backforecasts excluded) MS = 3,588 DF = 31 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 25,9 32,2 * * DF 10 22 * * P-Value 0,004 0,075 * *

Ljung-Box statistic: where n is the sample size d is the degree of nonseasonal differencing used to tranform original series to be stationary. Nonseasonal means taking differences at lags nearby, which can be written (1–B)d rl2(â) is the sample autocorrelation at lag l for the residuals of the estimated model. K is a number of lags covering multiples of seasonal cycles, e.g. 12, 24, 36,… for monthly data

Under the assumption of no correlation left in the residuals the Ljung-Box statistic is chi-square distributed with K – nC degrees of freedom, where nC is the number of estimated parameters in model except for the constant   A low P-value for any K should be taken as evidence for correlated residuals, and thus the estimated model must be revised.

 Problems with residuals at nonseasonal level ARIMA Model ARIMA model for CPIChnge Final Estimates of Parameters Type Coef StDev T P AR 1 0,8247 0,1048 7,87 0,000 Constant 0,7634 0,3347 2,28 0,030 Mean 4,354 1,909 Number of observations: 33 Residuals: SS = 111,236 (backforecasts excluded) MS = 3,588 DF = 31 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 25,9 32,2 * * DF 10 22 * * P-Value 0,004 0,075 * * Low P-value for K=12.  Problems with residuals at nonseasonal level

Study SAC and SPAC for the original series:

PACF look not fully consistent with AR(1) More than one significant spike (2 it seems) If an AR(p)-model is correct, the ACF should decrease exponentially (montone or oscillating) and PACF should have exactly p significant spikes  Try an AR(2)

OK! Still not OK ARIMA Model ARIMA model for CPIChnge Final Estimates of Parameters Type Coef StDev T P AR 1 1,1872 0,1625 7,31 0,000 AR 2 -0,4657 0,1624 -2,87 0,007 Constant 1,3270 0,2996 4,43 0,000 Mean 4,765 1,076 Number of observations: 33 Residuals: SS = 88,6206 (backforecasts excluded) MS = 2,9540 DF = 30 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 19,8 25,4 * * DF 9 21 * * P-Value 0,019 0,231 * * OK! Still not OK

Might still be problematic. Could it be the case of an Moving Average (MA) model? MA(1): are still assumed to be uncorrelated and identically distributed with mean zero and constant variance

is in effect a moving average with weights MA(q): always stationary mean= is in effect a moving average with weights for the (unobserved) values

Try an MA(1):

ARIMA Model ARIMA model for CPIChnge Final Estimates of Parameters Type Coef StDev T P MA 1 -0,9649 0,1044 -9,24 0,000 Constant 4,8018 0,5940 8,08 0,000 Mean 4,8018 0,5940 Number of observations: 33 Residuals: SS = 104,185 (backforecasts excluded) MS = 3,361 DF = 31 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 33,8 67,6 * * DF 10 22 * * P-Value 0,000 0,000 * *

Still seems to be problems with residuals Look again at ACF and PACF of original series:

The pattern corresponds neither with AR(p), nor with MA(q) Could it be a combination of these two? Auto Regressive Moving Average (ARMA) model

mean value calculations more difficult ARMA(p,q): stationarity conditions harder to define mean value calculations more difficult identification patterns exist, but might be complex: exponentially decreasing patterns or sinusoidal decreasing patterns in both ACF and PACF (no cutting of at a certain lag)

Always try to keep p and q small. Try an ARMA(1,1):

ARIMA Model ARIMA model for CPIChnge Unable to reduce sum of squares any further Final Estimates of Parameters Type Coef StDev T P AR 1 0,6513 0,1434 4,54 0,000 MA 1 -0,9857 0,0516 -19,11 0,000 Constant 1,5385 0,4894 3,14 0,004 Mean 4,412 1,403 Number of observations: 33 Residuals: SS = 61,8375 (backforecasts excluded) MS = 2,0613 DF = 30 Modified Box-Pierce (Ljung-Box) Chi-Square statistic Lag 12 24 36 48 Chi-Square 9,6 17,0 * * DF 9 21 * * P-Value 0,386 0,713 * *

Calculating forecasts For AR(p) models quite simple: is set to 0 for all values of k

For MA(q) ?? MA(1): If we e.g. would set and equal to 0 the forecast would constantly be . which is not desirable.

Note that Similar investigations for ARMA-models.