FORECASTING. Minimum Mean Square Error Forecasting.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Dates for term tests Friday, February 07 Friday, March 07
CHAPTER 8 More About Estimation. 8.1 Bayesian Estimation In this chapter we introduce the concepts related to estimation and begin this by considering.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 10) Slideshow: introduction to maximum likelihood estimation Original citation: Dougherty,
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Model Building For ARIMA time series
Part II – TIME SERIES ANALYSIS C5 ARIMA (Box-Jenkins) Models
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
Christopher Dougherty EC220 - Introduction to econometrics (chapter 13) Slideshow: stationary processes Original citation: Dougherty, C. (2012) EC220 -
Time Series Building 1. Model Identification
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 13 Nonlinear and Multiple Regression.
The General Linear Model. The Simple Linear Model Linear Regression.
STAT 497 LECTURE NOTES 8 ESTIMATION.
FITTING MODELS WITH NONSTATIONARY TIME SERIES 1 Detrending Early macroeconomic models tended to produce poor forecasts, despite having excellent sample-period.
Forecasting JY Le Boudec 1. Contents 1.What is forecasting ? 2.Linear Regression 3.Avoiding Overfitting 4.Differencing 5.ARMA models 6.Sparse ARMA models.
Open Methods Chapter 6 The Islamic University of Gaza
Chapter 3 Simple Regression. What is in this Chapter? This chapter starts with a linear regression model with one explanatory variable, and states the.
Curve-Fitting Regression
1 Ka-fu Wong University of Hong Kong Pulling Things Together.
Prediction and model selection
ARIMA Forecasting Lecture 7 and 8 - March 14-16, 2011
Chapter 11 Multiple Regression.
Non-Seasonal Box-Jenkins Models
Linear Systems The definition of a linear equation given in Chapter 1 can be extended to more variables; any equation of the form for real numbers.
LIAL HORNSBY SCHNEIDER
BOX JENKINS METHODOLOGY
Box Jenkins or Arima Forecasting. H:\My Documents\classes\eco346\Lectures\chap ter 7\Autoregressive Models.docH:\My Documents\classes\eco346\Lectures\chap.
Chapter 15 Forecasting Copyright © 2011 Pearson Addison-Wesley. All rights reserved. Slides by Niels-Hugo Blunch Washington and Lee University.
Least-Squares Regression
ARMA models Gloria González-Rivera University of California, Riverside
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Lecture 8: Estimation & Diagnostic Checking in Box-Jenkins.
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
TIME SERIES ANALYSIS Time Domain Models: Red Noise; AR and ARMA models LECTURE 7 Supplementary Readings: Wilks, chapters 8.
#1 EC 485: Time Series Analysis in a Nut Shell. #2 Data Preparation: 1)Plot data and examine for stationarity 2)Examine ACF for stationarity 3)If not.
Intervention models Something’s happened around t = 200.
Slide 1 DSCI 5340: Predictive Modeling and Business Forecasting Spring 2013 – Dr. Nick Evangelopoulos Exam 2 review: Quizzes 7-12* (*) Please note that.
Curve-Fitting Regression
Autoregressive Integrated Moving Average (ARIMA) Popularly known as the Box-Jenkins methodology.
Models for Non-Stationary Time Series The ARIMA(p,d,q) time series.
Vector Norms and the related Matrix Norms. Properties of a Vector Norm: Euclidean Vector Norm: Riemannian metric:
Introduction to Time Series Analysis
Exponential and Logarithmic Functions Logarithms Exponential and Logarithmic Functions Objectives Switch between exponential and logarithmic form.
Data Modeling Patrice Koehl Department of Biological Sciences National University of Singapore
MULTIVARIATE TIME SERIES & FORECASTING 1. 2 : autocovariance function of the individual time series.
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
K. Ensor, STAT Spring 2005 Estimation of AR models Assume for now mean is 0. Estimate parameters of the model, including the noise variace. –Least.
Linear Filters. denote a bivariate time series with zero mean. Let.
Review and Summary Box-Jenkins models Stationary Time series AR(p), MA(q), ARMA(p,q)
The Box-Jenkins (ARIMA) Methodology
MODELS FOR NONSTATIONARY TIME SERIES By Eni Sumarminingsih, SSi, MM.
Seasonal ARIMA FPP Chapter 8.
Example 13.3 Quarterly Sales at Intel Regression-Based Trend Models.
Lecture 39 Numerical Analysis. Chapter 7 Ordinary Differential Equations.
Introduction to stochastic processes
Time Series Analysis PART II. Econometric Forecasting Forecasting is an important part of econometric analysis, for some people probably the most important.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
STA302/1001 week 11 Regression Models - Introduction In regression models, two types of variables that are studied:  A dependent variable, Y, also called.
Convergence of Taylor Series Objective: To find where a Taylor Series converges to the original function; approximate trig, exponential and logarithmic.
Data Modeling Patrice Koehl Department of Biological Sciences
Applied Econometric Time Series Third Edition
Chapter 6: Autoregressive Integrated Moving Average (ARIMA) Models
Model Building For ARIMA time series
CHAPTER 16 ECONOMIC FORECASTING Damodar Gujarati
Chapter 6: Forecasting/Prediction
6.1.1 Deriving OLS OLS is obtained by minimizing the sum of the square errors. This is done using the partial derivative 6.
BOX JENKINS (ARIMA) METHODOLOGY
Presentation transcript:

FORECASTING

Minimum Mean Square Error Forecasting

 AR(1) ARIMA Forecasting We shall first illustrate many of the ideas with the simple AR(1) process with a nonzero mean that satisfies Consider the problem of forecasting one time unit into the future. Replacing t by t + 1 in Equation (9.3.1), we have

 However, Equation (9.3.7) can also be solved to yield an explicit expression for the forecasts in terms of the observed history of the series. Iterating backward on l in Equation (9.3.7), we have

 As a numerical example, consider the AR(1) model that we have fitted to the industrial color property time series.  The maximum likelihood estimation results were partially shown in Exhibit 7.7

 For illustration purposes, we assume that the estimates φ = and μ = are true values. The final forecasts may then be rounded  The last observed value of the color property is 67, so we would forecast one time period ahead as†

 For lead time 2, we have from Equation (9.3.7) Alternatively, we can use Equation (9.3.8):

 At lead 5, we have  and by lead 10 the forecast is which is very nearly μ (= )

 MA(1) consider the MA(1) case with nonzero mean: Again replacing t by t + 1 and taking conditional expectations of both sides, we have However, for an invertible model, e t is a function of Y 1, Y 2, …, Y t and so

 Using Equations (9.3.19) and (9.3.20), we have the one-step-ahead forecast for an invertible MA(1) expressed as  one-step-ahead forecast error is

 For longer lead times, we have  But, for l > 1, both e t + l and e t + l − 1 are independent of Y 1, Y 2,…, Y t.  Consequently,these conditional expected values are the unconditional expected values, namely zero, and we have

 ARMA(1,1) model. We have With and, more generally, using Equation (9.3.30) to get the recursion started.

 Equations (9.3.30) and (9.3.31) can be rewritten in terms of the process mean and then solved by iteration to get the alternative explicit expression

 ARIMA(1,1,1)  so that  Thus

 For a given confidence level 1 − α, we could use a standard normal percentile, z 1 − α/2, to claim that  or, equivalently, Prediction Limits

 Thus we may be (1 − α)100% confident that the future observation Y t + l will be contained within the prediction limits

Differencing Suppose we are interested in forecasting a series whose model involves a first difference to achieve stationarity. Two methods of forecasting can be considered: 1.forecasting the original nonstationary series, for example by using the difference equation form of Equation (9.3.28), with φ’s replaced by ϕ ’s throughout, or 2.forecasting the stationary differenced series W t = Y t − Y t − 1 and then “undoing” the difference by summing to obtain the forecast in original terms. Forecasting Transformed Series

Log Transformations  As we saw earlier, it is frequently appropriate to model the logarithms of the original series—a nonlinear transformation.  Let Y t denote the original series value and let Z t =log(Y t ).  It can be shown that we always have