Model Parameter Stability

Slides:



Advertisements
Similar presentations
Overview of Lecture Parametric vs Non-Parametric Statistical Tests.
Advertisements

Lecture 2 ANALYSIS OF VARIANCE: AN INTRODUCTION
Econometric Modelling
Cointegration and Error Correction Models
Multiple Regression.
F-tests continued.
Autocorrelation and Heteroskedasticity
Inference in the Simple Regression Model
Assumptions underlying regression analysis
Things to do in Lecture 1 Outline basic concepts of causality
Chapter 18: The Chi-Square Statistic
Multiple Regression and Model Building
The Multiple Regression Model.
CHOW TEST AND DUMMY VARIABLE GROUP TEST
EC220 - Introduction to econometrics (chapter 5)
Applied Econometrics Second edition
CHAPTER 8 MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF INFERENCE
Correlation and regression
Instrumental Variables Estimation and Two Stage Least Square
Chapter 8 Linear Regression © 2010 Pearson Education 1.
Some Topics In Multivariate Regression. Some Topics We need to address some small topics that are often come up in multivariate regression. I will illustrate.
Objectives (BPS chapter 24)
1 Lecture 4:F-Tests SSSII Gwilym Pryce
1 Module II Lecture 4:F-Tests Graduate School 2004/2005 Quantitative Research Methods Gwilym Pryce
Chapter 13 Multiple Regression
Chapter 12 Multiple Regression
The Simple Regression Model
Econ 140 Lecture 181 Multiple Regression Applications III Lecture 18.
Multiple Regression Applications
1 Ka-fu Wong University of Hong Kong Pulling Things Together.
Chapter 11 Multiple Regression.
Topic 3: Regression.
An Introduction to Logistic Regression
SIMPLE LINEAR REGRESSION
Ch. 14: The Multiple Regression Model building
So are how the computer determines the size of the intercept and the slope respectively in an OLS regression The OLS equations give a nice, clear intuitive.
Multiple Linear Regression Analysis
Hypothesis Tests and Confidence Intervals in Multiple Regressors
Lecture 3-2 Summarizing Relationships among variables ©
SIMPLE LINEAR REGRESSION
Inference for regression - Simple linear regression
Chapter 13: Inference in Regression
Hypothesis Testing. Distribution of Estimator To see the impact of the sample on estimates, try different samples Plot histogram of answers –Is it “normal”
Hypothesis Testing in Linear Regression Analysis
Returning to Consumption
Non-Linear Models. Non-Linear Growth models many models cannot be transformed into a linear model The Mechanistic Growth Model Equation: or (ignoring.
1 1 Slide © 2005 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 Slide Simple Linear Regression Part A n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n.
What is the MPC?. Learning Objectives 1.Use linear regression to establish the relationship between two variables 2.Show that the line is the line of.
Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Copyright © 2011 Pearson Education, Inc. The Simple Regression Model Chapter 21.
Lecture 8 Simple Linear Regression (cont.). Section Objectives: Statistical model for linear regression Data for simple linear regression Estimation.
Part 2: Model and Inference 2-1/49 Regression Models Professor William Greene Stern School of Business IOMS Department Department of Economics.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 21 The Simple Regression Model.
Chapter 22: Building Multiple Regression Models Generalization of univariate linear regression models. One unit of data with a value of dependent variable.
6. Simple Regression and OLS Estimation Chapter 6 will expand on concepts introduced in Chapter 5 to cover the following: 1) Estimating parameters using.
Dynamic Models, Autocorrelation and Forecasting ECON 6002 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s notes.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
4-1 MGMG 522 : Session #4 Choosing the Independent Variables and a Functional Form (Ch. 6 & 7)
Stats Methods at IC Lecture 3: Regression.
The simple linear regression model and parameter estimation
F-tests continued.
BINARY LOGISTIC REGRESSION
26134 Business Statistics Week 5 Tutorial
Chow test.
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Chapter 9 Dummy Variables Undergraduated Econometrics Page 1
Presentation transcript:

Model Parameter Stability

Problem caused by breaks Recall that the below equation can be thought of as a condition expectation equation or an estimation of average relationships between variables. If a break occurs in this model during the sample period, then the OLS regression estimated over the full sample will estimate a relationship that holds on average, in the sense that the estimate combines the two different periods. Depending on the location and size of the break, the “average” regression function can be quite different from the true regression function. This leads to poor forecasts.

Parameter Stability testing So far we have estimated regression of the type: Where the implicit assumption is the parameters (βs) are constant over the entire sample. In financial time series large fluctuations are common possibly invalidating this assumption. We can test this assumption using parameter stability tests. If the break point is known the Chow test can be used. The idea is to split the data into sub-periods and estimate up to three models, for each of the sub-parts and the whole sample and then compare the RSS from the models. The test can be simplified by using dummy variables to categorize the sub- periods around the known break point.

How do we decide the sub-parts to use? As a rule of thumb, we could use all or some of the following: Plot the dependent variable over time and split the data accordingly to any obvious structural changes in the series. Split the data according to any known important historical events (e.g. stock market crash, new government elected) Intuition here is that a major change in the underlying environment in which y is measured will cause a structural change in the model’s parameters.

Steps in performing the Chow test Split the data into two sub-periods. Use a dummy variable to categorise these two periods. Create interaction terms using this dummy variable for each explanatory variable in the model Run a regression ignoring the categorisation. This is a pooled regression using the whole sample without the dummy or interaction terms (This would be the restricted model). Run a second regression using the whole sample but now including a dummy variable and all the interaction terms (a fully interacted model) to distinguished between sub periods. (This is the unrestricted model; you are allowing for the possibility of two sub periods in the model). We can thus form an F-test which is the difference between the RSS’s.

Steps in performing the Chow test T=number of observations k=number of parameters who stability are being tested. RSSunrestricted = RSS from the regression in step 5. This is equivalent to the sum of the RSS from a regression on a sub-period before the break point plus the RSS from a regression on a sub-period after the breakpoint. This is a test of how much the RSS for the whole sample is bigger than the sum of the RSS of the two sub-samples. If coefficients don't change much then RSS will not rise much upon imposing restriction; that is we have stable parameters in our model!

STATA: Characteristic line of a Mutual Fund Consider a CAPM model of Century Share Funds excess returns: Using as sample from 1996m6 to 2012m2 How stable will the OLS parameter estimates be in the above model? As a first step plot the dependent variable over time.

STATA: Chow test of known break Choosing the most extreme value date (2001m3) we perform a chow test using the following. From the resultant F test statistic we reject the null hypothesis of parameter stability at the 1% level

What if structural break point isn't know? These previous tests will work well only if the structural break point is specified. In reality we may only know it lies within a given range of the sample period. Use a modified version of Chow Test know as Quandt Likelihood Ratio Test. QLR test automatically computes the usual Chow F-test repeatedly with differing break dates. The Break date with the largest F-statistic is chosen. QLR follows a non-standard distribution and is well behaved only when range of possible break points are far away from end of the sample.

As the Max QLR statistic is greater than 5% critical value we reject the null hypothesis of parameter stability.

Recursive estimation and Stability If the researcher believes the series has a structural break but cannot identify where then can use recursive estimation; recursive least squares. It involves starting with a sub-sample(normally the minimum required for estimation), estimating a regression, then sequentially adding one observation at a time, then rerunning the regression until the end of the sample is reached. Intuition is that parameter estimates at the start of this procedure will appear unstable; but as sample size increases the estimates should settle down. The results can then be plotted to give an excellent visually impression of how stable the parameters are.

Recursive estimation and Stability Two statistical tests based on recursive least squares are the CUSUM and CUSUM2. They are general tests of the stability of a time series process. The are derived from the residuals of the recursive estimation; recursive residuals. Under the null of perfect parameter stability The CUSUM statistic should be zero The CUSUM squared should range from zero at start of period and end at one. In practice both are normally plotted with a 95% confidence bands and the Null is rejected of the plot strays outside this band.

STATA: CSF characteristic line Run a recursive estimation method starting with 2 observations: rolling, recursive window(2)clear: reg erCENSX er_GSPC, r This is a rolling window regression command in Stata that start with a sample of three and repeats the estimation adding one observation on each time. We can visually analyse the parameter estimates using: tsset end tsline _b_cons if end>tm(1997m1), ytitle(Intercept) xtitle(" ") name(alpha, replace) nodraw tsline _b_er_GSPC if end>tm(1997m1), ytitle(CAPM Beta estimate) xtitle(" ") name(beta, replace) nodraw graph combine alpha beta, title(Century Share Fund CAPM stability) r(2)

The recursive intercept fluctuates but decreases gradual with a sharp drop downward tick around 2000m1. Similarly the recursive CAPM beta fluctuates but sets to a fairly constant level beyond 200m1.

STATA: Apple’s characteristic line To run the CUSUM squared test in Stata we can use a user written command cusum6 erCENSX er_GSPC The above command will graph the CUSUM squared statistic along with a 95% confidence band. The Null hypothesis of parameter stability is rejected if the statistic strays outside this band. As the CUSUM squared statistics strays out the 95% confidence band we reject the null of model parameter stability

Solution to Failing stability tests Model is re-specified by including additional variables. Separate estimations are conducted for each of the sub- samples. If the Null cannot be rejected it is valid to pool all of the sample together in a single regression. In our Century Share fund example there is some evidence to suggest its characteristic line would be better modelled with consideration given to break points. As a first step the model should be re-estimated using a dummy variable specification and the previous recursive least squares tests performed again.