MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS

Slides:



Advertisements
Similar presentations
CHOW TEST AND DUMMY VARIABLE GROUP TEST
Advertisements

EC220 - Introduction to econometrics (chapter 5)
Christopher Dougherty EC220 - Introduction to econometrics (chapter 5) Slideshow: slope dummy variables Original citation: Dougherty, C. (2012) EC220 -
Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: a Monte Carlo experiment Original citation: Dougherty, C. (2012) EC220.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 11) Slideshow: adaptive expectations Original citation: Dougherty, C. (2012) EC220.
1 XX X1X1 XX X Random variable X with unknown population mean  X function of X probability density Sample of n observations X 1, X 2,..., X n : potential.
1 THE NORMAL DISTRIBUTION In the analysis so far, we have discussed the mean and the variance of a distribution of a random variable, but we have not said.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 4) Slideshow: interactive explanatory variables Original citation: Dougherty, C. (2012)
1 PROBABILITY DISTRIBUTION EXAMPLE: X IS THE SUM OF TWO DICE red This sequence provides an example of a discrete random variable. Suppose that you.
Random effects estimation RANDOM EFFECTS REGRESSIONS When the observed variables of interest are constant for each individual, a fixed effects regression.
MEASUREMENT ERROR 1 In this sequence we will investigate the consequences of measurement errors in the variables in a regression model. To keep the analysis.
1 ASSUMPTIONS FOR MODEL C: REGRESSIONS WITH TIME SERIES DATA Assumptions C.1, C.3, C.4, C.5, and C.8, and the consequences of their violations are the.
EC220 - Introduction to econometrics (chapter 9)
00  sd  0 –sd  0 –1.96sd  0 +sd 2.5% CONFIDENCE INTERVALS probability density function of X null hypothesis H 0 :  =  0 In the sequence.
EXPECTED VALUE OF A RANDOM VARIABLE 1 The expected value of a random variable, also known as its population mean, is the weighted average of its possible.
1 A MONTE CARLO EXPERIMENT In the previous slideshow, we saw that the error term is responsible for the variations of b 2 around its fixed component 
Christopher Dougherty EC220 - Introduction to econometrics (chapter 3) Slideshow: prediction Original citation: Dougherty, C. (2012) EC220 - Introduction.
SLOPE DUMMY VARIABLES 1 The scatter diagram shows the data for the 74 schools in Shanghai and the cost functions derived from a regression of COST on N.
1 In the previous sequence, we were performing what are described as two-sided t tests. These are appropriate when we have no information about the alternative.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 10) Slideshow: maximum likelihood estimation of regression coefficients Original citation:
DERIVING LINEAR REGRESSION COEFFICIENTS
Christopher Dougherty EC220 - Introduction to econometrics (chapter 5) Slideshow: Chow test Original citation: Dougherty, C. (2012) EC220 - Introduction.
1 In a second variation, we shall consider the model shown above. x is the rate of growth of productivity, assumed to be exogenous. w is now hypothesized.
1 PREDICTION In the previous sequence, we saw how to predict the price of a good or asset given the composition of its characteristics. In this sequence,
1 UNBIASEDNESS AND EFFICIENCY Much of the analysis in this course will be concerned with three properties of estimators: unbiasedness, efficiency, and.
FIXED EFFECTS REGRESSIONS: WITHIN-GROUPS METHOD The two main approaches to the fitting of models using panel data are known, for reasons that will be explained.
Christopher Dougherty EC220 - Introduction to econometrics (review chapter) Slideshow: sampling and estimators Original citation: Dougherty, C. (2012)
DUMMY CLASSIFICATION WITH MORE THAN TWO CATEGORIES This sequence explains how to extend the dummy variable technique to handle a qualitative explanatory.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 12) Slideshow: autocorrelation, partial adjustment, and adaptive expectations Original.
THE DUMMY VARIABLE TRAP 1 Suppose that you have a regression model with Y depending on a set of ordinary variables X 2,..., X k and a qualitative variable.
1 INTERACTIVE EXPLANATORY VARIABLES The model shown above is linear in parameters and it may be fitted using straightforward OLS, provided that the regression.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 8) Slideshow: measurement error Original citation: Dougherty, C. (2012) EC220 - Introduction.
THE FIXED AND RANDOM COMPONENTS OF A RANDOM VARIABLE 1 In this short sequence we shall decompose a random variable X into its fixed and random components.
CONSEQUENCES OF AUTOCORRELATION
ALTERNATIVE EXPRESSION FOR POPULATION VARIANCE 1 This sequence derives an alternative expression for the population variance of a random variable. It provides.
CONFLICTS BETWEEN UNBIASEDNESS AND MINIMUM VARIANCE
1 t TEST OF A HYPOTHESIS RELATING TO A POPULATION MEAN The diagram summarizes the procedure for performing a 5% significance test on the slope coefficient.
EC220 - Introduction to econometrics (chapter 8)
F TEST OF GOODNESS OF FIT FOR THE WHOLE EQUATION 1 This sequence describes two F tests of goodness of fit in a multiple regression model. The first relates.
MULTIPLE REGRESSION WITH TWO EXPLANATORY VARIABLES: EXAMPLE 1 This sequence provides a geometrical interpretation of a multiple regression model with two.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 12) Slideshow: footnote: the Cochrane-Orcutt iterative process Original citation: Dougherty,
A.1The model is linear in parameters and correctly specified. PROPERTIES OF THE MULTIPLE REGRESSION COEFFICIENTS 1 Moving from the simple to the multiple.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 9) Slideshow: instrumental variable estimation: variation Original citation: Dougherty,
Christopher Dougherty EC220 - Introduction to econometrics (chapter 6) Slideshow: multiple restrictions and zero restrictions Original citation: Dougherty,
1 We will now look at the properties of the OLS regression estimators with the assumptions of Model B. We will do this within the context of the simple.
1 COVARIANCE, COVARIANCE AND VARIANCE RULES, AND CORRELATION Covariance The covariance of two random variables X and Y, often written  XY, is defined.
1 Y SIMPLE REGRESSION MODEL Suppose that a variable Y is a linear function of another variable X, with unknown parameters  1 and  2 that we wish to estimate.
1 We will continue with a variation on the basic model. We will now hypothesize that p is a function of m, the rate of growth of the money supply, as well.
COST 11 DUMMY VARIABLE CLASSIFICATION WITH TWO CATEGORIES 1 This sequence explains how you can include qualitative explanatory variables in your regression.
Christopher Dougherty EC220 - Introduction to econometrics (review chapter) Slideshow: alternative expression for population variance Original citation:
Definition of, the expected value of a function of X : 1 EXPECTED VALUE OF A FUNCTION OF A RANDOM VARIABLE To find the expected value of a function of.
4 In our case, the starting point should be the model with all the lagged variables. DYNAMIC MODEL SPECIFICATION General model with lagged variables Static.
INSTRUMENTAL VARIABLES 1 Suppose that you have a model in which Y is determined by X but you have reason to believe that Assumption B.7 is invalid and.
1 INSTRUMENTAL VARIABLE ESTIMATION OF SIMULTANEOUS EQUATIONS In the previous sequence it was asserted that the reduced form equations have two important.
1 ESTIMATORS OF VARIANCE, COVARIANCE, AND CORRELATION We have seen that the variance of a random variable X is given by the expression above. Variance.
1 CHANGES IN THE UNITS OF MEASUREMENT Suppose that the units of measurement of Y or X are changed. How will this affect the regression results? Intuitively,
SEMILOGARITHMIC MODELS 1 This sequence introduces the semilogarithmic model and shows how it may be applied to an earnings function. The dependent variable.
1 REPARAMETERIZATION OF A MODEL AND t TEST OF A LINEAR RESTRICTION Linear restrictions can also be tested using a t test. This involves the reparameterization.
F TESTS RELATING TO GROUPS OF EXPLANATORY VARIABLES 1 We now come to more general F tests of goodness of fit. This is a test of the joint explanatory power.
1 We will illustrate the heteroscedasticity theory with a Monte Carlo simulation. HETEROSCEDASTICITY: MONTE CARLO ILLUSTRATION 1 standard deviation of.
Christopher Dougherty EC220 - Introduction to econometrics (review chapter) Slideshow: independence of two random variables Original citation: Dougherty,
1 COMPARING LINEAR AND LOGARITHMIC SPECIFICATIONS When alternative specifications of a regression model have the same dependent variable, R 2 can be used.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 1) Slideshow: simple regression model Original citation: Dougherty, C. (2012) EC220.
FOOTNOTE: THE COCHRANE–ORCUTT ITERATIVE PROCESS 1 We saw in the previous sequence that AR(1) autocorrelation could be eliminated by a simple manipulation.
VARIABLE MISSPECIFICATION I: OMISSION OF A RELEVANT VARIABLE In this sequence and the next we will investigate the consequences of misspecifying the regression.
Introduction to Econometrics, 5th edition
Introduction to Econometrics, 5th edition
Introduction to Econometrics, 5th edition
Introduction to Econometrics, 5th edition
Introduction to Econometrics, 5th edition
Presentation transcript:

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS The F test approach to testing a restriction may be extended to cover the case where we wish to test whether several restrictions are valid simultaneously. 1

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS Suppose that there are p restrictions. Let RSSU be RSS for the fully unrestricted model and RSSR be RSS for the model where all p restrictions have been imposed. The test statistic is then as shown. 2

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS The numerator is the reduction in RSS comparing the fully restricted model with the unrestricted model, divided by the number of degrees of freedom lost when the restrictions are relaxed. 3

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS The denominator is the RSS for the unrestricted model, divided by the number of degrees of freedom remaining when that model is fitted. k is the number of parameters in the unrestricted model. 4

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS The t test approach can be used, as before, to test individual restrictions in isolation. 5

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS You will often encounter references to zero restrictions. This just means that a particular parameter is hypothesized to be equal to zero, for example, b5 in the model above. Taken in isolation, the appropriate test is of course the t test. 6

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS It can be considered to be a special case of the t test of a restriction discussed above where there is no need for reparameterization. The test statistic is just the t statistic for the parameter in question. 7

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS or both and Likewise the testing of multiple zero restrictions can be thought of as a special case of the testing of multiple restrictions. The example shown is for a model where there are two zero restrictions. 8

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS or both and The F test of the joint explanatory power of a group of explanatory variables discussed in Section 3.5 in the text can be thought of in this way. 9

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Even the F statistic for the equation as a whole can be treated as a special case. Here the unrestricted and restricted models are as shown. 10

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Fitting restricted model: When we fit the restricted model, we find that the OLS estimator of b1 is the sample mean of Y (see Exercise 1.3). 11

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Fitting restricted model: for all i Hence the fitted value of Y in all observations is equal to the sample mean of Y. 12

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Fitting restricted model: for all i Now we know that for any OLS regression, TSS = ESS + RSS. 13

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Fitting restricted model: for all i Hence TSS = RSS for the restricted regression. 14

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Fitting restricted model: for all i Obviously, if there are no explanatory variables, none of the variation in Y is explained by the model and so RSS is equal to TSS. 15

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Here is the F statistic for the comparison of the unrestricted model with all of the X variables and the restricted model with only the intercept. 16

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients We have just seen that RSS from the restricted version is equal to TSS. 17

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Now we refer to the decomposition of TSS in the case of the unrestricted regression. This is similar to the decomposition for the restricted model, with the difference that RSSU will in be smaller than RSSR and ESSU will be positive, instead of zero. 18

MULTIPLE RESTRICTIONS AND ZERO RESTRICTIONS RSSU Unrestricted model: RSSR Restricted model: Restrictions: Hypotheses: at least one of the slope coefficients Given the decomposition for the unrestricted version, we can rewrite the F statistic as shown. This is the expression for the F statistic for the equation as a whole that was given in Section 3.5. 19

Copyright Christopher Dougherty 2012. These slideshows may be downloaded by anyone, anywhere for personal use. Subject to respect for copyright and, where appropriate, attribution, they may be used as a resource for teaching an econometrics course. There is no need to refer to the author. The content of this slideshow comes from Section 6.5 of C. Dougherty, Introduction to Econometrics, fourth edition 2011, Oxford University Press. Additional (free) resources for both students and instructors may be downloaded from the OUP Online Resource Centre http://www.oup.com/uk/orc/bin/9780199567089/. Individuals studying econometrics on their own who feel that they might benefit from participation in a formal course should consider the London School of Economics summer school course EC212 Introduction to Econometrics http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx or the University of London International Programmes distance learning course EC2020 Elements of Econometrics www.londoninternational.ac.uk/lse. 2012.11.10