2010 ECON Hypothesis Testing 2: Joint Restrictions Testing joint hypotheses Chow test Objectives
2010 ECON Y i = 0 + 1 X 1i + 2 X 1i 2 + 3 X 2i + i Can the variation in X 1 explain the variation in Y significantly? Y i = 0 + 1 X 1i + 2 X 2i + 3 X 3i + i Can X 2 and X 3 explain Y significantly simultaneously? 1. Adding or Dropping Variables
2010 ECON Regression model: Y i = 0 + 1 X 1i + 2 X 2i + … + K X Ki + i Ho: 1 =0, 2 = 0, , M = 0 H A : i 0 for at least one i = 1, 2, , M. Unconstrained model: Y i = 0 + 1 X 1i + 2 X 2i + … + K X Ki + i ESS U, RSS U. Constrained model: (delete M regressors) Y i = 0 + M+1 X M+1,i + … + K X Ki + i ESS C ESS U, RSS C RSS U.
2010 ECON Unconstrained model: Y i = 0 + 1 X 1i + 2 X 2i + … + K X Ki + i ESS U, RSS U. Constrained model: (delete M regressors) Y i = 0 + M+1 X M+1,i + … + K X Ki + i ESS C ESS U, RSS C RSS U.
2010 ECON If is normally distributed, then RSS C – RSS U has a chi-square distribution. Total variation in Y: Unexplained variation in the unconstrained model: RSS U = e U 2 Increased unexplained variation in the constrained model: RSS C – RSS U = e C 2 – e U 2
2010 ECON F 0 f(F) F Distribution 1- FcFc Ho: 1 =0, 2 = 0, , M = 0 H A : i 0 for at least one i = 1, 2, , M.
2010 ECON Y i = 0 + 1 X 1i + … + K X Ki + i Unconstrained model RSS U with N – K – 1 degrees of freedom Constrained model with M restrictions RSS C with N – K – 1 + M degrees of freedom Critical value: F c = F M,N-K-1, Reject H o if F > F c. Testing Procedures
2010 ECON Example 1: Consider the following regression model: Y i = 0 + 1 X 1i + 2 X 2i + 3 X 3i + i. What are the unconstrained and constrained models that are used to test the following null hypotheses? a. 1 = 0 b. 2 = 0 and 3 = 0 c. k = 0 for k = 1, 2, 3
2010 ECON Exclusion Restriction: 1 variable Unconstrained model: uniGPA = 0 + 1 hsGPA + 2 HKAL + 3 skipped + Restriction: 3 =0 Constrained model: uniGPA = 0 + 1 hsGPA + 2 HKAL + Example 2
2010 ECON Example 2 (Cont’d): Regression results Unconstrained model uniGPA’ = hsGPA +.015HKAL -.083skipped se (0.332) (0.094) (0.011) (0.026) R 2 = , N = 141, RSS U = Constrained model uniGPA’ = hsGPA +.009HKAL se (0.341) (0.096) (0.011) R 2 = , N = 141, RSS C =
2010 ECON H o : 3 = 0; H A : 3 0 (RSS C RSS U )/M RSS U /(N K – 1 ) F = ( )/ /( ) = = t = = Note that when there is only one restriction, F = t 2. Example 2 (Cont’d): Hypothesis testing
2010 ECON Exclusion Restrictions: 2 variables TR i = 0 + 1 P i + 2 A i + 3 A 2 i + i Example 3: A general functional form H 0 : = 0, 3 = 0 H A : H 0 not true Testing the significance of advertising expenses on revenue. Constrained model: TR i = 0 + 1 P i + i
2010 ECON Next run the constrained regression by dropping A i and A i 2 to get RSS C. First run unconstrained regression to get RSS U. (RSS C RSS U )/M RSS U /(N K – 1) F = = TR = *** – *** P *** A – * A 2 se (3.74) (1.58) (0.42) (0.016) R 2 = 0.878, N = 78, RSS U = 2, ^ TR = *** P se (8.85) (4.01) R 2 = , N = 78, RSS C = 20, ^
2010 ECON Remark: Relation between F and R 2 RSS C = TSS(1 - R C 2 ) RSS U = TSS(1 - R U 2 )
2010 ECON To test the overall significance of the regression equation, the null and alternative hypotheses are A Special Case: Testing the Overall Significance of the Regression Equation Y i = 0 + 1 X 1i + 2 X 2i + … + K X Ki + i H 0 : 1 = 2 = = K = 0 H A : H 0 not true
2010 ECON The test statistic is ESS / K = average explained sum of squares RSS / (N – K – 1) = average unexplained sum of squares Larger F means higher explanatory power. Degrees of freedom: 1 = K, 2 = N – K – 1 Reject H o if F > F c = F 1, 2,
2010 ECON Example 4: Picking restaurant locations pp. 75 – 78) Y i = 0 + 1 N i + 2 P i + 3 I i + i N: Competition P: Population I: Income If the model cannot explain the variation of Y: 1 = 2 = 3 = 0.
2010 ECON Example 4: Picking Restaurant Locations (Table 3.1) Yhat = – 9075N P I se (12800) (2053) (0.0727) (0.5433) R 2 = , N = 33, RSS = , TSS = F = ESS/K RSS/(N-K-1)
2010 ECON
2010 ECON Example 6 : Consider the following estimated saving function: Shat = Y W r se (-3.30) (2.09) (1.75) (3.81) Adj.R 2 = 0.962, F = 251.5, RSS = , N = 31 Another regression has been run with the same data set, Shat = Y se (2.1) (17.2) Adj.R 2 = 0.908, F = 296.4, RSS = , N = 31. Are the coefficients for wealth and interest rate jointly significant at 1% level?
2010 ECON Are Two Equations Equal?
2010 ECON Suppose there are 2 groups of data: Group A: (Y i, X 2i,…,X Ki ), i = 1,…,N 1. Group B: (Y i, X 2i,…,X Ki ), i = N 1 +1,…,N If the relation between X & Y is different, then (1) Y i = X 1i +…+ K X Ki + 1i, i = 1,…,N 1 (2) Y i = 0 + 1 X 1i +…+ K X Ki + 2i, i = N 1 +1,…,N If the relation between is identical for both groups, (3) Y i = 0 + 1 X 1i +…+ K X Ki + i, i = 1,…,N
2010 ECON Should the two groups be treated as one group? 1. H o : k = k, k= 0,1,…,K; H 1 : k k for at least one k 2. Estimate equations (1) and (2) to get RSS 1 and RSS 2. RSS U = RSS 1 + RSS Estimate equation (3) to get RSS C.
2010 ECON Reject H o if F > F K+1,(N-2K-2), . Remarks: a. This method is called the Chow test. b.It is assumed that the variances of the two groups are equal. c. One can use dummy variables to test for this change of equation structure.
2010 ECON Example 7 : Structural change in the US saving function (BE4_Tab0809) savings = 0 + 1 Income +
2010 ECON Example 7 (Cont’d) : Empirical results of different periods Dep. variable ConstantIndep. V X R 2 SEERSS N Y (70-81) ( ) ( ) Y (82-95) ( ) ( ) Y (70-95) ( ) (0.0424) F = (RSS C - RSS U )/(K+1) RSS U / (N-2K-2) = ( – – )/ 2 ( ) / (26-2*2) F = F c = F 2,22, 0.01 = 5.72 >
2010 ECON Exercises: 1.Find the following critical values a. = 5%, 1 = 3, 2 = 10; b. = 5%, 1 = 12, 2 = 5; c. = 1%, 1 = 2, 2 = 19;
2010 ECON Testing the joint significance of the estimated coefficients of X 3, X 4 and X 5. ( = 5%)
2010 ECON Consider the following regression results using the weight-height data of some students in Test whether the weight-height relation is different for male and female. AllFemaleMale Intercept *** ( ) * ( ) ( ) Height *** (0.1110) *** (0.1291) * (0.2946) R2R N RSS