2010 ECON 7710 5.1 Hypothesis Testing 2: Joint Restrictions Testing joint hypotheses Chow test Objectives.

Slides:



Advertisements
Similar presentations
Multiple Regression.
Advertisements

Chapter 9: Simple Regression Continued
Managerial Economics in a Global Economy
Hypothesis Testing Steps in Hypothesis Testing:
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
Econ 488 Lecture 5 – Hypothesis Testing Cameron Kaplan.
CHAPTER 8 MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF INFERENCE
Lecture 3 (Ch4) Inferences
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Econ 140 Lecture 81 Classical Regression II Lecture 8.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
4.3 Confidence Intervals -Using our CLM assumptions, we can construct CONFIDENCE INTERVALS or CONFIDENCE INTERVAL ESTIMATES of the form: -Given a significance.
8. Heteroskedasticity We have already seen that homoskedasticity exists when the error term’s variance, conditional on all x variables, is constant: Homoskedasticity.
Classical Regression III
The Multiple Regression Model Prepared by Vera Tabakova, East Carolina University.
Lecture 3 Cameron Kaplan
1 1 Slide © 2009, Econ-2030 Applied Statistics-Dr Tadesse Chapter 10: Comparisons Involving Means n Introduction to Analysis of Variance n Analysis of.
Multiple Regression Applications
1 Regression Analysis Regression used to estimate relationship between dependent variable (Y) and one or more independent variables (X). Consider the variable.
Chapter 11 Multiple Regression.
Multiple Regression and Correlation Analysis
Ch. 14: The Multiple Regression Model building
Statistical Methods in Computer Science Hypothesis Testing II: Single-Factor Experiments Ido Dagan.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 13-1 Chapter 13 Introduction to Multiple Regression Statistics for Managers.
Lecture 5 Correlation and Regression
Hypothesis Tests and Confidence Intervals in Multiple Regressors
ECON 7710, Heteroskedasticity What is heteroskedasticity? What are the consequences? How is heteroskedasticity identified? How is heteroskedasticity.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
5.1 Basic Estimation Techniques  The relationships we theoretically develop in the text can be estimated statistically using regression analysis,  Regression.
Multiple Regression. In the previous section, we examined simple regression, which has just one independent variable on the right side of the equation.
1 Tests with two+ groups We have examined tests of means for a single group, and for a difference if we have a matched sample (as in husbands and wives)
1 1 Slide © 2005 Thomson/South-Western Chapter 13, Part A Analysis of Variance and Experimental Design n Introduction to Analysis of Variance n Analysis.
Analysis of Variance: Some Review and Some New Ideas
Multiple Regression Analysis Multivariate Analysis.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Lecturer: Kem Reat, Viseth, PhD (Economics)
Welcome to Econ 420 Applied Regression Analysis Study Guide Week Six.
1Spring 02 First Derivatives x y x y x y dy/dx = 0 dy/dx > 0dy/dx < 0.
Y X 0 X and Y are not perfectly correlated. However, there is on average a positive relationship between Y and X X1X1 X2X2.
Chapter 5 Demand Estimation Managerial Economics: Economic Tools for Today’s Decision Makers, 4/e By Paul Keat and Philip Young.
May 2004 Prof. Himayatullah 1 Basic Econometrics Chapter 5: TWO-VARIABLE REGRESSION: Interval Estimation and Hypothesis Testing.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
Previous Lecture: Phylogenetics. Analysis of Variance This Lecture Judy Zhong Ph.D.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Environmental Modeling Basic Testing Methods - Statistics III.
2010, ECON Hypothesis Testing 1: Single Coefficient Review of hypothesis testing Testing single coefficient Interval estimation Objectives.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics S eventh Edition By Brase and Brase Prepared by: Lynn Smith.
14-1 Qualitative Variable - Example Frequently we wish to use nominal-scale variables—such as gender, whether the home has a swimming pool, or whether.
MEASURES OF GOODNESS OF FIT The sum of the squares of the actual values of Y (TSS: total sum of squares) could be decomposed into the sum of the squares.
Econ 3790: Business and Economic Statistics Instructor: Yogesh Uppal
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Lesson 14 - R Chapter 14 Review. Objectives Summarize the chapter Define the vocabulary used Complete all objectives Successfully answer any of the review.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 14-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
CHAPTER 10: ANALYSIS OF VARIANCE(ANOVA) Leon-Guerrero and Frankfort-Nachmias, Essentials of Statistics for a Diverse Society.
Jacek Wallusch _________________________________ Statistics for International Business Lecture 10: Introduction to Hypothesis Testing.
Lecture #25 Tuesday, November 15, 2016 Textbook: 14.1 and 14.3
Basic Estimation Techniques
Multiple Regression Analysis: Inference
Correlation and Simple Linear Regression
Econ 3790: Business and Economic Statistics
LESSON 24: INFERENCES USING REGRESSION
Chi-square and F Distributions
Correlation and Simple Linear Regression
Goodness of Fit The sum of squared deviations from the mean of a variable can be decomposed as follows: TSS = ESS + RSS This decomposition can be used.
Simple Linear Regression and Correlation
Chapter 7: The Normality Assumption and Inference with OLS
Chapter 9 Dummy Variables Undergraduated Econometrics Page 1
Introduction to Regression
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

2010 ECON Hypothesis Testing 2: Joint Restrictions Testing joint hypotheses Chow test Objectives

2010 ECON Y i =  0 +  1 X 1i +  2 X 1i 2 +  3 X 2i +  i Can the variation in X 1 explain the variation in Y significantly? Y i =  0 +  1 X 1i +  2 X 2i +  3 X 3i +  i Can X 2 and X 3 explain Y significantly simultaneously? 1. Adding or Dropping Variables

2010 ECON Regression model: Y i =  0 +  1 X 1i +  2 X 2i + … +  K X Ki +  i Ho:  1 =0,  2 = 0, ,  M = 0 H A :  i  0 for at least one i = 1, 2, , M. Unconstrained model: Y i =  0 +  1 X 1i +  2 X 2i + … +  K X Ki +  i  ESS U, RSS U. Constrained model: (delete M regressors) Y i =  0 +  M+1 X M+1,i + … +  K X Ki +  i  ESS C  ESS U, RSS C  RSS U.

2010 ECON Unconstrained model: Y i =  0 +  1 X 1i +  2 X 2i + … +  K X Ki +  i  ESS U, RSS U. Constrained model: (delete M regressors) Y i =  0 +  M+1 X M+1,i + … +  K X Ki +  i  ESS C  ESS U, RSS C  RSS U.

2010 ECON If  is normally distributed, then RSS C – RSS U has a chi-square distribution. Total variation in Y: Unexplained variation in the unconstrained model: RSS U =  e U 2 Increased unexplained variation in the constrained model: RSS C – RSS U =  e C 2 –  e U 2

2010 ECON F 0 f(F) F Distribution 1-   FcFc Ho:  1 =0,  2 = 0, ,  M = 0 H A :  i  0 for at least one i = 1, 2, , M.

2010 ECON Y i =  0 +  1 X 1i + … +  K X Ki +  i Unconstrained model  RSS U with N – K – 1 degrees of freedom Constrained model with M restrictions  RSS C with N – K – 1 + M degrees of freedom Critical value: F c = F M,N-K-1,  Reject H o if F > F c. Testing Procedures

2010 ECON Example 1: Consider the following regression model: Y i =  0 +  1 X 1i +  2 X 2i +  3 X 3i +  i. What are the unconstrained and constrained models that are used to test the following null hypotheses? a.  1 = 0 b.  2 = 0 and  3 = 0 c.  k = 0 for k = 1, 2, 3

2010 ECON Exclusion Restriction: 1 variable Unconstrained model: uniGPA =  0 +  1 hsGPA +  2 HKAL +  3 skipped +  Restriction:  3 =0 Constrained model: uniGPA =  0 +  1 hsGPA +  2 HKAL +  Example 2

2010 ECON Example 2 (Cont’d): Regression results Unconstrained model uniGPA’ = hsGPA +.015HKAL -.083skipped se (0.332) (0.094) (0.011) (0.026) R 2 = , N = 141, RSS U = Constrained model uniGPA’ = hsGPA +.009HKAL se (0.341) (0.096) (0.011) R 2 = , N = 141, RSS C =

2010 ECON H o :  3 = 0; H A :  3  0 (RSS C  RSS U )/M RSS U /(N  K – 1 ) F = (  )/ /( ) = = t = = Note that when there is only one restriction, F = t 2. Example 2 (Cont’d): Hypothesis testing

2010 ECON Exclusion Restrictions: 2 variables TR i =  0 +  1 P i +  2 A i +  3 A 2 i +  i Example 3: A general functional form H 0 :   = 0,  3 = 0 H A : H 0 not true Testing the significance of advertising expenses on revenue. Constrained model: TR i =  0 +  1 P i +  i

2010 ECON Next run the constrained regression by dropping A i and A i 2 to get RSS C. First run unconstrained regression to get RSS U. (RSS C  RSS U )/M RSS U /(N  K – 1) F = = TR = *** – *** P *** A – * A 2 se (3.74) (1.58) (0.42) (0.016) R 2 = 0.878, N = 78, RSS U = 2, ^ TR = *** P se (8.85) (4.01) R 2 = , N = 78, RSS C = 20, ^

2010 ECON Remark: Relation between F and R 2 RSS C = TSS(1 - R C 2 ) RSS U = TSS(1 - R U 2 )

2010 ECON To test the overall significance of the regression equation, the null and alternative hypotheses are A Special Case: Testing the Overall Significance of the Regression Equation Y i =  0 +  1 X 1i +  2 X 2i + … +  K X Ki +  i H 0 :  1 =  2 =  =  K = 0 H A : H 0 not true

2010 ECON The test statistic is ESS / K = average explained sum of squares RSS / (N – K – 1) = average unexplained sum of squares Larger F means higher explanatory power. Degrees of freedom: 1 = K, 2 = N – K – 1 Reject H o if F > F c = F 1, 2, 

2010 ECON Example 4: Picking restaurant locations pp. 75 – 78) Y i =  0 +  1 N i +  2 P i +  3 I i +  i N: Competition P: Population I: Income If the model cannot explain the variation of Y:  1 =  2 =  3 = 0.

2010 ECON Example 4: Picking Restaurant Locations (Table 3.1) Yhat = – 9075N P I se (12800) (2053) (0.0727) (0.5433) R 2 = , N = 33, RSS = , TSS = F = ESS/K RSS/(N-K-1)

2010 ECON

2010 ECON Example 6 : Consider the following estimated saving function: Shat = Y W r se (-3.30) (2.09) (1.75) (3.81) Adj.R 2 = 0.962, F = 251.5, RSS = , N = 31 Another regression has been run with the same data set, Shat = Y se (2.1) (17.2) Adj.R 2 = 0.908, F = 296.4, RSS = , N = 31. Are the coefficients for wealth and interest rate jointly significant at 1% level?

2010 ECON Are Two Equations Equal?

2010 ECON Suppose there are 2 groups of data: Group A: (Y i, X 2i,…,X Ki ), i = 1,…,N 1. Group B: (Y i, X 2i,…,X Ki ), i = N 1 +1,…,N If the relation between X & Y is different, then (1) Y i = X 1i +…+ K X Ki +  1i, i = 1,…,N 1 (2) Y i =  0 +  1 X 1i +…+  K X Ki +  2i, i = N 1 +1,…,N If the relation between is identical for both groups, (3) Y i =  0 +  1 X 1i +…+  K X Ki +  i, i = 1,…,N

2010 ECON Should the two groups be treated as one group? 1. H o : k =  k, k= 0,1,…,K; H 1 : k   k for at least one k 2. Estimate equations (1) and (2) to get RSS 1 and RSS 2. RSS U = RSS 1 + RSS Estimate equation (3) to get RSS C.

2010 ECON Reject H o if F > F K+1,(N-2K-2), . Remarks: a. This method is called the Chow test. b.It is assumed that the variances of the two groups are equal. c. One can use dummy variables to test for this change of equation structure.

2010 ECON Example 7 : Structural change in the US saving function (BE4_Tab0809) savings =  0 +  1 Income + 

2010 ECON Example 7 (Cont’d) : Empirical results of different periods Dep. variable ConstantIndep. V X R 2 SEERSS N Y (70-81) ( ) ( ) Y (82-95) ( ) ( ) Y (70-95) ( ) (0.0424) F = (RSS C - RSS U )/(K+1) RSS U / (N-2K-2) = ( – – )/ 2 ( ) / (26-2*2) F = F c = F 2,22, 0.01 = 5.72 >

2010 ECON Exercises: 1.Find the following critical values a.  = 5%, 1 = 3, 2 = 10; b.  = 5%, 1 = 12, 2 = 5; c.  = 1%, 1 = 2, 2 = 19;

2010 ECON Testing the joint significance of the estimated coefficients of X 3, X 4 and X 5. (  = 5%)

2010 ECON Consider the following regression results using the weight-height data of some students in Test whether the weight-height relation is different for male and female. AllFemaleMale Intercept *** ( ) * ( ) ( ) Height *** (0.1110) *** (0.1291) * (0.2946) R2R N RSS