General Linear Regression

Slides:



Advertisements
Similar presentations
SADC Course in Statistics Revision of key regression ideas (Session 10)
Advertisements

Statistical Analysis SC504/HS927 Spring Term 2008 Session 6: Week 22: 29 th February OLS (3): multiple regression and dummy coding.
Class 18 – Thursday, Nov. 11 Omitted Variables Bias
The Regression Equation  A predicted value on the DV in the bi-variate case is found with the following formula: Ŷ = a + B (X1)
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Chapter 7.3 Dummy Variables.
FIN822 Li11 Binary independent and dependent variables.
(c) 2007 IUPUI SPEA K300 (4392) Outline Least Squares Methods Estimation: Least Squares Interpretation of estimators Properties of OLS estimators Variance.
Summary of previous lecture Introduction of dummy variable
Linear Regression with One Regression
January 6, afternoon session 1 Statistics Micro Mini Multiple Regression January 5-9, 2008 Beth Ayers.
© 2000 Prentice-Hall, Inc. Chap Multiple Regression Models.
Multiple Regression Models. The Multiple Regression Model The relationship between one dependent & two or more independent variables is a linear function.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Economics 20 - Prof. Anderson
Ch. 14: The Multiple Regression Model building
Empirical Estimation Review EconS 451: Lecture # 8 Describe in general terms what we are attempting to solve with empirical estimation. Understand why.
1Prof. Dr. Rainer Stachuletz Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 5. Dummy Variables.
CHAPTER 6 ECONOMETRICS x x x x x Dummy Variable Regression Models Dummy, or indicator, variables take on values of 0 or 1 to indicate the presence or absence.
1 Javier Aparicio División de Estudios Políticos, CIDE Primavera Regresión.
 Independent X – variables that take on only a limited number of values are termed categorical variables, dummy variables, or indicator variables. 
Multiple Linear Regression A method for analyzing the effects of several predictor variables concurrently. - Simultaneously - Stepwise Minimizing the squared.
Multiple Regression Analysis The principles of Simple Regression Analysis can be extended to two or more explanatory variables. With two explanatory variables.
Chapter 14 Introduction to Multiple Regression Sections 1, 2, 3, 4, 6.
Multiple Regression Analysis Multivariate Analysis.
Moderation & Mediation
1 1 Slide Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple Coefficient of Determination n Model Assumptions n Testing.
CHAPTER 9 DUMMY VARIABLE REGRESSION MODELS
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Introduction to regression 3D. Interpretation, interpolation, and extrapolation.
Multiple Regression BPS chapter 28 © 2006 W.H. Freeman and Company.
Copyright © 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Dummy Variable Regression Models chapter ten.
Lecture 25 Summary of previous lecture Specification Bias Detection methods.
WARM-UP Do the work on the slip of paper (handout)
Chapter 6 (cont.) Difference Estimation. Recall the Regression Estimation Procedure 2.
Categorical Independent Variables STA302 Fall 2013.
28. Multiple regression The Practice of Statistics in the Life Sciences Second Edition.
9.1 Chapter 9: Dummy Variables A Dummy Variable: is a variable that can take on only 2 possible values: yes, no up, down male, female union member, non-union.
Dummy Variables; Multiple Regression July 21, 2008 Ivan Katchanovski, Ph.D. POL 242Y-Y.
Categorical Independent Variables STA302 Fall 2015.
Multiple Regression Learning Objectives n Explain the Linear Multiple Regression Model n Interpret Linear Multiple Regression Computer Output n Test.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
The General Linear Model. Estimation -- The General Linear Model Formula for a straight line y = b 0 + b 1 x x y.
Lecturer: Ing. Martina Hanová, PhD. Business Modeling.
QUALITATIVE EXPLANATORY VARIABLES REGRESSION MODELS
Chapter 14 Introduction to Multiple Regression
Multiple Regression Analysis with Qualitative Information
Simple Bivariate Regression
Linear Regression with One Regression
CHAPTER 3 Describing Relationships
Understanding Regression Analysis Basics
Multiple Regression Analysis and Model Building
Multiple Regression Analysis with Qualitative Information
Introduction to logistic regression a.k.a. Varbrul
Soc 3306a: ANOVA and Regression Models
QUALITATIVE EXPLANATORY VARIABLES REGRESSION MODELS
Multiple Regression Analysis with Qualitative Information
David Pieper, Ph.D. STATISTICS David Pieper, Ph.D.
Multiple Regression BPS 7e Chapter 29 © 2015 W. H. Freeman and Company.
Indicator Variables Often, a data set will contain categorical variables which are potential predictor variables. To include these categorical variables.
3 4 Chapter Describing the Relation between Two Variables
Soc 3306a Lecture 11: Multivariate 4
Introduction to Logistic Regression
Determine the type of correlation between the variables.
Multiple Regression Analysis with Qualitative Information
Regression and Categorical Predictors
Chapter 9 Dummy Variables Undergraduated Econometrics Page 1
Financial Econometrics Fin. 505
Cases. Simple Regression Linear Multiple Regression.
Regression and Correlation of Data
Decomposition of Sum of Squares
Presentation transcript:

General Linear Regression Linear regression may have more than one regressors (multiple regression) How many regressors are needed? 1, 10, 100, 1000? Parsimony of a model The smaller (# regressors), the better as long as having same explanatory power (c) 2007 IUPUI SPEA K300 (4392)

Good Regression Models Specification that makes sense Parsimonious models Supported by reliable data Large N Larger explanatory power (R2) Less sensitive to outliers Less sensitive to including additional regressors (c) 2007 IUPUI SPEA K300 (4392)

Significant Coefficients Needed? Should all coefficients be significant to be a good model? Not necessarily When # regressors is large (say 100), F test and R2 are less informative. Not likely that all coefficients are significant Regressors of interest: important Regressors for control; less important (c) 2007 IUPUI SPEA K300 (4392)

Dummy Variable What if we want to compare male and female using a linear regression model? A dummy variable is a binary variable that has either 0 or 1. Of course, this is a nominal scale (categorical) whose values indicate names of categories (no substantive meaning) Dummy variables can be used in a linear regression and influence the intercept. (c) 2007 IUPUI SPEA K300 (4392)

Lease Squares Dummy Variable Suppose we have a dummy variable x2 in a linear regression. X2 is 0 for male and 1 for female For male (x2=0), For female (x2=1), For female, intercept is β0+β2 (c) 2007 IUPUI SPEA K300 (4392)

Coefficient of a Dummy Variable How do we interpret the coefficient of a dummy variable x2? β2 is the difference of intercepts of groups 0 and 1 Intercept of group 0: β0 Intercept of group 1: β0+β2 Β2=(β0+β2 )-β0 (c) 2007 IUPUI SPEA K300 (4392)

Illustration (c) 2007 IUPUI SPEA K300 (4392)