R2Y-InterceptTstat YintSlopeTstat Slope Education014%5032915-33887-3 Education211%5001815-29833-2 Education40%4767510880 Education62%455621286431 Education827%4466415530144.

Slides:



Advertisements
Similar presentations
Multiple Regression and Model Building
Advertisements

Statistics and Quantitative Analysis U4320
Simple Regression Model
Statistics for Managers Using Microsoft® Excel 5th Edition
Statistics for Managers Using Microsoft® Excel 5th Edition
Econ 140 Lecture 131 Multiple Regression Models Lecture 13.
1 An example. 2 AirlinePercentage on time Complaints Southwest Continental Northwest US Airways United American
Multiple Regression Models
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Business Statistics: Communicating with Numbers By Sanjiv Jaggia.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 11 th Edition.
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Chapter 15: Model Building
 Independent X – variables that take on only a limited number of values are termed categorical variables, dummy variables, or indicator variables. 
Simple Linear Regression Analysis
Copyright ©2011 Pearson Education 15-1 Chapter 15 Multiple Regression Model Building Statistics for Managers using Microsoft Excel 6 th Global Edition.
Example of Simple and Multiple Regression
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall 15-1 Chapter 15 Multiple Regression Model Building Statistics for Managers using Microsoft.
5.1 Basic Estimation Techniques  The relationships we theoretically develop in the text can be estimated statistically using regression analysis,  Regression.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Model Selection1. 1. Regress Y on each k potential X variables. 2. Determine the best single variable model. 3. Regress Y on the best variable and each.
You want to examine the linear dependency of the annual sales of produce stores on their size in square footage. Sample data for seven stores were obtained.
Regression Maarten Buis Outline Recap Estimation Goodness of Fit Goodness of Fit versus Effect Size transformation of variables and effect.
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
Applied Quantitative Analysis and Practices LECTURE#22 By Dr. Osman Sadiq Paracha.
EQT 373 Chapter 3 Simple Linear Regression. EQT 373 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value.
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Statistical Methods Statistical Methods Descriptive Inferential
Class 23 The most over-rated statistic The four assumptions The most Important hypothesis test yet Using yes/no variables in regressions.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Multiple Regression BPS chapter 28 © 2006 W.H. Freeman and Company.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Discussion of time series and panel models
Regression Analysis Relationship with one independent variable.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Simple Linear Regression In the previous lectures, we only focus on one random variable. In many applications, we often work with a pair of variables.
Lecture 10: Correlation and Regression Model.
Environmental Modeling Basic Testing Methods - Statistics III.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 14-1 Chapter 14 Multiple Regression Model Building Statistics for Managers.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice- Hall, Inc. Chap 14-1 Business Statistics: A Decision-Making Approach 6 th Edition.
Lesson 14 - R Chapter 14 Review. Objectives Summarize the chapter Define the vocabulary used Complete all objectives Successfully answer any of the review.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 10 th Edition.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 14-1 Chapter 14 Multiple Regression Model Building Statistics for Managers.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Multiple Regression Chapter 14.
Simple linear regression and correlation Regression analysis is the process of constructing a mathematical model or function that can be used to predict.
Chapter 12 Simple Regression Statistika.  Analisis regresi adalah analisis hubungan linear antar 2 variabel random yang mempunyai hub linear,  Variabel.
Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.
Stats Methods at IC Lecture 3: Regression.
Chapter 15 Multiple Regression Model Building
Chapter 4 Basic Estimation Techniques
Regression Analysis AGEC 784.
PowerPoint Slides Prepared by Robert F. Brooker, Ph.D. Slide 1
BUSI 410 Business Analytics
Relationship with one independent variable
CHAPTER 29: Multiple Regression*
AP Stats: 3.3 Least-Squares Regression Line
Managerial Economics in a Global Economy
Multiple Regression Models
Simple Linear Regression
Relationship with one independent variable
Example on the Concept of Regression . observation
Regression Part II.
Presentation transcript:

R2Y-InterceptTstat YintSlopeTstat Slope Education014% Education211% Education40% Education62% Education827%

Multiple Regression 13 We use least squares approach again ^ Y = b 0 + b 1 X 1 + b 2 X 2 + … + b k X k Find (b 0, b 1, b 2, …, b k ) to minimize the sum of squared residuals, where k is the number of independent variables.

Multiple Regression 14 Things that are pretty much the same as in simple regression: R 2 S t-tests Additional: F-test Adjusted R 2 Multiple Regression Output

SUMMARY OUTPUT Regression Statistics Multiple R0.709 R Square0.503 Adjusted R Square0.461FStat = Standard Error17748SigF = Observations52 CoefficientsStandard Errort Stat Intercept Education Education Education Education

Multiple Regression 16 H 0 :  1 =  2 = …=  k = 0 (None of the Xs help explain Y) H 1 : Not all  s are 0 (At least one X is useful) H 0 : R 2 = 0 is an equivalent hypothesis

Multiple Regression 17  Allows for the comparison of models with different numbers of variables.  “Penalizes" or adjusts the regular R 2 for the number of variables used.

 For the simple education regression, the model using the Education8 variable which had an R2 of 27% and an adjusted R2 of 25.2%.  For the multiple education regression, the model had an R2 of 50% and an adjusted R2 of 46.1%.  This tells us that in comparison the multiple regression model is more explanatory than the simple regression model.

Multiple Regression 19 Explained variation = R 2, k dof Unexplained variation = 1 - R 2,n-k-1 dof

 Have considered the education variables individually: 5 separate regressions.  Have considered all education variables simultaneously: 1 regression.  Need a method for considering various subsets and modeling of a general multiple variable model.  With 11 variables, there are =2047 possible regressions. It is generally impracticable to consider all possible combinations.

Model Selection11 1. Regress Y on each k potential X variables. 2. Determine the best single variable model. 3. Regress Y on the best variable and each of the remaining k-1 variables. 4. Determine the best model that includes the previous best variable and one new best variable. 5. If either the adjusted-R 2 declines, the standard error of the regression increases, the F-test fails, the t-statistic of the best variable is insignificant, or the coefficients are theoretically inconsistent, STOP, and use the previous best model. Repeat 2-4 until stopped or an all variable model has been reached.

R2Y-IntT YIntSlopeT Slope Age83% Prior Experience45% Alpha Experience67% Education42% Executive76% Gender3% Education014% Education211% Education40% Education62% Education827%

 The starting point for the best regression model is the R2. The model with the highest R2 is the best model if the following conditions are met.  The t-statistics indicate that all of the coefficients are statistically significant.  The coefficients and the model are consistent with a desired theoretical model.  If the conditions are not met, select the next best model, highest R2.

 The best candidate model is using the variable Age: R2 is 83% and the t-statistics of the coefficients are all statistically significant. The sign and scale of the coefficients are plausible. However, it is unlikely that the company would choose to construct as a matter of theory a salary model based on age.  The next best candidate model is using the variable Executive: R2 is 76% and the t-statistics are all statistically significant. The sign and scale of the coefficients are plausible. There is no conceptual business objection to the model.

 Including the Executive variable, add in turn each of the remaining variables in constructing a two- variable model. This requires ten separate regressions.  This process is continued until the stopping criteria are met: adjusted-R2 declines, standard error increases, the F-test fails for all models, the t-statistics for the best model are not significant, the sign and scale of the coefficients are conceptually contradictory or an irreducible theoretical contradictions are reached.  The maximum number of multiple regressions required for this process is: …1 = 55. This is a vast improvement over 2047.