Multiple Regression Analysis: Estimation

Slides:



Advertisements
Similar presentations
Properties of Least Squares Regression Coefficients
Advertisements

Multiple Regression Analysis
CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION
The Multiple Regression Model.
Chapter 12 Simple Linear Regression
Chap 12-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 12 Simple Regression Statistics for Business and Economics 6.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Chapter 12 Simple Linear Regression
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
Chapter 13 Multiple Regression
1 Lecture 2: ANOVA, Prediction, Assumptions and Properties Graduate School Social Science Statistics II Gwilym Pryce
The Simple Linear Regression Model: Specification and Estimation
Chapter 10 Simple Regression.
Chapter 12 Simple Regression
Chapter 3 Simple Regression. What is in this Chapter? This chapter starts with a linear regression model with one explanatory variable, and states the.
Econ Prof. Buckles1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
Chapter 12 Multiple Regression
FIN357 Li1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
FIN357 Li1 The Simple Regression Model y =  0 +  1 x + u.
The Simple Regression Model
CHAPTER 4 ECONOMETRICS x x x x x Multiple Regression = more than one explanatory variable Independent variables are X 2 and X 3. Y i = B 1 + B 2 X 2i +
FIN357 Li1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
Chapter 11 Multiple Regression.
Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Chapter 11 Simple Regression
Estimating Demand Functions Chapter Objectives of Demand Estimation to determine the relative influence of demand factors to forecast future demand.
Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.
7.1 Multiple Regression More than one explanatory/independent variable This makes a slight change to the interpretation of the coefficients This changes.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
EQT 373 Chapter 3 Simple Linear Regression. EQT 373 Learning Objectives In this chapter, you learn: How to use regression analysis to predict the value.
Ordinary Least Squares Estimation: A Primer Projectseminar Migration and the Labour Market, Meeting May 24, 2012 The linear regression model 1. A brief.
1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Lecture 10: Correlation and Regression Model.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Multiple Regression I 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Multiple Regression Analysis (Part 1) Terry Dielman.
1 Prof. Dr. Rainer Stachuletz Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
Essentials of Business Statistics: Communicating with Numbers By Sanjiv Jaggia and Alison Kelly Copyright © 2014 by McGraw-Hill Higher Education. All rights.
Introduction to Multiple Regression Lecture 11. The Multiple Regression Model Idea: Examine the linear relationship between 1 dependent (Y) & 2 or more.
Chapter 12 Simple Linear Regression n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n Testing.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Multiple Regression Analysis: Estimation. Multiple Regression Model y = ß 0 + ß 1 x 1 + ß 2 x 2 + …+ ß k x k + u -ß 0 is still the intercept -ß 1 to ß.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
Lecture 6 Feb. 2, 2015 ANNOUNCEMENT: Lab session will go from 4:20-5:20 based on the poll. (The majority indicated that it would not be a problem to chance,
The simple linear regression model and parameter estimation
Lecture 11: Simple Linear Regression
Chapter 14 Introduction to Multiple Regression
Multiple Regression Analysis: Estimation
Correlation and Simple Linear Regression
The Simple Linear Regression Model: Specification and Estimation
Multiple Regression Analysis: Inference
THE LINEAR REGRESSION MODEL: AN OVERVIEW
Chapter 11 Simple Regression
ECONOMETRICS DR. DEEPTI.
Multiple Regression Analysis
Correlation and Simple Linear Regression
Chapter 6: MULTIPLE REGRESSION ANALYSIS
The regression model in matrix form
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Correlation and Simple Linear Regression
Simple Linear Regression
Simple Linear Regression and Correlation
BEC 30325: MANAGERIAL ECONOMICS
Linear Regression Summer School IFPRI
The Multiple Regression Model
BEC 30325: MANAGERIAL ECONOMICS
Introduction to Regression
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Multiple Regression Analysis: Estimation

Multiple Regression Model y = ß0 + ß1x1 + ß2x2 + …+ ßkxk + u ß0 is still the intercept ß1 to ßk all called slope parameters u is still the error term (or disturbance term) Zero mean assumption E(u) = 0 Still minimize the sum of squared residuals

Multiple Regression Model: Example Demand Estimation: Dependent variable: Q, tile cases (in 1000 of cases) Right-hand side variables: tile price per case (p), income per capita I (in 1000 of $), and advertising expenditure A (in 1000 $) Regression: Q = ß0 + ß1P + ß2I + ß3A + u Interpretation: ß1 measures the effects of the tile price on the tile consumption, holding all other factors fixed ß2 represents the effects of income, holding all other factors fixed ß3 represents the effects of advertising, holding all other factors fixed

Q = 17.513 – 0.296P + 0.066I + 0.036A What is the impact of a price change on tile scales? What is the impact of a change in income on tile scales? What is the impact of a change in advertising expenditures on tile scales? Calculation of own-price elasticity? Calculation of income elasticity? Calculation of advertising elasticity?

Random Sampling Collecting sales data of 23 tile stores in 2002 in the market For each observation, Qi = ß0 + ß1Pi + ß2Ii + ß3Ai + ui Goal: Estimate ß0, ß1, ß2, ß3 Dependent Variable Price Income Advertising Q1 P1 I1 A1 Q2 P2 I2 A2 Q3 P3 I3 A3 … Q23 P23 I23 A23 Using OLS to estimate the coefficients to minimize the sum of squared errors.

The Generic Multiple Regression Model Estimation of regression parameters: Least Squares (no knowledge of the distribution of the error or disturbance terms is required). The use of the matrix notation allows a view of how the data are housed in software programs.

Components of the Model Endogenous Variables—dependent variables, values of which are determined within the system. Exogenous Variables—determined outside the system but influence the system by affecting the values of the endogenous variables. Structural Parameters—estimated using statistical techniques and relevant data. Lagged Endogenous Variables Lagged Exogenous Variables Predetermined Variables

The Disturbance (or Error) Term Stochastic, a random variable. Statistical distribution often normal. Captures: Omission of the influence of other variables. Measurement error. Recognition that any regression model is a parsimonious stochastic representation of reality. Also recognition that any regression model is stochastic and not deterministic.

OLS Estimates Associated with the Multiple Regression Model

The Gauss-Markov Theorem Given the assumptions below, it can be shown that the OLS estimator is “BLUE.” - Best - Linear - Unbiased - Estimator Assumptions: - Linear in parameters - Corr (εi, εj) = 0 - Zero mean - No perfect collinearity - Homoscedasticity

Communication and Aims for the Analyst

Communication Aims Bottom Line A technician can run a program and get output. An analyst must interpret the findings from examination of this output. There are no bonus points to be given to terrific hackers but poor analysts. Aims Improve your ability in developing models to conduct structural analysis and to forecast with some accuracy. Enhance your ability in interpreting and communicating the results, so as to improve your decision-making. Bottom Line The analyst transforms the economic model/idea to a mathematical/statistical one. The technician estimates the model and obtains a mathematical/statistical answer. The analyst transforms the mathematical/statistical answer to an economic one.

Goodness-of-Fit

Goodness-of-Fit (continued . . .) How well does our sample regression line fit our sample data? R-squared of regression is the fraction of the total sum of squares (SST) that is explained by the model. R² = SSR/SST = 1 – SSE/SST

More about R-Squared R² can never decrease when another explanatory or predetermined variable is added to a regression; usually R² will increase. Because R² will usually increase (or at least not decrease) with increases in the number of right-hand side or explanatory variables, it is not necessarily a good way to compare alternative models with the same dependent variable.

R² and Adjusted R² R² Adjusted R² Questions: Why do we care about the adjusted R² ? Is adjusted R² always better than R² ? What’s the relationship between R² and adjusted R² ?

Model Selection Criteria

Model Selection Criteria Example AIC 19.35 15.83 17.15 SIC 19.37 15.86 17.17 Which model to choose?

Estimate of Error Variance df = n – (k + 1), or df = n – k – 1 df (i.e. degrees of freedom) is the (number of observations) – (number of estimated parameters)

Variance of OLS Parameter Estimates

Quantity sold of shrimp Example: SAS Output of the Demand Function for Shrimp Quantity sold of shrimp

Price of shrimp Price of finfish Price of other shellfish Advertising for shrimp Advertising for finfish Advertising for other shellfish

Model Selection Criteria for the QSHRIMP Problem