NOTATION & ASSUMPTIONS 2 Y i =  1 +  2 X 2i +  3 X 3i + U i Zero mean value of U i No serial correlation Homoscedasticity Zero covariance between U.

Slides:



Advertisements
Similar presentations
Chapter 9: Simple Regression Continued
Advertisements

Multiple Regression W&W, Chapter 13, 15(3-4). Introduction Multiple regression is an extension of bivariate regression to take into account more than.
Lecture 10 F-tests in MLR (continued) Coefficients of Determination BMTRY 701 Biostatistical Methods II.
The Simple Regression Model
Structural Equation Modeling
CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION
Statistics and Quantitative Analysis U4320
Regression Greg C Elvers.
Ch11 Curve Fitting Dr. Deshi Ye
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Econ Prof. Buckles1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 4. Further Issues.
Analysis of Covariance Goals: 1)Reduce error variance. 2)Remove sources of bias from experiment. 3)Obtain adjusted estimates of population means.
Statistical Analysis SC504/HS927 Spring Term 2008 Session 5: Week 20: 15 th February OLS (2): assessing goodness of fit, extension to multiple regression.
1Prof. Dr. Rainer Stachuletz Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 4. Further Issues.
Chapter Topics Types of Regression Models
Topics: Regression Simple Linear Regression: one dependent variable and one independent variable Multiple Regression: one dependent variable and two or.
Chapter 11 Multiple Regression.
Simple Linear Regression Analysis
The Simple Regression Model
Analysis of Covariance Goals: 1)Reduce error variance. 2)Remove sources of bias from experiment. 3)Obtain adjusted estimates of population means.
Business Statistics - QBM117 Statistical inference for regression.
Multiple Regression Research Methods and Statistics.
Introduction to Regression Analysis, Chapter 13,
So are how the computer determines the size of the intercept and the slope respectively in an OLS regression The OLS equations give a nice, clear intuitive.
Lecture 5 Correlation and Regression
Multiple Linear Regression Response Variable: Y Explanatory Variables: X 1,...,X k Model (Extension of Simple Regression): E(Y) =  +  1 X 1 +  +  k.
Objectives of Multiple Regression
Chapter 11 Simple Regression
1 MADE WHAT IF SOME OLS ASSUMPTIONS ARE NOT FULFILED?
Understanding Multivariate Research Berry & Sanders.
Analysis of Variance: Some Review and Some New Ideas
CORRELATION & REGRESSION
Correlation.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Regression. Population Covariance and Correlation.
Welcome to Econ 420 Applied Regression Analysis Study Guide Week Six.
Pearson-Product Moment Correlation Coefficient (r) A measure of the relation between x and y, but is not standardized To standardize, we divide the covariance.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
1 Javier Aparicio División de Estudios Políticos, CIDE Primavera Regresión.
Maths Study Centre CB Open 11am – 5pm Semester Weekdays
Chapter Three TWO-VARIABLEREGRESSION MODEL: THE PROBLEM OF ESTIMATION
May 2004 Prof. Himayatullah 1 Basic Econometrics Chapter 7 MULTIPLE REGRESSION ANALYSIS: The Problem of Estimation.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Environmental Modeling Basic Testing Methods - Statistics III.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
 Relationship between education level, income, and length of time out of school  Our new regression equation: is the predicted value of the dependent.
Multiple Regression I 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Multiple Regression Analysis (Part 1) Terry Dielman.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 14-1 Chapter 14 Multiple Regression Model Building Statistics for Managers.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
CORRELATION ANALYSIS.
Using SPSS Note: The use of another statistical package such as Minitab is similar to using SPSS.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Linear Regression and Correlation Chapter 13.
AP STATISTICS LESSON 3 – 3 (DAY 2) The role of r 2 in regression.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Predicting Energy Consumption in Buildings using Multiple Linear Regression Introduction Linear regression is used to model energy consumption in buildings.
Fundamentals of regression analysis
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Quantitative Methods Simple Regression.
BIVARIATE REGRESSION AND CORRELATION
MULTIPLE REGRESSION ANALYSIS: THE PROBLEM OF ESTIMATION
Analysis of Variance: Some Review and Some New Ideas
Some issues in multivariate regression
Tutorial 6 SEG rd Oct..
Adding variables. There is a difference between assessing the statistical significance of a variable acting alone and a variable being added to a model.
Presentation transcript:

NOTATION & ASSUMPTIONS 2 Y i =  1 +  2 X 2i +  3 X 3i + U i Zero mean value of U i No serial correlation Homoscedasticity Zero covariance between U i and X i No specification bias No exact collinearity between the X variables

ESTIMATION 3

BETA COEFFICIENTS 4 Occasional you’ll see reference to a “standardized coefficient” or “beta coefficient” which has a specific meaning Idea is to replace y and each x variable with a standardized version – i.e. subtract mean and divide by standard deviation Coefficient reflects standard deviation of y for a one standard deviation change in x

VARIANCE AND STANDARD ERROR 5

THE T TEST 6

ONE-SIDED ALTERNATIVES 7 y i =  0 +  1 x i1 + … +  k x ik + u i H 0 :  j = 0 H 1 :  j > 0 c 0   Fail to reject reject

TWO-SIDED ALTERNATIVES 8 y i =  0 +  1 X i1 + … +  k X ik + u i H 0 :  j = 0 H 1 :  j > 0 c 0   -c  reject fail to reject

THE COEFFICIENT OF DETERMINATION A MEASURE OF “GOODNESS OF FIT” 9 Verbally, R-square measure the proportion or percentage of the total variation in Y explained by the regression model. Verbally, R-square measure the proportion or percentage of the total variation in Y explained by the regression model.

ADJUSTED R-SQUARED 10 Recall that the R2 will always increase as more variables are added to the model. The adjusted R2 takes into account the number of variables in a model, and may decrease.

CONT.. 11 It’s easy to see that the adjusted R2 is just (1 – R2)(n – 1) / (n – k – 1), but most packages will give you both R2 and adj-R2. You can compare the fit of 2 models (with the same y) by comparing the adj-R2. You cannot use the adj-R2 to compare models with different y’s (e.g. y vs. ln(y)).

THE F STATISTIC 12 0 c   f( F ) F reject fail to reject Reject H 0 at  significance level if F > c

13