Simple Linear Regression Analysis

Slides:



Advertisements
Similar presentations
Simple Linear Regression Analysis
Advertisements

Multiple Regression and Model Building
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Lesson 10: Linear Regression and Correlation
Kin 304 Regression Linear Regression Least Sum of Squares
Chap 12-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 12 Simple Regression Statistics for Business and Economics 6.
Forecasting Using the Simple Linear Regression Model and Correlation
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Objectives (BPS chapter 24)
Simple Linear Regression
Chapter 12 Simple Linear Regression
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
Chapter 10 Simple Regression.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Linear Regression and Correlation
SIMPLE LINEAR REGRESSION
Chapter 11 Multiple Regression.
Simple Linear Regression Analysis
Multiple Regression and Correlation Analysis
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Simple Linear Regression and Correlation
Lecture 5 Correlation and Regression
Correlation & Regression
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
SIMPLE LINEAR REGRESSION
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Inference for regression - Simple linear regression
Chapter 13: Inference in Regression
Chapter 11 Simple Regression
Correlation and Linear Regression
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Examining Relationships in Quantitative Research
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Copyright © 2005 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics Thomas Maurice eighth edition Chapter 4.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Lesson 14 - R Chapter 14 Review. Objectives Summarize the chapter Define the vocabulary used Complete all objectives Successfully answer any of the review.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Multiple Regression Chapter 14.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Linear Regression and Correlation Chapter 13.
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
AP Statistics Chapter 14 Section 1.
Multiple Regression and Model Building
Chapter 11 Simple Regression
Correlation and Simple Linear Regression
CHAPTER 29: Multiple Regression*
6-1 Introduction To Empirical Models
Correlation and Simple Linear Regression
Simple Linear Regression
SIMPLE LINEAR REGRESSION
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Simple Linear Regression Analysis Chapter 14 Simple Linear Regression Analysis McGraw-Hill/Irwin Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.

Simple Linear Regression Analysis 14.1 The Simple Linear Regression Model and the Least Square Point Estimates 14.2 Model Assumptions and the Standard Error 14.3 Testing the Significance of Slope and y- Intercept 14.4 Confidence and Prediction Intervals 14.5 Simple Coefficients of Determination and Correlation

Simple Linear Regression Analysis Continued 14.6 Testing the Significance of the Population Correlation Coefficient 14.7 An F Test for the Model 14.8 The QHIC Case 14.9 Residual Analysis 14.10 Some Shortcut Formulas (Optional)

LO14-1: Explain the simple linear regression model. 14.1 The Simple Linear Regression Model and the Least Squares Point Estimates The dependent (or response) variable is the variable we wish to understand or predict The independent (or predictor) variable is the variable we will use to understand or predict the dependent variable Regression analysis is a statistical technique that uses observed data to relate the dependent variable to one or more independent variables The objective is to build a regression model that can describe, predict and control the dependent variable based on the independent variable

Form of The Simple Linear Regression Model LO14-1 Form of The Simple Linear Regression Model y = β0 + β1x + ε y = β0 + β1x + ε is the mean value of the dependent variable y when the value of the independent variable is x β0 is the y-intercept; the mean of y when x is 0 β1 is the slope; the change in the mean of y per unit change in x ε is an error term that describes the effect on y of all factors other than x

Regression Terms β0 and β1 are called regression parameters LO14-1 Regression Terms β0 and β1 are called regression parameters β0 is the y-intercept and β1 is the slope We do not know the true values of these parameters So, we must use sample data to estimate them b0 is the estimate of β0 and b1 is the estimate of β1

The Least Squares Point Estimates LO14-2: Find the least squares point estimates of the slope and y-intercept. The Least Squares Point Estimates Estimation/prediction equation ŷ = b0 + b1x Least squares point estimate of the slope β1 Least squares point estimate of y-intercept 0

14.2 Model Assumptions and the Standard Error LO14-3: Describe the assumptions behind simple linear regression and calculate the standard error. 14.2 Model Assumptions and the Standard Error Mean of Zero At any given value of x, the population of potential error term values has a mean equal to zero Constant Variance Assumption At any given value of x, the population of potential error term values has a variance that does not depend on the value of x Normality Assumption At any given value of x, the population of potential error term values has a normal distribution Independence Assumption Any one value of the error term ε is statistically independent of any other value of ε Figure 14.7

14.3 Testing the Significance of the Slope and y-Intercept LO14-4: Test the significance of the slope and y-intercept. 14.3 Testing the Significance of the Slope and y-Intercept A regression model is not likely to be useful unless there is a significant relationship between x and y To test significance, we use the null hypothesis: H0: β1 = 0 Versus the alternative hypothesis: Ha: β1 ≠ 0

14.4 Confidence and Prediction Intervals LO14-5: Calculate and interpret a confidence interval for a mean value and a prediction interval for an individual value. 14.4 Confidence and Prediction Intervals The point on the regression line corresponding to a particular value of x0 of the independent variable x is ŷ = b0 + b1x0 It is unlikely that this value will equal the mean value of y when x equals x0 Therefore, we need to place bounds on how far the predicted value might be from the actual value We can do this by calculating a confidence interval mean for the value of y and a prediction interval for an individual value of y

14.5 Simple Coefficient of Determination and Correlation LO 6: Calculate and interpret the simple coefficients of determination and correlation. 14.5 Simple Coefficient of Determination and Correlation How useful is a particular regression model? One measure of usefulness is the simple coefficient of determination It is represented by the symbol r2 This section may be covered anytime after reading Section 14.1

LO14-7: Test hypotheses about the population correlation coefficient. 14.6 Testing the Significance of the Population Correlation Coefficient The simple correlation coefficient (r) measures the linear relationship between the observed values of x and y from the sample The population correlation coefficient (ρ) measures the linear relationship between all possible combinations of observed values of x and y r is an estimate of ρ

LO14-8: Test the significance of a simple linear regression model by using an F test. 14.7 An F Test for Model For simple regression, this is another way to test the null hypothesis H0: β1 = 0 This is the only test we will use for multiple regression The F test tests the significance of the overall regression relationship between x and y

LO14-9: Use residual analysis to check the assumptions of simple linear regression. Checks of regression assumptions are performed by analyzing the regression residuals Residuals (e) are defined as the difference between the observed value of y and the predicted value of y, e = y - ŷ Note that e is the point estimate of ε If regression assumptions valid, the population of potential error terms will be normally distributed with mean zero and variance σ2 Different error terms will be statistically independent