Linear Regression and Correlation

Slides:



Advertisements
Similar presentations
Managerial Economics in a Global Economy
Advertisements

Lesson 10: Linear Regression and Correlation
13- 1 Chapter Thirteen McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
Chapter Thirteen McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc., All Rights Reserved. Linear Regression and Correlation.
© The McGraw-Hill Companies, Inc., 2000 CorrelationandRegression Further Mathematics - CORE.
Chapter 12 Simple Linear Regression
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Correlation and Regression Analysis
Chapter 13 Introduction to Linear Regression and Correlation Analysis
Ka-fu Wong © 2003 Chap Dr. Ka-fu Wong ECON1003 Analysis of Economic Data.
SIMPLE LINEAR REGRESSION
Irwin/McGraw-Hill © The McGraw-Hill Companies, Inc., 2000 LIND MASON MARCHAL 1-1 Chapter Twelve Multiple Regression and Correlation Analysis GOALS When.
Simple Linear Regression Analysis
Regression Chapter 10 Understandable Statistics Ninth Edition By Brase and Brase Prepared by Yixun Shi Bloomsburg University of Pennsylvania.
Chapter 9: Correlation and Regression
SIMPLE LINEAR REGRESSION
Chapter 14 Introduction to Linear Regression and Correlation Analysis
Simple Linear Regression and Correlation
Simple Linear Regression Analysis
Lecture 5 Correlation and Regression
Correlation & Regression
Correlation and Linear Regression
Correlation and Linear Regression
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 13 Linear Regression and Correlation.
Correlation and Linear Regression Chapter 13 Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Correlation and Regression
Linear Regression and Correlation
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
SIMPLE LINEAR REGRESSION
Correlation and Regression
Introduction to Linear Regression and Correlation Analysis
Chapter 11 Simple Regression
Linear Regression and Correlation
Correlation and Linear Regression
Anthony Greene1 Correlation The Association Between Variables.
© The McGraw-Hill Companies, Inc., 2000 Business and Finance College Principles of Statistics Lecture 10 aaed EL Rabai week
Chapter 6 & 7 Linear Regression & Correlation
© The McGraw-Hill Companies, Inc., Chapter 11 Correlation and Regression.
Introduction to Linear Regression
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 13 Linear Regression and Correlation.
Elementary Statistics Correlation and Regression.
Examining Relationships in Quantitative Research
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 4 Summary Scatter diagrams of data pairs (x, y) are useful in helping us determine visually if there is any relation between x and y values and,
CHAPTER 5 CORRELATION & LINEAR REGRESSION. GOAL : Understand and interpret the terms dependent variable and independent variable. Draw a scatter diagram.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Linear Regression and Correlation Chapter GOALS 1. Understand and interpret the terms dependent and independent variable. 2. Calculate and interpret.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics Seventh Edition By Brase and Brase Prepared by: Lynn Smith.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
© The McGraw-Hill Companies, Inc., Chapter 10 Correlation and Regression.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Linear Regression and Correlation Chapter 13.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 9 l Simple Linear Regression 9.1 Simple Linear Regression 9.2 Scatter Diagram 9.3 Graphical.
Correlation and Linear Regression Chapter 13 McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin Linear Regression and Correlation Chapter 13.
Chapter 13 Linear Regression and Correlation. Our Objectives  Draw a scatter diagram.  Understand and interpret the terms dependent and independent.
Correlation and Linear Regression
Correlation and Simple Linear Regression
Correlation and Regression
Correlation and Simple Linear Regression
Inferential Statistics and Probability a Holistic Approach
Correlation and Regression
SIMPLE LINEAR REGRESSION
SIMPLE LINEAR REGRESSION
Chapter Thirteen McGraw-Hill/Irwin
Linear Regression and Correlation
Presentation transcript:

Linear Regression and Correlation 1-1 Linear Regression and Correlation Chapter Eleven GOALS When you have completed this chapter, you will be able to: ONE Draw a scatter diagram. TWO Understand and interpret the terms dependent and independent variable. THREE Calculate and interpret the coefficient of correlation, the coefficient of determination, and the standard error of estimate. FOUR Conduct a test of hypothesis to determine whether the population coefficient of correlation is different from zero. Irwin/McGraw-Hill © The McGraw-Hill Companies, Inc., 1999

Linear Regression and Correlation 1-1 Linear Regression and Correlation Chapter Eleven GOALS When you have completed this chapter, you will be able to: FIVE Calculate the least squares regression line. SIX Construct and interpret confidence intervals and prediction intervals for the dependent variable. SEVEN Set up and interpret an ANOVA table. Irwin/McGraw-Hill © The McGraw-Hill Companies, Inc., 1999

Dependent Variable: The variable that is being predicted or estimated. 11-3 Correlation Analysis Correlation Analysis: A group of statistical techniques used to measure the strength of the relationship (correlation) between two variables. Scatter Diagram: A chart that portrays the relationship between the two variables of interest. Dependent Variable: The variable that is being predicted or estimated. Independent Variable: The variable that provides the basis for estimation. It is the predictor variable.

The Coefficient of Correlation, r 11-4 The Coefficient of Correlation, r The Coefficient of Correlation (r) is a measure of the strength of the relationship between two variables. It requires interval or ratio-scaled data (variables). It can range from -1.00 to 1.00. Values of -1.00 or 1.00 indicate perfect and strong correlation. Values close to 0.0 indicate weak correlation. Negative values indicate an inverse relationship and positive values indicate a direct relationship.

Perfect Negative Correlation 11-5 Perfect Negative Correlation 10 9 8 7 6 5 4 3 2 1 Y 0 1 2 3 4 5 6 7 8 9 10 X

Perfect Positive Correlation 11-6 Perfect Positive Correlation 10 9 8 7 6 5 4 3 2 1 Y 0 1 2 3 4 5 6 7 8 9 10 X

11-7 Zero Correlation 10 9 8 7 6 5 4 3 2 1 Y 0 1 2 3 4 5 6 7 8 9 10 X

Strong Positive Correlation 11-8 Strong Positive Correlation 10 9 8 7 6 5 4 3 2 1 Y 0 1 2 3 4 5 6 7 8 9 10 X

Formula for correlation coefficient (r) 11-9 Formula for correlation coefficient (r)

Coefficient of Determination 11-10 Coefficient of Determination The Coefficient of Determination, r2 - the proportion of the total variation in the dependent variable Y that is explained or accounted for by the variation in the independent variable X. The coefficient of determination is the square of the coefficient of correlation, and ranges from 0 to 1.

11-11 EXAMPLE 1 Dan Ireland, the student body president at Toledo State University, is concerned about the cost of textbooks. To provide insight into the problem he selects a sample of eight textbooks currently on sale in the bookstore. He decides to study the relationship between the number of pages in the text and the cost. Compute the correlation coefficient.

11-12 EXAMPLE 1 continued

Step 2: H0 is rejected if t>3.143 or if t<-3.143, df=6,  =.02 11-13 EXAMPLE 1 continued r=.614 (verify) Test the hypothesis that there is no correlation in the population. Use a .02 significance level. Step 1: H0 : The correlation in the population is zero. H1: The correlation in the population is not zero. Step 2: H0 is rejected if t>3.143 or if t<-3.143, df=6,  =.02

The test statistic is t = 1.9055, computed by 11-14 EXAMPLE 1 continued The test statistic is t = 1.9055, computed by with (n-2) degrees of freedom Step 4: H0 is not rejected

11-15 Regression Analysis Purpose: to determine the regression equation; it is used to predict the value of the dependent variable (Y) based on the independent variable (X). Procedure: select a sample from the population and list the paired data for each observation; draw a scatter diagram to give a visual portrayal of the relationship; determine the regression equation.

the regression equation: Y’= a + bX, where: 11-16 Regression Analysis the regression equation: Y’= a + bX, where: Y’ is the average predicted value of Y for any X. a is the Y-intercept, or the estimated Y value when X=0 b is the slope of the line, or the average change in Y’ for each change of one unit in X least squares principle is used to obtain a and b:

By the least squares principle, b=.01714 and a=16.00175 11-17 EXAMPLE 2 Develop a regression equation for the information given in EXAMPLE 1 that can be used to estimate the selling price based on the number of pages. By the least squares principle, b=.01714 and a=16.00175 Y’ =16.00175 + .01714X

The Standard Error of Estimate 11-18 The Standard Error of Estimate The standard error of estimate measures the scatter, or dispersion, of the observed values around the line of regression The formulas that are used to compute the standard error:

Assumptions Underlying Linear Regression 11-19 Assumptions Underlying Linear Regression For each value of X, there is a group of Y values, and these Y values are normally distributed. The means of these normal distributions of Y values all lie on the straight line of regression. The standard deviations of these normal distributions are equal. The Y values are statistically independent. This means that in the selection of a sample, the Y values chosen for a particular X value do not depend on the Y values for any other X values.

11-20 Confidence Interval The confidence interval for the mean value of Y for a given value of X is given by:

11-21 Prediction Interval The prediction interval for an individual value of Y for a given value of X is given by:

Use the information from EXAMPLE 1 to: 11-22 EXAMPLE 3 Use the information from EXAMPLE 1 to: Compute the standard error of estimate: Develop a 95% confidence interval for all 650 page textbooks: [24.03, 30.25] Verify Develop a 95% prediction interval for a 650 page text: [18.09, 36.19] Verify

More on the Coefficient of Determination 11-23 More on the Coefficient of Determination

More on the Coefficient of Determination 11-24 More on the Coefficient of Determination