Least Squares Regression.   If we have two variables X and Y, we often would like to model the relation as a line  Draw a line through the scatter.

Slides:



Advertisements
Similar presentations
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Advertisements

Correlation and Regression
Chapter 4 The Relation between Two Variables
Chapter Describing the Relation between Two Variables © 2010 Pearson Prentice Hall. All rights reserved 3 4.
Chapter 3 Bivariate Data
Warm up Use calculator to find r,, a, b. Chapter 8 LSRL-Least Squares Regression Line.
Chapter 4 Describing the Relation Between Two Variables
LSRL Least Squares Regression Line
2.2 Correlation Correlation measures the direction and strength of the linear relationship between two quantitative variables.
Describing the Relation Between Two Variables
REGRESSION What is Regression? What is the Regression Equation? What is the Least-Squares Solution? How is Regression Based on Correlation? What are the.
Math 227 Elementary Statistics Math 227 Elementary Statistics Sullivan, 4 th ed.
Copyright © 2014, 2013, 2010 and 2007 Pearson Education, Inc. Chapter Describing the Relation between Two Variables 4.
Business Statistics - QBM117 Least squares regression.
CHAPTER 3 Describing Relationships
REGRESSION Predict future scores on Y based on measured scores on X Predictions are based on a correlation from a sample where both X and Y were measured.
Least Squares Regression
Haroon Alam, Mitchell Sanders, Chuck McAllister- Ashley, and Arjun Patel.
Chapter 2 – Simple Linear Regression - How. Here is a perfect scenario of what we want reality to look like for simple linear regression. Our two variables.
Regression, Residuals, and Coefficient of Determination Section 3.2.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Linear Regression Analysis
Linear Regression.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Section 10-3 Regression.
Relationship of two variables
Chapter 11 Simple Regression
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Chapter 13 Statistics © 2008 Pearson Addison-Wesley. All rights reserved.
A student wonders if tall women tend to date taller men than do short women. She measures herself, her dormitory roommate, and the women in the adjoining.
© 2008 Pearson Addison-Wesley. All rights reserved Chapter 1 Section 13-6 Regression and Correlation.
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
Statistical Methods Statistical Methods Descriptive Inferential
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 4 Section 2 – Slide 1 of 20 Chapter 4 Section 2 Least-Squares Regression.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 3 Describing Relationships 3.2 Least-Squares.
STA291 Statistical Methods Lecture LINEar Association o r measures “closeness” of data to the “best” line. What line is that? And best in what terms.
LECTURE 9 Tuesday, 24 FEBRUARY STA291 Fall Administrative 4.2 Measures of Variation (Empirical Rule) 4.4 Measures of Linear Relationship Suggested.
POD 09/19/ B #5P a)Describe the relationship between speed and pulse as shown in the scatterplot to the right. b)The correlation coefficient, r,
LEAST-SQUARES REGRESSION 3.2 Least Squares Regression Line and Residuals.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics Seventh Edition By Brase and Brase Prepared by: Lynn Smith.
Least Squares Regression Lines Text: Chapter 3.3 Unit 4: Notes page 58.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Unit 4 Lesson 3 (5.3) Summarizing Bivariate Data 5.3: LSRL.
Chapter 7 Linear Regression. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Describing the Relation between Two Variables 4.
Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill Education.
By Samuel Chukwuemeka (Samdom For Peace) USING TECHNOLOGY TO DETERMINE SAMPLE LINEAR CORRELATION COEFFICIENT AND THE LEAST-SQUARES.
Describing Relationships. Least-Squares Regression  A method for finding a line that summarizes the relationship between two variables Only in a specific.
4.2 – Linear Regression and the Coefficient of Determination Sometimes we will need an exact equation for the line of best fit. Vocabulary Least-Squares.
1 Objective Given two linearly correlated variables (x and y), find the linear function (equation) that best describes the trend. Section 10.3 Regression.
Chapter 3 LSRL. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable Use x to predict.
Chapter 5 LSRL. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable Use x to predict.
CHAPTER 3 Describing Relationships
Unit 4 LSRL.
LSRL.
Least Squares Regression Line.
CHAPTER 3 Describing Relationships
Chapter 5 LSRL.
LSRL Least Squares Regression Line
Chapter 3.2 LSRL.
No notecard for this quiz!!
Least Squares Regression Line LSRL Chapter 7-continued
Lecture Notes The Relation between Two Variables Q Q
3 4 Chapter Describing the Relation between Two Variables
3 4 Chapter Describing the Relation between Two Variables
Chapter 5 LSRL.
Chapter 5 LSRL.
Chapter 5 LSRL.
3 4 Chapter Describing the Relation between Two Variables
Ch 4.1 & 4.2 Two dimensions concept
Presentation transcript:

Least Squares Regression

  If we have two variables X and Y, we often would like to model the relation as a line  Draw a line through the scatter diagram  We want to find the line that “best” describes the linear relationship … the regression line Best Fit

 ● We want to use a linear model ● Linear models can be written in several different (equivalent) ways  y = m x + b  y – y 1 = m ( x – x 1 )  y = b 1 x + b 0 ● Because the slope and the intercept both are important to analyze, we will use y = b 1 x + b 0 Linear Model

 ● One difference between math and stat is that statistics assumes that the measurements are not exact, that there is an error or residual ● The formula for the residual is always Residual = Observed – Predicted ● This relationship is not just for this chapter … it is the general way of defining error in statistics Residuals

  What the residual is on the scatter diagram Residual The model line The x value of interest The observed value y The residual The predicted value y

 ● We want to minimize the residuals, but we need to define what this means ● We use the method of least-squares  We consider a possible linear mode  We calculate the residual for each point  We add up the squares of the residuals ● The line that has the smallest is called the least-squares regression line Least-Squares Regression Line

  The equation for the least-squares regression line is given by y = b 1 x + b 0  b 1 is the slope of the least-squares regression line  b 0 is the y-intercept of the least-squares regression line Least Squares Regression Line

 ● Finding the values of b 1 and b 0, by hand, is a very tedious process ● You should use calculator for this ● Finding the coefficients b 1 and b 0 is only the first step of a regression analysis  We need to interpret the slope b 1  We need to interpret the y-intercept b 0 Tough Stuff

  Interpreting the slope b 1  The slope is sometimes defined as  The slope is also sometimes defined as  The slope relates changes in y to changes in x Slope

 The speed of a golf club and the distance the ball went were measured for a linear relationship. Draw a scatter pot of the data, and the least- squares regression line. Write down the equation. Example

 Club Head Speed (mph) Distance (yards) Data Using your equation, estimate how far a golf ball would travel if it was hit at 104 mph. Interpret the slope of the regression equation

Sample Problem  The heights and weights of 11 men between the ages of 21 and 26 were measured. The data are presented in the table below.  A. Create at a scatter diagram to confirm that an approximately linear relationship exists between x and y.  B. Find the least squares regression line, treating height, x, as the explanatory variable and weight, y, as the response variable – two ways, 1. by hand and 2. use calculator  c. Interpret the slope and intercept, if appropriate.  d. Use the regression line to predict the weight of a man who is 73 inches tall?

If the least-squares regression line is used to make predictions based on values of the explanatory variable that are much larger or much smaller than the observed values, we say the researcher is working outside the scope of the model. Never use a least-squares regression line to make predictions outside the scope of the model because we can’t be sure the linear relation continues to exist © 2010 Pearson Prentice Hall. All rights reserved