Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.

Slides:



Advertisements
Similar presentations
AP Statistics.  Least Squares regression is a way of finding a line that summarizes the relationship between two variables.
Advertisements

Regression, Correlation. Research Theoretical empirical Usually combination of the two.
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Definition  Regression Model  Regression Equation Y i =  0 +  1 X i ^ Given a collection of paired data, the regression equation algebraically describes.
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Summarizing Bivariate Data Introduction to Linear Regression.
LINEAR REGRESSION: What it Is and How it Works Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r.
LINEAR REGRESSION: What it Is and How it Works. Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r.
LINEAR REGRESSION: What it Is and How it Works. Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r Assumptions.
Bivariate Regression CJ 526 Statistical Analysis in Criminal Justice.
Business Statistics - QBM117 Least squares regression.
REGRESSION Predict future scores on Y based on measured scores on X Predictions are based on a correlation from a sample where both X and Y were measured.
Least Squares Regression Line (LSRL)
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 13 Linear Regression and Correlation.
Linear Regression.
Chapter 6 & 7 Linear Regression & Correlation
1 © 2008 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 5 Summarizing Bivariate Data.
Summarizing Bivariate Data
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 4 Section 2 – Slide 1 of 20 Chapter 4 Section 2 Least-Squares Regression.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
Correlation and Regression Basic Concepts. An Example We can hypothesize that the value of a house increases as its size increases. Said differently,
A medical researcher wishes to determine how the dosage (in mg) of a drug affects the heart rate of the patient. DosageHeart rate
Examining Bivariate Data Unit 3 – Statistics. Some Vocabulary Response aka Dependent Variable –Measures an outcome of a study Explanatory aka Independent.
CHAPTER 5 Regression BPS - 5TH ED.CHAPTER 5 1. PREDICTION VIA REGRESSION LINE NUMBER OF NEW BIRDS AND PERCENT RETURNING BPS - 5TH ED.CHAPTER 5 2.
Chapter 6 (cont.) Difference Estimation. Recall the Regression Estimation Procedure 2.
Essential Statistics Chapter 51 Least Squares Regression Line u Regression line equation: y = a + bx ^ –x is the value of the explanatory variable –“y-hat”
CHAPTER 5 CORRELATION & LINEAR REGRESSION. GOAL : Understand and interpret the terms dependent variable and independent variable. Draw a scatter diagram.
Least Squares Regression.   If we have two variables X and Y, we often would like to model the relation as a line  Draw a line through the scatter.
Chapter 10: Determining How Costs Behave 1 Horngren 13e.
^ y = a + bx Stats Chapter 5 - Least Squares Regression
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Least Squares Regression Lines Text: Chapter 3.3 Unit 4: Notes page 58.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Unit 4 Lesson 3 (5.3) Summarizing Bivariate Data 5.3: LSRL.
3.2 - Residuals and Least Squares Regression Line.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Describing the Relation between Two Variables 4.
Method 3: Least squares regression. Another method for finding the equation of a straight line which is fitted to data is known as the method of least-squares.
Chapter 5 Lesson 5.2 Summarizing Bivariate Data 5.2: LSRL.
OLS Regression What is it? Closely allied with correlation – interested in the strength of the linear relationship between two variables One variable is.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
CHAPTER 5: Regression ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Correlation and Regression Basic Concepts. An Example We can hypothesize that the value of a house increases as its size increases. Said differently,
4.2 – Linear Regression and the Coefficient of Determination Sometimes we will need an exact equation for the line of best fit. Vocabulary Least-Squares.
1 Objective Given two linearly correlated variables (x and y), find the linear function (equation) that best describes the trend. Section 10.3 Regression.
Describing Bivariate Relationships. Bivariate Relationships When exploring/describing a bivariate (x,y) relationship: Determine the Explanatory and Response.
Chapter 3 LSRL. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable Use x to predict.
Chapter 5 LSRL. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable Use x to predict.
Unit 4 LSRL.
LSRL.
Least Squares Regression Line.
LEAST – SQUARES REGRESSION
Linear Regression Special Topics.
Practice. Practice Practice Practice Practice r = X = 20 X2 = 120 Y = 19 Y2 = 123 XY = 72 N = 4 (4) 72.
Regression Chapter 6 I Introduction to Regression
Chapter 5 LSRL.
LSRL Least Squares Regression Line
Chapter 3.2 LSRL.
The Least-Squares Regression Line
Least Squares Regression Line LSRL Chapter 7-continued
The Weather Turbulence
Chapter 5 LSRL.
Chapter 5 LSRL.
Chapter 5 LSRL.
Least-Squares Regression
Lesson 2.2 Linear Regression.
Correlation and Regression
Ch 4.1 & 4.2 Two dimensions concept
A medical researcher wishes to determine how the dosage (in mg) of a drug affects the heart rate of the patient. Find the correlation coefficient & interpret.
9/27/ A Least-Squares Regression.
Chapter 14 Multiple Regression
Presentation transcript:

Section 5.2: Linear Regression: Fitting a Line to Bivariate Data

Dependent (response variable) – y variable Independent (predictor, or explanatory variable) – x variable

The relationship y = a + bx is the equation of a straight line The value b called the slope of the line is the amount by which y increases when x increases by 1 unit The value a, called the intercept (or sometimes the y-intercept or vertical intercept) of the line is the height of the line above the value x = 0

Example x y y = 7 + 3x a = 7 x increases by 1 y increases by b = 3

Example y y = x x increases by 1 y changes by b = -4 (i.e., changes by –4) a = 17

Least Squares Lines The most widely used criterion for measuring the goodness of fit of a line y = a + bx to bivariate data (x 1, y 1 ),…,(x n, y n ) is the sum of the squared deviations about the line The line that gives the best fit to data is the one that minimizes this sum; it is called the least-squares line or the sample regression line

Coefficients a and b The slope of the least – squares line is: The y intercept is: We write the equation of the least-squares line as: Where the ^ above y (read as y-hat) is a prediction of y resulting from the substitution of a particular x value into the equation

Calculating Formula for the Slope of the Least-Squares Line

Example: Greyhound

Calculations

Classwork

Activity: Exploring Correlation and Regression