Simple Linear Regression. Deterministic Relationship If the value of y (dependent) is completely determined by the value of x (Independent variable) (Like.

Slides:



Advertisements
Similar presentations
Kin 304 Regression Linear Regression Least Sum of Squares
Advertisements

Examining Relationships Chapter 3. Least Squares Regression Line If the data in a scatterplot appears to be linear, we often like to model the data by.
Regresi Linear Sederhana Pertemuan 01 Matakuliah: I0174 – Analisis Regresi Tahun: Ganjil 2007/2008.
Inference for Regression
Simple Linear Regression. Start by exploring the data Construct a scatterplot  Does a linear relationship between variables exist?  Is the relationship.
Statistics Measures of Regression and Prediction Intervals.
 Coefficient of Determination Section 4.3 Alan Craig
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Simple Regression. Major Questions Given an economic model involving a relationship between two economic variables, how do we go about specifying the.
Chapter 14 The Simple Linear Regression Model. I. Introduction We want to develop a model that hopes to successfully explain the relationship between.
Simple Linear Regression
Introduction to Regression Analysis
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Correlation and Regression Analysis
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Simple Linear Regression Analysis
Introduction to Probability and Statistics Linear Regression and Correlation.
Lecture 17 Interaction Plots Simple Linear Regression (Chapter ) Homework 4 due Friday. JMP instructions for question are actually for.
Correlation and Regression Analysis
Simple Linear Regression and Correlation
Simple Linear Regression Analysis
Simple Linear Regression. Introduction In Chapters 17 to 19, we examine the relationship between interval variables via a mathematical equation. The motivation.
Chapter 2 – Simple Linear Regression - How. Here is a perfect scenario of what we want reality to look like for simple linear regression. Our two variables.
Chapter 6 (cont.) Regression Estimation. Simple Linear Regression: review of least squares procedure 2.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Correlation & Regression
Introduction to Linear Regression and Correlation Analysis
Chapter 11 Simple Regression
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
Review of Statistical Models and Linear Regression Concepts STAT E-150 Statistical Methods.
Linear Trend Lines = b 0 + b 1 X t Where is the dependent variable being forecasted X t is the independent variable being used to explain Y. In Linear.
Least-Squares Regression Section 3.3. Why Create a Model? There are two reasons to create a mathematical model for a set of bivariate data. To predict.
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
Elementary Statistics Correlation and Regression.
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 4 Section 2 – Slide 1 of 20 Chapter 4 Section 2 Least-Squares Regression.
10B11PD311 Economics REGRESSION ANALYSIS. 10B11PD311 Economics Regression Techniques and Demand Estimation Some important questions before a firm are.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
Linear Trend Lines = b 0 + b 1 X t Where is the dependent variable being forecasted X t is the independent variable being used to explain Y. In Linear.
Introduction to Regression Analysis. Dependent variable (response variable) Measures an outcome of a study  Income  GRE scores Dependent variable =
PS 225 Lecture 20 Linear Regression Equation and Prediction.
Simple Linear Regression In the previous lectures, we only focus on one random variable. In many applications, we often work with a pair of variables.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
Chapter 14: Inference for Regression. A brief review of chapter 4... (Regression Analysis: Exploring Association BetweenVariables )  Bi-variate data.
SWBAT: Calculate and interpret the residual plot for a line of regression Do Now: Do heavier cars really use more gasoline? In the following data set,
POD 09/19/ B #5P a)Describe the relationship between speed and pulse as shown in the scatterplot to the right. b)The correlation coefficient, r,
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 3 Association: Contingency, Correlation, and Regression Section 3.3 Predicting the Outcome.
© 2001 Prentice-Hall, Inc.Chap 13-1 BA 201 Lecture 18 Introduction to Simple Linear Regression (Data)Data.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Least Squares Regression Lines Text: Chapter 3.3 Unit 4: Notes page 58.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Section 9.3 Measures of Regression and Prediction Intervals.
Method 3: Least squares regression. Another method for finding the equation of a straight line which is fitted to data is known as the method of least-squares.
Chapter 5 Lesson 5.2 Summarizing Bivariate Data 5.2: LSRL.
AP Statistics Section 15 A. The Regression Model When a scatterplot shows a linear relationship between a quantitative explanatory variable x and a quantitative.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
11-1 Copyright © 2014, 2011, and 2008 Pearson Education, Inc.
Introduction. We want to see if there is any relationship between the results on exams and the amount of hours used for studies. Person ABCDEFGHIJ Hours/
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
1. Analyzing patterns in scatterplots 2. Correlation and linearity 3. Least-squares regression line 4. Residual plots, outliers, and influential points.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Chapter 5 LSRL. Bivariate data x – variable: is the independent or explanatory variable y- variable: is the dependent or response variable Use x to predict.
The simple linear regression model and parameter estimation
CHAPTER 3 Describing Relationships
Simple Linear Regression
Unit 4 LSRL.
Chapter 5 LSRL.
Chapter 3.2 LSRL.
Chapter 5 LSRL.
Algebra Review The equation of a straight line y = mx + b
A medical researcher wishes to determine how the dosage (in mg) of a drug affects the heart rate of the patient. Find the correlation coefficient & interpret.
Presentation transcript:

Simple Linear Regression

Deterministic Relationship If the value of y (dependent) is completely determined by the value of x (Independent variable) (Like an equation in the form y = 2x + 10, or f(x) = 5x-1) However, in most situations, the variables of interest are not deterministically related! For example, the value of y = 1 st year college GPA is certainly not determined solely by x = high school GPA.

Probabilistic Model

Let x * denote the value of x…. Without the random deviation e, all observed (x, y) points would fall exactly on the population regression line. The inclusion of e in the model equation recognizes that points will deviate from the line.

Simple Linear Regression Model:

Slope Population Regression Line

Summary

X * denotes a specified value of the predictor variable x …. So has 2 different interpretations  It is a point estimate of the true mean y value when x = x *.  It is a point predictor of an individual y value that would be observed when x = x *.

Find the point estimate of the mean y-value for the following: Age (x) Weight (y) So what’s the point estimate for an 18 year old mom?

Point estimate and point prediction are identical – only the interpretation is different. Prediction – weight of single baby who mom is 18 Estimate – average weight of all babies born to 18 year- olds

Answer the following: Explain the slope in context of the problem Explain the y-intercept in context of the problem.

Find SS Resid. On calculator – every time you calculate a linear regression – it calculates the residuals. Put them in list 3 and square them & add the list.

It represents the typical deviation in the y-variable from the least squares line.

Find the residual for a mother who is 19.

Find the probability that a 19 year old mother has a baby that is more than 3000 g.

Coefficient of determination (r 2 ) It’s the amount of variation in the y-variables that can be explained by the least squares line.

Homework Worksheet