Descriptive measures of the degree of linear association R-squared and correlation.

Slides:



Advertisements
Similar presentations
Lesson 10: Linear Regression and Correlation
Advertisements

Correlation and regression
13- 1 Chapter Thirteen McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
Learning Objectives 1 Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
1 Simple Linear Regression and Correlation The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES Assessing the model –T-tests –R-square.
EPI 809/Spring Probability Distribution of Random Error.
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Summarizing Bivariate Data Introduction to Linear Regression.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 13-1 Chapter 13 Simple Linear Regression Basic Business Statistics 11 th Edition.
Chapter 13 Introduction to Linear Regression and Correlation Analysis
1 Review of Correlation A correlation coefficient measures the strength of a linear relation between two measurement variables. The measure is based on.
Simple Linear Regression Analysis
REGRESSION AND CORRELATION
Part 18: Regression Modeling 18-1/44 Statistics and Data Analysis Professor William Greene Stern School of Business IOMS Department Department of Economics.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Linear Regression and Linear Prediction Predicting the score on one variable.
Correlation 1. Correlation - degree to which variables are associated or covary. (Changes in the value of one tends to be associated with changes in the.
Descriptive measures of the strength of a linear association r-squared and the (Pearson) correlation coefficient r.
Lecture 5 Correlation and Regression
Correlation and Linear Regression
Introduction to Linear Regression and Correlation Analysis
Simple linear regression Linear regression with one predictor variable.
Chapter 14 – Correlation and Simple Regression Math 22 Introductory Statistics.
Chapter 6 & 7 Linear Regression & Correlation
M23- Residuals & Minitab 1  Department of ISM, University of Alabama, ResidualsResiduals A continuation of regression analysis.
Inferences in Regression and Correlation Analysis Ayona Chatterjee Spring 2008 Math 4803/5803.
Regression Analysis. Scatter plots Regression analysis requires interval and ratio-level data. To see if your data fits the models of regression, it is.
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 12-1 Correlation and Regression.
Introduction to Linear Regression
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
An alternative approach to testing for a linear association The Analysis of Variance (ANOVA) Table.
Chapter 7 Relationships Among Variables What Correlational Research Investigates Understanding the Nature of Correlation Positive Correlation Negative.
Chap 13-1 Copyright ©2012 Pearson Education, Inc. publishing as Prentice Hall Chap 13-1 Chapter 13 Simple Linear Regression Basic Business Statistics 12.
Copyright ©2011 Nelson Education Limited Linear Regression and Correlation CHAPTER 12.
14- 1 Chapter Fourteen McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc., All Rights Reserved.
Multiple regression. Example: Brain and body size predictive of intelligence? Sample of n = 38 college students Response (Y): intelligence based on the.
Chapter Thirteen Copyright © 2006 John Wiley & Sons, Inc. Bivariate Correlation and Regression.
Correlation and Regression: The Need to Knows Correlation is a statistical technique: tells you if scores on variable X are related to scores on variable.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
CHAPTER 5 CORRELATION & LINEAR REGRESSION. GOAL : Understand and interpret the terms dependent variable and independent variable. Draw a scatter diagram.
Linear Prediction Correlation can be used to make predictions – Values on X can be used to predict values on Y – Stronger relationships between X and Y.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Chapter 12 Simple Linear Regression.
Simple Linear Regression The Coefficients of Correlation and Determination Two Quantitative Variables x variable – independent variable or explanatory.
SOCW 671 #11 Correlation and Regression. Uses of Correlation To study the strength of a relationship To study the direction of a relationship Scattergrams.
Multicollinearity. Multicollinearity (or intercorrelation) exists when at least some of the predictor variables are correlated among themselves. In observational.
Interaction regression models. What is an additive model? A regression model with p-1 predictor variables contains additive effects if the response function.
Agenda 1.Exam 2 Review 2.Regression a.Prediction b.Polynomial Regression.
Correlation and Regression Elementary Statistics Larson Farber Chapter 9 Hours of Training Accidents.
11-1 Copyright © 2014, 2011, and 2008 Pearson Education, Inc.
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Chapter 11 Linear Regression and Correlation. Explanatory and Response Variables are Numeric Relationship between the mean of the response variable and.
Analysis of variance approach to regression analysis … an (alternative) approach to testing for a linear association.
Correlation and Linear Regression Chapter 13 McGraw-Hill/Irwin Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved.
Regression Analysis AGEC 784.
Chapter 13 Created by Bethany Stubbe and Stephan Kogitz.
Regression Analysis.
Relationship with one independent variable
Chapter 13 Simple Linear Regression
Regression Analysis PhD Course.
Inference for Regression Lines
Merve denizci nazlıgül, M.s.
Relationship with one independent variable
Chapter Thirteen McGraw-Hill/Irwin
Presentation transcript:

Descriptive measures of the degree of linear association R-squared and correlation

Coefficient of determination R 2 is a number (a proportion!) between 0 and 1. If R 2 = 1: –all data points fall perfectly on the regression line –predictor X accounts for all of the variation in Y If R 2 = 0: –the fitted regression line is perfectly horizontal –predictor X accounts for none of the variation in Y

Interpretations of R 2 R 2 ×100 percent of the variation in Y is reduced by taking into account predictor X. R 2 ×100 percent of the variation in Y is “explained by” the variation in predictor X.

R-sq on Minitab fitted line plot

R-sq on Minitab regression output The regression equation is Mort = Lat S = R-Sq = 68.0 % R-Sq(adj) = 67.3 % Analysis of Variance Source DF SS MS F P Regression Error Total

Correlation coefficient r is a number between -1 and 1, inclusive. Sign of coefficient of correlation –plus sign if slope of fitted regression line is positive –negative sign if slope of fitted regression line is negative.

Correlation coefficient formulas

Interpretation of correlation coefficient No clear-cut operational interpretation as for R-squared value. r = -1 is perfect negative linear relationship. r = 1 is perfect positive linear relationship. r = 0 is no linear relationship.

R 2 = 100% and r = +1

R 2 = 2.9% and r = 0.17

R 2 = 70.1% and r = U.S. Norway Finland Italy France

R 2 = 82.8% and r = 0.91

R 2 = 50.4% and r = 0.71

R 2 = 0% and r = 0

Cautions about R 2 and r Summary measures of linear association. Possible to get R 2 = 0 with a perfect curvilinear relationship. Large R 2 does not necessarily imply that estimated regression line fits the data well. Both measures can be greatly affected by one (outlying) data point.

Cautions about R 2 and r A “statistically significant R 2 ” does not imply that slope is meaningfully different from 0. A large R 2 does not necessarily mean that useful predictions can be made. Can still get wide intervals.