Chapter 12: Linear Regression 1. Introduction Regression analysis and Analysis of variance are the two most widely used statistical procedures. Regression.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

More on understanding variance inflation factors (VIFk)
 Population multiple regression model  Data for multiple regression  Multiple linear regression model  Confidence intervals and significance tests.
13- 1 Chapter Thirteen McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Objectives (BPS chapter 24)
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Simple Linear Regression Estimates for single and mean responses.
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Summarizing Bivariate Data Introduction to Linear Regression.
Chubaka Producciones Presenta :.
Analysis of Economic Data
Chapter 10 Simple Regression.
2012 JANUARY Sun Mon Tue Wed Thu Fri Sat
Note 14 of 5E Statistics with Economics and Business Applications Chapter 12 Multiple Regression Analysis A brief exposition.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 15-1 Chapter 15 Multiple Regression Model Building Basic Business Statistics 11 th Edition.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Simple Linear Regression Analysis
Correlation & Regression
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Simple Linear Regression Models
1 1 Slide © 2003 Thomson/South-Western Chapter 13 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple Coefficient of Determination.
Business Statistics, 4e, by Ken Black. © 2003 John Wiley & Sons Business Statistics, 4e by Ken Black Chapter 15 Building Multiple Regression Models.
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 12-1 Correlation and Regression.
Introduction to Linear Regression
MTH 161: Introduction To Statistics
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
Introduction to Probability and Statistics Thirteenth Edition Chapter 12 Linear Regression and Correlation.
An alternative approach to testing for a linear association The Analysis of Variance (ANOVA) Table.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
Copyright ©2011 Nelson Education Limited Linear Regression and Correlation CHAPTER 12.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
Solutions to Tutorial 5 Problems Source Sum of Squares df Mean Square F-test Regression Residual Total ANOVA Table Variable.
Inference for regression - More details about simple linear regression IPS chapter 10.2 © 2006 W.H. Freeman and Company.
14- 1 Chapter Fourteen McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc., All Rights Reserved.
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Summarizing Bivariate Data Non-linear Regression Example.
Multiple regression. Example: Brain and body size predictive of intelligence? Sample of n = 38 college students Response (Y): intelligence based on the.
Fitting Curves to Data 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 5: Fitting Curves to Data Terry Dielman Applied Regression.
Lecture 10 Chapter 23. Inference for regression. Objectives (PSLS Chapter 23) Inference for regression (NHST Regression Inference Award)[B level award]
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Model Building and Model Diagnostics Chapter 15.
Overview of our study of the multiple linear regression model Regression models with more than one slope parameter.
Multiple Regression I 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Multiple Regression Analysis (Part 1) Terry Dielman.
2011 Calendar Important Dates/Events/Homework. SunSatFriThursWedTuesMon January
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Inference for regression - More details about simple linear regression IPS chapter 10.2 © 2006 W.H. Freeman and Company.
732G21/732G28/732A35 Lecture 4. Variance-covariance matrix for the regression coefficients 2.
Multiple Regression II 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Multiple Regression Analysis (Part 2) Terry Dielman.
July 2007 SundayMondayTuesdayWednesdayThursdayFridaySaturday
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Descriptive measures of the degree of linear association R-squared and correlation.
David Housman for Math 323 Probability and Statistics Class 05 Ion Sensitive Electrodes.
Chapter 15 Inference for Regression. How is this similar to what we have done in the past few chapters?  We have been using statistics to estimate parameters.
Chapter 20 Linear and Multiple Regression
Regression Analysis AGEC 784.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Inference for Regression Lines
CHAPTER 29: Multiple Regression*
Regression Models - Introduction
Multiple Regression Chapter 14.
Chapter 13 Additional Topics in Regression Analysis
Essentials of Statistics for Business and Economics (8e)
2015 January February March April May June July August September
Presentation transcript:

Chapter 12: Linear Regression 1

Introduction Regression analysis and Analysis of variance are the two most widely used statistical procedures. Regression analysis: –Description –Prediction –Estimation 2

12.1 Simple Linear Regression 3 (12.1) (12.2)

12.1 Simple Linear Regression 4

Table 12.1 Quality Improvement Data 5 MonthTime Devoted to Quality Impr. # of Non- conforming January5620 February5819 March5520 April6216 May6315 June6814 July6615 August6813 September7010 October6713 November729 December648

Figure 12.1 Scatter Plot 6

Figure 12.1a Scatter Plot 7

12.1 Simple Linear Regression 8

The regression equation is Y = X Predictor Coef SE Coef T P Constant X S = R-Sq = 95.6% R-Sq(adj) = 95.2% Analysis of Variance Source DF SS MS F P Regression Residual Error Total

12.1 Simple Linear Regression 10

12.2 Worth of the Prediction Equation 11 ObsXYFitSE FitResidualSt Resid

12.2 Worth of the Prediction Equation 12 (12.4)

12.3 Assumptions 13 (12.1)

12.4 Checking Assumptions through Residual Plots 14

12.4 Checking Assumptions through Residual Plots 15

12.5 Confidence Intervals 16

12.5 Hypothesis Test 17

12.6 Prediction Interval for Y 18

12.6 Prediction Interval for Y 19

12.7 Regression Control Chart 20 (12.5) (12.6)

12.8 Cause-Selecting Control Chart 21 The general idea is to try to distinguish between quality problems that occur at one stage in a process from problems that occur at a previous processing step. Let Y be the output from the second step and let X denote the output from the first step. The relationship between X and Y would be modeled.

12.9 Linear, Nonlinear, and Nonparametric Profiles 22 Profile refers to the quality of a process or product being characterized by a (Linear, Nonlinear, or Nonparametric) relationship between a response variable and one or more explanatory variables. A possible way is to monitor each parameter in the model with a Shewhart chart. –The independent variables must be fixed –Control chart for R 2

12.10 Inverse Regression 23 An important application of simple linear regression for quality improvement is in the area of calibration. Assume two measuring tools are available – One is quite accurate but expensive to use and the other is not as expensive but also not as accurate. If the measurements obtained from the two devices are highly correlated, then the measurement that would have been made using the expensive measuring device could be predicted fairly from the measurement using the less expensive device. Let Y = measurement from the less expensive device X = measurement from the accurate device

12.10 Inverse Regression 24

12.10 Inverse Regression Example 25 YX

12.11 Multiple Linear Regression 26

12.12 Issues in Multiple Regression Variable Selection 27

Multicollinear Data Problems occur when at least two of the regressors are related in some manner. Solutions: –Discard one or more variables causing the multicollinearity –Use ridge regression 28

Residual Plots 29

Transformations 30