732G21/732G28/732A35 Lecture 3. Properties of the model errors ε 4. ε are assumed to be normally distributed 2 1. 2. 3.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Inference for Regression
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Regression Analysis Simple Regression. y = mx + b y = a + bx.
Linear regression models
Ch11 Curve Fitting Dr. Deshi Ye
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Objectives (BPS chapter 24)
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
Chapter 10 Simple Regression.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Regression Diagnostics - I
Simple Linear Regression Analysis
Statistics 350 Lecture 10. Today Last Day: Start Chapter 3 Today: Section 3.8 Homework #3: Chapter 2 Problems (page 89-99): 13, 16,55, 56 Due: February.
Regression Diagnostics Checking Assumptions and Data.
Quantitative Business Analysis for Decision Making Simple Linear Regression.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Simple Linear Regression Analysis
Linear Regression/Correlation
Forecasting Revenue: An Example of Regression Model Building Setting: Possibly a large set of predictor variables used to predict future quarterly revenues.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS & Updated by SPIROS VELIANITIS.
Correlation & Regression
Introduction to Linear Regression and Correlation Analysis
Model Checking Using residuals to check the validity of the linear regression model assumptions.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
1 1 Slide © 2012 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Chapter 3: Diagnostics and Remedial Measures
Introduction to Linear Regression
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Correlation and Prediction Error The amount of prediction error is associated with the strength of the correlation between X and Y.
12.1 Heteroskedasticity: Remedies Normality Assumption.
Analysis of Residuals Data = Fit + Residual. Residual means left over Vertical distance of Y i from the regression hyper-plane An error of “prediction”
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
Maths Study Centre CB Open 11am – 5pm Semester Weekdays
STA 286 week 131 Inference for the Regression Coefficient Recall, b 0 and b 1 are the estimates of the slope β 1 and intercept β 0 of population regression.
1 1 Slide Simple Linear Regression Estimation and Residuals Chapter 14 BA 303 – Spring 2011.
1 1 Slide © 2015 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Model Selection and Validation. Model-Building Process 1. Data collection and preparation 2. Reduction of explanatory or predictor variables (for exploratory.
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
Residual Analysis for ANOVA Models KNNL – Chapter 18.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
732G21/732G28/732A35 Lecture 4. Variance-covariance matrix for the regression coefficients 2.
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Chapter 12: Correlation and Linear Regression 1.
Simple Linear Regression and Correlation (Continue..,) Reference: Chapter 17 of Statistics for Management and Economics, 7 th Edition, Gerald Keller. 1.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Lecturer: Ing. Martina Hanová, PhD..  How do we evaluate a model?  How do we know if the model we are using is good?  assumptions relate to the (population)
Quantitative Methods Residual Analysis Multiple Linear Regression C.W. Jackson/B. K. Gordor.
Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
ENM 310 Design of Experiments and Regression Analysis
Virtual COMSATS Inferential Statistics Lecture-26
Lecture Slides Elementary Statistics Thirteenth Edition
Inference for Regression Lines
CHAPTER 29: Multiple Regression*
Simple Linear Regression
Multiple Regression Chapter 14.
Adequacy of Linear Regression Models
Adequacy of Linear Regression Models
Diagnostics and Remedial Measures
Adequacy of Linear Regression Models
Chapter 13 Multiple Regression
Essentials of Statistics for Business and Economics (8e)
Diagnostics and Remedial Measures
Presentation transcript:

732G21/732G28/732A35 Lecture 3

Properties of the model errors ε 4. ε are assumed to be normally distributed

Properties of the residuals e The residuals shall be approximately normally distributed The residuals can not be considered as independent random variables. This is due to that the calculation of all residuals involves the fitted values, which are based on the same equation.

1. Non-linearity of the regression function  Residuals against the predictor variable (X)  Residuals against the fitted values ( ) 4 2. Nonconstancy of error variance  Residuals against the predictor variable (X)  Residuals against the fitted values ( )

3. Presence of outliers  Residuals against the predictor variable (X)  Residuals against the fitted values ( )  Dot plots of the residuals Nonindependecy of error terms  Residuals against time (the order in which observations were made)

5. Non-normality of error terms  Normality plot of residuals  Histogram of residuals 6 6. Omission of important predictors  Plotting the residuals versus those potentially important variables

Four in one plot from Minitab 7

An experiment for investigating the effect of the number of days of training (X) on performance in sales situations (Y) has been conducted. 8 Days of training (X)Performance score (Y)

9

10

11

Family confidence coefficient for estimation of β 0 and β 1 Let Then,  Interval estimate for β 0  Interval estimate for β 1 12

Family confidence coefficient for confidence intervals  The Working-Hotelling procedure:  The Bonferroni procedure: 13 where

Family confidence coefficient for prediction intervals  The Scheffé procedure:  The Bonferroni procedure: 14 where