Residual Analysis for ANOVA Models KNNL – Chapter 18.

Slides:



Advertisements
Similar presentations
Assumptions underlying regression analysis
Advertisements

Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 10 The Analysis of Variance.
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Model Adequacy Checking in the ANOVA Text reference, Section 3-4, pg
STA305 week 31 Assessing Model Adequacy A number of assumptions were made about the model, and these need to be verified in order to use the model for.
PSY 307 – Statistics for the Behavioral Sciences Chapter 20 – Tests for Ranked Data, Choosing Statistical Tests.
Class 16: Thursday, Nov. 4 Note: I will you some info on the final project this weekend and will discuss in class on Tuesday.
Conditions of application Assumption checking. Assumptions for mixed models and RM ANOVA Linearity  The outcome has a linear relationship with all of.
Nonparametric tests and ANOVAs: What you need to know.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
© 2010 Pearson Prentice Hall. All rights reserved Single Factor ANOVA.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
One-Way Between Subjects ANOVA. Overview Purpose How is the Variance Analyzed? Assumptions Effect Size.
Lesson #23 Analysis of Variance. In Analysis of Variance (ANOVA), we have: H 0 :  1 =  2 =  3 = … =  k H 1 : at least one  i does not equal the others.
MARE 250 Dr. Jason Turner Analysis of Variance (ANOVA) II.
Chapter 3 Experiments with a Single Factor: The Analysis of Variance
Final Review Session.
Regression Diagnostics - I
Simple Linear Regression Analysis
Statistics 350 Lecture 10. Today Last Day: Start Chapter 3 Today: Section 3.8 Homework #3: Chapter 2 Problems (page 89-99): 13, 16,55, 56 Due: February.
Stat Today: Multiple comparisons, diagnostic checking, an example After these notes, we will have looked at (skip figures 1.2 and 1.3, last.
Violations of Assumptions In Least Squares Regression.
Regression Diagnostics Checking Assumptions and Data.
Assumption and Data Transformation. Assumption of Anova The error terms are randomly, independently, and normally distributed The error terms are randomly,
Chapter 5 Transformations and Weighting to Correct Model Inadequacies
Business Statistics - QBM117 Statistical inference for regression.
Transforming the data Modified from: Gotelli and Allison Chapter 8; Sokal and Rohlf 2000 Chapter 13.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Fixing problems with the model Transforming the data so that the simple linear regression model is okay for the transformed data.
1/49 EF 507 QUANTITATIVE METHODS FOR ECONOMICS AND FINANCE FALL 2008 Chapter 9 Estimation: Additional Topics.
Checking Regression Model Assumptions NBA 2013/14 Player Heights and Weights.
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 14 Analysis.
The Examination of Residuals. The residuals are defined as the n differences : where is an observation and is the corresponding fitted value obtained.
Model Building III – Remedial Measures KNNL – Chapter 11.
Topic 14: Inference in Multiple Regression. Outline Review multiple linear regression Inference of regression coefficients –Application to book example.
Chapter 3: Diagnostics and Remedial Measures
A Repertoire of Hypothesis Tests  z-test – for use with normal distributions and large samples.  t-test – for use with small samples and when the pop.
Research Methods in Human-Computer Interaction
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
12.1 Heteroskedasticity: Remedies Normality Assumption.
Remedial measures … or “how to fix problems with the model” Transforming the data so that the simple linear regression model is okay for the transformed.
MBP1010H – Lecture 4: March 26, Multiple regression 2.Survival analysis Reading: Introduction to the Practice of Statistics: Chapters 2, 10 and 11.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
Comparing Three or More Means ANOVA (One-Way Analysis of Variance)
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Dr. C. Ertuna1 Issues Regarding Regression Models (Lesson - 06/C)
ANOVA Assumptions 1.Normality (sampling distribution of the mean) 2.Homogeneity of Variance 3.Independence of Observations - reason for random assignment.
Chapter 15 – Analysis of Variance Math 22 Introductory Statistics.
1 Always be mindful of the kindness and not the faults of others.
Model Selection and Validation. Model-Building Process 1. Data collection and preparation 2. Reduction of explanatory or predictor variables (for exploratory.
Chapter 8 1-Way Analysis of Variance - Completely Randomized Design.
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
Copyright © 2012 Pearson Education, Inc. All rights reserved. Chapter 8 Residual Analysis.
KNN Ch. 3 Diagnostics and Remedial Measures Applied Regression Analysis BUSI 6220.
Chapter 8. Process and Measurement System Capability Analysis
Chapter 3 Statistical Models or Quality Control Improvement.
Variance Stabilizing Transformations. Variance is Related to Mean Usual Assumption in ANOVA and Regression is that the variance of each observation is.
Chapters Way Analysis of Variance - Completely Randomized Design.
732G21/732G28/732A35 Lecture 3. Properties of the model errors ε 4. ε are assumed to be normally distributed
ANOVA Assumptions Consider the linear model X ij =  +  i +  ij i)  is a fixed constant common to all observations ii)The  ij are independent and normally.
Sampling and Sampling Distributions
Y - Tests Type Based on Response and Measure Variable Data
Single-Factor Studies
Single-Factor Studies
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Checking the data and assumptions before the final analysis.
Diagnostics and Remedial Measures
Diagnostics and Remedial Measures
Presentation transcript:

Residual Analysis for ANOVA Models KNNL – Chapter 18

Residuals

Model Departures Detected With Residuals and Plots Errors have non-constant variance Errors are not independent Existence of Outlying Observations Omission of Important Predictors Non-normal Errors Common Plots  Residuals versus Treatment  Residuals versus Treatment Mean  Aligned Dot Plot (aka Strip Chart)  Residuals versus Time  Residuals versus Omitted Variables  Box Plots, Histograms, Normal Probability Plots

Tests for Constant Variance H 0 :  1 2 =...=  t 2

Remedial Measures Normally distributed, Unequal variances – Use Weighted Least Squares with weights: w ij = 1/s i 2 Non-normal data (with possibly unequal variances) – Variance Stabilizing Transformations and Box-Cox Transformation – Variance proportional to mean: Y’=sqrt(Y) – Standard Deviation proportional to mean: Y’=log(Y) – Standard Deviation proportional to mean 2 : Y’=1/Y – Response is a (binomial) proportion: Y’=2arcsin(sqrt(Y)) Non-parametric tests – F-test based on ranks and Kruskal-Wallis Test

Effects of Model Departures Non-normal Data – Generally not problematic in terms of the F-test, if data are not too far from normal, and reasonably large sample sizes Unequal Error Variances – As long as sample sizes are approximately equal, generally not a problem in terms of F-test. Non-independence of error terms – Can cause problems with tests. Should use Repeated Measures ANOVA if same subject receives each treatment

Nonparametric Tests