Analysis of Covariance Combines linear regression and ANOVA Can be used to compare g treatments, after controlling for quantitative factor believed to.

Slides:



Advertisements
Similar presentations
1-Way Analysis of Variance
Advertisements

Topic 12: Multiple Linear Regression
Xuhua Xia Fitting Several Regression Lines Many applications of statistical analysis involves a continuous variable as dependent variable (DV) but both.
Linear Equations Review. Find the slope and y intercept: y + x = -1.
BA 275 Quantitative Business Methods
Psychology 202b Advanced Psychological Statistics, II February 1, 2011.
More on ANOVA. Overview ANOVA as Regression Comparison Methods.
EPI809/Spring Models With Two or More Quantitative Variables.
Introduction the General Linear Model (GLM) l what “model,” “linear” & “general” mean l bivariate, univariate & multivariate GLModels l kinds of variables.
General Linear Models -- #1 things to remember b weight interpretations 1 quantitative predictor 1 quantitative predictor & non-linear component 1 2-group.
What Is Multivariate Analysis of Variance (MANOVA)?
Multiple Linear Regression
Regression Approach To ANOVA
Chapter 6 (cont.) Regression Estimation. Simple Linear Regression: review of least squares procedure 2.
Generalized Linear Models
Objectives of Multiple Regression
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
 Combines linear regression and ANOVA  Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response.
Today: Quizz 8 Friday: GLM review Monday: Exam 2.
More complicated ANOVA models: two-way and repeated measures Chapter 12 Zar Chapter 11 Sokal & Rohlf First, remember your ANOVA basics……….
Econ 3790: Business and Economics Statistics
Applications The General Linear Model. Transformations.
23-1 Analysis of Covariance (Chapter 16) A procedure for comparing treatment means that incorporates information on a quantitative explanatory variable,
The Use of Dummy Variables. In the examples so far the independent variables are continuous numerical variables. Suppose that some of the independent.
Analysis of Covariance, ANCOVA (GLM2)
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Lab 5 instruction.  a collection of statistical methods to compare several groups according to their means on a quantitative response variable  Two-Way.
Regression Chapter 16. Regression >Builds on Correlation >The difference is a question of prediction versus relation Regression predicts, correlation.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Analysis of Covariance adjusting for potential confounds.
Week of April 6 1.ANCOVA: What it is 2.ANCOVA: What it’s good for 3.ANCOVA: How to do it 4.ANCOVA: An example.
Multivariate Models Analysis of Variance and Regression Using Dummy Variables.
Chapter 13 Multiple Regression
Analysis of Covariance (ANCOVA)
Chapter 15Design & Analysis of Experiments 8E 2012 Montgomery 1.
PSYC 3030 Review Session April 19, Housekeeping Exam: –April 26, 2004 (Monday) –RN 203 –Use pencil, bring calculator & eraser –Make use of your.
Regression Models for Quantitative (Numeric) and Qualitative (Categorical) Predictors KNNL – Chapter 8.
Single-Factor Studies KNNL – Chapter 16. Single-Factor Models Independent Variable can be qualitative or quantitative If Quantitative, we typically assume.
Environmental Modeling Basic Testing Methods - Statistics III.
Categorical Independent Variables STA302 Fall 2013.
Text Exercise 12.2 (a) (b) (c) Construct the completed ANOVA table below. Answer this part by indicating what the f test statistic value is, what the appropriate.
ANCOVA. What is Analysis of Covariance? When you think of Ancova, you should think of sequential regression, because really that’s all it is Covariate(s)
General Linear Model.
Multivariate Analysis: Analysis of Variance
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and Methods and Applications CHAPTER 15 ANOVA : Testing for Differences among Many Samples, and Much.
ANCOVA.
The Analysis of Covariance ANACOVA. Multiple Regression 1.Dependent variable Y (continuous) 2.Continuous independent variables X 1, X 2, …, X p The continuous.
Tutorial 5 Thursday February 14 MBP 1010 Kevin Brown.
Analysis of Covariance KNNL – Chapter 22. Analysis of Covariance Goal: To Compare treatments (1-Factor or Multiple Factors) after Controlling for Numeric.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Active Learning Lecture Slides For use with Classroom Response Systems Chapter 26 Analysis of Variance.
12b - 1 © 2000 Prentice-Hall, Inc. Statistics Multiple Regression and Model Building Chapter 12 part II.
29 October 2009 MRC CBU Graduate Statistics Lectures 4: GLM: The General Linear Model - ANOVA & ANCOVA1 MRC Cognition and Brain Sciences Unit Graduate.
Education 793 Class Notes ANCOVA Presentation 11.
CHAPTER 15: THE NUTS AND BOLTS OF USING STATISTICS.
Multiple Regression.
Analysis of Covariance
Analysis of Covariance, ANCOVA (GLM2)
Analysis of Variance and Regression Using Dummy Variables
Multiple Regression.
Analysis of Covariance
Simple Linear Regression
Analysis of Covariance
Multiple Linear Regression
Chapter 9: Differences among Groups
ADVANCED DATA ANALYSIS IN SPSS AND AMOS
Multivariate Analysis: Analysis of Variance
Notes Over 2.4 Writing an Equation Given the Slope and y-intercept
Analysis of Covariance
Analysis of Covariance
Analysis of Covariance
Presentation transcript:

Analysis of Covariance Combines linear regression and ANOVA Can be used to compare g treatments, after controlling for quantitative factor believed to be related to response (e.g. pre-treatment score) Can be used to compare regression equations among g groups (e.g. common slopes and/or intercepts) Model: (X quantitative, Z 1,...,Z g-1 dummy variables)

Tests for Additive Model Relation for group i (i=1,...,g-1): E(Y)=  +  X+  i Relation for group g: E(Y)=  +  X H 0 :  1 =...=  g-1 =0 (Controlling for covariate, no differences among treatments)

Interaction Model Regression slopes between Y and X are allowed to vary among groups Group i (i=1,...,g-1): E(Y)=  +  X+  i +  i X=(  +  i )+(  +  i )X Group g: E(Y)=  +  X No interaction means common slopes:  1 =...=  g-1 =0

Inference in ANCOVA Model: Construct 3 “sets” of independent variables: –{X}, {Z 1,Z 2,...,Z g-1 }, {XZ 1,...,XZ g-1 } Fit Complete model, containing all 3 sets. –Obtain SSE C (or, equivalently R C 2 ) and df C Fit Reduced, model containing {X}, {Z 1,Z 2,...,Z g-1 } –Obtain SSE R (or, equivalently R R 2 ) and df R H 0 :  1 =...=  g-1 =0 (No interaction). Test Statistic:

Inference in ANCOVA Test for Group Differences, controlling for covariate Fit Complete, model containing {X}, {Z 1,Z 2,...,Z g-1 } –Obtain SSE C (or, equivalently R C 2 ) and df C Fit Reduced, model containing {X} –Obtain SSE R (or, equivalently R R 2 ) and df R H 0 :  1 =...=  g-1 =0 (No group differences) Test Statistic:

Inference in ANCOVA Test for Effect of Covariate controlling for qualitative variable H 0 :  =0 (No covariate effect) Test Statistic:

Adjusted Means Goal: Compare the g group means, after controlling for the covariate Unadjusted Means: Adjusted Means: Obtained by evaluating regression equation at Comparing adjusted means (based on regression equation):

Multiple Comparisons of Adjusted Means Comparisons of each group with group g: Comparisons among the other g-1 groups: Variances and covariances are obtained from computer software packages (SPSS, SAS)