23-1 Analysis of Covariance (Chapter 16) A procedure for comparing treatment means that incorporates information on a quantitative explanatory variable, X, sometimes called a covariate. The procedure, ANCOVA, is a combination of ANOVA with regression.

23-2 Example: Calf Weight Gain An animal scientist wishes to examine the impact of a pair of new dietary supplements on calf weight gain (response). Three treatments are defined: standard diet, standard diet + supplement Q, and standard diet + supplement R. All new calves from a large herd are available for use as study units. She selects 30 calves for study. Calves are randomized to the three diets at random (completely randomized design). Initial weights are recorded, then calves are placed on the diets. At the end of four weeks the final weight is taken and weight gain is computed. Simple analysis of variance and associated multiple comparisons procedures indicate no significant differences in weight gain between the two supplementary diets, but big differences between the supplemental diets and the standard diet. Is this the end of the story? …

23-3 ANOVA Results Average Weight Gain (Response g/day) Standard Diet + Supplement Q + Supplement R xx x xx x x xx xxx xxx x xx xx x x x xx x x x Simple ANOVA of a one-way classification would suggest no difference between Supplements Q and R but both different from Standard diet.

23-4 Initial Weights Initial Weight Standard Diet + Supplement Q + Supplement R xx x x xx x x xx xx x xxxx x xx x x x xx xx x x x Plotting of the initial weights by group shows that the groups were not equal when it came to initial weights.

23-5 Weight Gain to Initial Weight Standard Diet Weight (kg) age If animals come into the study at different ages, they have different initial weights and are at different points on the growth curve. Expected weight gains will be different depending on age at entry into study.

23-6 Regression of Initial Weight to Weight Gain Initial Weight (x) Weight Gain (g/day) (Y) If we disregard the age of the animal but instead focus on the initial weight, we see that there is a linear relationship between initial weight and the weight gain expected.

23-7 Covariates Initial weight in the previous example is a covariable or covariate. A covariate is a disturbing variable (confounder), that is, it is known to have an effect on the response. Usually, the covariate can be measured but often we may not be able to control its effect through blocking. In the EXAMPLE, had the animal scientist known that the calves were very variable in initial weight (or age), she could have: Created blocks of 3 or 6 equal weight animals, and randomized treatments to calves within these blocks. This would have entailed some cost in terms of time spent sorting the calves and then keeping track of block membership over the life of the study. It was much easier to simply record the calf initial weight and then use analysis of covariance for the final analysis. In many cases, due to the continuous nature of the covariate, blocking is just not feasible.

23-8 Expectations under H o Initial Weight (x) Expected Weight Gain (g/day) (Y) Under H o : no treatment effects. If all animals had come in with the same initial weight, All three treatments would produce the same weight gain. Average Weight Animal

23-9 Expectations under H A Initial Weight (x) Expected Weight Gain (g/day) (Y) Standard Diet (c) + Supplement Q (q) + Supplement R (r) Under H a : Significant Treatment effects Average Weight Animal WG s WG Q WG R Different treatments produce different weight gains for animals of the same initial weight.

23-10 Different Initial Weights Initial Weight (x) Expected Weight Gain (g/day) (Y) cc c c cc c c cc qq q qqqq q qq r r r rr rr r r r Under H o : no treatment effects. If the average initial weights in the treatment groups differ, the observed weight gains will be different, even if treatments have no effect. WG s WG Q WG R

23-11 Observed Responses under H A Initial Weight (x) Weight Gain (g/day) (Y) cc c c cc c c cc qq q qqqq q qq r r r rr rr r r r q q q q q q q q q q c c c c c c c c c c r r r r r r r r r r Standard Diet + Supplement Q + Supplement R Under H A : Significant Treatment effects Suppose now that different supplements actually do increase weight gain. This translates to animals in different treatment groups following different, but parallel regression lines with initial weight. WG R WG s WG Q What difference in weight gain is due to Initial weight and what is due to Treatment?

23-12 Observed Group Means Initial Weight (x) Weight Gain (g/day) (Y) cc c c cc c c cc qq q qqqq q qq r r r rr rr r r r q q q q q q q q q q c c c c c c c c c c r r r r r r r r r r Standard Diet + Supplement Q + Supplement R Unadjusted treatment means Simple one-way classification ANOVA (without accounting for initial weight) gives us the wrong answer!

23-13 Predicted Average Responses Initial Weight (x) Weight Gain (g/day) (Y) cc c c cc c c cc qq q qqqq q qq r r r rr rr r r r q q q q q q q q q q c c c c c c c c c c r r r r r r r r r r Standard Diet + Supplement Q + Supplement R Expected weight gain is computed for treatments for the average initial weight and comparisons are then made. Adjusted treatment means

23-14 ANCOVA: Objectives The objective of an analysis of covariance is to compare the treatment means after adjusting for differences among the treatments due to differences in the covariate levels for the treatments groups. The analysis proceeds by combining a regression model with an analysis of variance model.

23-15 Model The  i, i=1,…,t, are estimates of how each of the t treatments modifies the overall mean response. (The index j=1,…,n, runs over the n replicates for each treatment.) The slope coefficient, , is a measure of how the average response changes as the value of the covariate changes. The analysis proceeds by fitting a linear regression model with dummy variables to code for the different treatment levels.

23-16 A Priori Assumptions The covariate is related to the response, and can account for variation in the response. Check with a scatterplot of Y vs. X. The covariate is NOT related to the treatments. If Y is related to X, then the variance of the treatment differences is increased relative to that obtained from an ANOVA model without X, which results in a loss of precision. The treatment’s regression equations are linear in the covariate. Check with a scatterplot of Y vs. X, for each treatment. Non-linearity can be accommodated (e.g. polynomial terms, transforms), but analysis may be more complex. The regression lines for the different treatments are parallel. This means there is only one slope in the Y vs. X plots. Non-parallel lines can be accommodated, but this complicates the analysis since differences in treatments will now depend on the value of X.

23-17 Example Four different formulations of an industrial glue are being tested. The tensile strength (response) of the glue is known to be related to the thickness as applied. Five observations on strength (Y) in pounds, and thickness (X) in 0.01 inches are made for each formulation. Here: There are t=4 treatments (formulations of glue). Covariate X is thickness of applied glue. Each treatment is replicated n=5 times at different values of X. FormulationStrengthThickness

23-18 Formulation Profiles

23-19 SAS Program data glue; input FormulationStrengthThickness; datalines; ; run; proc glm; class formulation; model strength = thickness formulation / solution ; lsmeans formulation / stderr pdiff; run; The basic model is a combination of regression and one-way classification.

23-20 Output: Use Type III SS to test significance of each variable Source DF Squares Mean Square F Value Pr > F Model Error Corrected Total R-Square Coeff Var Root MSE Strength Mean Source DF Type I SS Mean Square F Value Pr > F Thickness <.0001 Formulation Source DF Type III SS Mean Square F Value Pr > F Thickness <.0001 Formulation Standard Parameter Estimate Error t Value Pr > |t| Intercept B <.0001 Thickness <.0001 Formulation B Formulation B Formulation B Formulation B... Regression on thickness is significant. No formulation differences. Divide by MSE to get mean squares. MSE

23-21 Least Squares Means (Adjusted Formulation means computed at the average value of Thickness [=12.45]) The GLM Procedure Least Squares Means Strength Standard LSMEAN Formulation LSMEAN Error Pr > |t| Number < < < < Least Squares Means for effect Formulation Pr > |t| for H0: LSMean(i)=LSMean(j) Dependent Variable: Strength i/j

23-22 ANCOVA in Minitab Formulation Strength Thickness Stat > ANOVA > General Linear Model … > Responses: Strength > Model: Formulation > Covariates: Thickness > Options: Adjusted (Type III) Sums of Squares General Linear Model: Strength versus Formulation Factor Type Levels Values Formulat fixed Source DF Seq SS Adj SS Adj MS F P Thicknes Formulat Error Total Term Coef SE Coef T P Constant Thicknes Formulat

23-23 Factor Plots… > Main Effects Plot > Formulation

23-24 ANCOVA in R > glue <- read.table("glue.txt",header=TRUE) > glue$Formulation <- as.factor(glue$Formulation) > # fit linear models: full, thickness only, formulation only > full.lm <- lm(Strength ~ Formulation + Thickness, data=glue) > thick.lm <- lm(Strength ~ Thickness, data=glue) > formu.lm <- lm(Strength ~ Formulation, data=glue) > > anova(thick.lm,full.lm) Analysis of Variance Table Model 1: Strength ~ Thickness Model 2: Strength ~ Formulation + Thickness Res.Df RSS Df Sum of Sq F Pr(>F) > anova(formu.lm,full.lm) Analysis of Variance Table Model 1: Strength ~ Formulation Model 2: Strength ~ Formulation + Thickness Res.Df RSS Df Sum of Sq F Pr(>F) e-05 *** Test for Formulation differences Test for significance of Thickness

23-25 R > summary(full.lm) Call: lm(formula = Strength ~ Formulation + Thickness, data = glue) Residuals: Min 1Q Median 3Q Max Coefficients: Estimate Std. Error t value Pr(>|t|) (Intercept) e-14 *** Formulation Formulation Formulation Thickness e-05 *** > summary(thick.lm) Call: lm(formula = Strength ~ Thickness, data = glue) Residuals: Min 1Q Median 3Q Max Coefficients: Estimate Std. Error t value Pr(>|t|) (Intercept) < 2e-16 *** Thickness e-06 *** Residual standard error: on 18 degrees of freedom Multiple R-Squared: , Adjusted R-squared: F-statistic: on 1 and 18 DF, p-value: 4.317e-06 Full model (can be refined by omitting formulation) Reduced model (formulation omitted)

23-26 R Plot lines for full model; but these can all be replaced by single line for reduced model (blue).

23-27 R Check fit of reduced model (with just thickness).