1. ANOVA TABLE Factorial Experiment Completely Randomized Design

2. Anova table for the 3 factor Experiment SourceSSdfMSFp -value ASS A a - 1MS A MS A /MS Error BSS B b - 1MS B MS B /MS Error CSS C c - 1MS C MS C /MS Error ABSS AB (a - 1)(b - 1)MS AB MS AB /MS Error ACSS AC (a - 1)(c - 1)MS AC MS AC /MS Error BCSS BC (b - 1)(c - 1)MS BC MS BC /MS Error ABCSS ABC (a - 1)(b - 1)(c - 1)MS ABC MS ABC /MS Error ErrorSS Error abc(n - 1)MS Error

3. Sum of squares entries Similar expressions for SS B, and SS C. Similar expressions for SS BC, and SS AC.

4. Sum of squares entries Finally

5. The statistical model for the 3 factor Experiment

6. Anova table for the 3 factor Experiment SourceSSdfMSFp -value ASS A a - 1MS A MS A /MS Error BSS B b - 1MS B MS B /MS Error CSS C c - 1MS C MS C /MS Error ABSS AB (a - 1)(b - 1)MS AB MS AB /MS Error ACSS AC (a - 1)(c - 1)MS AC MS AC /MS Error BCSS BC (b - 1)(c - 1)MS BC MS BC /MS Error ABCSS ABC (a - 1)(b - 1)(c - 1)MS ABC MS ABC /MS Error ErrorSS Error abc(n - 1)MS Error

7. The testing in factorial experiments 1.Test first the higher order interactions. 2.If an interaction is present there is no need to test lower order interactions or main effects involving those factors. All factors in the interaction affect the response and they interact 3.The testing continues with lower order interactions and main effects for factors which have not yet been determined to affect the response.

8. Examples Using SPSS

9. Example In this example we are examining the effect of We have n = 10 test animals randomly assigned to k = 6 diets the level of protein A (High or Low) and the source of protein B (Beef, Cereal, or Pork) on weight gains (grams) in rats.

10. The k = 6 diets are the 6 = 3×2 Level-Source combinations 1.High - Beef 2.High - Cereal 3.High - Pork 4.Low - Beef 5.Low - Cereal 6.Low - Pork

11. Table Gains in weight (grams) for rats under six diets differing in level of protein (High or Low) and s ource of protein (Beef, Cereal, or Pork) Level of ProteinHigh ProteinLow protein Source of ProteinBeefCerealPorkBeefCerealPork Diet123456 7398949010749 1027479769582 1185696909773 10411198648086 8195102869881 10788102517497 100821087274106 877791906770 11786120958961 11192105785882 Mean100.085.999.579.283.978.7 Std. Dev.15.1415.0210.9213.8915.7116.55

12. The data as it appears in SPSS

13. To perform ANOVA select Analyze->General Linear Model-> Univariate

14. The following dialog box appears

15. Select the dependent variable and the fixed factors Press OK to perform the Analysis

16. The Output

17. Example – Four factor experiment Four factors are studied for their effect on Y (luster of paint film). The four factors are: Two observations of film luster (Y) are taken for each treatment combination 1) Film Thickness - (1 or 2 mils) 2)Drying conditions (Regular or Special) 3)Length of wash (10,30,40 or 60 Minutes), and 4)Temperature of wash (92 ˚C or 100 ˚C)

18. The data is tabulated below: Regular DrySpecial Dry Minutes92  C100  C92  C100  C 1-mil Thickness 203.43.419.614.52.13.817.213.4 304.14.117.517.04.04.613.514.3 404.94.217.615.25.13.316.017.8 605.04.920.917.18.34.317.513.9 2-mil Thickness 205.53.726.629.54.54.525.622.5 305.76.131.630.25.95.929.229.8 405.55.630.530.25.55.832.627.4 607.26.031.429.68.09.933.529.5

19. The Data as it appears in SPSS

20. The dialog box for performing ANOVA

21. The output

22. Random Effects and Fixed Effects Factors

23. So far the factors that we have considered are fixed effects factors This is the case if the levels of the factor are a fixed set of levels and the conclusions of any analysis is in relationship to these levels. If the levels have been selected at random from a population of levels the factor is called a random effects factor The conclusions of the analysis will be directed at the population of levels and not only the levels selected for the experiment

24. Example - Fixed Effects Source of Protein, Level of Protein, Weight Gain Dependent –Weight Gain Independent –Source of Protein, Beef Cereal Pork –Level of Protein, High Low

25. Example - Random Effects In this Example a Taxi company is interested in comparing the effects of three brands of tires (A, B and C) on mileage (mpg). Mileage will also be effected by driver. The company selects b = 4 drivers at random from its collection of drivers. Each driver has n = 3 opportunities to use each brand of tire in which mileage is measured. Dependent –Mileage Independent –Tire brand (A, B, C), Fixed Effect Factor –Driver (1, 2, 3, 4), Random Effects factor

26. The Model for the fixed effects experiment where ,  1,  2,  3,  1,  2, (  ) 11, (  ) 21, (  ) 31, (  ) 12, (  ) 22, (  ) 32, are fixed unknown constants And  ijk is random, normally distributed with mean 0 and variance  2. Note:

27. The Model for the case when factor B is a random effects factor where ,  1,  2,  3, are fixed unknown constants And  ijk is random, normally distributed with mean 0 and variance  2.  j is normal with mean 0 and variance and (  ) ij is normal with mean 0 and variance Note: This model is called a variance components model

28. The Anova table for the two factor model SourceSSdfMS ASS A a -1 SS A /(a – 1) BSS A b - 1 SS B /(a – 1) ABSS AB (a -1)(b -1) SS AB /(a – 1) (a – 1) ErrorSS Error ab(n – 1) SS Error /ab(n – 1)

29. The Anova table for the two factor model (A, B – fixed) SourceSSdfMSEMSF ASS A a -1MS A MS A /MS Error BSS A b - 1MS B MS B /MS Error ABSS AB (a -1)(b -1)MS AB MS AB /MS Error ErrorSS Error ab(n – 1)MS Error EMS = Expected Mean Square

30. The Anova table for the two factor model (A – fixed, B - random) SourceSSdfMSEMSF ASS A a -1MS A MS A /MS AB BSS A b - 1MS B MS B /MS Error ABSS AB (a -1)(b -1)MS AB MS AB /MS Error ErrorSS Error ab(n – 1)MS Error Note: The divisor for testing the main effects of A is no longer MS Error but MS AB.

31. Rules for determining Expected Mean Squares (EMS) in an Anova Table 1.Schultz E. F., Jr. “Rules of Thumb for Determining Expectations of Mean Squares in Analysis of Variance,”Biometrics, Vol 11, 1955, 123-48. Both fixed and random effects Formulated by Schultz [1]

32. 1.The EMS for Error is  2. 2.The EMS for each ANOVA term contains two or more terms the first of which is  2. 3.All other terms in each EMS contain both coefficients and subscripts (the total number of letters being one more than the number of factors) (if number of factors is k = 3, then the number of letters is 4) 4.The subscript of  2 in the last term of each EMS is the same as the treatment designation.

33. 5.The subscripts of all  2 other than the first contain the treatment designation. These are written with the combination involving the most letters written first and ending with the treatment designation. 6.When a capital letter is omitted from a subscript, the corresponding small letter appears in the coefficient. 7.For each EMS in the table ignore the letter or letters that designate the effect. If any of the remaining letters designate a fixed effect, delete that term from the EMS.

34. 8.Replace  2 whose subscripts are composed entirely of fixed effects by the appropriate sum.

35. Example: 3 factors A, B, C – all are random effects SourceEMSF A B C AB AC BC ABC Error

36. Example: 3 factors A fixed, B, C random SourceEMSF A B C AB AC BC ABC Error

37. Example: 3 factors A, B fixed, C random SourceEMSF A B C AB AC BC ABC Error

38. Example: 3 factors A, B and C fixed SourceEMSF A B C AB AC BC ABC Error

39. Example - Random Effects In this Example a Taxi company is interested in comparing the effects of three brands of tires (A, B and C) on mileage (mpg). Mileage will also be effected by driver. The company selects at random b = 4 drivers at random from its collection of drivers. Each driver has n = 3 opportunities to use each brand of tire in which mileage is measured. Dependent –Mileage Independent –Tire brand (A, B, C), Fixed Effect Factor –Driver (1, 2, 3, 4), Random Effects factor

40. The Data

41. Asking SPSS to perform Univariate ANOVA

42. Select the dependent variable, fixed factors, random factors

43. The Output The divisor for both the fixed and the random main effect is MS AB This is contrary to the advice of some texts

44. The Anova table for the two factor model (A – fixed, B - random) SourceSSdfMSEMSF ASS A a -1MS A MS A /MS AB BSS A b - 1MS B MS B /MS Error ABSS AB (a -1)(b -1)MS AB MS AB /MS Error ErrorSS Error ab(n – 1)MS Error Note: The divisor for testing the main effects of A is no longer MS Error but MS AB. References Guenther, W. C. “Analysis of Variance” Prentice Hall, 1964

45. The Anova table for the two factor model (A – fixed, B - random) SourceSSdfMSEMSF ASS A a -1MS A MS A /MS AB BSS A b - 1MS B MS B /MS AB ABSS AB (a -1)(b -1)MS AB MS AB /MS Error ErrorSS Error ab(n – 1)MS Error Note: In this case the divisor for testing the main effects of A is MS AB. This is the approach used by SPSS. References Searle “Linear Models” John Wiley, 1964

46. Crossed and Nested Factors

47. The factors A, B are called crossed if every level of A appears with every level of B in the treatment combinations. Levels of B Levels of A

48. Factor B is said to be nested within factor A if the levels of B differ for each level of A. Levels of B Levels of A

49. Example: A company has a = 4 plants for producing paper. Each plant has 6 machines for producing the paper. The company is interested in how paper strength (Y) differs from plant to plant and from machine to machine within plant Plants Machines

50. Machines (B) are nested within plants (A) The model for a two factor experiment with B nested within A.

51. The ANOVA table SourceSSdfMSFp - value ASS A a - 1MS A MS A /MS Error B(A)B(A)SS B(A) a(b – 1)MS B(A) MS B(A) /MS Error ErrorSS Error ab(n – 1)MS Error Note: SS B(A ) = SS B + SS AB and a(b – 1) = (b – 1) + (a - 1)(b – 1)

52. Example: A company has a = 4 plants for producing paper. Each plant has 6 machines for producing the paper. The company is interested in how paper strength (Y) differs from plant to plant and from machine to machine within plant. Also we have n = 5 measurements of paper strength for each of the 24 machines

53. The Data

54. Anova Table Treating Factors (Plant, Machine) as crossed

55. Anova Table: Two factor experiment B(machine) nested in A (plant)