1. Running Scheffe’s Multiple Comparison Test in Excel
For finding Inter-Groups Differences after getting significant results in overall ANOVA test

2. Scheffe’s Test
Scheffe’s Test is a very popular and the most conservative Post Hoc Test (Post Hoc = unplanned before experiments).
It is most useful in cases of UNequal sample size, when the number of groups increase or when planned comparison of contrast being
required (Not a Post Hoc test then)!

3. Part One
One-Way Anova

4. e.g. Completely Randomized Design Unequal Sample Size
An experiment with Completely Randomized Design has been started with 10 equal weight chickens in each group of Treatment A (Control), Treatment B, Treatment C and Treatment D, with increasing dosage of a new drug that might increase growing rate.
However, some chickens have died during the experiment, especially in groups with higher dosage.
Please find any significant different increase of weight among the 4 groups.

5. In Excel with ‘Analysis ToolPak’ Add-In activated, click Data, Data Analysis :-

6. Choose ‘Anova: Single Factor’ = One-way Anova

7. Select Data Area including Labels:-

8. Overall Anova result:-
The overall Anova result reject the null hypothesis that all group means are equal! For finding exactly where the differences exist, we proceed to run Scheffe’s Test!!
Critical F value to be used later N
Group Means
to be used later
Within Group Variance MSw to be used later

9. Step One – Creating a ‘Critical F value for Scheffe’ - F
This ‘Critical F Value for Scheffe’ is calculated by:
F = ‘F Crit’ in Anova X (Num. of Groups – 1)
= X 3 =

10. Step Two – Calculation of ‘F for Scheffe’ for all combinations
Equation for calculation of Fs (F for Scheffe) :-

11. Any F > 9.0264 would indicate significant differences
F for A vs B = ( )2/1.2408(1/10 +1/8) = / = < F for A vs C = ( )2/1.2408(1/10 +1/6) = / = > F for A vs D = ( )2/1.2408(1/10 +1/4) = / = > F for B vs C = ( )2/1.2408(1/8 +1/6) = / = > F for B vs D = ( )2/1.2408(1/8 +1/4) = / = > F for C vs D = ( )2/1.2408(1/6 +1/4) = / = >
Significant Difference between A and C !!

12. Counter Checking with SPSS
Using the same Data Set

15. Choose Post Hoc test e.g. Scheffe :-

16. Overall Anova result similiar to that in Excel:-

17. The Result in SPSS for the Scheffe Test well matched the result in Excel that only Group A and Group C are found to be significantly different in their Group Mean.

18. Proving that the Excel results are exactly equal to that in SPSS!!
Although the Excel result for the Scheffe test well matched that in SPSS, this might not be enough to
prove the figures they got are absolutely the same!
. Unlike in Tukey’s Test that ‘Critical Differences’ are can be used for counter checking to 95% Conf. Int of the SPSS output But we can simply use another method by checking
the ‘F-Table’ backward.

19. For Proving that the Excel result is consistent with SPSS!!
For Example, for Group A vs Group C :-
F for A vs C = ( )2/1.2408(1/10 +1/6)
= / = >
/(k-1) = /3 =
Num of Groups - 1
Let’s Check the F Table on df (3,24)

20. 0.016
4.2321
SPSS output
Excel Result

21. Conclusion
After activating the ‘Analysis TookPak’ Add-in in Excel, we can have useful statistical tests to use including different Anova tests.
We find that, if overall Anova result is significant, we can work further to run Post Hoc Test e.g. Scheffe’s Test to find where the mean differences exist, not too difficultly!
For One-way Anova, the Excel result has been proved to be consistent with SPSS, even with Unequal Sample Size! Let’s go to Part 2 for Two-way Anova now!!

22. Part 2
Two-Way Anova

23. e.g. Scheffe’s HDS Test using Excel in aXb factorial Design With Replication
- 6 cages each with 4 rats have been used for a Completely Randomized Two-Factors (a x b factorial) With Replication Design Experiment.
The 24 rats had been assigned randomly to be subjects for the ‘combinations’ of factor one (Diet A, B, C, D) with factor two (Lighting 1, 2, 3-2 times each). The response is a ‘score’ after the 12 ‘treatments’ e.g. a growing rate in body weight within a certain period of time.
Please find any Significant Differences caused by the two factors.

25. Running the Scheffe’s Test in Excel
e.g.Two-way Anova
aXb Factorial Design
With Replication

26. In Excel with ‘Analysis ToolPak’ Add-In activated, click Data, Data Analysis :-

27. Choose ‘Two-Factor With Replication’:-

28. Select Data Area including all Labels :-

29. A closer look:-
Range Including Labels
Number of rows of Replication

30. Output :-
Overall Anova Results

31. Pair of degree of freedom
To be used for checking F!!
‘Critical F’ value for Scheffe’s Test
Overall Anova Result
Lighting
‘MSE’ for
Scheffe’s Test
(Significant)
Diet
(Significant)
Interaction (Not Significant)

32. For the factor ‘Diet’ the Group Means are:-

33. Step One – Creating a ‘Critical F value for Scheffe’ - F
This ‘Critical F Value for Scheffe’ is calculated by:
F = ‘Critical F in Anova’ X (Num. of Groups – 1)
= X 3 =

34. Step Two – Calculation of ‘F for Scheffe’ for all combinations
Equation for Group Differences in Scheffe’s Test:-

35. Any F > 10.479 would indicate significant differences for ‘Diet’
F for A vs B = ( )2/10.417(1/6+1/6) = / = > F for A vs C = ( )2/10.417(1/6 +1/6) = / = < F for A vs D = ( )2/ (1/6+1/6) = 56.25/ = > F for B vs C = ( )2/ (1/6 +1/6) = 72.25/ = > F for B vs D = ( )2/ (1/6 +1/6) = /3.4726= < F for C vs D = ( )2/ (1/6 +1/6) = / = >
Significant Difference between A and B !!
Significant Difference between A and D !!
Significant Difference between B and C !!
Significant Difference between C and D !!

36. Counter Checking with SPSS
Using the same Data Set

41. The overall results are identical with that in Excel output previously:-

43. Proving that the Excel result are exactly equal to that in SPSS!!
Although the Excel result for the Scheffe test well matched that in SPSS, this might not be enough to
prove the figures they got are absolutely the same!
. Unlike in Tukey’s Test that ‘Critical Differences’ are can be used for counter checking to 95% Conf. Int of the SPSS output But we can simply use another method by checking
the ‘F-Table’ backward.

44. For Proving that the Excel result is consistent with SPSS!!
F for A vs B = ( )2/ (1/10 +1/10) SPSS sign / 3 = (Group Num. -1) F for A vs D = ( )2/ (1/10 +1/0) /3 = F for B vs C = ( )2/ (1/10 +1/10) / 3 = F for C vs D = ( )2/ (1/10 +1/10) /3 =

45. The Significance checked from F value from Excel well matched that in the SPSS output!!

46. Conclusion
After activating the ‘Analysis TookPak’ Add-in in Excel, we can have useful statistical tests to use including different Anova tests.
We find that, if overall Anova result is significant, we can work further in Excel to run Post Hoc Test e.g. Scheffe’s Test to find where the mean differences exist, not too difficultly!
We find that this is not only possible in One-way Anova, but even in Two-way Anova, such as aXb factorial tests!!

47. Thank You very much!