1. Understanding and Interpreting Statistics in Assessments Clare Trott and Hilary Maddocks

2. This Session Why use statistics in assessments? “Averages”, Standard Deviation, variance, Standard Error Normal distribution, confidence intervals Scales Overlapping confidence intervals

3. Why use statistics in assessments? What are the assumptions made?

4. Feedback

5. AVERAGE MEANMEDIANMODE Which is better? When? What is Standard Deviation? Variance? Standard Error? Central Tendency Spread

6. Feedback

7. MODE MOST OFTEN D E MEDIAN MEDIAN M ake Everyone Add Numbers (and) Share Means

8. Standard Deviation 2, 3, 6, 9, 10 Mean = 6, SD = 3.16 2, 2, 6, 10, 10 Mean = 6, SD = 3.58 Measures the average amount by which all the data values deviate from the mean Measured in the same units as the data

9. Variance and Standard Deviation Variance =

10. Standard Error This is the variance per person

11. Normal Distribution What is Normal Distribution? Why is it useful? Confidence Intervals What are Confidence Intervals? Why are they important?

12. Feedback

13. Number of standard deviations from the mean Normal Distribution

14. Confidence Intervals The wider the range the more confident we can be that the true score lies in this range TRUE SCORE Due to inherent error in measurement it is better to quote a 95% confidence interval 99% Confidence Interval 95% Confidence Interval C I

15. Confidence Intervals -1.645 1.645 1.96-1.96 2.575-2.575 90% Confidence Interval 95% Confidence Interval 99% Confidence Interval

16. True Score True score lies inside CI 95% of occasions 1 in 20 (5%) will not include the true score 95% Confidence Intervals

17. Scales What scales are used in reporting? How are they defined? Why are standardised scores preferred?

18. Feedback

19. Very lowlow Low average average High average highVery high 100130110120908070 509875902510 2 161214864 Scaled scores Standardised scores Percentiles

20. standar dised percent ile scaled 130 and above 98th>16+ 3SDWithin top 2% Very high 120-12991-9714-15+ 2SDAbove 91% high 110-11975-9012-13+ 1SDAbove 75% High average 90-10925-748-11MeanAbove 25% average 80-8910-246-7-1SDAbove 16% Low average 70-792-94-5-2SDAbove 10% Below average Below 70 Below 2< 4-3SDLowest 2% Very low Simplified Table

21. Scale to Standardised 1 to 5 ratio 10 scaled 100 standardised 9 scaled 95 standardised 11 scaled 105 standardised 15 scaled 125 standardised 6 scaled 80 standardised

22. 100130110120908070 Very lowlow Low average average High average highVery high Standardised scores against standard deviations -1sd -2sd -3sd 1sd 2sd 3sd mean

23. 509875902510 2 Very lowlowaverage High average high Very high Low average Percentiles against standard deviations -1sd -3sd -2sd 3sd 2sd 1sd mean

24. 10161214864 Very lowlowaverage High average high Very high Low average Scaled scores against standard deviations mean 3sd -2sd -3sd 1sd-1sd 2sd

25. Differences in Class Intervals Suppose we have the class intervals for two tests which could be linked, and we wish to find whether there is a significant difference between the two sets. Test 1 95% Confidence Interval 102 ± 15.8, standard error 2.96 Test 2 95% Confidence Interval 118 ± 23, standard error 6.63 86.2 102 117.8 105 118 131 There appears to be no significant difference as there is a distinct overlap.

26. H 0 : There is no significant difference in the two Confidence Intervals (the new confidence interval contains zero) H 1 : There is a significant difference in the two Confidence Intervals (the new CI does not contain zero =(118 – 102) Formula Difference in scores = 16 ± 14 New CI 2 16 30 This does not contain zero so we reject H 0 and so there is a significant difference in the two tests.

27. Test 1 95% Confidence Interval 95 ± 6, standard error 3.06 Test 2 95% Confidence Interval 106 ± 10, standard error 5.102 88 95 102 96 106 116 There appears to be no significant difference as there is a distinct overlap.

28. H 0 : There is no significant difference in the two Confidence Intervals (the new confidence interval contains zero) H 1 : There is a significant difference in the two Confidence Intervals (the new CI does not contain zero =(106 – 95) Difference in scores = 11 ± 11.6 New CI -0.6 11 22.6 This does contain zero so we accept H 0 and so there is no significant difference in the two tests.