1. Reliability n Consistent n Dependable n Replicable n Stable

2. Two Administrations n Test/retest same test - same group n Parallel/Alternate forms different versions of test - same group

3. Two administration procedure: n Administer tests (in two sessions) n Convert to z scores (if necessary) n Correlate (Pearson or Spearman)

4. Two administration issues: n Problems????? n Duration between???? n Type of variable?????

5. One Administration One test One test One group One group One administration One administration

6. One administration procedure:  Administer test to one group  Divide questions to score  Split Half  first/second or odd/even halves????  Correlate scores from halves  Apply Spearman-Brown formula  estimate changes in length

7. Uses of one administration: n Internal consistency of items n What types of tests to use this on???

8. Inter item consistency n Statistical estimation  Kuder-Richardson Formula 20 (KR20) = dichotomous questions  Cronbach alpha (alpha coefficient) = all questions n (factor analysis)

9. Reliability coefficient n 0.00 - 1.00 n higher is better n score is relative, not absolute

10. Inter-rater reliability n Consensus between raters n Percentage of agreement n Kappa statistic (2 or many raters)

11. Threats to reliability n Construction n Administration (tester, testee, environment) n Scoring n Interpretation

12. Project homework n Which approaches were used to determine the reliability of your measure? Why were those measures selected? Could they have used other measures? Why/why not?