1. Emily H. Wughalter, Ed.D. Measurement & Evaluation Spring 2010

2.  Reliability means the consistency in the measurement from one testing to the next trial.

3.  Validity means does the measure or the score measure what it purports (is supposed) to measure.

4.  For a measure to be valid it must be reliable; however, a measure can be reliable without it being valid.

5. X observed X True X Error

6. X observed = X true +X Error

7.  Testing environment should be favorable  Testing environment should be well- organized  Administrator should be competent to run a favorable testing environment  Range of talent  Motivation of the performers

8.  Good day vs bad day  Learning, forgetting, and fatigue  Length of the test  Test difficulty  Ability of the test to discriminate  Number of performers

9.  Nature of measurement device  Selection of scoring unit  Precision  Errors in measurement  Number of trials  Recording errors

10.  Classroom management  Warm-up opportunity

11.  Test-Retest (Stability Reliability)  Internal Consistency

12.  Difference or change scores should be avoided because of ceiling and floor effects.  Difference scores are highly unreliable scores

13.  Objectivity means interrater reliability or consistency from one person (rater) to another.

14.  A criterion score represents the score that will be used to represent an individual’s performance  The criterion score may be the mean of a series of trials.  The criterion score may be the best score for a series of trials.

15.  When selecting a criterion measure, whether it is the best score, the mean of all the trials score, or the mean of the best 2 or 3 trials score, a researcher must determine which of the criterion measures represents the most reliable and most valid score.

16.  Inconsistent scorers  Inconsistent performance  Inconsistent measures  Failure to develop a good set of instructions  Failure to follow testing procedures