Criterion Validity Kyle Sharp A ED 615 Fall 2006

Criterion Validity What is it?  This type of validity is used to measure the ability of an instrument to predict future outcomes.  Validity is usually determined by comparing two instruments ability to predict a similar outcome with a single variable being measured.  There are two major types of criterion validity predictive or concurrent forms of validity.

Concurrent Criterion Validity  Concurrent criterion validity is used when the two instruments are used to measure the same event at the same time.  Example: Exit polls during an election can be said to have concurrent criterion validity if they predict similar outcomes to the election.

Predictive Criterion Validity  Predictive validity is used when the instrument is administered then time is allowed to pass and is measured against the another outcome.  Example: During election season polls are taken of registered voters, the outcome of the polls are measured against the outcome of the election to determine their validity.

How is Criterion Validity Measured?  The statistical measure or correlation coefficient tells the degree to which the instrument is valid based on the measured criteria.  What does it look like in an equation? The symbol “r” denotes the correlation coefficient. A higher “r” value shows a positive relationship between the instruments. A mix of high and low “r” values shows a negative relationship.

So what does all of that Mean?  With regard to survey research criterion validity in its many forms supports the outcomes given by an instrument by showing it has the power to predict outcomes as well as other known events or instruments.

Criterion Validity and Quantitative Research  When doing quantitative research it is important to have criterion validity with regard to survey instruments. Instrument validity produces dependable raw data for further quantitative analysis. Dependable raw data provides strong evidence for reaching a trustworthy conclusions.  Criterion validity is useful when other instruments can be used for comparison and lead to the strongest relationship for a given variable.

Criterion Validity and Qualitative Research  In qualitative research when answers are more subjective it is even more important to have a valid instrument. When an instrument is valid it removes the possibility of researcher bias affecting the outcome. If researcher bias is removed from the analysis then the results can lead to stronger conclusions.  In qualitative analysis it is important that the instruments used in criterion validation are measuring the same variable.

Is it ever really used?  For an article which uses criterion validity click herehere This article describes how an existing instrument that was being used had been validated using this criterion validation.

Works Consulted  Frankel, J., Wallen, N. (2006). Validity and Reliability. In How to design and evaluate research in education (6 th ed., pp. 151, ), Boston, McGraw Hill  Garton, B., Dyer, J., King, B. (2000), The use of learning styles and admission criteria in predicting academic performance and retention of college freshmen, Journal of Agricultural Education, 41(2)   m m