Suppose you are a researcher who is interested in the effects of diet and exercise on blood pressure levels of males and females age How could you obtain blood pressure readings from your subjects?
Collect Data Analyze Data Report Results/Make Decisions Possible reasons for the observed results? Treatment was effective There were pre-existing differences between the groups. Poor instrumentation Treatment (or control) was not implemented correctly It was a fluke (e.g., chance)
Reliability: Does your measuring device produce consistent results? Validity: Does your measuring device produce accurate results? Instrument: A test or other tool that is used to collect data Instrumentation
Reliability is a necessary but not sufficient condition for validity
Types of Reliability Stability Equivalency Internal Consistency Interrater Interobserver Types of Validity ContentConstruct PredictiveConcurrent
Types of Reliability Stability Equivalency Internal Consistency Interrater Interobserver
Types of Validity ContentPredictive ConstructConcurrent
Characteristics of reliability and validity They are a matter of degree The estimates are specific to groups Validity is specific to the interpretation/context
Locating Existing Instruments Tests in Print Mental Measurements Yearbook Test Critiques