Validity of Researcher-Made Surveys

Evidence of Validity

Patterns of Association

Evidence of Validity Patterns of Association Comparing Results from Different Versions of the Same Question

Evidence of Validity Patterns of Association Comparing Results from Different Versions of the Same Question Comparing Responses to Data from Other Sources

Evidence of Validity Patterns of Association Comparing Results from Different Versions of the Same Question Comparing Responses to Data from Other Sources Asking the Same Question Twice and Comparing Results

Patterns of Association Comparing Results from Different Versions of the Same Question Comparing Responses to Data from Other Sources Asking the Same Question Twice and Comparing Results Evidence of Validity Reliability

Patterns of Association Evidence of Validity

Patterns of Association Scores from different measures believed to measure similar things should correlate. Scores from different measures believed not to measure similar things should not correlate. Responses to items believed to represent the same dimensions or factors should correlate. Evidence of Validity

Comparing Responses to Data from Other Sources Evidence of Validity

Comparing Responses to Data from Other Sources Compare to records. Compare to physical testing. Compare to population estimates. Evidence of Validity

Face Validity of Survey Questions

Have a reason for every question you ask. Keep questions simple. Keep questions precise. Avoid leading questions. Foresee social desirability. Response options should be mutually exclusive and exhaustive. Provide temporal frame of reference. Use Likert format correctly.