1. Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved.

2. Learning Objectives »Explain what a scholarly article is »Differentiate between CPR and LOAF elements of a scholarly articles »Analyze the relative merits of various scholarly articles »Use various search engines to find scholarly articles »Identify an area of research interest »Discriminate between scholarly articles and other publications © 2014 John Wiley & Sons, Inc. All rights reserved.

3. Key Terms »Concurrent validity »Convergent validity »Construct validity »Content validity »Criterion validity »Credibility »Dependent variable »Discriminant validity »Equivalent form reliability »External validity »Face validity »General validity »Golem effect »Independent variable »Instrumentation »Instrument validity »Internal consistency reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

4. Key Terms(cont’d) ˃ Internal validity ˃ Intervening variable ˃ Inter-rater reliability ˃ Moderating variable ˃ Operational definition ˃ Predictive validity ˃ Pygmalion effect ˃ Reliability ˃ Testing ˃ Test-retest reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

5. Internal Credibility »Believability »Trustworthiness »Specificity © 2014 John Wiley & Sons, Inc. All rights reserved.

6. Validity »Content validity »Face validity »Construct validity »Criterion validity »Predictive validity »Discriminant validity © 2014 John Wiley & Sons, Inc. All rights reserved.

7. Variables »Independent variable »Dependent variable »Confounding (moderating) variable »Intervening variable »Operationalizing the variables © 2014 John Wiley & Sons, Inc. All rights reserved.

8. Validity InternalExternal »General validity »Instrumental validity »To what extent can you apply the insights to other situations? © 2014 John Wiley & Sons, Inc. All rights reserved.

9. Internal Validity ˃ To what extent is your research design really focused on the problem statement you have? ˃ Will you collect and analyze relevant and accurate information? ˃ How can you be sure that your design answers your research questions? ˃ What aspects of the design can you create to ensure validity? © 2014 John Wiley & Sons, Inc. All rights reserved.

10. Forms of Instrument Validity »Content validity »Construct validity »Criterion validity »Discriminant validity »Face validity »Predictive validity © 2014 John Wiley & Sons, Inc. All rights reserved.

11. External Validity »To what extent does the literature review place your expected findings within a broader context? »Will you be able to generalize from what you find? »What limitations or qualifications will you have to make about your results? »How can you extend your findings and suggest opportunities for further research so that you protect its validity? »How does previous research help you interpret your results? »Does previous research provide a rationale for your research design and suggestions about the applicability of your findings? © 2014 John Wiley & Sons, Inc. All rights reserved.

12. Threats to Validity »Ambiguity »History »Instrumentation »Mortality »Maturation »Testing © 2014 John Wiley & Sons, Inc. All rights reserved.

13. Reliability »Types ˃ Equivalent form reliability ˃ Internal consistency reliability ˃ Inter-rater reliability ˃ Test-retest reliability © 2014 John Wiley & Sons, Inc. All rights reserved.

14. Review of Class Session »Anything unclear? »One thing that I was amazed by in sampling is … © 2014 John Wiley & Sons, Inc. All rights reserved.