1. Evaluating Research Articles From Start to Finish By Ellen R. Girden (Sage Publications, Inc. Thousand Oaks, CA) 2001 Chapter One PAF 502 Terrie Ekin

2. 2 Empirical Research

3. 3 Reliability Controlled Observation Validity

4. 4 The Predictive Power of the Study Decreased by THREATS to …. Internal Validity Tests with Pre-Tests and Post-Tests Other Research Situations Validity of statistical conclusion Type I / Type II Other

5. 5 Threats to Internal Validity

6. 6 Threats to Internal Validity – Studies with Pre- and Post-Tests History Maturation Instrumentation Initial Testing Regression towards the Mean

7. 7 More Threats to Internal Validity

8. 8 Threats in Other Situations Selection Bias Selective loss Diffusion of Treatment Compensatory Equalization

9. 9 Threats in Other Situations Compensatory Rivalry Resentful demoralization Interaction Effects Hawthorne Effect Experimentor Expectency

10. 10 Review of Traditional Model of Science Theory Operationalization Observation

11. 11 Possible Errors Type I Error Reject H 0 when it is true. Type II Error Accept H 0 when it is false.

12. 12 Threats to the Validity of the Statistical Conclusion Insufficient power of statistical test Unreliable instrument Varied test conditions

13. 13 Threats to the Validity of the Statistical Conclusion Varied participant characteristics Violation of statistical assumptions Fishing

14. 14 Plan of Critiques Rationale Purpose Method General Procedure Results Discussion

15. 15 Example 1 Brady, B. & Nies, M.A. (1999) A comparison of older African American women above and below poverty level. Journal of Holistic Nursing, 17(2), 197- 207. Copyright 1999 by Sage

16. 16 Critique All participants were volunteers All participants were from the same church Standard instrument used Validity measures not reported

17. 17 More Critique Researcher actively helped fill out questionnaires Potential confounding in Results Conclusion is inappropriate

18. 18 Example 2 Pressler, J.L., Hepworth, J.T., LaMontagne, L.L., Sevcik, R.H., & Hesselink, L.F. (1999). Behavioral responses of newborns of insulin- dependent and nondiabetic, healthy mothers. Clinical Nursing Research, 8(2), 102-118. Copyright 1999 by Sage

19. 19 Critique How many different clinics? Variability of birth weight very different between groups Groups matched on method of delivery Reliable assessment tool

20. 20 More Critique Well qualified examiners, interscorer agreement Well matched samples Conclusion well founded Only question concerns clinics