Evaluating Research Articles From Start to Finish By Ellen R. Girden (Sage Publications, Inc. Thousand Oaks, CA) 2001 Chapter One PAF 502 Terrie Ekin.

Slides:



Advertisements
Similar presentations
Agenda Group Hypotheses Validity of Inferences from Research Inferences and Errors Types of Validity Threats to Validity.
Advertisements

Chapter 8: Construct and External Validity in Experimental Research
Evaluation Procedures
Copyright © Allyn & Bacon (2007) Hypothesis Testing, Validity, and Threats to Validity Graziano and Raulin Research Methods: Chapter 8 This multimedia.
Experimental Research Neuman and Robson, Ch. 9. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.
Validity of Quantitative Research Conclusions. Internal Validity External Validity Issues of Cause and Effect Issues of Generalizability Validity of Quantitative.
Experimental Research Designs
Research Design and Validity Threats
Educational Action Research Todd Twyman Summer 2011 Week 1.
BHS Methods in Behavioral Sciences I April 25, 2003 Chapter 6 (Ray) The Logic of Hypothesis Testing.
Threats to Conclusion Validity. Low statistical power Low statistical power Violated assumptions of statistical tests Violated assumptions of statistical.
1 Exploring Quasi-Experiments Lab 5: May 9, 2008 Guthrie, J.T., Wigfield, A., & VonSecker, C. (2000). Effects of integrated instruction on motivation and.
Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.
MSc Applied Psychology PYM403 Research Methods Validity and Reliability in Research.
Types of Group Designs ____________ group design. The experiment compares groups that receive or _______________ the IV (control group) e.g., behavior.
Group-Level Research Designs
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
1 Exploring Quasi-experiments Lab Assignment #5 Due May 16, 2008 Locate an empirical journal article that employs a quasi-experimental design. Closely.
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. Experimental Research Chapter Thirteen.
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
Experimental Research Take some action and observe its effects Take some action and observe its effects Extension of natural science to social science.
Experimental Design The Gold Standard?.
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Day 6: Non-Experimental & Experimental Design
Chapter 11 Experimental Designs
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 11 Experimental Designs.
CHAPTER 8, experiments.
 Internal Validity  Construct Validity  External Validity * In the context of a research study, i.e., not measurement validity.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Enhancing Rigor in Quantitative Research.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Understanding Research Design Can have confusing terms Research Methodology The entire process from question to analysis Research Design Clearly defined.
Experimental Designs. Experiments are conducted to identify how independent variables influence some change in a dependent variable.
Experimental Design Chapter 1 Research Strategies and the Control of Nuisance Variables.
Research methods and statistics.  Internal validity is concerned about the causal-effect relationship in a study ◦ Can observed changes be attributed.
Experimental Designs Leedy and Ormrod, Ch. 10. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.
Experimental Research
Internal Validity. All about whether the research design (and data analysis) warrants the conclusions. Concerned with: – Causal relationships – Various.
Experimental Research Methods in Language Learning Chapter 5 Validity in Experimental Research.
Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.
Experimental & Quasi-Experimental Designs Dr. Guerette.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
 The basic components of experiments are: 1) taking action 2) observing the consequence of that action  Experimental model is most closely linked to.
Chapter Eight: Quantitative Methods
11-1 Chapter 11 Experiments and Test Markets Learning Objectives Understand... uses for experimentation advantages and disadvantages of the experimental.
Experimental Research Design Causality & Validity Threats to Validity –Construct (particular to experiments) –Internal –External – already discussed.
CJ490: Research Methods in Criminal Justice UNIT #4 SEMINAR Professor Jeffrey Hauck.
BHS Methods in Behavioral Sciences I May 9, 2003 Chapter 6 and 7 (Ray) Control: The Keystone of the Experimental Method.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 10 Experiments.
Unit 8.  Program improvement or appraisal  Assessing the value of a program  Measuring the efficacy of particular components of a program  Meeting.
Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.
Experimental Research Neuman and Robson, Ch. 9. Introduction Experiments are part of the traditional science model Involve taking “action” and observing.
Educational Research Experimental Research Chapter 9 (8 th Edition) Chapter 13 (7 th Edition) Gay and Airasian.
Research strategies & Methods of data collection
Experimental Research
Experiments Why would a double-blind experiment be used?
Instructor’s manual Mass Media Research: An Introduction, 7th Edition
Chapter 8 Experimental Design The nature of an experimental design
Hypothesis Testing, Validity, and Threats to Validity
Research Methods: Concepts and Connections First Edition
Chapter Eight: Quantitative Methods
Introduction to Design
The Nonequivalent Groups Design
Research strategies & Methods of data collection
Group Experimental Design
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Research strategies & Methods of data collection
BHS Methods in Behavioral Sciences I
Presentation transcript:

Evaluating Research Articles From Start to Finish By Ellen R. Girden (Sage Publications, Inc. Thousand Oaks, CA) 2001 Chapter One PAF 502 Terrie Ekin

2 Empirical Research

3 Reliability Controlled Observation Validity

4 The Predictive Power of the Study Decreased by THREATS to …. Internal Validity Tests with Pre-Tests and Post-Tests Other Research Situations Validity of statistical conclusion Type I / Type II Other

5 Threats to Internal Validity

6 Threats to Internal Validity – Studies with Pre- and Post-Tests History Maturation Instrumentation Initial Testing Regression towards the Mean

7 More Threats to Internal Validity

8 Threats in Other Situations Selection Bias Selective loss Diffusion of Treatment Compensatory Equalization

9 Threats in Other Situations Compensatory Rivalry Resentful demoralization Interaction Effects Hawthorne Effect Experimentor Expectency

10 Review of Traditional Model of Science Theory Operationalization Observation

11 Possible Errors Type I Error Reject H 0 when it is true. Type II Error Accept H 0 when it is false.

12 Threats to the Validity of the Statistical Conclusion Insufficient power of statistical test Unreliable instrument Varied test conditions

13 Threats to the Validity of the Statistical Conclusion Varied participant characteristics Violation of statistical assumptions Fishing

14 Plan of Critiques Rationale Purpose Method General Procedure Results Discussion

15 Example 1 Brady, B. & Nies, M.A. (1999) A comparison of older African American women above and below poverty level. Journal of Holistic Nursing, 17(2), Copyright 1999 by Sage

16 Critique All participants were volunteers All participants were from the same church Standard instrument used Validity measures not reported

17 More Critique Researcher actively helped fill out questionnaires Potential confounding in Results Conclusion is inappropriate

18 Example 2 Pressler, J.L., Hepworth, J.T., LaMontagne, L.L., Sevcik, R.H., & Hesselink, L.F. (1999). Behavioral responses of newborns of insulin- dependent and nondiabetic, healthy mothers. Clinical Nursing Research, 8(2), Copyright 1999 by Sage

19 Critique How many different clinics? Variability of birth weight very different between groups Groups matched on method of delivery Reliable assessment tool

20 More Critique Well qualified examiners, interscorer agreement Well matched samples Conclusion well founded Only question concerns clinics

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.