Single-Group Threats to Internal Validity. The Single Group Case Two designs:

Slides:



Advertisements
Similar presentations
Reliability and Validity
Advertisements

Increasing your confidence that you really found what you think you found. Reliability and Validity.
Defining Characteristics
Internal Threats to Validity
Chapter 9. Internal Validity Threats to Internal Validity Alternative explanations Alternative hypotheses The DV is NOT dependent upon the IV but instead.
Introduction to Research Design Threats to Internal Validity Two or More Groups Social Threats.
Research Design and Validity Threats
Who are the participants? Creating a Quality Sample 47:269: Research Methods I Dr. Leonard March 22, 2010.
1 Exploring Quasi-Experiments Lab 5: May 9, 2008 Guthrie, J.T., Wigfield, A., & VonSecker, C. (2000). Effects of integrated instruction on motivation and.
RESEARCH DESIGN : 1. Kinds of support for making CAUSAL interpretations of observed relationships quality of theory research design used measurement procedures.
Two essential characteristics of an experiment:
Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.
Probability Sampling uses random selection
Quasi-Experimental Designs Whenever it is not possible to establish cause-and-effect relations because there is not complete control over the variables.
Integrating Technology in the ESL Classroom By: Lorraine Vazquez Fall’12/Spring ‘13 Dr. O’Conner-Petruso.
Probability Sampling uses random selection
EVALUATING YOUR RESEARCH DESIGN EDRS 5305 EDUCATIONAL RESEARCH & STATISTICS.
Experimental Research Take some action and observe its effects Take some action and observe its effects Extension of natural science to social science.
The following lecture has been approved for University Undergraduate Students This lecture may contain information, ideas, concepts and discursive anecdotes.
Parental Involvement & Teacher Communication Inna Shenker Spring 2011 Mid-term.
Types of Experiments & Research Designs UAPP 702: Research Design for Urban & Public Policy Based on notes from Steven W. Peuquet. Ph.D.
Applying Science Towards Understanding Behavior in Organizations Chapters 2 & 3.
Research Methods for Counselors COUN 597 University of Saint Joseph Class # 5 Copyright © 2015 by R. Halstead. All rights reserved.
Professor James Byrne Oct. 30 th  The Classic experiment has three components:  1. independent and dependent variables  2. pretesting and post-testing.
© 2007 Thomson, a part of the Thomson Corporation. Thomson, the Star logo, and Atomic Dog are trademarks used herein under license. All rights reserved.
INTERNAL VALIDITY AND BASIC RESEARCH DESIGN. Internal Validity  the approximate truth about inferences regarding cause-effect or causal relationships.
Introduction to Research Design Threats to Internal Validity One Group Pretest-Posttest Design.
By: Valerie Passalacqua Alana Goldstein Gloren Brown.
Threats to validity in intervention studies Potential problems Issues to consider in planning.
Experimental Designs. Experiments are conducted to identify how independent variables influence some change in a dependent variable.
Research methods and statistics.  Internal validity is concerned about the causal-effect relationship in a study ◦ Can observed changes be attributed.
Experimental Research
Establishing a Cause-Effect Relationship. Internal Validity The “treatment” and the “outcomes”The “treatment” and the “outcomes” The independent and dependent.
Multiple-Group Threats to Internal Validity. The Central Issue l When you move from single to multiple group research the big concern is whether the groups.
Internal Validity. All about whether the research design (and data analysis) warrants the conclusions. Concerned with: – Causal relationships – Various.
Experimental & Quasi-Experimental Designs Dr. Guerette.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
Chapter 8 Experiments Topics Appropriate to Experiments The Classical Experiment Selecting Subjects Variations on Experimental Designs An Illustration.
 The basic components of experiments are: 1) taking action 2) observing the consequence of that action  Experimental model is most closely linked to.
How to Develop Balanced Biliteracy in Language Minority Children Education Fall 2010 Romina G. Ladner.
EXPERIMENTAL DESIGNS. Categories Lab experiments –Experiments done in artificial or contrived environment Field experiments –Experiments done in natural.
Journalism 614: Experimental Methods Experimental Research  Take some action and observe its effects –Extension of natural science to social science.
The Integration of Smartboards in the ESL English Language Instruction
Research Design: Causal Studies l Quick Review: Three general forms of quantitative research studies –Descriptive: Describes a situation –Relational :
1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.
Table of Contents  Research Design  Threats to Internal Validity  Threats to External Validity  Proposed Data  Pre-Test Post-Test Data Results 
Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.
School of Public Administration & Policy Dr. Kaifeng Yang 研究设计 : 实验研究的基本问题.
The Effects of Classroom Seating Arrangement On On-Task Behavior and Academic Performance An Action Research Project By Danielle Steger EDUC Spring.
Research designs Research designs Quantitative Research Designs.
Research Methodology Lecture No :19 (Experimental Design-Cont)
Internal Validity Questions
Experimental Research
Experiments Why would a double-blind experiment be used?
The Non-Experimental and Quasi- Experimental Strategies:
Quantitative design: Ungraded review questions
Experiments: Part 3.
Introduction to Design
Experiments and Quasi-Experiments
Social Research Methods Experimental Research
The Nonequivalent Groups Design
Experiments and Quasi-Experiments
External Validity.
Experiments: Part 2.
Experiments: Part 3.
Experiments: Part 3.
Chapter 18: Experimental and Quasi-Experimental Research
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Types of Designs: R: Random Assignment of subjects to groups
Presentation transcript:

Single-Group Threats to Internal Validity

The Single Group Case Two designs:

The Single Group Case AdministerprogramMeasureoutcomesXO Two designs:

The Single Group Case AdministerprogramMeasureoutcomesXO Two designs: AdministerprogramMeasureoutcomesXO Measurebaseline O

The Single Group Case AdministerprogramMeasureoutcomesXO Two designs: AdministerprogramMeasureoutcomesXO Measurebaseline O Alternativeexplanations Alternativeexplanations Alternativeexplanations

ExampleExample l Compensatory education in math for 1st graders l Pre-post single group design l Measures (O) are standardized achievement tests (at start of grade 1 and start of grade 2; Forms A & B)

History Threat l Any other event that occurs between pretest and posttest l For example, kids pick up math concepts watching Sesame Street ProgramPosttest XO Pretest O

Maturation Threat l Normal growth between pretest and posttest. l They would have learned these concepts anyway, even without program. ProgramPosttest XO Pretest O

Testing Threat l The effect on the posttest of taking the pretest l May have “primed” the kids or they may have learned from the test, not the program ProgramPosttest XO Pretest O

Instrumentation Threat l Any change in the test from pretest and posttest l For example, change due to different forms of test, not to program ProgramPosttest XO Pretest O

Mortality Threat l Nonrandom dropout between pretest and posttest l For example, kids “challenged” out of program by parents or teachers ProgramPosttest XO Pretest O

Regression Threat l Group is a nonrandom subgroup of population. l For example, mostly low-math kids will appear to improve because of regression to the mean. ProgramPosttest XO Pretest O

Regression Threat ProgramPosttest XO Pretest O