The Nonequivalent Groups Design

Slides:



Advertisements
Similar presentations
Chapter 11: Quasi- Experimental Designs This multimedia product and its contents are protected under copyright law. The following are prohibited by law:
Advertisements

Defining Characteristics
Validity of Quantitative Research Conclusions. Internal Validity External Validity Issues of Cause and Effect Issues of Generalizability Validity of Quantitative.
Introduction to Research Design Threats to Internal Validity Two or More Groups Social Threats.
Research Design and Validity Threats
Wed Oct 29, 2003 Exams after class Mean(SD): 71.6(11.6)% Range: 44-95% Appointment Research day 1 week.
Research Problems.
Threats to Conclusion Validity. Low statistical power Low statistical power Violated assumptions of statistical tests Violated assumptions of statistical.
1 Exploring Quasi-Experiments Lab 5: May 9, 2008 Guthrie, J.T., Wigfield, A., & VonSecker, C. (2000). Effects of integrated instruction on motivation and.
Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.
RESEARCH DESIGN : 1. Kinds of support for making CAUSAL interpretations of observed relationships quality of theory research design used measurement procedures.
Group-Level Research Designs
Statistical Analysis of the Nonequivalent Groups Design.
Educational Research by John W. Creswell. Copyright © 2002 by Pearson Education. All rights reserved. Slide 1 Chapter 11 Experimental and Quasi-experimental.
Probability Sampling uses random selection
Quasi-Experimental Designs Whenever it is not possible to establish cause-and-effect relations because there is not complete control over the variables.
L1 Chapter 11 Experimental and Quasi- experimental Designs Dr. Bill Bauer.
Probability Sampling uses random selection
Quasi-Experiments. The Basic Nonequivalent Groups Design (NEGD) l Key Feature: Nonequivalent assignment NOXONOONOXONOO.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Chapter 11 Experimental Designs
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 11 Experimental Designs.
CHAPTER 8, experiments.
INTERNAL VALIDITY AND BASIC RESEARCH DESIGN. Internal Validity  the approximate truth about inferences regarding cause-effect or causal relationships.
Single-Group Threats to Internal Validity. The Single Group Case Two designs:
Research methods and statistics.  Internal validity is concerned about the causal-effect relationship in a study ◦ Can observed changes be attributed.
Analysis of Covariance adjusting for potential confounds.
Internal Validity. All about whether the research design (and data analysis) warrants the conclusions. Concerned with: – Causal relationships – Various.
Experimental & Quasi-Experimental Designs Dr. Guerette.
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Chapter 11.  The general plan for carrying out a study where the independent variable is changed  Determines the internal validity  Should provide.
 The basic components of experiments are: 1) taking action 2) observing the consequence of that action  Experimental model is most closely linked to.
Chapter Eight: Quantitative Methods
EXPERIMENTAL DESIGNS. Categories Lab experiments –Experiments done in artificial or contrived environment Field experiments –Experiments done in natural.
11-1 Chapter 11 Experiments and Test Markets Learning Objectives Understand... uses for experimentation advantages and disadvantages of the experimental.
Research Design: Causal Studies l Quick Review: Three general forms of quantitative research studies –Descriptive: Describes a situation –Relational :
Experimental Research Design Causality & Validity Threats to Validity –Construct (particular to experiments) –Internal –External – already discussed.
Table of Contents  Research Design  Threats to Internal Validity  Threats to External Validity  Proposed Data  Pre-Test Post-Test Data Results 
Can you hear me now? Keeping threats to validity from muffling assessment messages Maureen Donohue-Smith, Ph.D., RN Elmira College.
Research designs Research designs Quantitative Research Designs.
Research Methodology Lecture No :19 (Experimental Design-Cont)
William M. Trochim James P. Donnelly Kanika Arora 8 Introduction to Design.
Experimental and Quasi-Experimental Research
Internal Validity Questions
Experimental Research
Experiments Why would a double-blind experiment be used?
The Non-Experimental and Quasi- Experimental Strategies:
“Social Interaction” Threats to Internal Validity
Change Score Analysis versus ANCOVA in Pretest/Posttest Designs:
Between- Subjects Design
Internal Validity and Confounding Variables
Experiments: Part 3.
Chapter Eight: Quantitative Methods
Designing an Experiment
Introduction to Design
Experiments and Quasi-Experiments
Quasi-Experimental Design
Purpose of Training Evaluation
Experiments and Quasi-Experiments
The Nonexperimental and Quasi-Experimental Strategies
12 Inferential Analysis.
Internal Validity - The extent to which all explanations for changes in the DV between conditions have been eliminated -- other than the IV. ie(7a)
Experiments: Part 2.
Experiments: Part 3.
Experiments: Part 3.
Group Experimental Design
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Types of Designs: R: Random Assignment of subjects to groups
Quasi experiments and small n designs
Reminder for next week CUELT Conference.
Presentation transcript:

The Nonequivalent Groups Design

The Basic Design N O X O N O O Key Feature: Nonequivalent assignment

What Does Nonequivalent Mean? Assignment is nonrandom. Researcher didn’t control assignment. Groups may be different. Group differences may affect outcomes.

Internal Validity   History Maturation Testing Instrumentation N O X O N O O History Maturation Testing Instrumentation Regression to the mean Selection Mortality Diffusion or imitation Compensatory equalization Compensatory rivalry Resentful demoralization  

Internal Validity Selection-history Selection-maturation N O X O N O O Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality  Statistical Analysis of Basic two-group pre-post NEGD cannot use the usual ANCOVA regression model because of measurement error on the pretest which leads to the attenuation of slopes and introduces bias have to do a reliability-corrected ANCOVA model adjusts the pretest scores based on estimates of reliability of the pretest

The Bivariate Distribution 8 7 6 5 4 3 9 P r e t s o

The Bivariate Distribution 8 7 6 5 4 3 9 p r e t s P o Program Group has a 5-point pretest advantage.

The Bivariate Distribution Program group scores 15-points higher on Posttest. 8 7 6 5 4 3 9 p r e t s P o Program group has a 5-point pretest advantage,

Graph of Means pretest posttest pretest posttest MEAN MEAN STD DEV STD DEV Comp 49.991 50.008 6.985 7.549 Prog 54.513 64.121 7.037 7.381 ALL 52.252 57.064 7.360 10.272

Possible Outcome #1 Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality   (CG not growing) (PG moving away, CG level) More low-score PG dropouts

Possible Outcome #2 Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality   (Both growing) (Wrong direction) More low-score dropouts

Possible Outcome #3   (In PG only) (In PG) Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality   (In PG only) (In PG) More high-score PG dropouts not as likely

Possible Outcome #4 Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality   (In PG only) (In PG)  More low-score PG dropouts

Possible Outcome #5 Selection-history Selection-maturation Selection-testing Selection-instrumentation Selection-regression Selection-mortality  