2. Chapter Four Experimental & Quasi-experimental Designs

3. Experiment Tests cause & effect relationships Controls for other factors Measures on 2 or more groups before and after an intervention Measure change in a dependent variable with other things being equal

4. Internal validity Experimental treatment is having an impact on the outcome Other sources of influence have been controlled

5. External Validity Extent to which one can extrapolate findings from the particular study to other groups in general

6. Key Elements in Experimental Designs Measures taken at different times Dependent Variable Independent Variables Treatment Variable Control Variable Confounding Variables Random Variables

7. Key Elements in Experimental Designs (Cont’d) 2 or more different treatment levels 2 x 2 design is the simplest multiple- variable design the first “2” represents the 2 levels of the treatment variable the second “2” the 2 levels of the control variable effect of University CD-ROM with Nature CD-ROM

8. Pre Experimental Designs Same Group: Pre-Test/Post-Test Time 1 Time 2 Pre-Test CD-ROM Post-Test

9. Threats to Internal Validity History Maturation Testing Instrument Decay Statistical Regression

10. If cases are selected on the basis of extreme scores (either high or low) then when retests are done, there will be a tendency of scores to move toward the mean Reading scores example Rule: Be cautious when evaluating programs where participants have been selected on the basis of some extreme measure. Retesting will almost certainly lead to changes in the direction of the mean

11. Exposed/Comparison Group Treatment GroupUniversity CD Obs. Comparison GroupNature CD Obs. In this design there are measures taken at only one point in time. The problem is that the groups may not have been similar initially. The result may, or may not, be due to the University CD.

12. Classic Experimental Design Between-subjects design Also known as the pretest, posttest control group design Three elements of classical experiment: –manipulation of a treatment –control over extraneous variables –methods of dealing with pretreatment similarity

13. Between Subjects Design. Treatment Time 1 Control Time 1 Control Time 2 Treatment Time 2 Nature CD- ROM University CD-ROM

14. Key to Experimental Design Treatment and Control groups constructed to be as similar as possible before the experiment begins. This is done by: – precision matching – randomization –a combination of the above two methods

15. What does Randomization Do? Provides control over both known and unknown factors (control and random variables)

16. % University Aspirations by CD-ROM Exposure Group Time 1Time 2Diff. Treatment57.073.0 73-57=16 Control55.061.061-55= 6 Estimated impact of CD-ROM 10

17. Demonstrating a Causal Relation Changes in treatment variable occur prior to changes in the dependent variable The treatment and dependent variables are associated: as the treatment variables goes up, the dependent varies systematically Nothing but the treatment variable has influenced the dependent variable

18. Ruling out Confounding Effects Context the same Background characteristics similar Neutralizing confounding (sources of spuriousness) variables Deal with Random Variables

19. Within-Subject Designs Also known as repeated measures design Subjects are exposed to the various treatments Subjects’ own scores are compared Subjects act as their own control: perfect control in that it is the same person--no need to control for gender, I.Q., or SES!

20. Crossover Designs Both treatments are given to the same individuals rather than separately to two different samples Subjects serve as their own controls, hence, sample size required to detect an effect size is less Assign subjects randomly to a specific sequencing of treatment conditions

21. Hawthorne Effect This phenomenon refers to differences in the dependent variable that are not the direct result of changes in the treatment variable

22. Quasi-Experimental Designs Approximation of experimental design: not possible to use random assignment or to control the nature or timing of the treatment Nonequivalent control group One-group pretest-posttest (pre- experimental) Time series design One-time case study

23. Panel Study Tips Name of relative or friend who stays put original phone number use phone directory from original time and present time one contact employer contact neighbors call people with same last name

24. Advantages & Disadvantages of Experimental Designs Advantages: ease of making clear causal inferences (internal validity) Disadvantages: low on external validity, poor on probing, poor on dealing with many variables simultaneously