Experimental & Quasi-Experimental Designs Dr. Guerette

Purpose Used in explanation and evaluation research purposes. Used in explanation and evaluation research purposes. Used in hypothesis testing. Used in hypothesis testing.

The Classical Experiment Independent and Dependent Variables Independent and Dependent Variables Pre-testing and Post-testing Pre-testing and Post-testing Subjects are measured on the dependent variable (pre-test), exposed to the independent variable and are measured again on the dependent variable (post- test). Subjects are measured on the dependent variable (pre-test), exposed to the independent variable and are measured again on the dependent variable (post- test).

The Classical Experiment Experimental and Control Groups Experimental and Control Groups In the classical experiment the experiment group receives the independent variable and the control group does not. Each is measured on the dependent variable and differences are identified. In the classical experiment the experiment group receives the independent variable and the control group does not. Each is measured on the dependent variable and differences are identified.

The Classical Experiment Selection of subjects Selection of subjects Identify the population for your study and decide how the subjects will be selected. Identify the population for your study and decide how the subjects will be selected. Randomization is the typical method of selection of subjects. Randomization removes bias. Randomization is the typical method of selection of subjects. Randomization removes bias.

The Classical Experiment Double-Blind Experiment Double-Blind Experiment One way to ensure that the researcher will not allow bias to enter into the study is to use a double-blind experiment where neither the researcher nor the subjects know which group they are in. One way to ensure that the researcher will not allow bias to enter into the study is to use a double-blind experiment where neither the researcher nor the subjects know which group they are in. Eliminates Hawthorne Effect Eliminates Hawthorne Effect e.g. reactivity by research subjects e.g. reactivity by research subjects

The Classical Experiment Experimental O O X O O Experimental O O X O O ControlO O O O ControlO O O O Random Assignment

Threats to Internal Validity History History Maturation Maturation Testing Testing Instrumentation Instrumentation Statistical Regression Statistical Regression Selection Bias Selection Bias Experimental Mortality Experimental Mortality Causal Time Order Diffusion or Imitation of Treatment Compensatory Treatment Compensatory Rivalry Demoralization

Generalizability The ability of the researcher to take findings from an experiment and apply them to the real world. The ability of the researcher to take findings from an experiment and apply them to the real world. The strength of the experimental design is the ability to control for causal processes. This is also its weakness. The strength of the experimental design is the ability to control for causal processes. This is also its weakness.

Generalizability Construct Validity Construct Validity Deals with the ability to generalize from what is observed in an experiment to actual causal processes in the real world. Deals with the ability to generalize from what is observed in an experiment to actual causal processes in the real world. External Validity External Validity Deals with whether results from experiments in one environment would be similar to those found in a different environment. Deals with whether results from experiments in one environment would be similar to those found in a different environment.

Generalizability Statistical Conclusion Validity Statistical Conclusion Validity Deals with the size of the sample and how representative that sample is of the target population. This can be an issue in experiments since by their very nature they do not lend themselves to large samples. Deals with the size of the sample and how representative that sample is of the target population. This can be an issue in experiments since by their very nature they do not lend themselves to large samples.

Variations on Classical Experiments When a study does not lend itself to the classical experiment, changes can be made that will allow for modifications in procedures, such as the post-test only design. When a study does not lend itself to the classical experiment, changes can be made that will allow for modifications in procedures, such as the post-test only design. The variations are called Quasi-experimental designs. The variations are called Quasi-experimental designs.

Quasi-Experimental Designs These are techniques that apply when random selection and assignment of subjects is not possible. These are techniques that apply when random selection and assignment of subjects is not possible. These varieties include These varieties include Cohort designs Cohort designs Time-series designs Time-series designs Variable oriented research (e.g. multiple regressions) Variable oriented research (e.g. multiple regressions)

Quasi-Experimental Designs There are an infinite number of ways to vary the number and composition of groups, subject, observations and the types of experimental stimuli used. There are an infinite number of ways to vary the number and composition of groups, subject, observations and the types of experimental stimuli used.

Quasi-Experimental Designs Pre-post tests with treatment only; no comparison group Experimental O O X O O

Quasi-Experimental Designs Post test only; Either with or without comparison group Experimental X O O

Quasi-Experimental Designs Non-random assignment Experimental O O X O O ComparisonO O O O

Quasi-Experimental Designs Interrupted time series with removed intervention Experimental O O X O O O X O O

Quasi-Experimental Designs Non-random assignment Interrupted time series with switched intervention Group 1 O O X O O O O Group 2O O O O X O O

In Class Exercise You have been asked to conduct a study of the relationship between watching CNN, and fear of violent crime. Using the “classical” experimental design, describe how you will conduct this research, assuming you have access to 200 FIU students who volunteered for the study. Be sure to discuss possible threats to validity, and how the design of your experiment will help to rule out such threats. You have been asked to conduct a study of the relationship between watching CNN, and fear of violent crime. Using the “classical” experimental design, describe how you will conduct this research, assuming you have access to 200 FIU students who volunteered for the study. Be sure to discuss possible threats to validity, and how the design of your experiment will help to rule out such threats.