Matching: Matched Pairs Design

Slides:



Advertisements
Similar presentations
Educational Research: Causal-Comparative Studies
Advertisements

Experimental Designs Dr. Farzin Madjidi Pepperdine University
Chapter 10 Basic between-subjects designs The experimental design - is the general structure of the experiment between-subjects design. –Comparing groups.
Nasih Jaber Ali Scientific and disciplined inquiry is an orderly process, involving: problem Recognition and identification of a topic to.
Key Stone Problem… Key Stone Problem… next Set 22 © 2007 Herbert I. Gross.
Chapter 13 Notes Observational Studies and Experimental Design
Brian Kelly '06 Chapter 13: Experiments. Observational Study n Observational Study: A type of study in which individuals are observed or certain outcomes.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Chapter 3.1.  Observational Study: involves passive data collection (observe, record or measure but don’t interfere)  Experiment: ~Involves active data.
Lecture PowerPoint Slides Basic Practice of Statistics 7 th Edition.
MSRP Year 1 (Preliminary) Impact Research for Better Schools RMC Corporation.
Diagram of a quasi-experimental design with two groups
T tests comparing two means t tests comparing two means.
Research Design Quantitative. Quantitative Research Design Quantitative Research is the cornerstone of evidence-based practice It provides the knowledge.
Research designs Research designs Quantitative Research Designs.
What does the Research Say About . . .
AP Statistics Exam Review Topic #4
Chapter 13! One Brick At A Time!.
Experiments vs. Observational Studies vs. Surveys and Simulations
Dependent-Samples t-Test
Chapter 11: The Nuts and Bolts of one-factor experiments.
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
EXPERIMENTAL RESEARCH
Causation & Experimental Design
Between-Subjects Designs
Repeated Measures Designs
What does the Research Say About . . .
Complex Experimental Designs Chp 10
CSD 5100 Introduction to Research Methods in CSD
Experimental Design-Chapter 8
The Experimental Method
7 How to Decide Which Variables to Manipulate and Measure Marziyeh Rezaee.
Chapter 8: Inference for Proportions
Observational Studies and Experiments
Chapter 13 Experimental and Observational Studies
A guide for the IB Psychology IA design section
Experiments and Observational Studies
BHS Methods in Behavioral Sciences I
CHAPTER 4 Designing Studies
Unit 2 Research and Methods.
Chapter 8 Experimental Design.
THE EXPERIMENT An EXPERIMENT allows researchers to control or manipulate the situation being studied.
Ten things about Experimental Design
Experimental Design.
Experimental Design.
Two experiments PPs are divided into two groups. Each PP is timed completing a jigsaw puzzle. In one group, the PPs complete the puzzle on their own.
CHAPTER 4 Designing Studies
CHAPTER 9: Producing Data— Experiments
Two-Sample Between-Subjects Experiments and Independent-Samples t-Tests So far, we’ve talked about experiments in which we needed to take only one sample.
Statistical Reasoning December 8, 2015 Chapter 6.2
Experimental Design: The Basic Building Blocks
CHAPTER 4 Designing Studies
Do Now is on google classroom
What are their purposes? What kinds?
Research Design Quantitative.
CHAPTER 4 Designing Studies
CHAPTER 10 Comparing Two Populations or Groups
Research Methods for the Behavioral Sciences
CHAPTER 4 Designing Studies
CHAPTER 4 Designing Studies
Chapter 4: Designing Studies
Unit 4 Variance control.
CHAPTER 4 Designing Studies
Analysis of Variance (ANOVA)
Reminder for next week CUELT Conference.
CHAPTER 4 Designing Studies
How to Design an Experiment: Part II
Memory and Priming: Meyer and Schvaneveldt’s Lexical Decision Task
Module 1 Experimental Psychology Guided-Inquiry Learning
Presentation transcript:

Matching: Matched Pairs Design Module 9 Experimental psychology guided-inquiry learning Module 9: Matching/Matched Pairs Design ©2012, Dr. A. Geliebter & Dr. B. Rumain, Touro College & University System

Motivation Let’s now get back to our depression study. Suppose we have 3 treatment groups with each group receiving a different dose of Elate. Let’s say the doses are 750mg, 1200mg, and 0 mg. And, suppose also we know that our subjects are not roughly equal in their level of depression; some are more severely depressed while others are only mildly or moderately depressed. What we need is to equate our three treatment groups in terms of how depressed the individuals in each group are.

If we didn’t, this is what might happen: It could happen that our very depressed patients all end up being in the 750 mg. group and our mildly depressed ones end up being in the 0 mg. group. Then, at the end of the study, we might find that the patients in the 0 mg. group were still mildly depressed, but those in the 750 mg. group were moderately depressed. Would we then want to say that Elate doesn’t work because people taking it ended up more depressed than those not taking it?

Would we then want to say that Elate doesn’t work because people taking it ended up more depressed than those not taking it? No, of course not! The groups did not start off equal to begin with, so you couldn’t possibly make such a statement! So now, the question remains: How do you make the groups equivalent to begin with? What we could do is matching.

What is matching? In this design, subjects are not randomly assigned to treatment conditions. Instead, they are first matched on some characteristic. The matching characteristic either is the dependent variable or is closely related to the dependent variable. It is preferable to use matching for small groups, and random assignment for large groups.

This is how you do the matching This is how you do the matching. You first get a measure of how depressed each patient is. You then rank order the subjects from highest to lowest on the matching variable. If you have 3 treatment groups, you then form matching triplets that are roughly equal on the matching variable. For example, the highest score 3 individuals would be your first triplet; the next highest scoring 3 individuals would be your second triplet. Now, the members of each triplet are randomly assigned to the 3 treatment conditions.

Level of Depression So, we have Treatment Condition 1 (750 mg Elate), Treatment Condition 2 (1200 mg Elate) and Treatment Condition 3 (0 mg. Elate). Let’s say our rank ordering of how depressed our patients are gives the following list (the most depressed person being highest on the list and the least depressed one being last on the list). Jones Marks Burns Capelli Kopel Smith Arbater Rayner Cohen …….etc.

Jones Marks Burns Capelli Kopel Smith Arbater Rayner Cohen …etc. So, our first triplet is Jones, Marks and Burns. These 3 individuals are the most depressed of all our subjects. We randomly assign one of them to Condition 1, another to Condition 2 and another one to Condition 3. We then take our next triplet, Capelli, Kopel and Smith. These individuals are roughly equivalent in their level of depression. We randomly assign one of them to Condition 1, another to Condition 2 and the third to Condition 3.

First triplet Jones --> Condition 1 Marks --> Condition 3 Burns --> Condition 2 Second triplet Capelli --> Condition 2 Kopel --> Condition3 Smith --> Condition 1 Third triplet Arbater --> Condition 3 Rayner --> Condition 1 Cohen --> Condition 2 …….etc. And so on…. Jones Marks Burns Capelli Kopel Smith Arbater Rayner Cohen …etc.

In summary, what is the purpose of matching In summary, what is the purpose of matching? The reason we match is to make certain our groups are equivalent on the matching variable before we introduce the independent variable. In this case, it means before we start seeing whether the dosage of Elate matters, we must have our 3 treatment conditions equivalent to begin with in terms of how depressed the individuals in each condition are.

Is matching the best way to ensure your groups are equivalent Is matching the best way to ensure your groups are equivalent? If not, what would be better? No, because when you match, you match on one variable that you want your groups to be equivalent on. But what if there are other differences between your groups that you are not aware of but that may influence your results? A better strategy would be to use random assignment. This is more likely to guarantee your groups will be equivalent on any variable which might affect the outcome of your experiment.