True Experimental Design

Slides:



Advertisements
Similar presentations
Educational Research: Causal-Comparative Studies
Advertisements

Variance in Research Design Sources, threats to internal validity, and “Noise”
GROUP-LEVEL DESIGNS Chapter 9.
Control Any means used to rule out threats to validity Example –Hypothesis: Rats learned to press a bar when a light was turned on. –Data for 10 rats bar.
Research Methods in Psychology Complex Designs.  Experiments that involve two or more independent variables studies simultaneously at least one dependent.
Non-theoretical Research (Radical Behaviorism). 1)When you run into something interesting, drop everything and study it. 2) Apparatuses sometimes breakdown.
PSY 250 Chapter 7: Experimental Research Strategy.
The Science of Psychology The Scientific Method and Research Design.
Research Methods in Psychology
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Lect 10a1 Experimental Research Experimental research is conducted to demonstrate functional (cause-and-effect) relationships An experiment must demonstrate.
Causal Comparative Research: Purpose
Lecture 9: One Way ANOVA Between Subjects
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Sampling and Experimental Control Goals of clinical research is to make generalizations beyond the individual studied to others with similar conditions.
Psych 231: Research Methods in Psychology
Variables cont. Psych 231: Research Methods in Psychology.
Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Lecture 4: Experiment 2011, 9, 15. How many pairs of shoes do you have in your closet?  Population mean:  Sample 1 mean:  Sample 2 mean:  Sample 3.
Chapter 9 Experimental Research Gay, Mills, and Airasian
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. Experimental Research Chapter Thirteen.
Experimental Research
Methods to Control Extraneous Variables
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Chapter 8 Experimental Research
Chapter 2: The Research Enterprise in Psychology
Matched Group, Natural Group, Repeated Measures. Matched Groups Design Different subjects serve at the different levels of the IV however the subjects.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
1 Basic Definitions Greg C Elvers, Ph.D.. 2 Statistics Statistics are a set of tools that help us to summarize large sets of data data -- set of systematic.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Understanding Statistics
Research Strategies, Part 2
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
The Scientific Method Observation Theory Hypothesis Test Making it public Peer review Replication.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Techniques of research control: -Extraneous variables (confounding) are: The variables which could have an unwanted effect on the dependent variable under.
Causal-Comparative Research Research that is interested in learning if there is a relationship between or among variables that is causal in nature (i.e.
Experiments Psychology. Laboratory Experiment Conducted under a tightly controlled environment, where the independent variable is directly manipulated.
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
YAAAAAAY!. What is it? In psychology we have an interest in studying human behaviour... which requires research! Research methods (or scientific methods)
Introduction section of article
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Chapter 6 Research Validity. Research Validity: Truthfulness of inferences made from a research study.
Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition
But! Let’s first review…
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Reasoning in Psychology Using Statistics Psychology
Chapter 8: Between Subjects Designs
Aim: What factors must we consider to make an experimental design?
Sampling Sampling – the process of obtaining a sample from a population Simple Random Sampling – sample selected at random from a population in which every.
 Allows researchers to detect cause and effect relationships  Researchers manipulate a variable and observe whether any changes occur in a second variable.
Psychological Experimentation The Experimental Method: Discovering the Causes of Behavior Experiment: A controlled situation in which the researcher.
PS Research Methods I with Kimberly Maring Unit 9 – Experimental Research Chapter 6 of our text: Zechmeister, J. S., Zechmeister, E. B., & Shaughnessy,
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
Chapter 2 Research Methods.
Approaches to social research Lerum
Internal Validity – Control through
Research Methods 3. Experimental Research.
Hypothesis Expresses a relationship between two variables.
Designing Experiments
Experiments with Two Groups
Analysis and Interpretation of Experimental Findings
Experimental Design: The Basic Building Blocks
Why Psychologists Conduct Experiments
Research Methods for the Behavioral Sciences
Psychological Experimentation
Chapter Ten: Designing, Conducting, Analyzing, and Interpreting Experiments with Two Groups The Psychologist as Detective, 4e by Smith/Davis.
Presentation transcript:

True Experimental Design

Variables In any experiment there are three types of variables: Experimental “Manipulations” a) Independent Variable (IV) b) Individual Differences Variable 2) Dependent Variable (DV) 3) Secondary Variable- a variable that is not a part of the hypothesis under study.

Types of Secondary Variables Confound secondary variable- variable that has unintentionally co-varied along with the IV causing a threat to internal validity. Extraneous or random secondary variable- variable that is not directly related to the hypothesis and which the E does not attempt to control (allows to vary at random). Controlled secondary variable- variable not related to the hypothesis but which E does control, either by holding constant, equating across groups or by matching.

Independent Groups Designs: Random, Matched, Natural Independent Groups Designs- the IV is varied (or manipulated) between sets of different subjects, one set for each level of the IV. Three Types of Independent Group Designs: 1) Random Groups Design 2) Matched Groups Design 3) Natural Groups Design

Random Groups Design The subjects are assigned to the levels of the IV randomly. This is a two step process: 1) draw a pool of subjects from population using some method of randomization. 2) randomly assign subjects to levels of the IV (usually with a constraint of equal n per level) Must use a formal randomization process, i.e. a random number table (in text), dice, coin toss. Examples showing why.

Examples of way you should us a formal randomization process Time estimation example Two level IV (with feedback and without) Class of 50 students go to room 666 at 7:00 PM Arbitrarily (informal randomization) decide: first 25 that arrive placed in “feedback” last 25 that arrive placed in “no feedback” Results: better time estimation in feedback group

Real life (subtle) example: Learning in Rats

What does random assignment “buy” you? Will, on average, in the long run, have an equal representation of all levels of secondary variables in all groups. The larger the population size and/or the more homogeneous the population, the better randomization will work to provide equal groups.

differences between groups may occur as a result of secondary variables but these differences will occur solely on the basis of chance and we know a lot about “chance” and how it operates (inferential statistics).

Random Groups Design Example Dittmar, Halliwell, & Ive (2006) page 188 of 9th ed. “Does Barbie make girls want to be thin?” The effect of exposure to very thin models on young girl’s body image. Most research on body image done with adolescents and young women. This research looked at girls age 5.5-6 years

All girls listened to same story, “Mira” shopping for party dress Looked at picture book while listening to adult read Some girls saw Barbie doll as “Mira”. Some girls saw Emme doll as “Mira”, some saw a book without any pictures of “Mira”, just scenes and objects. All girls complete “Child Figure Rating Scale”

IV (s)? DV (s)? Secondary variable(s)?

Barbie condition showed the highest body dissatisfaction. Emmie and no-doll condition showed no body dissatisfaction at all.

Matched Groups Design Different subjects serve at the different levels of the IV however the subjects are matched on the basis of some “important” secondary variable An attempt to create equivalent groups when you cannot gather a large number of participants and/or your population is very heterogeneous (with respect to your DV).

Steps to forming “Matched Groups” 1) Rank-order subjects by performance on the selected “matching task”. Often the task used is the same as your DV but could be some other similar variable relevant to the outcome of the study. 2) Form sets of similar (“matched”) subjects and randomly assign one member from each set to each level of your IV. Will help to take important secondary variables and form groups that are equivalent with respect to that variable.

Example: New drug to control high blood pressure Measure participants’ blood pressure WITHOUT medication. Form pairs of people with similar pre-study BP. Randomly assign one member of each pair to the new medication group and the other to the old medication group.

Natural Groups Design There is no true IV The variable of interest is an “individual differences” variable Very common in Psychological Research Example: Relationship between divorce and subsequent emotional disorders Even if you find a “statistically significant” result, you cannot claim causality.