Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs Designs to avoid (not true experiments)

Slides:



Advertisements
Similar presentations
EXPERIMENTAL DESIGN.  Three conditions  Covariation  Time-order relation  Elimination of plausible alternatives.
Advertisements

Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 14: Correlated Groups Designs 1.
Control Any means used to rule out threats to validity Example –Hypothesis: Rats learned to press a bar when a light was turned on. –Data for 10 rats bar.
Research Variables.
Chapter 9: Within Designs
EXPERIMENTAL DESIGNS Criteria for Experiments
QUASI-EXPERIMENTS w Compare subjects in different conditions on a DV w Lacks one or more criteria for an experiment (cause, comparison, control) w Interpreted.
Ch8(1)1 Within Subjects (Participants) Designs All participants serve in each condition of the study. Advantage: Individual Differences are not a Confound.
Quasi-Experimental Designs
Basics of Experimentation (1) Experimental Design: Which to Choose and Why?
Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Types of Group Designs _________-subject design. The experiment compares _____ group across different levels of the IV. e.g., behavior is studied in 1.
Experimental Designs Psych 231: Research Methods in Psychology.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
PSYC512: Research Methods PSYC512: Research Methods Lecture 12 Brian P. Dyre University of Idaho.
Factorial Experiments Factorial Design = experiment in which more than one IV (factor) at a time is manipulated Uses all possible combinations of the levels.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Outline Single-factor ANOVA Two-factor ANOVA Three-factor ANOVA
Repeated Measures Designs
Matched Group, Natural Group, Repeated Measures. Matched Groups Design Different subjects serve at the different levels of the IV however the subjects.
+ Controlled User studies HCI /6610 Winter 2013.
1 Experimental Designs HOW DO HOW DO WE FIND WE FIND THE ANSWERS ? THE ANSWERS ?
Research Methods in Psychology
Matched Pairs, Within-Subjects, and Mixed Designs
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Single-Factor Experimental Designs
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
A Within-Subjects Experiment: Homophone Priming of Proper Names
Experimental Design. Threats to Internal Validity 1.No Control Group Known as a “one-shot case study” XOXO (IV)(DV)
Today: Assignment 2 misconceptions Our process True Experiments: Single-Factor Design Assignment 3 Q&A Mid-term: format, coverage.
Review During the last lecture we were discussing the use of experiments as a way of answering questions about the causal relationship between variables.
Psych 5500/6500 Other ANOVA’s Fall, Factorial Designs Factorial Designs have one dependent variable and more than one independent variable (i.e.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
CHAPTER 6 Control Problems in Experimental Research.
1 Within subjects designs 1. Definition 2. Reasons for using within subjects designs 3. Stage of Practice effects A. Definition B. Two types of practice.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Mixed ANOVA Models combining between and within. Mixed ANOVA models We have examined One-way and Factorial designs that use: We have examined One-way.
Experimental design 2:. Good experimental designs have high internal validity: To unequivocally establish causality, we need to ensure that groups in.
Choosing the right research design
Experimental Design Research Methods.
EXPERIMENTS: PART 3. Overview  Goodwin7 and these lecture notes mainly provide a review of key concepts and additional practice  Mastery needed for.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Today: Assignment 2 back on Friday
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
LECTURE 11 Chapter 11 Repeated Measures / Within Subs Design 1.Control error variance = individual diff. No diff. due to sampling error! 2. Fewer subjects.
Within-Subjects (Repeated Measures) Designs Each participant receives all conditions in the experiment Main advantage: increased power Since the number.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Psychology 290 Lab #6 – Research Design Nov. 7-9 Descriptive Correlation Experimental Quasi-experimental.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
7 Control Techniques in Experimental Research.
Experiments: Part 2.
Chapter 11: The Nuts and Bolts of one-factor experiments.
Experimental Design-Chapter 8
Psychology 3450W: Experimental Psychology
Designing an Experiment
Experiment Basics: Designs
Control error variance = individual diff.
Experiments: Part 2.
Experiment Basics: Designs
Within Subjects (Participants) Designs
Correlated-Groups and Single-Subject Designs
Repeated Measures Balancing Practice Effects with an Incomplete Design
First choice Experiment Or Quasi-experiment.
Experiment Basics: Designs
Presentation transcript:

Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs Designs to avoid (not true experiments)

What is a true experiment? Experiment = study in which researcher has complete control over all aspects of the study 2 Essential features of experiments: Control Group or Control Condition (actually, or 2 or more levels of an IV) Random allocation of subjects to groups (if it has a between-subjects factor)

Some Terminology IV = what the experimenter manipulates (varies) in an experiment; the hypothesized cause DV = what the experimenter measures to test the hypothesis in an experiment; the hypothesized effect Factor = IV Level = condition = treatment: –One value of an IV –Example: for the factor “gender,” the levels are “male” and “female” (in a quasi-experiment) –Example: for the factor “number of witnesses” in a bystander intervention experiment, the levels could be “one” “two” and “four”

Between-subjects designs At least 2 conditions (groups) –Control and Experimental Condition, or –2 or more levels of IV without “control” condition Each subject is assigned to only one condition Random assignment of subjects to conditions Design a between-subjects experiment testing this hypothesis: Vocalization impairs short-term memory.

Between-subjects Designs with Multiple Conditions More than 2 levels of the IV Randomly assign subjects to conditions Design a between-subjects experiment testing to answer the following questions: –Does vocalization impair STM? –Does it matter whether the vocalization is aloud or just “in your head”?

Within-Subjects Designs At least 2 conditions –Control and Experimental Condition, or –2 or more levels of IV without “control” condition Each subject is assigned to all conditions Counterbalance to control for order and sequence effects Design a within-subjects experiment testing this hypothesis: Sub-vocalized speech impairs short-term memory.

Counterbalancing in Within-Subjects Designs Counterbalancing within subjects –Useful when each level of the IV occurs multiple times for each subject –Each subject gets both sequences of the conditions Counterbalancing within groups (not within each subject) –Useful when there are many (more than 2) conditions –Necessary if each condition occurs only once per subject –An equal number of subjects get each sequence of the conditions

Order and Sequence Effects Order effects –Result from the position in which a condition occurs (first, second, third, etc) –If the order of conditions is “A-B”, order effects on B would be the effects that result from B being in the second position in the list –Example: practice effects Sequence effects –Result from which conditions precede or follow a condition –If the order of conditions is “A-B”, sequence effects on B would be the effects that result from B following A –Example: color perception

Controlling Order and Sequence Effects Controlling Order Effects –Counterbalance the position in which each condition appears –ABC, CBA, ACB: C occurs first, second, and third an equal number of times Controlling Sequence Effects –Counterbalance what each condition follows –ABC, BAC : C follows A half the time, and follows B half the time.

Controlling Order and Sequence Effects Within Subjects Only possible when each condition occurs at least twice for each subject Method depends on how many times each condition occurs per subject: –Many times: randomize order of conditions –A few times: use block randomization of conditions –Twice: use reverse counterbalancing

Controlling Order and Sequence Effects Within Groups When it is not possible or practical to control within subjects Necessary if each condition occurs only once for each subject Sequences and orders controlled within a group of subjects, but not within each subject Latin Square – a technique for partial counterbalancing (when full counterbalancing is impractical)

Latin Square A square matrix with length = number of conditions Each condition occurs only once on each row and only once in each column: abcd bcda cdab dabc

Balanced Latin Square A Latin Square in which each condition is preceded by every other condition exactly once: abcd bdac cadb dcba

Designs to Avoid One-group post-test only Post-test only with non-equivalent control group One-group pretest-posttest design