Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs.

Slides:



Advertisements
Similar presentations
Techniques expérimentelles 2 Barbara Hemforth Most of this is stolen from a lecture by Chuck Clifton
Advertisements

Chapter 9 Choosing the Right Research Design Chapter 9.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 14: Correlated Groups Designs 1.
Control Any means used to rule out threats to validity Example –Hypothesis: Rats learned to press a bar when a light was turned on. –Data for 10 rats bar.
Research Variables.
Chapter 9: Within Designs
EXPERIMENTAL DESIGNS Criteria for Experiments
Ch8(1)1 Within Subjects (Participants) Designs All participants serve in each condition of the study. Advantage: Individual Differences are not a Confound.
Basics of Experimentation (1) Experimental Design: Which to Choose and Why?
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
EXPERIMENTAL DESIGNS What Is Required for a True Experiment? What Are the Independent and Dependent Variables? What Is a Confounding Variable? What Are.
Types of Group Designs _________-subject design. The experiment compares _____ group across different levels of the IV. e.g., behavior is studied in 1.
Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs Designs to avoid (not true experiments)
PSYC512: Research Methods PSYC512: Research Methods Lecture 11 Brian P. Dyre University of Idaho.
Experimental Designs Psych 231: Research Methods in Psychology.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Experimental Design: Between and Within factors Psych 231: Research Methods in Psychology.
Control Techniques ♣ Chapter 9 Introduction  Randomization 
PSYC512: Research Methods PSYC512: Research Methods Lecture 12 Brian P. Dyre University of Idaho.
Factorial Experiments Factorial Design = experiment in which more than one IV (factor) at a time is manipulated Uses all possible combinations of the levels.
Experimental Design: Between and within factors Psych 231: Research Methods in Psychology.
Matched Group, Natural Group, Repeated Measures. Matched Groups Design Different subjects serve at the different levels of the IV however the subjects.
+ Controlled User studies HCI /6610 Winter 2013.
1 Experimental Designs HOW DO HOW DO WE FIND WE FIND THE ANSWERS ? THE ANSWERS ?
Research Methods in Psychology
Matched Pairs, Within-Subjects, and Mixed Designs
Design Experimental Control. Experimental control allows causal inference (IV caused observed change in DV) Experiment has internal validity when it fulfills.
Single-Factor Experimental Designs
Control in Experimentation & Achieving Constancy Chapters 7 & 8.
A Within-Subjects Experiment: Homophone Priming of Proper Names
Today: Assignment 2 misconceptions Our process True Experiments: Single-Factor Design Assignment 3 Q&A Mid-term: format, coverage.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter Six: The Basics of Experimentation I: Variables and Control Chapter Six:
CHAPTER 6 Control Problems in Experimental Research.
Chapter Six: The Basics of Experimentation I: Variables and Control.
1 Within subjects designs 1. Definition 2. Reasons for using within subjects designs 3. Stage of Practice effects A. Definition B. Two types of practice.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Simple Experiments. Causal Claim Boldest claim a scientist can make Verbs such as “associated with” and “related to” replaced with “causes, influences,
Choosing the right research design
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Today: Assignment 2 back on Friday
Experimental Control. Part 1 Experimental Control.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
LECTURE 11 Chapter 11 Repeated Measures / Within Subs Design 1.Control error variance = individual diff. No diff. due to sampling error! 2. Fewer subjects.
 Allows researchers to detect cause and effect relationships  Researchers manipulate a variable and observe whether any changes occur in a second variable.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
Experiment Basics: Designs Psych 231: Research Methods in Psychology.
7 Control Techniques in Experimental Research.
Experiments: Part 2.
Chapter 11: The Nuts and Bolts of one-factor experiments.
Experiment Basics: Designs
Research Methods: Concepts and Connections First Edition
Experimental Design-Chapter 8
Designing an Experiment
Experiment Basics: Designs
Control problems in experimental research
Experiment Basics: Designs
Control error variance = individual diff.
Scientific Variables.
Experiments: Part 2.
Experiment Basics: Designs
Single-Variable, Correlated-Groups Designs
Within Subjects (Participants) Designs
Correlated-Groups and Single-Subject Designs
Repeated Measures Balancing Practice Effects with an Incomplete Design
Experiment Basics: Designs
Research Methods for the Behavioral Sciences
Experiment Basics: Designs
Experiment Basics: Designs
Presentation transcript:

Single-Factor Experiments What is a true experiment? Between-subjects designs Within-subjects designs

What is a true experiment? Experiment = study in which researcher has complete control over all aspects of the study 2 Essential features of experiments: 2 or more levels of an IV (control condition or group) Random allocation of subjects to groups (if between-subjects)

Some Terminology IV = what the experimenter manipulates (varies) in an experiment; the hypothesized cause DV = what the experimenter measures to test the hypothesis in an experiment; the hypothesized effect Factor = IV Level = condition = treatment: –One value of an IV Control Variable – value held constant Counterbalancing Variable Confounded Variable – covaries with IV Random variable – value is randomly varied

Between-subjects designs At least 2 conditions (groups) –Control and Experimental Condition, or –2 or more levels of IV without “control” condition Each subject is assigned to only one condition Random assignment of subjects to conditions

Between-subjects Designs with Multiple Conditions More than 2 levels of the IV Randomly assign subjects to conditions Design a between-subjects experiment with multiple levels to test the hypothesis: People work harder individually than they do in a group.

Within-Subjects Designs At least 2 conditions –Control and Experimental Condition, or –2 or more levels of IV without “control” condition Each subject is assigned to all conditions Design a within-subjects experiment with multiple levels to test the hypothesis that people can perceive a light more quickly when their attention is focused where the light will appear. (Spatial Cuing)

Order and Sequence Effects Order effects –Result from the position in which a condition occurs (first, second, third, etc) –If the order of conditions is “A-B”, order effects on B would be the effects that result from B being in the second position in the list –Example: practice effects Sequence effects –Result from which conditions precede or follow a condition –If the order of conditions is “A-B”, sequence effects on B would be the effects that result from B following A –Example: color perception

Controlling Order and Sequence Effects Controlling Order Effects –Counterbalance the position in which each condition appears –ABC, CBA, ACB: C occurs first, second, and third an equal number of times Controlling Sequence Effects –Counterbalance what each condition follows –ABC, BAC : C follows A half the time, and follows B half the time.

Counterbalancing in Within-Subjects Designs Counterbalancing within subjects –Useful when each level of the IV occurs multiple times for each subject –Each subject gets all sequences of the conditions (ideally) Counterbalancing within groups (not within each subject) –Useful when there are many (more than 2) conditions –Necessary if each condition occurs only once per subject –An equal number of subjects get each sequence of the conditions (ideally)

Controlling Order and Sequence Effects Within Subjects Only possible when each condition occurs at least twice for each subject Method depends on how many times each condition occurs per subject: –Many times: randomize order of conditions –A few times: use block randomization of conditions –Twice: use reverse counterbalancing

Controlling Order and Sequence Effects Within Groups When it is not possible or practical to control within subjects Necessary if each condition occurs only once for each subject Sequences and orders controlled within a group of subjects, but not within each subject Latin Square – a technique for partial counterbalancing (when full counterbalancing is impractical)

Latin Square A square matrix with length = number of conditions Each condition occurs only once on each row and only once in each column: Subject #1:ABCD Subject #2:BCDA Subject #3:CDAB Subject #4:DABC Controls order, but not sequence effects

Balanced Latin Square A Latin Square in which each condition is preceded by every other condition exactly once: Subject #1:ABCD Subject #2:BDAC Subject #3:CADB Subject #4:DCBA Controls both order and sequence effects

In-Class Group Assignment Hypothesis: Meditation improves short-term memory for lists of words Groups of 4 Design an experiment to test this hypothesis –Define your IV and DV –State your prediction (hypothesized results) –Write a plan for the condition(s) each participant will be in, and in what order Considerations: –Number of levels of IV? –Within or between-subjects design? –Random assignment to conditions? –Controlling order and sequence effects? –Other possible confounds?