Between- Subjects Design

Slides:



Advertisements
Similar presentations
Experimental and Ex Post Facto Designs
Advertisements

Group Discussion Identify two time-related factors that can threaten the internal validity of a within-subjects research study.  In each case, explain.
Questions What is the relationship between ‘research designs’ and ‘research strategies’? Which method of experiments, within subjects or between subjects.
Copyright © Allyn & Bacon (2007) Single-Variable, Independent-Groups Designs Graziano and Raulin Research Methods: Chapter 10 This multimedia product and.
Experimental Design I. Definition of Experimental Design
Variance in Research Design Sources, threats to internal validity, and “Noise”
Group Discussion Describe the fundamental flaw that prevents a nonequivalent group design from being a true experiment? (That is, why can’t these designs.
Experimental Research Designs
Questions  Is Exam 2 going to be cumulative or will it just cover the second part of the information?  Are cause-and-effect relationships the same as.
Introduction to Research Design Threats to Internal Validity Two or More Groups Social Threats.
CHAPTER 8 EXPERIMENTAL DESIGN.
Chapter 9 Group-Level Research Designs. CHARACTERISTICS OF “IDEAL” EXPERIMENTS Controlling the Time Order of Variables Manipulating the Independent Variable.
Group-Level Research Designs
Questions What is the best way to avoid order effects while doing within subjects design? We talked about people becoming more depressed during a treatment.
Group Discussion Describe the similarities and differences between experiments , non-experiments , and quasi-experiments. Actions for Describe the similarities.
PowerPoint presentation to accompany Research Design Explained 4th edition ; ©2000 Mark Mitchell & Janina Jolley Chapter 7 The Multiple Group Experiment.
CHAPTER OVERVIEW Experimental Designs
Chapter 9 Experimental Research Gay, Mills, and Airasian
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
Applying Science Towards Understanding Behavior in Organizations Chapters 2 & 3.
Group Discussion Explain the difference between assignment bias and selection bias. Which one is a threat to internal validity and which is a threat to.
Consumer Preference Test Level 1- “h” potato chip vs Level 2 - “g” potato chip 1. How would you rate chip “h” from 1 - 7? Don’t Delicious like.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 11 Experimental Designs.
Chapter 8 Experimental Design: Dependent Groups and Mixed Groups Designs.
Which Test Do I Use? Statistics for Two Group Experiments The Chi Square Test The t Test Analyzing Multiple Groups and Factorial Experiments Analysis of.
Between- Subjects Design Chapter 8. Review Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared.
Research Strategies Chapter 6. Research steps Literature Review identify a new idea for research, form a hypothesis and a prediction, Methodology define.
© 2011 Pearson Prentice Hall, Salkind. Pre- and True Experimental Research Designs.
Experimental Design: One-Way Correlated Samples Design
Selecting and Recruiting Subjects One Independent Variable: Two Group Designs Two Independent Groups Two Matched Groups Multiple Groups.
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
Introduction section of article
Research Design. Time of Data Collection Longitudinal Longitudinal –Panel study –Trend study –Cohort study Cross-sectional Cross-sectional.
Finishing up: Statistics & Developmental designs Psych 231: Research Methods in Psychology.
Chapter 8: Between Subjects Designs
1. /32  A quasi-experimental design is one that looks like an experimental design but lacks the key ingredient -- random assignment. 2.
© 2009 Pearson Prentice Hall, Salkind. Chapter 11 Pre- and True Experimental Research Designs.
Chapter 11: The Nuts and Bolts of one-factor experiments.
Selecting the Best Measure for Your Study
Reasoning in Psychology Using Statistics
Experiments Why would a double-blind experiment be used?
Experimental Research Strategy
The Non-Experimental and Quasi- Experimental Strategies:
METHODS IN BEHAVIORAL RESEARCH
Experimental Design-Chapter 8
Between-Subjects, within-subjects, and factorial Experimental Designs
Internal Validity and Confounding Variables
Single-Variable, Independent-Groups Designs
Within- Subjects Design
Within- Subjects Design
Internal Validity – Control through
2 independent Groups Graziano & Raulin (1997).
Designing an Experiment
Chapter 6 Research Validity.
Between-Subjects Experimental Designs
Experiments and Quasi-Experiments
Pre-post Double Blind Placebo Control Group Design
Analysis of Variance (ANOVA)
Experiments and Quasi-Experiments
The Nonexperimental and Quasi-Experimental Strategies
Experiments II: Validity and Design Considerations
Experiments: Part 2.
Reasoning in Psychology Using Statistics
Experimental Design I. Definition of Experimental Design
Chapter 11 EDPR 7521 Dr. Kakali Bhattacharya
Experiment Basics: Designs
Introduction to Between-Subjects Experiments
Within-Subjects Experiments
Reasoning in Psychology Using Statistics
Presentation transcript:

Between- Subjects Design Chapter 8

Review

Two types of Ex research Two basic research designs are used to obtain the groups of scores that are compared in an experiment: within-subjects design between-subjects design.

Within & Between designs Between Subjects Students Silence Music A 12   B 13 C 15 D 14 E F G H I J Within Subjects Students Silence Music A 12 15 B 13 14 C D E

Between subjects limitations

1- More subjects required To compare three different treatment conditions with 30 scores in each treatment, the between- subjects design requires 90 participants.

2-Group Difference Individual differences, may lead to group differences or assignment bias.

Example If the participants in one group are generally older ( or smarter, or taller, or faster, etc.) than the participants in the other group, then the experiment has a confounding variable.

3- Larger variance Increases variance which makes it hard to find significant differences (explained later)

Two types of confounding variables Confounding from individual differences, which is called assignment bias. Confounding from environmental variables. one group may be tested in a large room and another group in a smaller room.

Making equivalent groups Random Assignment ( Randomization) Matching Groups ( Matched Assignment) Holding Variables Constant or Restricting Range of Variability

1-Random Assignment It is relatively easy, and does not require any measurement or direct control of extraneous variables. However, random assignment is not perfect and cannot guarantee equivalent groups, especially when a small sample is used. Pure chance is not a dependable process for obtaining balanced equivalent groups.

2-Matching Groups School records are used to determine the IQs of the participants, and each student is classified as high IQ, medium IQ, or low IQ. The high- IQ participants are distributed equally between the two groups; half is assigned to one group and the other half is assigned to the second group using restricted random assignment. However, matching requires pre-testing to measure the variable( s) being controlled, It can become difficult to match several variables simultaneously.

3-Holding a variable constant For example, a researcher concerned about potential IQ differences between groups could restrict participants to those with IQs between 100 and 110. Holding a variable constant guarantees that the variable cannot confound the research, but this process limits the external validity of the research results.

INDIVIDUAL DIFFERENCES AND VARIABILITY High variability can obscure any treatment effects that may exist and therefore can undermine the likelihood of a successful study.

Restricted range 40.4 50

Wide Range 39.6 49.2

Other threats to internal validity of between-subjects designs Differential attrition (Mortality) (2 Dieting Programs) Diffusion of treatments (communication between groups) Compensatory equalization (computer lab) Compensation rivalry (John Henry) Resentful demoralization

STATISTICAL ANALYSES OF BETWEEN- SUBJECTS DESIGNS single- factor /two- group design or simply the two- group design a mean is computed for each group of participants, and then an independent- measures t-test is used to determine whether there is a significant difference between the means

Advantage It is easy to set up a two- group study, In addition, a two- group design provides the best opportunity to maximize the difference between the two treatment conditions; that is, you may select opposite extreme values for the independent variable.

Disadvantage of 2 groups The primary disadvantage of a two- group design is that it provides relatively little information. With only two groups, a researcher obtains only two real data points for comparison.

Comparing Means for More Than Two Groups a single- factor /multiple- group design may be used. For example, a re-searcher may want to compare driving performance under three telephone conditions: while talking on a cell phone, while texting on a cell phone, and without using a phone.

ANOVA For this study, the mean is computed for each group of participants, and a single- factor analysis of variance ( ANOVA for independent measures). When the ANOVA concludes that significant differences exist, some form of post hoc test or posttest is used to determine exactly which groups are significantly different from each other.

Advantage of ANOVA In addition to revealing the full functional relationship between variables, a multiple- group design also provides stronger evidence for a real cause- and- effect relationship than can be obtained from a two- group design.

Nominal and ordinal variables Because you cannot compute means for these variables, you cannot use an independent- measures t test or an ANOVA ( F test) to compare means between groups. However, it is possible to compare proportions between groups using a chi- square test for independence

Example Math test Teaching methods Passed failed Traditional 5 6 Group Work Computer Based 4 1