Don't Sweat the Simple Stuff (But it's not all Simple Stuff)

Slides:



Advertisements
Similar presentations
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Advertisements

Within Subjects Designs
Mixed Designs: Between and Within Psy 420 Ainsworth.
Hypothesis testing 5th - 9th December 2011, Rome.
Repeated Measures ANOVA
Independent t -test Features: One Independent Variable Two Groups, or Levels of the Independent Variable Independent Samples (Between-Groups): the two.
DOCTORAL SEMINAR, SPRING SEMESTER 2007 Experimental Design & Analysis Analysis of Covariance; Within- Subject Designs March 13, 2007.
C82MST Statistical Methods 2 - Lecture 7 1 Overview of Lecture Advantages and disadvantages of within subjects designs One-way within subjects ANOVA Two-way.
Independent Samples and Paired Samples t-tests PSY440 June 24, 2008.
Chapter 3 Analysis of Variance
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 17: Repeated-Measures ANOVA.
Lecture 9: One Way ANOVA Between Subjects
Repeated Measures ANOVA Cal State Northridge  320 Andrew Ainsworth PhD.
Analysis of Variance & Multivariate Analysis of Variance
Today Concepts underlying inferential statistics
Analysis of Variance with Repeated Measures. Repeated Measurements: Within Subjects Factors Repeated measurements on a subject are called within subjects.
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
Repeated ANOVA. Outline When to use a repeated ANOVA How variability is partitioned Interpretation of the F-ratio How to compute & interpret one-way ANOVA.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
LEARNING PROGRAMME Hypothesis testing Intermediate Training in Quantitative Analysis Bangkok November 2007.
Repeated Measures ANOVA
Repeated Measures Design
Repeated Measures Design
Calculations of Reliability We are interested in calculating the ICC –First step: Conduct a single-factor, within-subjects (repeated measures) ANOVA –This.
ANOVA Greg C Elvers.
Analysis of Covariance David Markham
Chapter 14: Repeated-Measures Analysis of Variance.
Which Test Do I Use? Statistics for Two Group Experiments The Chi Square Test The t Test Analyzing Multiple Groups and Factorial Experiments Analysis of.
B AD 6243: Applied Univariate Statistics Repeated Measures ANOVA Professor Laku Chidambaram Price College of Business University of Oklahoma.
ANOVA. Independent ANOVA Scores vary – why? Total variability can be divided up into 2 parts 1) Between treatments 2) Within treatments.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
Repeated Measurements Analysis. Repeated Measures Analysis of Variance Situations in which biologists would make repeated measurements on same individual.
Hypothesis testing Intermediate Food Security Analysis Training Rome, July 2010.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 10-1 Chapter 10 Analysis of Variance Statistics for Managers Using Microsoft.
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
ANOVA: Analysis of Variance.
Chapter 13 - ANOVA. ANOVA Be able to explain in general terms and using an example what a one-way ANOVA is (370). Know the purpose of the one-way ANOVA.
Adjusted from slides attributed to Andrew Ainsworth
1 ANALYSIS OF VARIANCE (ANOVA) Heibatollah Baghi, and Mastee Badii.
Chapter 13 Repeated-Measures and Two-Factor Analysis of Variance
Kin 304 Inferential Statistics Probability Level for Acceptance Type I and II Errors One and Two-Tailed tests Critical value of the test statistic “Statistics.
Handout Ten: Mixed Design Analysis of Variance EPSE 592 Experimental Designs and Analysis in Educational Research Instructor: Dr. Amery Wu Handout Ten:
Sphericity. More on sphericity With our previous between groups Anova we had the assumption of homogeneity of variance With our previous between groups.
HIERARCHICAL LINEAR MODELS. NESTED DESIGNS A factor A is said to be nested in factor B if the levels of A are divided among the levels of B. This is given.
More repeated measures. More on sphericity With our previous between groups Anova we had the assumption of homogeneity of variance With repeated measures.
©2013, The McGraw-Hill Companies, Inc. All Rights Reserved Chapter 4 Investigating the Difference in Scores.
Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.
Multivariate vs Univariate ANOVA: Assumptions. Outline of Today’s Discussion 1.Within Subject ANOVAs in SPSS 2.Within Subject ANOVAs: Sphericity Post.
Repeated-Measures Analysis of Variance
Chapter 11 Analysis of Variance
Design Lecture: week3 HSTS212.
Becoming Acquainted With Statistical Concepts
Dependent-Samples t-Test
Factorial Experiments
Inferential Statistics
Repeated Measures ANOVA
Kin 304 Inferential Statistics
Statistics for the Social Sciences
Analysis of Variance (ANOVA)
Statistics for the Social Sciences
Reasoning in Psychology Using Statistics
One way ANALYSIS OF VARIANCE (ANOVA)
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Psych 231: Research Methods in Psychology
Statistics for the Social Sciences
Chapter 13: Repeated-Measures Analysis of Variance
Analysis of Variance: repeated measures
Psych 231: Research Methods in Psychology
Psych 231: Research Methods in Psychology
Presentation transcript:

Don't Sweat the Simple Stuff (But it's not all Simple Stuff) David A. Rowe Middle Tennessee State University

Outline what is a within-subjects design? why should I use a within-subjects design? how do I use a within-subjects design? the simple within-subjects ANOVA

Presentation available from: email: darowe@frank.mtsu.edu

What is a Within-Subjects Design? repeated measures design same subjects tested several times same subjects tested under different experimental conditions subjects serve as own controls

Example studies: to what degree do elementary schoolchildren identify different types of sports personality as a role model? differences in BIA readings prior to and 10, 20, and 30 minutes following ingestion of a 12-oz soda

Why should I use repeated measures? Advantages: fewer subjects needed (all subjects complete all conditions) subjects tested in each condition are similar (same people) more powerful (smaller error term, less unexplained variance)

Why are within-subjects designs more powerful? purpose of research is to explain, understand variance (in dependent variables) in independent groups design, only one source of explained variance (assigned treatment, group number) in repeated measures design, another source of explained variance is subject id (correlation between Ss’ scores on the different trials)

Smaller error - statistical explanation consider formula for t-test: independent groups: repeated measures:

Smaller error - example study (simple one-way RM ANOVA) Dependent variable = strength 3 treatment conditions 3 subjects

Subject One (Arnold)

Subjects Two and Three (Charlie and The Kid)

Results

Why should I use repeated measures? Disadvantages: higher levels of attrition possible carry-over, practice, fatigue or latent effects across trials error degrees of freedom are smaller some independent variables can not be investigated using repeated measures designs greater number of assumptions

How do I use repeated measures? counterbalance order of treatments, e.g., for 4 treatments:

How do I use repeated measures? Consider underlying assumptions: normally distributed data independence of observations random selection & assignment compound symmetry (Box, 1954) sphericity, circularity (Huynh & Feldt, 1970; Rouanet &Lépine, 1970)

Compound symmetry variances of treatment conditions are equal covariances among treatments are equal type s matrix sufficient, but not necessary condition if type s matrix does not exist, hypothesis test may be too liberal (critical F too small)

Sphericity (circularity) Equal variances of differences between scores s2(T1-T2)= s2(T2-T3)= s2(T1-T3) H matrix less restrictive than compound symmetry rarely occurs when T>2 can use Geisser Greenhouse correction problem: Geisser-Greenhouse may overcorrect (too conservative)

What to do?

Example Analysis 18 subjects, 4 treatment conditions 72 observations DV = pain rating originally analyzed using a one-way, repeated measures ANOVA SPSS version 8.0 (reliabilities program) also run using independent groups ANOVA (for comparison)

Data - Repeated Measures

Data - “Independent Groups”

Output - Descriptive Statistics

Output - Correlations

Output - Repeated Measures ANOVA

Output - Independent Groups ANOVA

Summary within-subjects designs have specific advantages over independent groups designs within-subjects designs also have added disadvantages should consider whether assumptions are met (and adjust if necessary) seek statistical advice

How do I use repeated measures? seek statistical advice early: “Seeking the advice of a statistician after the research is over is a little like conducting a post-mortem; often he can do little more than tell you what the experiment died of” - Charles Babbage