Multivariate Analysis of Variance

Slides:



Advertisements
Similar presentations
MANOVA (and DISCRIMINANT ANALYSIS) Alan Garnham, Spring 2005
Advertisements

Agenda of Week V Review of Week IV Inference on MV Mean Vector One population Two populations Multi-populations: MANOVA.
Presented by: Shaun Deaton. The idea is to hypothesize constraints on the interchangeability of N normally distributed random variables. Then test the.
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
“Students” t-test.
MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Experimental Statistics - week 5
A. The Basic Principle We consider the multivariate extension of multiple linear regression – modeling the relationship between m responses Y 1,…,Y m and.
Randomized Experimental Design
Repeated Measure Ideally, we want the data to maintain compound symmetry if we want to justify using univariate approaches to deal with repeated measures.
Introduction to One way and Two Way analysis of Variance......
ANOVA notes NR 245 Austin Troy
Analysis of variance (ANOVA)-the General Linear Model (GLM)
Discrim Continued Psy 524 Andrew Ainsworth. Types of Discriminant Function Analysis They are the same as the types of multiple regression Direct Discrim.
Independent Samples and Paired Samples t-tests PSY440 June 24, 2008.
MARE 250 Dr. Jason Turner Multiway, Multivariate, Covariate, ANOVA.
Ch10.1 ANOVA The analysis of variance (ANOVA), refers to a collection of experimental situations and statistical procedures for the analysis of quantitative.
Analysis of Variance & Multivariate Analysis of Variance
Techniques for studying correlation and covariance structure
Correlation. The sample covariance matrix: where.
Multivariate Analysis of Variance, Part 1 BMTRY 726.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 14 Analysis.
Inference for the mean vector. Univariate Inference Let x 1, x 2, …, x n denote a sample of n from the normal distribution with mean  and variance 
The Randomized Block Design. Suppose a researcher is interested in how several treatments affect a continuous response variable (Y). The treatments may.
One-Way Manova For an expository presentation of multivariate analysis of variance (MANOVA). See the following paper, which addresses several questions:
Multivariate Analysis of Variance (MANOVA). Outline Purpose and logic : page 3 Purpose and logic : page 3 Hypothesis testing : page 6 Hypothesis testing.
1 1 Slide © 2006 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Profile Analysis. Definition Let X 1, X 2, …, X p denote p jointly distributed variables under study Let  1,  2, …,  p denote the means of these variables.
Chapter 14: Repeated-Measures Analysis of Variance.
The Multiple Correlation Coefficient. has (p +1)-variate Normal distribution with mean vector and Covariance matrix We are interested if the variable.
Repeated Measures Designs. In a Repeated Measures Design We have experimental units that may be grouped according to one or several factors (the grouping.
The Randomized Block Design. Suppose a researcher is interested in how several treatments affect a continuous response variable (Y). The treatments may.
1 Comparison of Several Multivariate Means Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute.
MANOVA Multivariate Analysis of Variance. One way Analysis of Variance (ANOVA) Comparing k Populations.
Factorial Experiments Analysis of Variance (ANOVA) Experimental Design.
MARE 250 Dr. Jason Turner Multiway, Multivariate, Covariate, ANOVA.
1 Chapter 13 Analysis of Variance. 2 Chapter Outline  An introduction to experimental design and analysis of variance  Analysis of Variance and the.
MANOVA Multivariate Analysis of Variance. One way Analysis of Variance (ANOVA) Comparing k Populations.
11 Comparison of Several Multivariate Means Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute.
MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Repeated Measures Designs. In a Repeated Measures Design We have experimental units that may be grouped according to one or several factors (the grouping.
Statistical Analysis of Data1 of 38 1 of 42 Department of Cognitive Science Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 MANOVA Multivariate.
Analysis of Variance (One Factor). ANOVA Analysis of Variance Tests whether differences exist among population means categorized by only one factor or.
Experimental Research Methods in Language Learning
Repeated Measures Designs. In a Repeated Measures Design We have experimental units that may be grouped according to one or several factors (the grouping.
Copyright © Cengage Learning. All rights reserved. 12 Analysis of Variance.
Correlated-Samples ANOVA The Univariate Approach.
Inference for the mean vector. Univariate Inference Let x 1, x 2, …, x n denote a sample of n from the normal distribution with mean  and variance 
Other experimental designs Randomized Block design Repeated Measures designs.
Two-Group Discriminant Function Analysis. Overview You wish to predict group membership. There are only two groups. Your predictor variables are continuous.
The p-value approach to Hypothesis Testing
ANOVA EDL 714, Fall Analysis of variance  ANOVA  An omninbus procedure that performs the same task as running multiple t-tests between all groups.
ANCOVA (adding covariate) MANOVA (adding more DVs) MANCOVA (adding DVs and covariates) Group Differences: other situations…
MANOVA Lecture 12 Nuance stuff Psy 524 Andrew Ainsworth.
Repeated Measures ANOVA Comparison of Task Completion Times of 4 Navigation Techniques and 2 Input Methods by 36 Subjects Source: F.-G. Wu, H. Lin, M.
Design Lecture: week3 HSTS212.
Differences Among Group Means: Multifactorial Analysis of Variance
ANOVA Econ201 HSTS212.
Inference for the mean vector
Comparing k Populations
Statistics for the Social Sciences
Multivariate Statistical Methods
Comparisons Among Treatments/Groups
Chapter 13: Repeated-Measures Analysis of Variance
MANOVA Control of experimentwise error rate (problem of multiple tests). Detection of multivariate vs. univariate differences among groups (multivariate.
Chapter 10 – Part II Analysis of Variance
ANOVA: Analysis of Variance
Principles of Experimental Design
One way Analysis of Variance (ANOVA)
Presentation transcript:

Multivariate Analysis of Variance MANOVA Multivariate Analysis of Variance

One way Multivariate Analysis of Variance (MANOVA) Comparing k p-variate Normal Populations

Comparing k mean vectors Situation We have k normal populations Let denote the mean vector and covariance matrix of population i. i = 1, 2, 3, … k. Note: we assume that the covariance matrix for each population is the same.

We want to test against

The data Assume we have collected data from each of k populations Let denote the n observations from population i. i = 1, 2, 3, … k.

The summary statistics Sample mean vectors Sample covariance matrices S1, S2, etc.

Computing Formulae: Compute 1) 2) 3)

4) 5)

Let = the Between SS and SP matrix

Let = the Within SS and SP matrix

The Manova Table Source SS and SP matrix Between Within

There are several test statistics for testing against

1. Roy’s largest root 2. Wilk’s lambda (L) This test statistic is derived using Roy’s union intersection principle 2. Wilk’s lambda (L) This test statistic is derived using the generalized Likelihood ratio principle

3. Lawley-Hotelling trace statistic 4. Pillai trace statistic (V)

Example In the following study, n = 15 first year university students from three different School regions (A, B and C) who were each taking the following four courses (Math, biology, English and Sociology) were observed: The marks on these courses is tabulated on the following slide:

The data

Summary Statistics

Computations : 1) 2) 3)

4) =

5) =

Now = the Between SS and SP matrix

Let = the Within SS and SP matrix

Using SPSS to perform MANOVA

Selecting the variables and the Factors

The output

Univariate Tests

Profile Analysis

Repeated Measures Designs

In a Repeated Measures Design We have experimental units that may be grouped according to one or several factors (the grouping factors) Then on each experimental unit we have not a single measurement but a group of measurements (the repeated measures) The repeated measures may be taken at combinations of levels of one or several factors (The repeated measures factors)

Example In the following study the experimenter was interested in how the level of a certain enzyme changed in cardiac patients after open heart surgery. The enzyme was measured immediately after surgery (Day 0), one day (Day 1), two days (Day 2) and one week (Day 7) after surgery for n = 15 cardiac surgical patients.

The data is given in the table below. Table: The enzyme levels -immediately after surgery (Day 0), one day (Day 1),two days (Day 2) and one week (Day 7) after surgery

The subjects are not grouped (single group). There is one repeated measures factor -Time – with levels Day 0, Day 1, Day 2, Day 7 This design is the same as a randomized block design with Blocks = subjects

The Anova Table for Enzyme Experiment The Subject Source of variability is modelling the variability between subjects The ERROR Source of variability is modelling the variability within subjects

Example : (Repeated Measures Design - Grouping Factor) In the following study, similar to example 3, the experimenter was interested in how the level of a certain enzyme changed in cardiac patients after open heart surgery. In addition the experimenter was interested in how two drug treatments (A and B) would also effect the level of the enzyme.

The 24 patients were randomly divided into three groups of n= 8 patients. The first group of patients were left untreated as a control group while the second and third group were given drug treatments A and B respectively. Again the enzyme was measured immediately after surgery (Day 0), one day (Day 1), two days (Day 2) and one week (Day 7) after surgery for each of the cardiac surgical patients in the study.

Table: The enzyme levels - immediately after surgery (Day 0), one day (Day 1),two days (Day 2) and one week (Day 7) after surgery for three treatment groups (control, Drug A, Drug B)

The subjects are grouped by treatment control, Drug A, Drug B There is one repeated measures factor -Time – with levels Day 0, Day 1, Day 2, Day 7

The Anova Table There are two sources of Error in a repeated measures design: The between subject error – Error1 and the within subject error – Error2

Tables of means Drug Day 0 Day 1 Day 2 Day 7 Overall Control 118.63 77.88 60.50 55.75 78.19 A 103.25 68.25 52.00 51.50 68.75 B 103.38 69.38 54.13 51.50 69.59 Overall 108.42 71.83 55.54 52.92 72.18

Example : Repeated Measures Design - Two Grouping Factors In the following example , the researcher was interested in how the levels of Anxiety (high and low) and Tension (none and high) affected error rates in performing a specified task. In addition the researcher was interested in how the error rates also changed over time. Four groups of three subjects diagnosed in the four Anxiety-Tension categories were asked to perform the task at four different times patients in the study.

The number of errors committed at each instance is tabulated below.

The Anova Table