MANOVA LDF & MANOVA Geometric example of MANVOA & multivariate power MANOVA dimensionality Follow-up analyses if k > 2 Factorial MANOVA.

Slides:



Advertisements
Similar presentations
MANOVA (and DISCRIMINANT ANALYSIS) Alan Garnham, Spring 2005
Advertisements

Discriminant Analysis and Classification. Discriminant Analysis as a Type of MANOVA  The good news about DA is that it is a lot like MANOVA; in fact.
Canonical Correlation simple correlation -- y 1 = x 1 multiple correlation -- y 1 = x 1 x 2 x 3 canonical correlation -- y 1 y 2 y 3 = x 1 x 2 x 3 The.
Metrics, Algorithms & Follow-ups Profile Similarity Measures Cluster combination procedures Hierarchical vs. Non-hierarchical Clustering Statistical follow-up.
Chapter 17 Overview of Multivariate Analysis Methods
Lecture 7: Principal component analysis (PCA)
More on ANOVA. Overview ANOVA as Regression Comparison Methods.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 14 Using Multivariate Design and Analysis.
Linear Discriminant Function LDF & MANOVA LDF & Multiple Regression Geometric example of LDF & multivariate power Evaluating & reporting LDF results 3.
Research methods and statistics
Regression Models w/ k-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
Discrim Continued Psy 524 Andrew Ainsworth. Types of Discriminant Function Analysis They are the same as the types of multiple regression Direct Discrim.
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, Semi-Partial correlations, statistical control Using model plotting to think about ANCOVA & Statistical control.
Multiple Regression Models Advantages of multiple regression Important preliminary analyses Parts of a multiple regression model & interpretation Differences.
Multiple Regression Models: Some Details & Surprises Review of raw & standardized models Differences between r, b & β Bivariate & Multivariate patterns.
19-1 Chapter Nineteen MULTIVARIATE ANALYSIS: An Overview.
Multiple-group linear discriminant function maximum & contributing ldf dimensions concentrated & diffuse ldf structures follow-up analyses evaluating &
What Is Multivariate Analysis of Variance (MANOVA)?
Bivariate & Multivariate Regression correlation vs. prediction research prediction and relationship strength interpreting regression formulas process of.
An Introduction to Classification Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification.
Multivariate Analysis Techniques
Multiple Linear Regression A method for analyzing the effects of several predictor variables concurrently. - Simultaneously - Stepwise Minimizing the squared.
Business Research Methods William G. Zikmund Chapter 24 Multivariate Analysis.
Multivariate Data Analysis Chapter 8 - Canonical Correlation Analysis.
By Hui Bian Office for Faculty Excellence 1. K-group between-subjects MANOVA with SPSS Factorial between-subjects MANOVA with SPSS How to interpret SPSS.
Discriminant Function Analysis Basics Psy524 Andrew Ainsworth.
Some matrix stuff.
MANOVA.
بسم الله الرحمن الرحیم.. Multivariate Analysis of Variance.
1 Multivariate Analysis (Source: W.G Zikmund, B.J Babin, J.C Carr and M. Griffin, Business Research Methods, 8th Edition, U.S, South-Western Cengage Learning,
Business Research Methods William G. Zikmund Chapter 24 Multivariate Analysis.
Discriminant Analysis
Chapter 9 Analyzing Data Multiple Variables. Basic Directions Review page 180 for basic directions on which way to proceed with your analysis Provides.
Coding Multiple Category Variables for Inclusion in Multiple Regression More kinds of predictors for our multiple regression models Some review of interpreting.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
Inferential Statistics
Chapter 10: Analyzing Experimental Data Inferential statistics are used to determine whether the independent variable had an effect on the dependent variance.
Multivariate Data Analysis Chapter 5 – Discrimination Analysis and Logistic Regression.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
Complex Analytic Designs. Outcomes (DVs) Predictors (IVs)1 ContinuousMany Continuous1 CategoricalMany Categorical None(histogram)Factor Analysis: PCA,
Available at Chapter 13 Multivariate Analysis BCB 702: Biostatistics
Statistical Analysis of Data1 of 38 1 of 42 Department of Cognitive Science Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 MANOVA Multivariate.
Regression Models w/ 2 Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting the regression.
Multiple Discriminant Analysis
Adjusted from slides attributed to Andrew Ainsworth
Regression Models w/ 2-group & Quant Variables Sources of data for this model Variations of this model Main effects version of the model –Interpreting.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 12 Testing for Relationships Tests of linear relationships –Correlation 2 continuous.
ANCOVA. What is Analysis of Covariance? When you think of Ancova, you should think of sequential regression, because really that’s all it is Covariate(s)
Multivariate Analysis: Analysis of Variance
Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.
MANOVA One-Way. MANOVA This is just a DFA in reverse. You predict a set of continuous variables from one or more grouping variables. Often used in an.
Copyright c 2001 The McGraw-Hill Companies, Inc.1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent variable.
 Seeks to determine group membership from predictor variables ◦ Given group membership, how many people can we correctly classify?
ANCOVA Workings of ANOVA & ANCOVA ANCOVA, partial correlations & multiple regression Using model plotting to think about ANCOVA & Statistical control Homogeneity.
ANCOVA.
Unit 7 Statistics: Multivariate Analysis of Variance (MANOVA) & Discriminant Functional Analysis (DFA) Chat until class starts.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 11 Testing for Differences Differences betweens groups or categories of the independent.
General Linear Model What is the General Linear Model?? A bit of history & our goals Kinds of variables & effects It’s all about the model (not the data)!!
ANCOVA (adding covariate) MANOVA (adding more DVs) MANCOVA (adding DVs and covariates) Group Differences: other situations…
D/RS 1013 Discriminant Analysis. Discriminant Analysis Overview n multivariate extension of the one-way ANOVA n looks at differences between 2 or more.
Biostatistics Regression and Correlation Methods Class #10 April 4, 2000.
MANOVA Lecture 12 Nuance stuff Psy 524 Andrew Ainsworth.
Profile Analysis and Doubly Manova Comps in PA and Doubly Manova Psy 524 Andrew Ainsworth.
Linear Discriminant Function Classification vs. Prediction Classification & ANOVA Classification Cutoffs, Errors, etc. Multivariate Classification & LDF.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
MANOVA Dig it!.
Soc 3306a: ANOVA and Regression Models
Multivariate Statistics
Soc 3306a Lecture 11: Multivariate 4
Multivariate Analysis: Analysis of Variance
Presentation transcript:

MANOVA LDF & MANOVA Geometric example of MANVOA & multivariate power MANOVA dimensionality Follow-up analyses if k > 2 Factorial MANOVA

ldf & MANOVA 1 grouping variable and multiple “others” (quantitative or binary) Naming conventions : LDF -- if the groups are “naturally occurring” bio-taxonomy to diagnostic categories & measurement grouping variable is called the “criterion” others called the “discriminator” or “predictor” variables MANOVA -- if the groups are the “result of IV manipulation” multivariate assessment of agricultural “programs” grouping variable is called the “IV” others called the “DVs”

Ways of thinking about the “new variable” in MANOVA (like regression) involves constructing a “new” quantitative variate from a weighted combination of quantitative, binary, or coded predictors, discriminators or DVs The “new” variable is constructed so that when it is used as the DV in an ANOVA, the F-value will be as large as possible (simultaneously maximizing between groups variation and minimizing within-groups variation) the “new” variable is called MANOVA variate -- a “variate” is constructed from variables linear discriminant function -- a linear function of the original variables constructed to maximally discriminate among the “groups” canonical variate -- alludes to canonical correlation as the general model within which all corr and ANOVA models fit

How MANOVA works -- two groups and 2 vars Var #1 Var#2Var#2 Plot each participant’s position in this “2-space”, keeping track of group membership. Mark each groups “centroid”

Look at the group difference on each variable, separately. Var #1 Var#2Var#2 The dash/dot lines show the mean difference on each variable -- which are small relative to within-group differences, so small Fs

The MANOVA variate “positioned” to maximize resulting F Var #1 Var#2Var#2 In this way, two variables with non-significant ANOVA Fs can combine to produce a significant MANOVA F

Like ANOVA, ldf can be applied to two or more groups. When we have multiple groups there may be an advantage to using multiple discriminant functions to maximally discriminate between the groups. That is, we must decide whether the multiple groups “line up” on a single dimension (called a concentrated structure), or whether they are best described by their position in a multidimensional “space” (called a diffuse structure). Maximum # dimensions for a given analysis: the smaller of# groups - 1 # predictor variables e.g., 4 groups with 6 predictor variables ? Max # ldfs = _____

“Anticipating” the number of dimensions (MANOVAs) By inspecting the “group profiles,” (means of each group on each of the predictor variables) you can often anticipate whether there will be more than one ldf … if the groups have similar patterns of differences (similar profiles) for each predictor variable (for which there are differences), then you would expect a single discriminant function. If the groups have different profiles for different predictor variables, then you would expect more than one ldf Group Var1 Var2 Var3 Var4Group Var1 Var2 Var3 Var Concentrated Diffuse 1st nd

Determining the number of dimensions (variates) Like other “determinations”, there is a significance test involved Each variate is tested as to whether it “contributes to the model” using one of the available F-tests of the -value. The first variate will always account for the most between-group variation (have the largest F and R c ) -- subsequent variates are “orthogonal” (providing independent information), and will account for successively less between group variation. If there is a single variate, then the model is said to have a concentrated structure if there are 2 or more variates then the model has a diffuse structure the distinction between a concentrated and a diffuse structure is considered the “fundamental multivariate question” in a multiple group analysis.

There are two major types of follow-ups when k > 2 Univariate follow-ups -- abandoning the multivariate analysis, simply describe the results of the ANOVA (with pairwise comparisons) for each of the predictors (DVs) MANOVA variate follow-ups -- use the ldf(s) as DVs in ANOVA (with pairwise comparisons) to explicate what which ldfs discriminate between what groups this nicely augments the spatial & re-classification depictions if you have a concentrated structure, it tells you exactly what groups can be significantly discriminated if you have a diffuse structure, it tells you whether the second variate provides discriminatory power the 1st doesn’t

Factorial MANOVA A factorial MANOVA is applied with you have... a factorial design multiple DVs A factorial MANOVA analysis is (essentially) a separate MANOVA performed for each of the factorial effects, in a 2-way factorial... Interaction effect one main effect other main effect It is likely that the MANOVA variates for the effects will not be the same. Said differently, different MANOVA main and interaction effects are likely to be produced by different DV combinations & weightings. So, each variate for each effect must be carefully examined and interpreted!