Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-1 Chapter 7 Multivariate Analysis of Variance

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-2 LEARNING OBJECTIVES... Upon completing this chapter, you should be able to do the following: Explain the difference between the univariate null hypothesis of ANOVA and the multivariate null hypothesis of MANOVA. Discuss the advantages of a multivariate approach to significance testing compared to the more traditional univariate approaches. State the assumptions for the use of MANOVA. Discuss the different types of test statistics that are available for significance testing in MANOVA. Chapter 7 Multivariate Analysis of Variance Chapter 7 Multivariate Analysis of Variance

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-3 LEARNING OBJECTIVES continued... Upon completing this chapter, you should be able to do the following: Describe the purpose of post hoc tests in ANOVA and MANOVA. Describe the purpose of post hoc tests in ANOVA and MANOVA. Interpret interaction results when more than one independent variable is used in MANOVA. Interpret interaction results when more than one independent variable is used in MANOVA. Describe the purpose of multivariate analysis of covariance (MANCOVA). Describe the purpose of multivariate analysis of covariance (MANCOVA). Chapter 7 Multivariate Analysis of Variance Chapter 7 Multivariate Analysis of Variance

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-4 MANOVA... is the multivariate extension of the univariate techniques for assessing the differences between group means. In contrast to ANOVA, it can examine more than one dependent variable at the same time. MANOVA... is the multivariate extension of the univariate techniques for assessing the differences between group means. In contrast to ANOVA, it can examine more than one dependent variable at the same time. MANOVA Defined

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-5 In the univariate case, a single dependent measure is tested for equality across the groups. In the multivariate case, a variate is tested for equality. In MANOVA, the researcher actually has two variate – one for the dependent variables and another for the independent variables. The dependent variable variate is of more interest because the metric-dependent measures can be combined in a linear combination, as we have already seen in multiple regression and discriminant analysis. The unique aspect of MANOVA is that the variate optimally combines the multiple dependent measures into a single value that maximizes the differences across groups. ANOVA versus MANOVA

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-6 ANOVA vs. MANOVA The relationship between the univariate and multivariate procedures is shown below: Number of Dependent Variables Number of Groups in Independent Variable One(Univariate) Two or More (Multivariate) Two Groups (Specialized Case) t-test Hotelling’s T 2 Two or More Groups (Generalized Case) Analysis of Variance (ANOVA) Multivariate Analysis of Variance (MANOVA)

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-7 MANOVA Decision Process Stage 1: Objectives of MANOVA Stage 2: Research Design of MANOVA Stage 3: Assumptions in Multiple MANOVA Stage 4: Estimating the MANOVA Model and Assessing Overall Fit Stage 5: Interpreting the MANOVA Variate Stage 6: Validation of the Results

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-8 Stage 1: Objectives of MANOVA 1.To analyze a dependence relationship represented as the differences in a set of dependent measure across a series of groups formed by one or more categorical independent measures. 2.To provide insights into the nature and predictive power of the independent measures as well as the interrelationships and differences in the multiple dependent measures.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall. 7-9 What Can We Do With MANOVA? Three types of questions suitable for MANOVA: Multiple Univariate Questions Multiple Univariate Questions Structured Multivariate Questions Structured Multivariate Questions Intrinsically Multivariate Questions Intrinsically Multivariate Questions

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–1 DECISION PROCESSES FOR MANOVA MANOVA is an extension of ANOVA that examines the effect of one or more nonmetric independent variables on two or more metric dependent variables. MANOVA is an extension of ANOVA that examines the effect of one or more nonmetric independent variables on two or more metric dependent variables. In addition to the ability to analyze multiple dependent variables, MANOVA also has the advantages of: In addition to the ability to analyze multiple dependent variables, MANOVA also has the advantages of: Controlling the experiment-wide error rate when there is some degree of intercorrelation among dependent variables. Controlling the experiment-wide error rate when there is some degree of intercorrelation among dependent variables. Providing more statistical power than ANOVA when the number of dependent variables is 5 or less. Providing more statistical power than ANOVA when the number of dependent variables is 5 or less.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–1 continued... DECISION PROCESSES FOR MANOVA Nonmetric independent variables create ‘groups’ between which the dependent variables are compared. Many times the groups represent experimental variables or “treatment effects.” Nonmetric independent variables create ‘groups’ between which the dependent variables are compared. Many times the groups represent experimental variables or “treatment effects.” Researchers should include only dependent variables that have strong theoretical support. Researchers should include only dependent variables that have strong theoretical support.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Sample Size Requirements – Overall and by Group. Sample Size Requirements – Overall and by Group. Factorial Designs – Two or More Treatments. Factorial Designs – Two or More Treatments. Selecting Treatments – types and number; interaction effects Selecting Treatments – types and number; interaction effects Using covariates – ANCOVA AND MANCOVA Using covariates – ANCOVA AND MANCOVA Stage 2: Issues in the Research Design of MANOVA

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Sample Size Requirements by Group

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–2 RESEARCH DESIGN OF MANOVA Cells (groups) are formed by the combination of independent variables. For example, a three-category nonmetric variable (e.g., low, medium, high) combined with a two-category nonmetric variable (e.g., gender of male versus female) will result in a 3 x 2 design with six cells (groups). Sample size per group is a critical design issue: Minimum sample size per group must be greater than the number of dependent variables. The recommended minimum cell size is 20 observations per cell (group). Researchers should try to have approximately equal sample sizes per cell (group).

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–2 continued... RESEARCH DESIGN OF MANOVA Covariates and blocking variables are effective ways of controlling for external influences on the dependent variables that are not directly represented in the independent variables: An effective covariate is one that is highly correlated with the dependent variable(s) but not correlated with the independent variables. The maximum number of covariates in a model should be (.10 x Sample Size) – (Number of Groups – 1).

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Objectives of Covariance Analysis The objective of the covariate is to eliminate any effects that... 1.affect only a portion of the respondents, or 2.vary among the respondents. Similar to the use of a blocking factor, covariates can achieve two specific purposes... 1.eliminate some systematic error outside the control of the researcher that can bias the results, and 2.account for differences in the responses due to unique characteristics of the respondents.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall oIndependence of observations oEquality of variance – covariance matrices for all groups oNormality oLinearity and multicollinearity among the dependent variables oSensitivity to outliers Stage 3: Assumptions of ANOVA and MANOVA

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–3 MANOVA/ANOVA ASSUMPTIONS For the multivariate test procedures used with MANOVA to be valid: Observations must be independent. Variance-covariance matrices must be equal (or comparable) for all treatment groups. The dependent variables must have a multivariate normal distribution. Multivariate normality is assumed, but many times hard to assess. Univariate normality does not guarantee multivariate normality, but if all variables meet the univariate normality requirement then departures from multivariate normality are inconsequential. ANOVA F-tests are generally robust if violations of these assumptions are modest.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall oControl experimental error rate. oTest for difference between multiple dependent variables. Why Use MANOVA?

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Selecting criteria for significance tests. Selecting criteria for significance tests. Assessing statistical power. Assessing statistical power. Stage 4: Estimation of the MANOVA Model and Assessing Overall Fit

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Statistical Measures Statistical Measures Roy’s greatest characteristic root Roy’s greatest characteristic root Wilks’ Lambda Wilks’ Lambda Pillai’s criterion and Hotelling’s trace Pillai’s criterion and Hotelling’s trace Statistical Power Statistical Power Criteria for Statistical Tests

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–4 Selecting a Statistical Measure

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–4 continued... Selecting a Statistical Measure Roy’s gcr is a more powerful test statistic if the researcher is confident that all assumptions are strictly met and the dependent measures are representative of a single dimension of effects. Roy’s gcr is a more powerful test statistic if the researcher is confident that all assumptions are strictly met and the dependent measures are representative of a single dimension of effects. In a vast majority of situations, all of the statistical measures provide similar conclusions. In a vast majority of situations, all of the statistical measures provide similar conclusions. When faced with conflicting conditions, however, statistical measures can be selected that meet the situation faced by the researcher. When faced with conflicting conditions, however, statistical measures can be selected that meet the situation faced by the researcher.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–5 MANOVA ESTIMATION The four most widely used measures for assessing statistical significance between groups on the independent variables are: Roy’s Greatest Characteristic Root Wilk’s Lambda Pillai’s Criterion Hotelling’s Trace In most situations the results/conclusions will be the same across all four measures, but in some unique instances results will differ between the measures.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–5 continued... MANOVA ESTIMATION Maintaining adequate statistical power is critical: Power in the.80 range for the selected alpha level is acceptable. When the effect size is small, the researcher should use larger sample sizes per group to maintain acceptable levels of statistical power. The General Linear Model (GLM) is widely used in testing ANOVA or MANOVA models. GLM is available on most statistical packages like SPSS and SAS.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Interpret the effects of covariates, if used. Interpret the effects of covariates, if used. Assess which dependent variables exhibited differences across the groups of each treatment. Assess which dependent variables exhibited differences across the groups of each treatment. Identify whether the groups differ on a single dependent variable or the entire dependent variate. Identify whether the groups differ on a single dependent variable or the entire dependent variate. Stage 5: Interpretation of the MANOVA Results

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall oMain effects of the treatments oImpacts of interaction terms Statistical significance Statistical significance Types of significant interactions Types of significant interactions Ordinal interactions Ordinal interactions Disordinal interactions Disordinal interactions Assessing Effects on the Dependent Variate

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–6 Interpreting Covariates and Interaction Effects When covariates are involved in a GLM model: Analyze the model both with and without the covariates. If the covariates do not improve the statistical power or have no effect on the significance of the treatment effects, then they can be dropped from the final analysis. Any time two or more independent variables (treatments) are included in the analysis, interactions must be examined before drawing conclusions about main effects for any independent variable: If the interactions are not statistically significant, then main effects can be interpreted directly since the difference between treatments is considered constant across combinations of levels.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–6 Continued... If the interaction is statistically significant and the differences are not constant across combinations of levels, then the interaction must be determined to be ordinal or disordinal: oOrdinal interactions mean that the direction of differences do not vary by level (e.g., males always less than females) even though the difference between males/females varies by level on the other treatment. In this case, the size of the main effect (e.g., males versus females) should only be described separately for each level of the other treatment. oSignificant disordinal interactions occur when the direction of an observed main effect changes with the level of another treatment (e.g., males greater than females for one level and less than females for another level). Disordinal interactions interfere with the interpretation of main effects.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall oPost Hoc Methods oA Priori or Planned Comparisons Identifying Differences Between Individual Groups

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Scheffe Scheffe Tukey’s honestly significant difference (HSD) Tukey’s honestly significant difference (HSD) Tukey’s extension of the Fisher least significant difference (LSD) Tukey’s extension of the Fisher least significant difference (LSD) Duncan’s multiple-range test Duncan’s multiple-range test Newman-Kuels test Newman-Kuels test Post Hoc Methods

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall oReplication. oUse of covariates? oAssessing causation? Stage 6: Validation of the Results

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Rules of Thumb 7–7 Interpreting Differences between Individual Groups When the independent variable has more than two groups, two types of procedures can be used to isolate the source of differences: Post-hoc tests examine potential statistical differences among all possible combinations of group means. Post-hoc tests have limited power and thus are best suited to identify large effects. Planned comparisons are appropriate when a priori theoretical reasons suggest that certain groups will differ from another group or other groups. Type I error is inflated as the number of planned comparisons increases.

Copyright © 2010 Pearson Education, Inc., publishing as Prentice-Hall Variable Description Variable Type Data Warehouse Classification Variables X1Customer Typenonmetric X2Industry Typenonmetric X3Firm Sizenonmetric X4Regionnonmetric X5Distribution Systemnonmetric Performance Perceptions Variables X6Product Qualitymetric X7E-Commerce Activities/Websitemetric X8Technical Supportmetric X9Complaint Resolutionmetric X10Advertising metric X11Product Linemetric X12Salesforce Imagemetric X13Competitive Pricingmetric X14Warranty & Claimsmetric X15New Productsmetric X16Ordering & Billingmetric X17Price Flexibilitymetric X18Delivery Speedmetric Outcome/Relationship Measures X19Satisfactionmetric X20Likelihood of Recommendationmetric X21Likelihood of Future Purchasemetric X22Current Purchase/Usage Levelmetric X23Consider Strategic Alliance/Partnership in Futurenonmetric Description of HBAT Primary Database Variables