Multivariate Description. What Technique? Response variable(s)... Predictors(s) No Predictors(s) Yes... is one distribution summary regression models...

Slides:



Advertisements
Similar presentations
Which Test? Which Test? Explorin g Data Explorin g Data Planning a Study Planning a Study Anticipat.
Advertisements

Type of Data Matrix. Managing Dimensionality (but not acronyms) PCA, CA, RDA, CCA, MDS, NMDS, DCA, DCCA, pRDA, pCCA.
Gradient Analysis Approach to Ordination. Models of Species Response to Gradients.
Multivariate Description. What Technique? Response variable(s)... Predictors(s) No Predictors(s) Yes... is one distribution summary regression models...
Multivariate Description. What Technique? Response variable(s)... Predictors(s) No Predictors(s) Yes... is one distribution summary regression models...
Multivariate Description
What we Measure vs. What we Want to Know
Multivariate Description. What Technique? Response variable(s)... Predictors(s) No Predictors(s) Yes... is one distribution summary regression models...
Linear regression models in R (session 1) Tom Price 3 March 2009.
Step three: statistical analyses to test biological hypotheses General protocol continued.
Partial Least Squares Very brief intro. Multivariate regression The multiple regression approach creates a linear combination of the predictors that best.
Factor Analysis and Principal Components Removing Redundancies and Finding Hidden Variables.
Factor Analysis Continued
Dimension reduction (1)
A Quantitative Analysis of Success Factors in the Association of Tennis Professionals (ATP) Nick Korach UP-STAT 2013.
Chapter 17 Overview of Multivariate Analysis Methods
1 Multivariate Statistics ESM 206, 5/17/05. 2 WHAT IS MULTIVARIATE STATISTICS? A collection of techniques to help us understand patterns in and make predictions.
LISA Short Course Series Multivariate Analysis in R Liang (Sally) Shan March 3, 2015 LISA: Multivariate Analysis in RMar. 3, 2015.
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 14 Using Multivariate Design and Analysis.
Data mining and statistical learning - lab2-4 Lab 2, assignment 1: OLS regression of electricity consumption on temperature at 53 sites.
Linear Discriminant Function LDF & MANOVA LDF & Multiple Regression Geometric example of LDF & multivariate power Evaluating & reporting LDF results 3.
Bivariate Regression CJ 526 Statistical Analysis in Criminal Justice.
Data mining and statistical learning, lecture 4 Outline Regression on a large number of correlated inputs  A few comments about shrinkage methods, such.
19-1 Chapter Nineteen MULTIVARIATE ANALYSIS: An Overview.
New Methods in Ecology Complex statistical tests, and why we should be cautious!
Exploring Microarray data Javier Cabrera. Outline 1.Exploratory Analysis Steps. 2.Microarray Data as Multivariate Data. 3.Dimension Reduction 4.Correlation.
Review of the fundamental concepts of probability Exploratory data analysis: quantitative and graphical data description Estimation techniques, hypothesis.
Goals of Factor Analysis (1) (1)to reduce the number of variables and (2) to detect structure in the relationships between variables, that is to classify.
Introduction to Linear and Logistic Regression. Basic Ideas Linear Transformation Finding the Regression Line Minimize sum of the quadratic residuals.
Discriminant Analysis Testing latent variables as predictors of groups.
Advantages of Multivariate Analysis Close resemblance to how the researcher thinks. Close resemblance to how the researcher thinks. Easy visualisation.
The Tutorial of Principal Component Analysis, Hierarchical Clustering, and Multidimensional Scaling Wenshan Wang.
PCA Example Air pollution in 41 cities in the USA.
©The McGraw-Hill Companies, Inc., 2001Irwin/McGraw-Hill Donald Cooper Pamela Schindler Chapter 19 Business Research Methods.
Advanced Correlational Analyses D/RS 1013 Factor Analysis.
Thursday AM  Presentation of yesterday’s results  Factor analysis  A conceptual introduction to: Structural equation models Structural equation models.
Complex Analytic Designs. Outcomes (DVs) Predictors (IVs)1 ContinuousMany Continuous1 CategoricalMany Categorical None(histogram)Factor Analysis: PCA,
Stats Multivariate Data Analysis. Instructor:W.H.Laverty Office:235 McLean Hall Phone: Lectures: M W F 9:30am - 10:20am McLean Hall.
17-1 COMPLETE BUSINESS STATISTICS by AMIR D. ACZEL & JAYAVEL SOUNDERPANDIAN 6 th edition (SIE)
Techniques for studying correlation and covariance structure Principal Components Analysis (PCA) Factor Analysis.
Math 5364/66 Notes Principal Components and Factor Analysis in SAS Jesse Crawford Department of Mathematics Tarleton State University.
Introduction to Multivariate Analysis of Variance, Factor Analysis, and Logistic Regression Rubab G. ARIM, MA University of British Columbia December 2006.
ORDINATION What is it? What kind of biological questions can we answer? How can we do it in CANOCO 4.5? Some general advice on how to start analyses.
Principal Components Analysis. Principal Components Analysis (PCA) A multivariate technique with the central aim of reducing the dimensionality of a multivariate.
Reduces time complexity: Less computation Reduces space complexity: Less parameters Simpler models are more robust on small datasets More interpretable;
Principal Component Analysis (PCA)
Factor Analysis Basics. Why Factor? Combine similar variables into more meaningful factors. Reduce the number of variables dramatically while retaining.
Principal Component Analysis
Continuous Outcome, Dependent Variable (Y-Axis) Child’s Height
Multivariate statistical methods. Multivariate methods multivariate dataset – group of n objects, m variables (as a rule n>m, if possible). confirmation.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.
Chapter 13 LOGISTIC REGRESSION. Set of independent variables Categorical outcome measure, generally dichotomous.
Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.
Financial Analysis, Planning and Forecasting Theory and Application
Factor analysis Advanced Quantitative Research Methods
Information Management course
Dimension Reduction via PCA (Principal Component Analysis)
Simple Linear Regression
Measuring latent variables
Principal Components The Basics Principal Components 1. 11/30/2018.
Measuring latent variables
Measuring latent variables
Principal Components Analysis
Chapter_19 Factor Analysis
Factor Analysis (Principal Components) Output
Compare LDA and PCA.
Principal Component Analysis
Measuring latent variables
8/22/2019 Exercise 1 In the ISwR data set alkfos, do a PCA of the placebo and Tamoxifen groups separately, then together. Plot the first two principal.
Presentation transcript:

Multivariate Description

What Technique? Response variable(s)... Predictors(s) No Predictors(s) Yes... is one distribution summary regression models... are many indirect gradient analysis (PCA, CA, DCA, MDS) cluster analysis direct gradient analysis constrained cluster analysis discriminant analysis (CVA)

a) Rotate the Variable Space

Raw Data

Linear Regression

Two Regressions

Principal Components

Gulls Variables

Scree Plot

Output > gulls.pca2$loadings Loadings: Comp.1 Comp.2 Comp.3 Comp.4 Weight Wing Bill H.and.B > summary(gulls.pca2) Importance of components: Comp.1 Comp.2 Comp.3 Standard deviation Proportion of Variance Cumulative Proportion

Bi-Plot

Male or Female?

Linear Discriminant > gulls.lda <- lda(Sex ~ Wing + Weight + H.and.B + Bill, gulls) lda(Sex ~ Wing + Weight + H.and.B + Bill, data = gulls) Prior probabilities of groups: Group means: Wing Weight H.and.B Bill Coefficients of linear discriminants: LD1 Wing Weight H.and.B Bill

Discriminating

Relationship between PCA and LDA

CVA

b) Use Distance or Dissimilarity (Multi-Dimensional Scaling)

A Distance Matrix

Uses of Distances Distance/Dissimilarity can be used to:- Explore dimensionality in data (using PCO) As a basis for clustering/classification

UK Wet Deposition Network

Fitting Environmental Variables

A Map based on Measured Variables

Fitting Environmental Variables

c) Summarise by Weighted Averages

Species and Sites as Weighted Averages of each other SITES SPP Bel per Jun buf …42.. Jun art Air pra Ele pal Rum ace …23.. Vic lat Bra rut Ran fla Hyp rad Leo aut Pot pal Poa pra …4.. Cal cus Tri pra …2.. Tri rep Ant odo Sal rep Ach mil …2.. Poa tri …45.. Ely rep Sag pro Pla lan …5.. Agr sto Lol per …6.. Alo gen Bro hor …2..

Species and Sites as Weighted Averages of each other

Reciprocal Averaging - unimodal Site A B C D E F Species Prunus serotina Tilia americana Acer saccharum Quercus velutina Juglans nigra

Reciprocal Averaging - unimodal Site A B C D E F Species Score Species Iteration 1 Prunus serotina Tilia americana Acer saccharum Quercus velutina Juglans nigra Iteration Site Score

Reciprocal Averaging - unimodal Site A B C D E F Species Score Species Iteration 1 2 Prunus serotina Tilia americana Acer saccharum Quercus velutina Juglans nigra Iteration Site Score

Reciprocal Averaging - unimodal Site A B C D E F Species Score Species Iteration Prunus serotina Tilia americana Acer saccharum Quercus velutina Juglans nigra Iteration Site Score

Reciprocal Averaging - unimodal Site A B C D E F Species Score Species Iteration Prunus serotina Tilia americana Acer saccharum Quercus velutina Juglans nigra Iteration Site Score

Reordered Sites and Species Site A C E B D F Species Species Score Quercus velutina Prunus serotina Juglans nigra Tilia americana Acer saccharum Site Score

Managing Dimensionality (but not acronyms) PCA, CA, RDA, CCA, MDS, NMDS, DCA, DCCA, pRDA, pCCA

Type of Data Matrix species sites attributes species attributes sites attributes individuals desert macroph inverts uses watervar rain gulls

Ordination Techniques Linear methodsWeighted averaging unconstrainedPrincipal Components Analysis (PCA) Correspondence Analysis (CA) constrainedRedundancy Analysis (RDA) Canonical Correspondence Analysis (CCA)

Models of Species Response There are (at least) two models:- Linear - species increase or decrease along the environmental gradient Unimodal - species rise to a peak somewhere along the environmental gradient and then fall again

A Theoretical Model

Linear

Unimodal

Alpha and Beta Diversity alpha diversity is the diversity of a community (either measured in terms of a diversity index or species richness) beta diversity (also known as species turnover or differentiation diversity) is the rate of change in species composition from one community to another along gradients; gamma diversity is the diversity of a region or a landscape.

A Short Coenocline

A Long Coenocline

Inferring Gradients from Species (or Attribute) Data

Indirect Gradient Analysis Environmental gradients are inferred from species data alone Three methods: –Principal Component Analysis - linear model –Correspondence Analysis - unimodal model –Detrended CA - modified unimodal model

PCA - linear model

Terschelling Dune Data

PCA gradient - site plot

PCA gradient - site/species biplot standard nature biodynamic & hobby

Arches - Artifact or Feature?

The Arch Effect What is it? Why does it happen? What should we do about it?

From Alexandria to Suez

CA - with arch effect (sites)

CA - with arch effect (species)

Long Gradients ABCD

Gradient End Compression

CA - with arch effect (species)

CA - with arch effect (sites)

Detrending by Segments

DCA - modified unimodal

Making Effective Use of Environmental Variables

Approaches Use single responses in linear models of environmental variables Use axes of a multivariate dimension reduction technique as responses in linear models of environmental variables Constrain the multivariate dimension reduction into the factor space defined by the environmental variables

Unconstrained/Constrained Unconstrained ordination axes correspond to the directions of the greatest variability within the data set. Constrained ordination axes correspond to the directions of the greatest variability of the data set that can be explained by the environmental variables.

Direct Gradient Analysis Environmental gradients are constructed from the relationship between species environmental variables Three methods: –Redundancy Analysis - linear model –Canonical (or Constrained) Correspondence Analysis - unimodal model –Detrended CCA - modified unimodal model

Direct Gradient Analysis Basic PCA y ik = b 0k + b 1k x i + e ik –x i - the sample scores on the ordination axis –b 1k - the regression coefficients for each species (the species scores on the ordination axis) In RDA there is a further constraint on x i x i = c 1 z i1 + c 2 z i2 Making y ik = b 0k + b 1k c 1 z i1 + b 1k c 2 z i2 + e ik

Direct Gradient Analysis cca(species_data ~ e1 + e en + Condition(e5), data=environmental_data) cca(varespec ~ Al + P*(K + Baresoil) + Condition(pH), data=varechem)

Lake Nasser - Egypt

CCA - site/species joint plot

CCA - species/environment biplot

Removing the Effect of Nuisance Variables

Partial Analyses Remove the effect of covariates –variables that we can measure but which are of no interest –e.g. block effects, start values, etc. Carry out the gradient analysis on what is left of the variation after removing the effect of the covariates.

Cluster Analysis

Different types of data example Continuous data:height Categorical data ordered (nominal):growth rate very slow, slow, medium, fast, very fast not ordered:fruit colour yellow, green, purple, red, orange Binary data:fruit / no fruit

Similarity matrix We define a similarity between units – like the correlation between continuous variables. (also can be a dissimilarity or distance matrix) A similarity can be constructed as an average of the similarities between the units on each variable. (can use weighted average) This provides a way of combining different types of variables.

relevant for continuous variables: Euclidean city block or Manhattan Distance metrics A B A B (also many other variations)

Similarity coefficients for binary data simple matching count if both units 0 or both units 1 Jaccard count only if both units 1 (also many other variants) simple matching can be extended to categorical data 0,11,1 0,01,0 0,11,1 0,01,0

hierarchical divisive put everything together and split monothetic / polythetic agglomerative keep everything separate and join the most similar points (classical cluster analysis) non-hierarchical k-means clustering Clustering methods

Agglomerative hierarchical Single linkage or nearest neighbour finds the minimum spanning tree: shortest tree that connects all points chaining can be a problem

Agglomerative hierarchical Complete linkage or furthest neighbour compact clusters of approximately equal size. (makes compact groups even when none exist)

Agglomerative hierarchical Average linkage methods between single and complete linkage

Testing Significance in Ordination

Randomisation Tests

Randomisation Example Model: cca(formula = dune ~ Moisture + A1 + Management, data = dune.env) Df Chisq F N.Perm Pr(>F) Model < *** Residual Signif. codes: 0 *** ** 0.01 * 0.05