Canonical Correlation

Slides:



Advertisements
Similar presentations
Cause (Part II) - Causal Systems I. The Logic of Multiple Relationships II. Multiple Correlation Topics: III. Multiple Regression IV. Path Analysis.
Advertisements

MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Correlation and Linear Regression.
1 Simple Linear Regression and Correlation The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES Assessing the model –T-tests –R-square.
AP Statistics Chapter 16. Discrete Random Variables A discrete random variable X has a countable number of possible values. The probability distribution.
Lecture 7: Principal component analysis (PCA)
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Statistics II: An Overview of Statistics. Outline for Statistics II Lecture: SPSS Syntax – Some examples. Normal Distribution Curve. Sampling Distribution.
Discrim Continued Psy 524 Andrew Ainsworth. Types of Discriminant Function Analysis They are the same as the types of multiple regression Direct Discrim.
Canonical Correlation: Equations Psy 524 Andrew Ainsworth.
Canonical Correlation Analysis: An overview with application to learning methods By David R. Hardoon, Sandor Szedmak, John Shawe-Taylor School of Electronics.
Correlation. The sample covariance matrix: where.
Discriminant Analysis Testing latent variables as predictors of groups.
Lecture 5 Correlation and Regression
Structural Equation Models – Path Analysis
MANOVA - Equations Lecture 11 Psy524 Andrew Ainsworth.
Canonical Correlation. What is Canonical Correlation? Canonical correlation seeks the weighted linear composite for each variate (sets of D.V.s or I.V.s)
Analysis of Variance: Some Review and Some New Ideas
Multivariate Data Analysis Chapter 8 - Canonical Correlation Analysis.
Correlation and Regression
Canonical Correlation Analysis, Redundancy Analysis and Canonical Correspondence Analysis Hal Whitehead BIOL4062/5062.
The Multiple Correlation Coefficient. has (p +1)-variate Normal distribution with mean vector and Covariance matrix We are interested if the variable.
Discriminant Function Analysis Basics Psy524 Andrew Ainsworth.
Some matrix stuff.
Chapter 17 Partial Correlation and Multiple Regression and Correlation.
13.6 MATRIX SOLUTION OF A LINEAR SYSTEM.  Examine the matrix equation below.  How would you solve for X?  In order to solve this type of equation,
Production Planning and Control. A correlation is a relationship between two variables. The data can be represented by the ordered pairs (x, y) where.
Multiple Linear Regression. Purpose To analyze the relationship between a single dependent variable and several independent variables.
MANOVA Mechanics. MANOVA is a multivariate generalization of ANOVA, so there are analogous parts to the simpler ANOVA equations First lets revisit Anova.
Statistical analysis Outline that error bars are a graphical representation of the variability of data. The knowledge that any individual measurement.
By: Amani Albraikan.  Pearson r  Spearman rho  Linearity  Range restrictions  Outliers  Beware of spurious correlations….take care in interpretation.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
Canonical Correlation/Regression. AKA multiple, multiple regression AKA multivariate multiple regression Have two sets of variables (Xs and Ys) Create.
CANONICAL CORRELATION. Return to MR  Previously, we’ve dealt with multiple regression, a case where we used multiple independent variables to predict.
Canonical Correlation Psy 524 Andrew Ainsworth. Matrices Summaries and reconfiguration.
Statistical Analysis of Data1 of 38 1 of 42 Department of Cognitive Science Adv. Experimental Methods & Statistics PSYC 4310 / COGS 6310 MANOVA Multivariate.
Lecture 12 Factor Analysis.
General Linear Model.
AP Statistics Chapter 16. Discrete Random Variables A discrete random variable X has a countable number of possible values. The probability distribution.
LESSON 6: REGRESSION 2/21/12 EDUC 502: Introduction to Statistics.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
Discriminant Function Analysis Mechanics. Equations To get our results we’ll have to use those same SSCP matrices as we did with Manova.
Chapter 8 Relationships Among Variables. Outline What correlational research investigates Understanding the nature of correlation What the coefficient.
Canonical Correlation. Canonical correlation analysis (CCA) is a statistical technique that facilitates the study of interrelationships among sets of.
Multivariate Transformation. Multivariate Transformations  Started in statistics of psychology and sociology.  Also called multivariate analyses and.
Université d’Ottawa / University of Ottawa 2001 Bio 8100s Applied Multivariate Biostatistics L11.1 Lecture 11: Canonical correlation analysis (CANCOR)
Chapter 10 Canonical Correlation Analysis. Introduction Canonical correlation analysis focuses on the correlation between a linear combination of the.
Chapter 14 EXPLORATORY FACTOR ANALYSIS. Exploratory Factor Analysis  Statistical technique for dealing with multiple variables  Many variables are reduced.
1 FACTOR ANALYSIS Kazimieras Pukėnas. 2 Factor analysis is used to uncover the latent (not observed directly) structure (dimensions) of a set of variables.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
Canonical Correlation Analysis (CCA). CCA This is it! The mother of all linear statistical analysis When ? We want to find a structural relation between.
Chapter 11: Linear Regression E370, Spring From Simple Regression to Multiple Regression.
Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.
Statistical analysis.
Statistical analysis.
Factor analysis Advanced Quantitative Research Methods
BIVARIATE REGRESSION AND CORRELATION
Analysis of Variance: Some Review and Some New Ideas
Cause (Part II) - Causal Systems
Measuring latent variables
Use Inverse Matrices to Solve 2 Variable Linear Systems
Matrix Algebra and Random Vectors
Principal Components Analysis
Statistics II: An Overview of Statistics
Quote of the Day "Not everything that counts can be counted and not everything that can be counted counts". Albert Einstein.
Measuring latent variables
Canonical Correlation Analysis
Regression and Correlation of Data
Presentation transcript:

Canonical Correlation Mechanics

Data The input correlation setup is  The canonical correlation matrix is the product of four correlation matrices, between DVs (inverse of Ryy,), IVs (inverse of Rxx), and between DVs and IVs It also can be thought of as a product of regression coefficients for predicting Xs from Ys, and Ys from Xs 2

What does it mean? In this context the eigenvalues of that R matrix represent the percentage of overlapping variance between the canonical variate pairs To get the canonical correlations, you get the eigenvalues of R and take the square root The eigenvector corresponding to each eigenvalue is transformed into the coefficients that specify the linear combination that will make up a canonical variate 3

Canonical Coefficients Two sets of canonical coefficients (weights) are required One set to combine the Xs One to combine the Ys Same interpretation as regression coefficients 4

Equations 5

Is it significant? Testing Canonical Correlations There will be as many canonical correlations as there are variables in the smaller set Not all will be statistically significant Bartlett’s Chi Square test (Wilk’s on printouts) Tests whether an eigenvalue and the ones that follow are significantly different than zero. 6

Essentially it is an omnibus test of whether the eigenvalues are significantly different from zero It is possible this test would be significant even though a test for the correlation itself would not be 7

Variate Scores Canonical Variate Scores Like factor scores (we’ll get there later) What a subject would score if you could measure them directly on the canonical variate The values on a canonical variable for a given case, based on the canonical coefficients for that variable. Canonical coefficients are multiplied by the standardized scores of the cases and summed to yield the canonical scores for each case in the analysis 8

Loadings (structure coefficients) Loadings or structure coefficients Key question: how well do the variate(s) on either side relate to their own set of measured variables? Bivariate correlation between a variable and its respective variate Would equal the canonical coefficients if all variables were uncorrelated with one another Its square is the proportion of variance linearly shared by a variable with the variable’s canonical composite Found by multiplying the matrix of correlations between variables in a set by the matrix of canonical coefficients X1 X2 X4 X3 Y3 Y1 Y2 V1 W1 rX1 \rX2 rX3 rX4 ry1 ry2 ry3 Loadings 9

Redundancy Equations Redundancy Within Across Percentage of variance in a set of variables extracted by the canonical variate Adequacy coefficient Is the average of the squared correlations (loadings) Across Variance in IVs explained by the DVs and vice versa Take how much variance is accounted for with its own variables and multiply that by the canonical correlation squared 10