Procrustes analysis Purpose of procrustes analysis Algorithm Various modifications

Purpose of procrustes analysis There are many situations when different techniques produce different configurations. For example when metric and non-metric scaling are used then different configurations may be generated. Even if metric scaling is used, different proximity (dissimilarity) matrices can produce different configurations. Since these techniques are used for the same multivariate observations each observation in one configuration corresponds to exactly one observation in another one. Most of the techniques produce configuration that is rotationally undefined. Scores in factor analysis can also be considered as one of the possible configurations. There are other situations when comparison of configurations is needed. For example in macromolecular biology 3-dimensional structures of different proteins are derived using some experimental technique. One of the interesting question is if two different proteins are similar. If they are what is the similarity between them. To find similarity it is necessary to match configurations of two protein structures. All these questions can be addressed using procrustes analysis. Suppose we have two configurations X=(x 1,x 2,,,x n ) and Y = (y 1,y 2,,,y n ). where each x and y are vectors in p dimensional space. We want to find an orthogonal matrix A and a vector b so that:

Prcucrustes analysis: vector and matrix It can be show that finding translation (b) and rotation matrix (A) can be considered separately. Translation can easily be found if we centre each configuration. If rotation is already known then we can find translation. Let us denote z i =Ay i +b. Then we can write: It is minimised when centres of x and z coincide. I.e. We want centroids of the configuration to match. It can be done if we will subtract from x and y their respective centroids. Remaining problem is finding the orthogonal matrix (matrix of rotation or inverse). We can write: Here we used the fact that A is an orthogonal matrix: Then we want to perform constrained maximisation: We can do it using Lagrange’s multipliers technique.

Rotation matrix using SVD Let us define symmetric matrix of the constraints by 1/2 . Then we want to maximise: If we get derivatives of this expression wrt to matrix A and equate them to 0 then we can get: Here we used the following facts: and remembering that the matrix of the constraints is symmetric. We have necessary linear equations to find the required orthogonal matrix. Let us use SVD of Y T X: V and U are pxp orthogonal matrices. D is the diagonal matrix of the singular values.

Rotation matrix and SVD If we use the fact that A is orthogonal then we can write: and It gives the solution for the rotation (orthogonal) matrix. Now we can calculate least-squares differences between configurations: Thus we have the expressions for the rotation matrix and differences between configurations after matching. It is interesting to note that to find differences between configurations it is not necessary rotate them. This expression can also be written: One more useful expression is: This expression shows that it is even not necessary to do SVD to find differences between configurations. (For square root of a matrix Cholesky decomposition could be used)

Some modifications There are some situations where problems may occur: 1)Dimensions of configurations can be different. There are two ways of handling this problem. First way is to fill low dimensional (k) space with 0-s and make it high (p) dimensional. This way we assume that the first k dimensions coincide. Here we assume that k-dimensional configuration is in the k-dimensional subspace of p-dimensional space. Second way is to collapse high dimensional configuration to low dimensional one. For this we need to project p-dimensional configuration to k-dimensional space. 2)Second problem is when the scales of the configurations are different. In this case we can add scale factor to the function we want to minimise: If we find orthogonal matrix as before then we can find expression for the scale factor: As a result M is no longer symmetric wrt X and Y. 3) Sometimes it is necessary to weight some variables down and others up. In this case procrustes analysis can be performed using weights. We want to minimise the function: This modification can be taken into account. Analysis becomes easy when weight matrix is diagonal.

References 1)Krzanowski WJ and Marriout FHC. (1994) Multivatiate analysis. Kendall’s library of statistics 2)Mardia, K.V. Kent, J.T. and Bibby, J.M. (2003) Multivariate analysis