Presentation is loading. Please wait.

Presentation is loading. Please wait.

Classification (Dis)similarity measures, Resemblance functions

Similar presentations


Presentation on theme: "Classification (Dis)similarity measures, Resemblance functions"— Presentation transcript:

1 Classification (Dis)similarity measures, Resemblance functions
Cluster analysis TWINSPAN

2 Similarity measures Each ordination or classification method is based (explicitly or implicitly) on some similarity measure (Two possible formulations of ordination problem)

3 Similarities (dissimilarities, distances)
Resemblance functions (the term includes both similarities and dissimilarities) If 0 ≤ S ≤1, then often D = 1 – S nebo D = √(1 – S) nebo D = √(1 – S2) Different indices are usually used for sample similarity than for species similarity Similarity of two cases (samples) has a meaning by itself: similarity of two species has meaning only in relation to the data set. Species set is „fixed“ (e.g. all vascular plant species), cases are usually some selection from a “population of sites” (and the population of sites means geographic, environmental etc. definition of the set we are interested in).

4 Distance – should fulfill the triangular inequality
B AB < AC + BC

5 Resemblance functions
Probably hundreds were proposed and tens are used We compare: cases - Q species – R Data type Presence/absence (0 / 1) Sørensen coefficient Jaccard coefficient Pearson f (V) coeff. Yule (Q) coefficient Quantitative Euclidean distance c2 distance Percentage similarity correlation coefficients

6 Case similarity based on qualitative data
Sörensen Jacquard d - number of species absent in both cases (usually not used) - consequently, the value is independent of other cases in a table

7 Species similarity based on presence absence
d - number of cases without both species - absolutely necessary

8 Species vs. case similarity
Species similarity (i.e. similarity of species ecological behavior, e.g. V, Q) – often scaled from -1 to 1. “Null model” means independence of the species, and in this case V=Q=0. Case similarity (S, J), usually scaled from 0 (no common species) to 1 (identical species composition). No “null model” available. (or better, no meaningfull null model available; compare – random selection of two sets of species from species pool?)

9 Quantitative data Transformation is an algebraic function Xij’=f(Xij) which is applied independently of the other values. Standardization is done either with respect to the values of other species in the case (standardization by cases) or with respect to the values of the species in other cases (standardization by species). Centering means the subtraction of a mean so that the resulting variable (species) or case has a mean of zero. Standardization usually means division of each value by the case (species) norm or by the total of all the values in a case (species).

10 „Ordinal transformation“ of Br. -Bl
„Ordinal transformation“ of Br.-Bl. scale is roughly equivalent to log transformation of the cover values

11 Why to use the log(x) transformation
Changes the positively skewed distrnibution to (something closer to) symmetric – (in ordinations, not very relevant) Changes multiplicativity to additivity In effect, increases the effect of low abundant species, decreases the effect of dominants

12 x differ x log(x) differ log(x) 1 10 9 100 90 2

13 Why to use the log(ax+b) transformation
If x=0, log(x) is not defined Log(ax+b) – if b=1, then the function is 0 for x= reasonable option Thus, why not simply log(x+1)? If the X values are small, then:

14

15

16

17 Euclidean distance For ED, standardize by case norm, not by total The cases with t contain values standardized by the total, those with n are standardized by case norm. For cases standardized by total, ED12 = 1.41 (√2), whereas ED34=0.82, whereas for cases standardized by case norm, ED12=ED34=1.41

18 Euclidean distance after standardization by sample norm – ‚chord distance“

19 Percentual similarity (quantitative Sörensen)
Neither ED, nor PS take into consideration species which are absent in the two compared cases

20 PS – often multiplied by 100(%)
Bray-Curtis distance = 1 – PS Often used with standardization by sample total

21 Similarity of species based on quantitative data
Correlation coefficients (ordinary, rank) – i.e. again taking into account the cases where both species are missing Note the implicit double standardization (by both, case and species total) Consequently, the value is changing according to composition of other cases in the total table.

22 Inspired be seemingly high beta-diversity of insects in tropics
Similarity of samples vs. similarity of communities Inspired be seemingly high beta-diversity of insects in tropics

23 2 2 Normalized expected shared species =
expected number of shared species in two subsamples taken randomly from the second sample. 2 2

24 Similarity of objects when variable are measured on various scales

25 Gower distance

26 Standardization of variables by the s. d
Standardization of variables by the s.d. or range is sometimes problematic – possibility to standardize by variation – see Lepš et al. 2006

27 Similarity matrices - directly used in
Multidimensional scaling (both metric and non-metric – see Šmilauer lecture) Mantel test

28 Mantel Test Question – is there any dependence between two (dis)similarity matrices? e.g. is the distance of individual plants in physical space correlated with their genetic dissimilarity?

29 Individuals in the plot
Indiv. No. 5 And this individual is strange (just one of five)

30 Two dissimilarity matrices
Distance in the plot Genetic distance plant 1 2 3 4 5 1.41 1.00 2.24 12.04 10.63 12.73 11.31 plant 1 2 3 4 5 0.1 0.2 0.3 0.9 0.6 0.7 0.8

31 Regression is highly significant (but we have 10 “independent” observations out of five plants!)
And four „independent“ observations out of ten are the largest

32 Solution Permutation test
Not individual distances, but individuals are permuted

33 Classification Of historical significance only

34 Non-hierarchical classification
K-means clustering In fact, „reverse“ ANOVA ANOVA: F=Msgroup/MSresidual The goal – divide the set into groups to maximize F (multivariate counterpart of F)

35 Hierarchical agglomerative
(cluster analysis)

36 Subjective decisions in the objective procedure
Nevertheless, the procedure is reproducible

37 Cluster analysis joining
Distances among objects are in the (dis)similarity matrix. In the hierarchical classification, we need also the distances among clusters....

38 Single linkage (nearest neighbour, representative of short hand) and complete linkage (furthest neighbour, representative of long hand methods) Several other methods, e.g. Ward (minimum dispersion), “average linkage” – most popular, but the term was used for several methods – preferred name UPGMA - Unweighted Pair Group Method with Arithmetic mean

39 Single linkage - > chaining

40 Order does not play a role

41 TWINSPAN – Two Way INdicator SPecies ANalysis
Invented (by Mark Hill) to search for a pattern in extensive vegetation tables Inspired by classical phytosociology Algorithm based on the presence/absence data Quantitative data used for definition of “pseudospecies”

42 TWINSPAN 2 - pseudospecies
Lower exclusive border Definition of cut levels has similar effect as transformation (weighting dominance vs. presence/absence) Compare 0, 1, 10, vs. 0, 10, 20, 30, 40

43 Divisive method – each group is divided on the basis of the first CA axis
The first axis is based on CA ordination - it is then not surprising, that TWINSPAN results well correspond to, e.g., DCA and individual groups are well clustered in ordination space.

44 Divisive method – each group is divided on the basis of the first CA axis
Most of the cases are usually around the center -> we need some polarization

45 Polarized ordination (based on “indicator species”)

46 01 is more similar to 1 than 00 The order of groups reflects possible gradient in the table

47

48

49

50


Download ppt "Classification (Dis)similarity measures, Resemblance functions"

Similar presentations


Ads by Google