Pattern Recognition Introduction to bioinformatics 2005 Lecture 4.

Slides:



Advertisements
Similar presentations
BioInformatics (3).
Advertisements

Basic Gene Expression Data Analysis--Clustering
Computing a tree Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas.
Cluster analysis Species Sequence P.symA AATGCCTGACGTGGGAAATCTTTAGGGCTAAGGTTTTTATTTCGTATGCTATGTAGCTTAAGGGTACTGACGGTAG P.xanA AATGCCTGACGTGGGAAATCTTTAGGGCTAAGGTTAATATTCCGTATGCTATGTAGCTTAAGGGTACTGACGGTAG.
Computational Molecular Biology Biochem 218 – BioMedical Informatics Doug Brutlag Professor.
Phylogenetic Tree A Phylogeny (Phylogenetic tree) or Evolutionary tree represents the evolutionary relationships among a set of organisms or groups of.
Bioinformatics Phylogenetic analysis and sequence alignment The concept of evolutionary tree Types of phylogenetic trees Measurements of genetic distances.
Computing a tree Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas.
Introduction to Bioinformatics Lecture 16 Intracellular Networks Graph theory C E N T R F O R I N T E G R A T I V E B I O I N F O R M A T I C S V U E.
Introduction to Bioinformatics
Phylogenetics - Distance-Based Methods CIS 667 March 11, 2204.
Pattern recognition and phylogeny Genome Analyis (Integrative Bioinformatics & Genomics) 2008 Lecture 9 C E N T R F O R I N T E G R A T I V E B I O I.
Pattern Recognition Introduction to bioinformatics 2007 Lecture 4 C E N T R F O R I N T E G R A T I V E B I O I N F O R M A T I C S V U E.
Molecular Evolution Revised 29/12/06
C E N T R F O R I N T E G R A T I V E B I O I N F O R M A T I C S V U E Master Course Sequence Alignment Lecture 13 Evolution/Phylogeny.
Lecture 7 – Algorithmic Approaches Justification: Any estimate of a phylogenetic tree has a large variance. Therefore, any tree that we can demonstrate.
CENTER FOR BIOLOGICAL SEQUENCE ANALYSIS Phylogenetic Reconstruction: Distance Matrix Methods Anders Gorm Pedersen Molecular Evolution Group Center for.
25/05/2004 Evolution/Phylogeny/Pattern recognition Bioinformatics Master Course Bioinformatics Data Analysis and Tools.
10/10/06 Evolution/Phylogeny Bioinformatics Course Computational Genomics & Proteomics (CGP)
L16: Micro-array analysis Dimension reduction Unsupervised clustering.
Bioinformatics Master Course Sequence Analysis
The Tree of Life From Ernst Haeckel, 1891.
10/10/06 Evolution/Phylogeny Bioinformatics Course Computational Genomics & Proteomics (CGP)
Clustering Petter Mostad. Clustering vs. class prediction Class prediction: Class prediction: A learning set of objects with known classes A learning.
CISC667, F05, Lec15, Liao1 CISC 667 Intro to Bioinformatics (Fall 2005) Phylogenetic Trees (II) Distance-based methods.
07/05/2004 Evolution/Phylogeny Introduction to Bioinformatics MNW2.
Multiple sequence alignment
. Class 9: Phylogenetic Trees. The Tree of Life D’après Ernst Haeckel, 1891.
Introduction to Bioinformatics - Tutorial no. 12
1-month Practical Course Genome Analysis Evolution and Phylogeny methods Centre for Integrative Bioinformatics VU (IBIVU) Vrije Universiteit Amsterdam.
Ulf Schmitz, Pattern recognition - Clustering1 Bioinformatics Pattern recognition - Clustering Ulf Schmitz
Introduction to Bioinformatics Lecture 19 Intracellular Networks Graph theory C E N T R F O R I N T E G R A T I V E B I O I N F O R M A T I C S V U E.
Why is it useful to use multivariate statistical methods for microfacies analysis? A microfacies is a multivariate object: each sample is characterized.
Computational Biology, Part D Phylogenetic Trees Ramamoorthi Ravi/Robert F. Murphy Copyright  2000, All rights reserved.
BINF6201/8201 Molecular phylogenetic methods
Bioinformatics 2011 Molecular Evolution Revised 29/12/06.
Identification of Regulatory Binding Sites Using Minimum Spanning Trees Pacific Symposium on Biocomputing, pp , 2003 Reporter: Chu-Ting Tseng Advisor:
Pattern Recognition Introduction to bioinformatics 2006 Lecture 4.
OUTLINE Phylogeny UPGMA Neighbor Joining Method Phylogeny Understanding life through time, over long periods of past time, the connections between all.
Phylogenetic Prediction Lecture II by Clarke S. Arnold March 19, 2002.
Phylogenetic Trees Tutorial 5. Agenda How to construct a tree using Neighbor Joining algorithm Phylogeny.fr tool Cool story of the day: Horizontal gene.
Introduction to Phylogenetics
Multivariate Data Analysis  G. Quinn, M. Burgman & J. Carey 2003.
Cluster Analysis Cluster Analysis Cluster analysis is a class of techniques used to classify objects or cases into relatively homogeneous groups.
Dimension reduction : PCA and Clustering Slides by Agnieszka Juncker and Chris Workman modified by Hanne Jarmer.
Multiple Sequence Alignment benchmarking, pattern recognition and Phylogeny Introduction to bioinformatics 2008 Lecture 11 C E N T R F O R I N T E G R.
Lecture 9 Pattern recognition Bioinformatics Master Course Bioinformatics Data Analysis and Tools.
Lecture 3 1.Different centrality measures of nodes 2.Hierarchical Clustering 3.Line graphs.
CZ5225: Modeling and Simulation in Biology Lecture 3: Clustering Analysis for Microarray Data I Prof. Chen Yu Zong Tel:
Analyzing Expression Data: Clustering and Stats Chapter 16.
Tutorial 5 Phylogenetic Trees.
Tutorial 8 Gene expression analysis 1. How to interpret an expression matrix Expression data DBs - GEO Clustering –Hierarchical clustering –K-means clustering.
1 CAP5510 – Bioinformatics Phylogeny Tamer Kahveci CISE Department University of Florida.
Lecture 6 Ordination Ordination contains a number of techniques to classify data according to predefined standards. The simplest ordination technique is.
Distance-Based Approaches to Inferring Phylogenetic Trees BMI/CS 576 Colin Dewey Fall 2010.
Distance-based methods for phylogenetic tree reconstruction Colin Dewey BMI/CS 576 Fall 2015.
C E N T R F O R I N T E G R A T I V E B I O I N F O R M A T I C S V U E Master Course Sequence Alignment Lecture 13 Evolution/Phylogeny.
CSCE555 Bioinformatics Lecture 13 Phylogenetics II Meeting: MW 4:00PM-5:15PM SWGN2A21 Instructor: Dr. Jianjun Hu Course page:
Unsupervised Learning
Multiple Alignment and Phylogenetic Trees
The Tree of Life From Ernst Haeckel, 1891.
Clustering and Multidimensional Scaling
Introduction to bioinformatics 2007 Lecture 11
Multivariate Statistical Methods
Lecture 16: Evolution/Phylogeny
Cluster Analysis.
Lecture 19: Evolution/Phylogeny
Clustering The process of grouping samples so that the samples are similar within each group.
Unsupervised Learning
Presentation transcript:

Pattern Recognition Introduction to bioinformatics 2005 Lecture 4

Patterns Some are easy some are not Knitting patterns Cooking recipes Pictures (dot plots) Colour patterns Maps In 2D and 3D humans are hard to be beat by a computational pattern recognition technique, but humans are not so consistent

Example of algorithm reuse: Dataclustering Many biological data analysis problems can be formulated as clustering problems –microarray gene expression data analysis –identification of regulatory binding sites (similarly, splice junction sites, translation start sites,......) –(yeast) two-hybrid data analysis (for inference of protein complexes) –phylogenetic tree clustering (for inference of horizontally transferred genes) –protein domain identification –identification of structural motifs –prediction reliability assessment of protein structures –NMR peak assignments –......

Data Clustering Problems Clustering: partition a data set into clusters so that data points of the same cluster are “similar” and points of different clusters are “dissimilar” Cluster identification -- identifying clusters with significantly different features than the background

Application Examples Regulatory binding site identification: CRP (CAP) binding site Two hybrid data analysis l Gene expression data analysis These problems are all solvable by a clustering algorithm

Multivariate statistics – Cluster analysis C1 C2 C3 C4 C5 C6.. Raw table Any set of numbers per column Multi-dimensional problems Objects can be viewed as a cloud of points in a multidimensional space Need ways to group the data

Multivariate statistics – Cluster analysis Dendrogram Scores Similarity matrix 5× C1 C2 C3 C4 C5 C6.. Raw table Similarity criterion Cluster criterion Any set of numbers per column

Comparing sequences - Similarity Score - Many properties can be used: Nucleotide or amino acid composition Isoelectric point Molecular weight Morphological characters But: molecular evolution through sequence alignment

Multivariate statistics – Cluster analysis Now for sequences Phylogenetic tree Scores Similarity matrix 5×5 Multiple sequence alignment Similarity criterion Cluster criterion

Human -KITVVGVGAVGMACAISILMKDLADELALVDVIEDKLKGEMMDLQHGSLFLRTPKIVSGKDYNVTANSKLVIITAGARQ Chicken -KISVVGVGAVGMACAISILMKDLADELTLVDVVEDKLKGEMMDLQHGSLFLKTPKITSGKDYSVTAHSKLVIVTAGARQ Dogfish –KITVVGVGAVGMACAISILMKDLADEVALVDVMEDKLKGEMMDLQHGSLFLHTAKIVSGKDYSVSAGSKLVVITAGARQ Lamprey SKVTIVGVGQVGMAAAISVLLRDLADELALVDVVEDRLKGEMMDLLHGSLFLKTAKIVADKDYSVTAGSRLVVVTAGARQ Barley TKISVIGAGNVGMAIAQTILTQNLADEIALVDALPDKLRGEALDLQHAAAFLPRVRI-SGTDAAVTKNSDLVIVTAGARQ Maizey casei -KVILVGDGAVGSSYAYAMVLQGIAQEIGIVDIFKDKTKGDAIDLSNALPFTSPKKIYSA-EYSDAKDADLVVITAGAPQ Bacillus TKVSVIGAGNVGMAIAQTILTRDLADEIALVDAVPDKLRGEMLDLQHAAAFLPRTRLVSGTDMSVTRGSDLVIVTAGARQ Lacto__ste -RVVVIGAGFVGASYVFALMNQGIADEIVLIDANESKAIGDAMDFNHGKVFAPKPVDIWHGDYDDCRDADLVVICAGANQ Lacto_plant QKVVLVGDGAVGSSYAFAMAQQGIAEEFVIVDVVKDRTKGDALDLEDAQAFTAPKKIYSG-EYSDCKDADLVVITAGAPQ Therma_mari MKIGIVGLGRVGSSTAFALLMKGFAREMVLIDVDKKRAEGDALDLIHGTPFTRRANIYAG-DYADLKGSDVVIVAAGVPQ Bifido -KLAVIGAGAVGSTLAFAAAQRGIAREIVLEDIAKERVEAEVLDMQHGSSFYPTVSIDGSDDPEICRDADMVVITAGPRQ Thermus_aqua MKVGIVGSGFVGSATAYALVLQGVAREVVLVDLDRKLAQAHAEDILHATPFAHPVWVRSGW-YEDLEGARVVIVAAGVAQ Mycoplasma -KIALIGAGNVGNSFLYAAMNQGLASEYGIIDINPDFADGNAFDFEDASASLPFPISVSRYEYKDLKDADFIVITAGRPQ Lactate dehydrogenase multiple alignment Distance Matrix Human Chicken Dogfish Lamprey Barley Maizey Lacto_casei Bacillus_stea Lacto_plant Therma_mari Bifido Thermus_aqua Mycoplasma How can you see that this is a distance matrix?

Multivariate statistics – Cluster analysis Dendrogram/tree Scores Similarity matrix 5× C1 C2 C3 C4 C5 C6.. Data table Similarity criterion Cluster criterion

Multivariate statistics – Cluster analysis Why do it? Finding a true typology Model fitting Prediction based on groups Hypothesis testing Data exploration Data reduction Hypothesis generation But you can never prove a classification/typology!

Cluster analysis – data normalisation/weighting C1 C2 C3 C4 C5 C6.. Raw table Normalisation criterion C1 C2 C3 C4 C5 C6.. Normalised table Column normalisationx/max Column range normalise(x-min)/(max-min)

Cluster analysis – (dis)similarity matrix Scores Similarity matrix 5× C1 C2 C3 C4 C5 C6.. Raw table Similarity criterion D i,j = (  k | x ik – x jk | r ) 1/r Minkowski metrics r = 2 Euclidean distance r = 1 City block distance

Cluster analysis – Clustering criteria Dendrogram (tree) Scores Similarity matrix 5×5 Cluster criterion Single linkage - Nearest neighbour Complete linkage – Furthest neighbour Group averaging – UPGMA Ward Neighbour joining – global measure

Cluster analysis – Clustering criteria 1.Start with N clusters of 1 object each 2.Apply clustering distance criterion iteratively until you have 1 cluster of N objects 3.Most interesting clustering somewhere in between Dendrogram (tree) distance N clusters1 cluster

Single linkage clustering (nearest neighbour) Char 1 Char 2

Single linkage clustering (nearest neighbour) Char 1 Char 2

Single linkage clustering (nearest neighbour) Char 1 Char 2

Single linkage clustering (nearest neighbour) Char 1 Char 2

Single linkage clustering (nearest neighbour) Char 1 Char 2

Single linkage clustering (nearest neighbour) Char 1 Char 2 Distance from point to cluster is defined as the smallest distance between that point and any point in the cluster

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2

Complete linkage clustering (furthest neighbour) Char 1 Char 2 Distance from point to cluster is defined as the largest distance between that point and any point in the cluster

Average linkage clustering ( Unweighted Pair Group Mean Averaging -UPGMA) Char 1 Char 2 Distance from cluster to cluster is defined as the average distance over all within-cluster distances

Cluster analysis – Ward’s clustering criterion Per cluster: calculate Error Sum of Squares (ESS) ESS =  x 2 – (  x) 2 /n calculate minimum increase of ESS Suppose: ObjValc l u s t e r i n g  ESS This method gives good results in general clustering problems, has a desirable property that it tends to put “exeptions” (outliers) in a single cluster, but is not used frequently anymore

Neighbour joining Widely used method to cluster DNA or protein sequences Global measure – keeps total branch length minimal, tends to produce a tree with minimal total branch length At each step, join two nodes such that distances are minimal (criterion of minimal evolution) Agglomerative algorithm Leads to unrooted tree

Neighbour joining x x y x y x y x y x (a)(b) (c) (d)(e) (f) At each step all possible ‘neighbour joinings’ are checked and the one corresponding to the minimal total tree length (calculated by adding all branch lengths) is taken.

Phylogenetic tree (unrooted) human mousefugu Drosophila edge internal node leaf OTU – Observed taxonomic unit

Phylogenetic tree (unrooted) human mousefugu Drosophila root edge internal node leaf OTU – Observed taxonomic unit

Phylogenetic tree (rooted) human mouse fugu Drosophila root edge internal node (ancestor) leaf OTU – Observed taxonomic unit time

Combinatoric explosion # sequences# unrooted# rooted trees , ,395135, ,1352,027, ,027,02534,459,425

Multivariate statistics – Cluster analysis Phylogenetic tree Scores Similarity matrix 5× C1 C2 C3 C4 C5 C6.. Data table Similarity criterion Cluster criterion

Multivariate statistics – Cluster analysis Scores 5× C1 C2 C3 C4 C5 C6 Similarity criterion Cluster criterion Scores 6×6 Cluster criterion Make two-way ordered table using dendrograms

Multivariate statistics – Cluster analysis C4 C3 C6 C1 C2 C5 Make two-way (rows, columns) ordered table using dendrograms; This shows ‘blocks’ of numbers that are similar

Multivariate statistics – Principal Component Analysis (PCA) C1 C2 C3 C4 C5 C6 Similarity Criterion: Correlations 6×6 Calculate eigenvectors with greatest eigenvalues: Linear combinations Orthogonal Correlations Project data points onto new axes (eigenvectors) 1 2