Sequence alignment CS 394C Tandy Warnow Feb 15, 2012.

Slides:



Advertisements
Similar presentations
New methods for simultaneous estimation of trees and alignments Tandy Warnow The University of Texas at Austin.
Advertisements

Molecular Evolution Revised 29/12/06
Tree Reconstruction.
Multiple sequence alignment methods: evidence from data CS/BioE 598 Tandy Warnow.
Realistic evolutionary models Marjolijn Elsinga & Lars Hemel.
Multiple sequence alignment
Multiple sequence alignment methods 1 Corné Hoogendoorn Denis Miretskiy.
Complexity and The Tree of Life Tandy Warnow The University of Texas at Austin.
Multiple Sequence Alignments and Phylogeny.  Within a protein sequence, some regions will be more conserved than others. As more conserved,
Barking Up the Wrong Treelength Kevin Liu, Serita Nelesen, Sindhu Raghavan, C. Randal Linder, and Tandy Warnow IEEE TCCB 2009.
Phylogenetic Analysis. General comments on phylogenetics Phylogenetics is the branch of biology that deals with evolutionary relatedness Uses some measure.
Molecular phylogenetics 1 Level 3 Molecular Evolution and Bioinformatics Jim Provan Page and Holmes: Sections
Bioinformatics 2011 Molecular Evolution Revised 29/12/06.
Applied Bioinformatics Week 8 Jens Allmer. Practice I.
Building phylogenetic trees. Contents Phylogeny Phylogenetic trees How to make a phylogenetic tree from pairwise distances  UPGMA method (+ an example)
CS 173, Lecture B August 25, 2015 Professor Tandy Warnow.
Using traveling salesman problem algorithms for evolutionary tree construction Chantal Korostensky and Gaston H. Gonnet Presentation by: Ben Snider.
394C, Spring 2013 Sept 4, 2013 Tandy Warnow. DNA Sequence Evolution AAGACTT TGGACTTAAGGCCT -3 mil yrs -2 mil yrs -1 mil yrs today AGGGCATTAGCCCTAGCACTT.
More statistical stuff CS 394C Feb 6, Today Review of material from Jan 31 Calculating pattern probabilities Why maximum parsimony and UPGMA are.
Statistical stuff: models, methods, and performance issues CS 394C September 16, 2013.
Introduction to Phylogenetic Estimation Algorithms Tandy Warnow.
EVOLUTIONARY HMMS BAYESIAN APPROACH TO MULTIPLE ALIGNMENT Siva Theja Maguluri CS 598 SS.
Phylogeny Ch. 7 & 8.
394C, October 2, 2013 Topics: Multiple Sequence Alignment
Constructing the Tree of Life: Divide-and-Conquer! Tandy Warnow University of Illinois at Urbana-Champaign.
Using Divide-and-Conquer to Construct the Tree of Life Tandy Warnow University of Illinois at Urbana-Champaign.
598AGB Basics Tandy Warnow. DNA Sequence Evolution AAGACTT TGGACTTAAGGCCT -3 mil yrs -2 mil yrs -1 mil yrs today AGGGCATTAGCCCTAGCACTT AAGGCCTTGGACTT.
Three approaches to large- scale phylogeny estimation: SATé, DACTAL, and SEPP Tandy Warnow Department of Computer Science The University of Texas at Austin.
CS 395T: Computational phylogenetics January 18, 2006 Tandy Warnow.
Statistical stuff: models, methods, and performance issues CS 394C September 3, 2009.
Sequence alignment CS 394C: Fall 2009 Tandy Warnow September 24, 2009.
Approaching multiple sequence alignment from a phylogenetic perspective Tandy Warnow Department of Computer Sciences The University of Texas at Austin.
SEPP and TIPP for metagenomic analysis Tandy Warnow Department of Computer Science University of Texas.
Simultaneous alignment and tree reconstruction Collaborative grant: Texas, Nebraska, Georgia, Kansas Penn State University, Huston-Tillotson, NJIT, and.
394C: Algorithms for Computational Biology Tandy Warnow Jan 25, 2012.
CS 466 and BIOE 498: Introduction to Bioinformatics
Distance-based phylogeny estimation
Advances in Ultra-large Phylogeny Estimation
Phylogenetic basis of systematics
New Approaches for Inferring the Tree of Life
394C, Spring 2012 Jan 23, 2012 Tandy Warnow.
CS 581 / BIOE 540: Algorithmic Computational Genomics
Statistical tree estimation
Distance based phylogenetics
Multiple Sequence Alignment Methods
Tandy Warnow Department of Computer Sciences
The ideal approach is simultaneous alignment and tree estimation.
Techniques for MSA Tandy Warnow.
Algorithm Design and Phylogenomics
Multiple Alignment and Phylogenetic Trees
New methods for simultaneous estimation of trees and alignments
Absolute Fast Converging Methods
CS 581 Tandy Warnow.
CS 581 Tandy Warnow.
CS 581 Algorithmic Computational Genomics
Tandy Warnow Department of Computer Sciences
New methods for simultaneous estimation of trees and alignments
Texas, Nebraska, Georgia, Kansas
Ultra-Large Phylogeny Estimation Using SATé and DACTAL
Recent Breakthroughs in Mathematical and Computational Phylogenetics
Phylogeny.
CS 394C: Computational Biology Algorithms
September 1, 2009 Tandy Warnow
Algorithms for Inferring the Tree of Life
Tandy Warnow The University of Texas at Austin
Tandy Warnow The University of Texas at Austin
New methods for simultaneous estimation of trees and alignments
Ultra-large Multiple Sequence Alignment
TIPP and SEPP (plus PASTA)
Presentation transcript:

Sequence alignment CS 394C Tandy Warnow Feb 15, 2012

DNA Sequence Evolution AAGACTT TGGACTT AAGGCCT AGGGCAT TAGCCCT AGCACTT AGCGCTT AGCACAA TAGACTT TAGCCCA AAGACTT TGGACTT AAGGCCT AGGGCAT TAGCCCT AGCACTT AAGGCCT TGGACTT TAGCCCA TAGACTT AGCGCTT AGCACAA AGGGCAT TAGCCCT AGCACTT

U V W X Y X U Y V W AGGGCAT TAGCCCA TAGACTT TGCACAA TGCGCTT Unrooted trees are equivalent to a rooted tree with branch lengths and the root node omitted. Rooting is a separate problem which is not discussed in this talk. V W 3

Deletion Mutation …ACGGTGCAGTTACCA… …ACCAGTCACCA… 4

…ACGGTGCAGTTACCA… …ACGGTGCAGTTACCA… …AC----CAGTCACCA… …ACCAGTCACCA… Deletion Mutation …ACGGTGCAGTTACCA… …ACGGTGCAGTTACCA… …AC----CAGTCACCA… …ACCAGTCACCA… The true multiple alignment Reflects historical substitution, insertion, and deletion events in the true phylogeny Homology = nucleotides lined up since they come from a common ancestor. Indel = dash. 5

Input: unaligned sequences S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA

Phase 1: Multiple Sequence Alignment S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA

Phase 2: Construct tree S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA S1 S2 S4 S3

Many methods Phylogeny methods Alignment methods Bayesian MCMC Clustal Maximum parsimony Maximum likelihood Neighbor joining FastME UPGMA Quartet puzzling Etc. Alignment methods Clustal POY (and POY*) Probcons (and Probtree) MAFFT Prank Muscle Di-align T-Coffee Opal Etc. 9

…ACGGTGCAGTTACCA… …ACGGTGCAGTTACCA… …AC----CAGTCACCA… …ACCAGTCACCA… Deletion Mutation …ACGGTGCAGTTACCA… …ACGGTGCAGTTACCA… …AC----CAGTCACCA… …ACCAGTCACCA… The true multiple alignment Reflects historical substitution, insertion, and deletion events in the true phylogeny But how do we try to estimate this? Homology = nucleotides lined up since they come from a common ancestor. Indel = dash. 10

Pairwise alignments and edit transformations Each pairwise alignment implies one or more edit transformations Each edit transformation implies one or more pairwise alignments So calculating the edit distance (and hence minimum cost edit transformation) is the same as calculating the optimal pairwise alignment

Edit distances Substitution costs may depend upon which nucleotides are involved (e.g, transition/transversion differences) Gap costs Linear (aka “simple”): gapcost(L) = cL Affine: gapcost(L) = c+c’(L) Other: gapcost(L) = c+c’log(L)

Computing optimal pairwise alignments The cost of a pairwise alignment (under a simple gap model) is just the sum of the costs of the columns Under affine gap models, it’s a bit more complicated (but not much)

Computing edit distance Given two sequences and the edit distance function F(.,.), how do we compute the edit distance between two sequences? Simple algorithm for standard gap cost functions (e.g., affine) based upon dynamic programming

DP alg for simple gap costs Given two sequences A[1…n] and B[1…m], and an edit distance function F(.,.) with unit substitution costs and gap cost C, Let A = A1,A2,…,An B = B1,B2,…,Bm Let M(i,j)=F(A[1…i],B[1…j]) (i.e., the edit distance between these two prefixes )

Dynamic programming algorithm Let M(i,j)=F(A[1…i],B[1…j]) M(0,0)=0 M(n,m) stores our answer How do we compute M(i,j) from other entries of the matrix?

Calculating M(i,j) Examine final column in some optimal pairwise alignment of A[1…i] to B[1…j] Possibilities: Nucleotide over nucleotide: previous columns align A[1…i-1] to B[1…j-1]: M(i,j)=M(i-1,j-1)+subcost(Ai,Bj) Indel (-) over nucleotide: previous columns align A[1…i] to B[1…j-1]: M(i,j)=M(i,j-1)+indelcost Nucleotide over indel: previous columns align A[1…i-1] to B[1…j]: M(i,j)=M(i-1,j)+indelcost

Calculating M(i,j) Examine final column in some optimal pairwise alignment of A[1…i] to B[1…j] Possibilities: Nucleotide over nucleotide: previous columns align A[1…i-1] to B[1…j-1]: M(i,j)=M(i-1,j-1)+subcost(Ai,Bj) Indel (-) over nucleotide: previous columns align A[1…i] to B[1…j-1]: M(i,j)=M(i,j-1)+indelcost Nucleotide over indel: previous columns align A[1…i-1] to B[1…j]: M(i,j)=M(i-1,j)+indelcost

Calculating M(i,j) M(i,j) = min { M(i-1,j-1)+subcost(Ai,Bj), M(i,j-1)+indelcost, M(i-1,j)+indelcost }

O(nm) DP algorithm for pairwise alignment using simple gap costs Initialize M(0,j) = M(j,0) = jindelcost For i=1…n For j = 1…m M(i,j) = min { M(i-1,j-1)+subcost(Ai,Bj), M(i,j-1)+indelcost, M(i-1,j)+indelcost } Return M(n,m) Add arrows for backtracking (to construct an optimal alignment and edit transformation rather than just the cost) Modification for other gap cost functions is straightforward but leads to an increase in running time

Sum-of-pairs optimal multiple alignment Given set S of sequences and edit cost function F(.,.), Find multiple alignment that minimizes the sum of the implied pairwise alignments (Sum-of-Pairs criterion) NP-hard, but can be approximated Is this useful?

Other approaches to MSA Many of the methods used in practice do not try to optimize the sum-of-pairs Instead they use probabilistic models (HMMs) Often they do a progressive alignment on an estimated tree (aligning alignments) Performance of these methods can be assessed using real and simulated data

Many methods Phylogeny methods Alignment methods Bayesian MCMC Clustal Maximum parsimony Maximum likelihood Neighbor joining FastME UPGMA Quartet puzzling Etc. Alignment methods Clustal POY (and POY*) Probcons (and Probtree) MAFFT Prank Muscle Di-align T-Coffee Opal Etc. 23

Simulation study ROSE simulation: Computed alignments 1000, 500, and 100 sequences Evolution with substitutions and indels Varied gap lengths, rates of evolution Computed alignments Used RAxML to compute trees Recorded tree error (missing branch rate) Recorded alignment error (SP-FN)

1000 taxon models ranked by difficulty 1. 2 classes of MC: easy, moderate-to-difficult 2. true alignment 3. 2 classes: ClustalW, everything else Alignment error, measured this way, isn't a perfect predictor of tree error, measured this way. 1000 taxon models ranked by difficulty 25

Problems with the two phase approach Manual alignment can have a high level of subjectivity (and can take a long time). Current alignment methods fail to return reasonable alignments on markers that evolve with high rates of indels and substitutions, especially if these are large datasets. We discard potentially useful markers if they are difficult to align.

and Simultaneous estimation of trees and alignments S1 S4 S2 S3 S1 = AGGCTATCACCTGACCTCCA S2 = TAGCTATCACGACCGC S3 = TAGCTGACCGC S4 = TCACGACCGACA and S1 = -AGGCTATCACCTGACCTCCA S2 = TAG-CTATCAC--GACCGC-- S3 = TAG-CT-------GACCGC-- S4 = -------TCAC--GACCGACA Simultaneous estimation of trees and alignments 27

Simultaneous Estimation Methods Likelihood-based (under model of evolution including insertion/deletion events)‏ ALIFRITZ, BAli-Phy, BEAST, StatAlign, others Computationally intensive Most are limited to small datasets (< 30 sequences) Define parsimony: instead of seeking the most probably explanation under a model, you want the most parsimonious explanation with the smallest number of evolutionary events.

Treelength-based Input: Set S of unaligned sequences over an alphabet ∑, and an edit distance function F(.,.) (must account for gaps and substitutions) Output: Tree T with sequences S at the leaves and other sequences at the internal nodes so as to minimize eF(sv,sw), where the sum is taken over all edges e=(sv,sw) in the tree

Minimizing treelength Given set S of sequences and edit distance function F(.,.), Find tree T with S at the leaves and sequences at the internal nodes so as to minimize the treelength (sum of edit distances) NP-hard but can be approximated NP-hard even if the tree is known!

Minimizing treelength The problem of finding sequences at the internal nodes of a fixed tree was introduced by Sankoff. Several algorithmic results related to this problem, with pretty theory Most popular software is POY, which tries to optimize tree length. The accuracy of any tree or alignment depends upon the edit distance function F(.,.)

More SATé: our method for simultaneous estimation and tree alignment POY, POY*, and BeeTLe: results of how changing the gap penalty from simple to affine impacts the alignment and tree Impact of guide tree on MSA Statistical co-estimation using models that include indel events (Statalign, Alifritz, BAliPhy) Getting “inside” some of the best MSAs