Practical algorithms in Sequence Alignment Sushmita Roy BMI/CS 576 Sep 17 th, 2013.

Slides:



Advertisements
Similar presentations
Fa07CSE 182 CSE182-L4: Database filtering. Fa07CSE 182 Summary (through lecture 3) A2 is online We considered the basics of sequence alignment –Opt score.
Advertisements

Blast outputoutput. How to measure the similarity between two sequences Q: which one is a better match to the query ? Query: M A T W L Seq_A: M A T P.
Hidden Markov Models (1)  Brief review of discrete time finite Markov Chain  Hidden Markov Model  Examples of HMM in Bioinformatics  Estimations Basic.
Gapped BLAST and PSI-BLAST Altschul et al Presenter: 張耿豪 莊凱翔.
1 Genome information GenBank (Entrez nucleotide) Species-specific databases Protein sequence GenBank (Entrez protein) UniProtKB (SwissProt) Protein structure.
Bioinformatics Tutorial I BLAST and Sequence Alignment.
BLAST Sequence alignment, E-value & Extreme value distribution.
Sequence Alignment Kun-Mao Chao ( 趙坤茂 ) Department of Computer Science and Information Engineering National Taiwan University, Taiwan
Local alignments Seq X: Seq Y:. Local alignment  What’s local? –Allow only parts of the sequence to match –Results in High Scoring Segments –Locally.
Searching Sequence Databases
Database Searching for Similar Sequences Search a sequence database for sequences that are similar to a query sequence Search a sequence database for sequences.
Lecture outline Database searches
Heuristic alignment algorithms and cost matrices
We continue where we stopped last week: FASTA – BLAST
. Class 4: Fast Sequence Alignment. Alignment in Real Life u One of the major uses of alignments is to find sequences in a “database” u Such collections.
Sequence Alignment vs. Database Task: Given a query sequence and millions of database records, find the optimal alignment between the query and a record.
1 1. BLAST (Basic Local Alignment Search Tool) Heuristic Only parts of protein are frequently subject to mutations. For example, active sites (that one.
1 BLAST – A heuristic algorithm Anjali Tiwari Pannaben Patel Pushkala Venkataraman.
Similar Sequence Similar Function Charles Yan Spring 2006.
Sequence Alignment III CIS 667 February 10, 2004.
Heuristic Approaches for Sequence Alignments
Practical algorithms in Sequence Alignment Sushmita Roy BMI/CS 576 Sep 16 th, 2014.
Fa05CSE 182 CSE182-L5: Scoring matrices Dictionary Matching.
Sequence similarity. Motivation Same gene, or similar gene Suffix of A similar to prefix of B? Suffix of A similar to prefix of B..Z? Longest similar.
Blast heuristics Morten Nielsen Department of Systems Biology, DTU.
Sequence alignment, E-value & Extreme value distribution
Heuristic methods for sequence alignment in practice Sushmita Roy BMI/CS 576 Sushmita Roy Sep 27 th,
Whole genome alignments Genome 559: Introduction to Statistical and Computational Genomics Prof. James H. Thomas
Alignment Statistics and Substitution Matrices BMI/CS 576 Colin Dewey Fall 2010.
An Introduction to Bioinformatics
BLAST What it does and what it means Steven Slater Adapted from pt.
Gapped BLAST and PSI- BLAST: a new generation of protein database search programs By Stephen F. Altschul, Thomas L. Madden, Alejandro A. Schäffer, Jinghui.
Computational Biology, Part 9 Efficient database searching methods Robert F. Murphy Copyright  1996, 1999, All rights reserved.
Searching Molecular Databases with BLAST. Basic Local Alignment Search Tool How BLAST works Interpreting search results The NCBI Web BLAST interface Demonstration.
Database Searches BLAST. Basic Local Alignment Search Tool –Altschul, Gish, Miller, Myers, Lipman, J. Mol. Biol. 215 (1990) –Altschul, Madden, Schaffer,
Last lecture summary. Window size? Stringency? Color mapping? Frame shifts?
BLAST Anders Gorm Pedersen & Rasmus Wernersson. Database searching Using pairwise alignments to search databases for similar sequences Database Query.
CISC667, F05, Lec9, Liao CISC 667 Intro to Bioinformatics (Fall 2005) Sequence Database search Heuristic algorithms –FASTA –BLAST –PSI-BLAST.
Comp. Genomics Recitation 3 The statistics of database searching.
BLAST: Basic Local Alignment Search Tool Altschul et al. J. Mol Bio CS 466 Saurabh Sinha.
Basic Local Alignment Search Tool BLAST Why Use BLAST?
Pairwise Local Alignment and Database Search Csc 487/687 Computing for Bioinformatics.
Pairwise Sequence Alignment Part 2. Outline Summary Local and Global alignments FASTA and BLAST algorithms Evaluating significance of alignments Alignment.
©CMBI 2005 Database Searching BLAST Database Searching Sequence Alignment Scoring Matrices Significance of an alignment BLAST, algorithm BLAST, parameters.
Heuristic Methods for Sequence Database Searching BMI/CS 576 Colin Dewey Fall 2015.
Sequence Alignment.
Doug Raiford Phage class: introduction to sequence databases.
Pairwise Sequence Alignment (cont.) (Lecture for CS397-CXZ Algorithms in Bioinformatics) Feb. 4, 2004 ChengXiang Zhai Department of Computer Science University.
Step 3: Tools Database Searching
The statistics of pairwise alignment BMI/CS 576 Colin Dewey Fall 2015.
Heuristic Methods for Sequence Database Searching BMI/CS 576 Colin Dewey Fall 2010.
©CMBI 2005 Database Searching BLAST Database Searching Sequence Alignment Scoring Matrices Significance of an alignment BLAST, algorithm BLAST, parameters.
Heuristic Alignment Algorithms Hongchao Li Jan
BLAST: Database Search Heuristic Algorithm Some slides courtesy of Dr. Pevsner and Dr. Dirk Husmeier.
Heuristic Methods for Sequence Database Searching BMI/CS 776 Mark Craven February 2002.
Substitution Matrices and Alignment Statistics BMI/CS 776 Mark Craven February 2002.
9/6/07BCB 444/544 F07 ISU Dobbs - Lab 3 - BLAST1 BCB 444/544 Lab 3 BLAST Scoring Matrices & Alignment Statistics Sept6.
Database Scanning/Searching FASTA/BLAST/PSIBLAST G P S Raghava.
What is BLAST? Basic BLAST search What is BLAST?
Blast Basic Local Alignment Search Tool
Basics of BLAST Basic BLAST Search - What is BLAST?
Homology Search Tools Kun-Mao Chao (趙坤茂)
Homology Search Tools Kun-Mao Chao (趙坤茂)
Fast Sequence Alignments
Basic Local Alignment Search Tool
Basic Local Alignment Search Tool (BLAST)
Basic Local Alignment Search Tool
Homology Search Tools Kun-Mao Chao (趙坤茂)
Sequence alignment, E-value & Extreme value distribution
Searching Sequence Databases
Presentation transcript:

Practical algorithms in Sequence Alignment Sushmita Roy BMI/CS Sep 17 th, 2013

Key concepts Extreme value distribution gives an analytical form to compute the significance of a score Heuristic algorithms BLAST algorithm – BLAST relies on this significance value to quickly eliminate low scoring hits Sequence databases Using BLAST with large sequence database

Bayesian approach Recall in our log odds ratio we estimated We could instead ask what is the probability of the two sequences being related as opposed to unrelated Related Unrelated

Using Bayes Rule to estimate P(M 1 |x,y) Bayes rule Marginalization Chain Rule Model priors

Points about P(M 1 |x,y) Has the form of a logistic function where Alignment scorePrior log odds score

Scores from random alignments Suppose we assume Sequence lengths m and n A particular substitution matrix and amino-acid frequencies And we consider generating random sequences of lengths m and n and finding the best alignment of these sequences This will give us a distribution over alignment scores for random pairs of sequences

The extreme value distribution Because we’re picking the best alignments, we want to know the distribution of max scores for alignments against a random set of sequences looks like this is given by an extreme value distribution x P(x)

Assessing significance of sequence score alignments It can be shown that the mode of the distribution for optimal scores is – K, λ estimated from the substitution matrix Probability of observing a score greater than S

Need to speed up sequence alignment consider the task of searching the RefSeq collection of sequences against a query sequence: – most recent release of DB contains 32,504,738 proteins – Entails 33,000,000*(300*300) matrix operations (assuming query sequence is of length 300 and avg. sequence length is 300) O(mn) too slow for large databases with high query traffic

Speeding up sequence alignment Indexing techniques to locate possible small high scoring segments Throw away segments that are not significant (based on theory of score significance) Extending only high scoring segments Two heuristic algorithms – BLAST – FASTA

BLAST: Basic Local Alignment Search Tool Altshul et al 1990 – Cited >48,000 times! Optimizes Maximal Segment Pair (MSP) score – A local measure of similarity Used EVD like theory for random sequence score Works for both protein sequence and DNA sequence – Only scores differ

Maximal Segment Pair (MSP) Sequence segment: A contiguous stretch of residues of any length Relies on key assumption of addivity: – Similarity score for two aligned segments of the same length is the sum of similarity values for each pair of aligned residues. MSP: highest scoring pair of identical length segments from two sequences Theoretical analysis gives the statistical significance of an MSP score – Allows BLAST to efficiently prune out low scoring pairs

BLAST continued BLAST finds locally maximal segment pairs that exceeds a particular cutoff Let a word pair be a segment pair of length w BLAST only seeks those word pairs that have a score at least T Extend only word pairs with a score of at least T to determine if it has a segment pair of score at least S.

Key steps of the BLAST algorithm For each query sequence 1.Compile a list of high-scoring words of score at least T First generate words in the query sequence Then find words that match query sequence words with score at least T Thus allows for inexact matches 2.Scan the database for hits of these words 3.Extend hits

Determining query words Given: query sequence: QLNFSAGW word length w = 2 (default for protein usually w = 3) word score threshold T = 9 Step 1: determine all words of length w in query sequence QL LN NF FS SA AG GW

Determining query words Determine all words that score at least T when compared to a word in the query sequence QLQL=9 LNLN=10 NFNF=12, NY=9 … SAnone... words from query sequence words with T≥9 Additional words in the database

Scanning the database How to efficiently search a long sequence for multiple occurrences of short sequences BLAST has two approaches – Indexing approach – Finite state machine

Indexing approach Let w=3. For amino acids, the number of words is Map a word to an integer between 1 and Thus a word has an index into an array Each index points to a list of matches of the word in the query sequence As we scan the database, each database word immediately leads to the hits in the query sequence

Deterministic finite state machine (FSM) Deterministic behavior as input is read – State transitions/outputs An example FSM to match CHY, CHH and CYH C H Y C C ~C~CHY ε1 ε2 Transition from 2 or 3 to 0, happens when C is not observed. Can result in “restarting” or “acceptance”

Extending a hit Extending a word hit to a segment pair is straightforward Terminate extension when the score of the pair falls a certain distance below the best score found for shorter extensions

How to choose w and T? Tradeoff between running time and sensitivity Sensitivity T – small T: greater sensitivity, more hits to expand – large T: lower sensitivity, fewer hits to expand W – Larger w: fewer query word seeds, lower time for extending, but more possible words (20 w for AAs) In practice w=4, T=17 is good for proteins

Summary of BLAST T: Don’t consider seeds with score < T Don’t extend hits when score falls below a specified threshold Pre-processing of database or query helps to improve the running time

FASTA Starts with exact seed matches instead of inexact matches that satisfy a threshold Extends seeds (similar to BLAST) Join high scoring seeds allowing for gaps Re-align high scoring matches

Different versions of BLAST programs ProgramQueryDatabase BLASTPProtein BLASTNDNA BLASTX Translated DNA Protein TBLASTNProteinTranslated DNA TBLASTX Translated DNA

Sequence databases Large database centers – NCBI: – EBI: – Sanger: – Each of these centers link to hundreds of databases Nucleotide sequences – Genbank – EMBL-EBI Nucleotide Sequence Database – Comprise ~8% of the total database (Nucleic Acid Research 2006 Database edition) Protein sequences – UniProtKB

Using BLAST Will blast a DNA sequence against NCBI nucleotide database We will select – =70545&to=72150&report=fasta =70545&to=72150&report=fasta

Using BLAST Choose the database Enter the query sequence

Using BLAST The sequence corresponds to the human HBB (hemoglobin) gene. But we will select the mouse DB Use Megablast (large word size)

Interpreting results Assesses significance of a score. Related to P-value, but gives the expected number of alignments of this score value or higher.