CSE182-L9 Gene Finding (DNA signals) Genome Sequencing and assembly.

Slides:



Advertisements
Similar presentations
Gene Prediction: Similarity-Based Approaches
Advertisements

HIDDEN MARKOV MODELS IN COMPUTATIONAL BIOLOGY CS 594: An Introduction to Computational Molecular Biology BY Shalini Venkataraman Vidhya Gunaseelan.
Ab initio gene prediction Genome 559, Winter 2011.
Hidden Markov Models Eine Einführung.
 CpG is a pair of nucleotides C and G, appearing successively, in this order, along one DNA strand.  CpG islands are particular short subsequences in.
Hidden Markov Models CBB 231 / COMPSCI 261. An HMM is a following: An HMM is a stochastic machine M=(Q, , P t, P e ) consisting of the following: a finite.
Ka-Lok Ng Dept. of Bioinformatics Asia University
Hidden Markov Models in Bioinformatics
Profiles for Sequences
Hidden Markov Models Theory By Johan Walters (SR 2003)
Hidden Markov Models (HMMs) Steven Salzberg CMSC 828H, Univ. of Maryland Fall 2010.
. Hidden Markov Model Lecture #6. 2 Reminder: Finite State Markov Chain An integer time stochastic process, consisting of a domain D of m states {1,…,m}
1 Computational Molecular Biology MPI for Molecular Genetics DNA sequence analysis Gene prediction Gene prediction methods Gene indices Mapping cDNA on.
Hidden Markov Models in Bioinformatics Example Domain: Gene Finding Colin Cherry
Gene Prediction Methods G P S Raghava. Prokaryotic gene structure ORF (open reading frame) Start codon Stop codon TATA box ATGACAGATTACAGATTACAGATTACAGGATAG.
Lecture 6, Thursday April 17, 2003
Hidden Markov Models. Two learning scenarios 1.Estimation when the “right answer” is known Examples: GIVEN:a genomic region x = x 1 …x 1,000,000 where.
Gene prediction and HMM Computational Genomics 2005/6 Lecture 9b Slides taken from (and rapidly mixed) Larry Hunter, Tom Madej, William Stafford Noble,
Hidden Markov Models Pairwise Alignments. Hidden Markov Models Finite state automata with multiple states as a convenient description of complex dynamic.
Hidden Markov Models Sasha Tkachev and Ed Anderson Presenter: Sasha Tkachev.
Hidden Markov Models Lecture 5, Tuesday April 15, 2003.
1 Gene Finding Charles Yan. 2 Gene Finding Genomes of many organisms have been sequenced. We need to translate the raw sequences into knowledge. Where.
Hidden Markov Models Lecture 5, Tuesday April 15, 2003.
Gene Finding (DNA signals) Genome Sequencing and assembly
Gene Finding Charles Yan.
CSE182-L10 Gene Finding.
CSE182-L12 Gene Finding.
Comparative ab initio prediction of gene structures using pair HMMs
CSE182-L7 Protein Sequence Analysis using HMMs, Gene Finding.
Eukaryotic Gene Finding
CSE182-L10 LW statistics/Assembly. Whole Genome Shotgun Break up the entire genome into pieces Sequence ends, and assemble using a computer LW statistics.
CSE182-L8 Gene Finding. Project EST clustering and assembly Given a collection of EST (3’/5’) sequences, your goal is to cluster all ESTs from the same.
Markov models and applications Sushmita Roy BMI/CS 576 Oct 7 th, 2014.
Lecture 12 Splicing and gene prediction in eukaryotes
CSE182-L10 MS Spec Applications + Gene Finding + Projects.
Hidden Markov Model Continues …. Finite State Markov Chain A discrete time stochastic process, consisting of a domain D of m states {1,…,m} and 1.An m.
Eukaryotic Gene Finding
Biological Motivation Gene Finding in Eukaryotic Genomes
Hidden Markov Models In BioInformatics
Gene finding with GeneMark.HMM (Lukashin & Borodovsky, 1997 ) CS 466 Saurabh Sinha.
BINF6201/8201 Hidden Markov Models for Sequence Analysis
Assignment 2: Papers read for this assignment Paper 1: PALMA: mRNA to Genome Alignments using Large Margin Algorithms Paper 2: Optimal spliced alignments.
Doug Raiford Lesson 3.  Have a fully sequenced genome  How identify the genes?  What do we know so far? 10/13/20152Gene Prediction.
Motif finding with Gibbs sampling CS 466 Saurabh Sinha.
DNA sequencing. Dideoxy analogs of normal nucleotide triphosphates (ddNTP) cause premature termination of a growing chain of nucleotides. ACAGTCGATTG ACAddG.
Gene finding and gene structure prediction M. Fatih BÜYÜKAKÇALI Computational Bioinformatics 2012.
10/29/20151 Gene Finding Project (Cont.) Charles Yan.
CSE182-L9 Modeling Protein domains using HMMs. Profiles Revisited Note that profiles are a powerful way of capturing domain information Pr(sequence x|
10-07CSE182 CSE182-L7 Protein Sequence Analysis Patterns (regular expressions) Profiles HMM Gene Finding.
Gene Prediction: Similarity-Based Methods (Lecture for CS498-CXZ Algorithms in Bioinformatics) Sept. 15, 2005 ChengXiang Zhai Department of Computer Science.
Mark D. Adams Dept. of Genetics 9/10/04
Comp. Genomics Recitation 9 11/3/06 Gene finding using HMMs & Conservation.
From Genomes to Genes Rui Alves.
Algorithms in Computational Biology11Department of Mathematics & Computer Science Algorithms in Computational Biology Markov Chains and Hidden Markov Model.
CSE182 CSE182-L11 Protein sequencing and Mass Spectrometry.
Alternative Splicing (a review by Liliana Florea, 2005) CS 498 SS Saurabh Sinha 11/30/06.
Genes and Genomes. Genome On Line Database (GOLD) 243 Published complete genomes 536 Prokaryotic ongoing genomes 434 Eukaryotic ongoing genomes December.
JIGSAW: a better way to combine predictions J.E. Allen, W.H. Majoros, M. Pertea, and S.L. Salzberg. JIGSAW, GeneZilla, and GlimmerHMM: puzzling out the.
Applications of HMMs in Computational Biology BMI/CS 576 Colin Dewey Fall 2010.
(H)MMs in gene prediction and similarity searches.
BIOINFORMATICS Ayesha M. Khan Spring 2013 Lec-8.
Fa07CSE182-L8 HMMs, Gene Finding. Fa07CSE182-L8 Midterm 1 In class next Tuesday Syllabus: L1-L8 –Please review HW, questions, and other notes –Bring one.
1 Gene Finding. 2 “The Central Dogma” TranscriptionTranslation RNA Protein.
bacteria and eukaryotes
What is a Hidden Markov Model?
CSE182-L12 Gene Finding.
Eukaryotic Gene Finding
Ab initio gene prediction
Hidden Markov Models (HMMs)
4. HMMs for gene finding HMM Ability to model grammar
Presentation transcript:

CSE182-L9 Gene Finding (DNA signals) Genome Sequencing and assembly

Basic Math Given a vector V in an n- dimensional space –What is ||V||? –What is V/||V||? How can you compute the angle between two vectors? V V1V1

Transcription and translation We define a gene as a location on the genome that codes for proteins. The genic information is used to manufacture proteins through transcription, and translation. There is a unique mapping from triplets to amino-acids

Translation The ribosomal machinery reads mRNA. Each triplet is translated into a unique amino-acid until the STOP codon is encountered. There is also a special signal where translation starts, usually at the ATG (M) codon.

Translation The ribosomal machinery reads mRNA. Each triplet is translated into a unique amino-acid until the STOP codon is encountered. There is also a special signal where translation starts, usually at the ATG (M) codon. Given a DNA sequence, how many ways can you translate it?

Eukaryotic gene structure The coding regions of a gene are discontiguous regions (exons), separated by non-coding regions (introns). Transcription initially copies the entire region into RNA The introns are ‘spliced out’ to form the mature mRNA (message) Translation starts from an intitiating ATG somewhere in the message.

Gene Features ATG 5’ UTR intron exon 3’ UTR Acceptor Donor splice site Transcription start Translation start

Gene Features The gene can lie on any strand (relative to the reference genome) The code can be in one of 3 frames. AGTAGAGTATAGTGGACG S R V * W R V Q Y S G * S I V D Frame 1 Frame 2 Frame 3 -ve strand TCATCTCATATCACCTGC

Gene identification Eukaryotic gene definitions: –Location that codes for a protein –The transcript sequence(s) that encodes the protein –The protein sequence(s) Suppose you want to know all of the genes in an organism. This was a major problem in the 70s. PhDs, and careers were spent isolating a single gene sequence. All of that changed with better reagents and the development of high throughput methods like EST sequencing With genome sequencing, the initial problem became computational.

Computational Gene Finding Given Genomic DNA, identify all the coordinates of the gene TRIVIA QUIZ! What is the name of the FIRST gene finding program? (google testcode) ATG 5’ UTR intron exon 3’ UTR Acceptor Donor splice site Transcription start Translation start

Gene Finding: The 1st generation Given genomic DNA, does it contain a gene (or not)? Key idea: The distributions of nucleotides is different in coding (translated exons) and non- coding regions. Therefore, a statistical test can be used to discriminate between coding and non-coding regions.

Coding versus non-coding You are given a collection of exons, and a collection of intergenic sequence. Count the number of occurrences of ATGATG in Introns and Exons. –Suppose 1% of the hexamers in Exons are ATGATG –Only 0.01% of the hexamers in Intergenic are ATGATG How can you use this idea to find genes?

Generalizing AAAAAA AAAAAC AAAAAG AAAAAT IE Compute a frequency count for all hexamers. Exons, Intergenic and the sequence X are all vectors in a multi-dimensional space Use this to decide whether a sequence X is exonic/intergenic X 5 Frequencies (X10 -5 )

A geometric approach (2 hexamers) Plot the following vectors – E= [10, 20] – I = [10, 5] – V 3 = [6, 10] – V 4 = [9, 15] Is V 3 more like E or more like I? E I V3V3

Choosing between Intergenic and Exonic Normalize V’ = V/||V|| All vectors have the same length (lie on the unit circle) Next, compute the angle to E, and I. Choose the feature that is ‘closer’ (smaller angle. E I V3V3

Coding versus non-coding signals Fickett and Tung (1992) compared various measures Measures that preserve the triplet frame are the most successful. Genscan uses a 5th order Markov Model

5th order markov chain Pr EXON [AAAAAACGAGAC..] =T[AAAAA,A] T[AAAAA,C] T[AAAAC,G] T[AAACG,A]…… = (20/T) (50/T)………. AAAAAA 20 1 AAAAAC AAAAAG 5 30 AAAAAT 3.. T AAAAA A G C AAAAG AAAAC ExonIntron

Scoring for coding regions The coding differential can be computed as the log odds of the probability that a sequence is an exon vs. and intron. In Genscan, separate transition matrices are trained for each frame, as different frames have different hexamer distributions

Coding differential for 380 genes

Coding region can be detected Coding Plot the coding score using a sliding window of fixed length. The (large) exons will show up reliably. Not enough to predict gene boundaries reliably

Other Signals GT ATG AG Coding Signals at exon boundaries are precise but not specific. Coding signals are specific but not precise. When combined they can be effective

Combining Signals We can compute the following: –E-score[i,j] –I-score[i,j] –D-score[i] –I-score[i] –Goal is to find coordinates that maximize the total score ij

The second generation of Gene finding Ex: Grail II. Used statistical techniques to combine various signals into a coherent gene structure. It was not easy to train on many parameters. Guigo & Bursett test revealed that accuracy was still very low. Problem with multiple genes in a genomic region

Combining signals using D.P. An HMM is the best way to model and optimize the combination of signals Here, we will use a simpler approach which is essentially the same as the Viterbi algorithm for HMMs, but without the formalism.

Hidden states & gene structure Identifying a gene is equivalent to labeling each nucleotide as E/I/intergenic etc. These ‘labels’ are the hidden states For simplicity, consider only two states E and I IIIIIEEEEEEIIIIIIEEEEEEIIIIEEEEEE IIIII i1i1 i2i2 i3i3 i4i4

Gene finding reformulated Given a labeling L, we can score it as I-score[0..i 1 -1] + E-score[i 1..i 2 ] + D-score[i 2 +1] + I-score[i i 3 -1] + A-score[i 3 -1] + E-score[i 3..i 4 ] + ……. Goal is to compute a labeling with maximum score. IIIIIEEEEEEIIIIIIEEEEEEIIIIEEEEEE IIIII i1i1 i2i2 i3i3 i4i4

Optimum labeling using D.P. (Viterbi) Define V E (i) = Best score of a labeling of the prefix 1..i such that the i-th position is labeled E Define V I (i) = Best score of a labeling of the prefix 1..i such that the i-th position is labeled I Why is it enough to compute V E (i) & V I (i) ?

Optimum parse of the gene j i ji

Generalizing Note that we deal with two states, and consider all paths that move between the two states. E I i

Generalizing We did not deal with the boundary cases in the recurrence. Instead of labeling with two states, we can label with multiple states, –E init, E fin, E mid, –I, I G (intergenic) E init I E fin E mid IGIG Note: all links are not shown here

An HMM for Gene structure

Gene Finding via HMMs Gene finding can be interpreted as a d.p. approach that threads genomic sequence through the states of a ‘gene’ HMM. –E init, E fin, E mid, –I, I G (intergenic) E init I E fin E mid IGIG Note: all links are not shown here i

End of L9

Generalized HMMs, and other refinements A probabilistic model for each of the states (ex: Exon, Splice site) needs to be described In standard HMMs, there is an exponential distribution on the duration of time spent in a state. This is violated by many states of the gene structure HMM. Solution is to model these using generalized HMMs.

Length distributions of Introns & Exons

Generalized HMM for gene finding Each state also emits a ‘duration’ for which it will cycle in the same state. The time is generated according to a random process that depends on the state.

Forward algorithm for gene finding ji qkqk Emission Prob.: Probability that you emitted X i..X j in state q k (given by the 5th order markov model) Forward Prob: Probability that you emitted i symbols and ended up in state q k Duration Prob.: Probability that you stayed in state q k for j-i+1 steps

De novo Gene prediction: Summary Various signals distinguish coding regions from non-coding HMMs are a reasonable model for Gene structures, and provide a uniform method for combining various signals. Further improvement may come from improved signal detection

DNA Signals Coding versus non-coding Splice Signals Translation start ATG 5’ UTR intron exon 3’ UTR Acceptor Donor splice site Transcription start Translation start

DNA signal example: The donor site marks the junction where an exon ends, and an intron begins. For gene finding, we are interested in computing a probability –D[i] = Prob[Donor site at position i] Approach: Collect a large number of donor sites, align, and look for a signal.

PWMs Fixed length for the splice signal. Each position is generated independently according to a distribution Figure shows data from > 1200 donor sites AAGGTGAGT CCGGTAAGT GAGGTGAGG TAGGTAAGG

Improvements to signal detection GGTAPr[ GGTA ] is a donor site? –0.5*0.5 CGTAPr[ CGTA ] is a donor site? –0.5*0.5 Is something wrong with this explanation? GGTA CGTG

MDD PWMs do not capture correlations between positions Many position pairs in the Donor signal are correlated

Maximal Dependence Decomposition Choose the position i which has the highest correlation score. Split sequences into two: those which have the consensus at position i, and the remaining. Recurse until –Stop if #sequences is ‘small enough’

MDD for Donor sites

Gene prediction: Summary Various signals distinguish coding regions from non-coding HMMs are a reasonable model for Gene structures, and provide a uniform method for combining various signals. Further improvement may come from improved signal detection

How many genes do we have? Nature Science

Alternative splicing

Comparative methods Gene prediction is harder with alternative splicing. One approach might be to use comparative methods to detect genes Given a similar mRNA/protein (from another species, perhaps?), can you find the best parse of a genomic sequence that matches that target sequence Yes, with a variant on alignment algorithms that penalize separately for introns, versus other gaps. There is a genome sequencing project for a different Hirudo species. You could compare the Hirudo ESTs against the genome to do gene finding.

Comparative gene finding tools Procrustes/Sim4: mRNA vs. genomic Genewise: proteins versus genomic CEM: genomic versus genomic Twinscan: Combines comparative and de novo approach. Mass Spec related? –Later in the class we will consider mass spectrometry data. –Can we use this data to identify genes in eukaryotic genomes? (Research project)

Databases RefSeq and other databases maintain sequences of full- length transcripts/genes. We can query using sequence.

Course Sequence Comparison (BLAST & other tools) Protein Motifs: –Profiles/Regular Expression/HMMs Discovering protein coding genes –Gene finding HMMs –DNA signals (splice signals) How is the genomic sequence itself obtained? Protein sequence analysis ESTs Gene finding

Silly Quiz Who are these people, and what is the occasion?

Genome Sequencing and Assembly

DNA Sequencing DNA is double- stranded The strands are separated, and a polymerase is used to copy the second strand. Special bases terminate this process early.

Sequencing A break at T is shown here. Measuring the lengths using electrophoresis allows us to get the position of each T The same can be done with every nucleotide. Fluorescent labeling can help separate different nucleotides

Automated detectors ‘read’ the terminating bases. The signal decays after 1000 bases.

Sequencing Genomes: Clone by Clone Clones are constructed to span the entire length of the genome. These clones are ordered and oriented correctly (Mapping) Each clone is sequenced individually

Shotgun Sequencing Shotgun sequencing of clones was considered viable However, researchers in 1999 proposed shotgunning the entire genome.

Library Create vectors of the sequence and introduce them into bacteria. As bacteria multiply you will have many copies of the same clone.

Sequencing

Questions Algorithmic: How do you put the genome back together from the pieces? Will be discussed in the next lecture. Statistical? EX: Let G be the length of the genome, and L be the length of a fragment. How many fragments do you need to sequence? –The answer to the statistical questions had already been given in the context of mapping, by Lander and Waterman.

Lander Waterman Statistics G L Island

LW statistics: questions As the coverage c increases, more and more areas of the genome are likely to be covered. Ideally, you want to see 1 island. Q1: What is the expected number of islands? Ans: N exp(-c  ) The number increases at first, and gradually decreases.

Analysis: Expected Number Islands Computing Expected # islands. Let X i =1 if an island ends at position i, X i =0 otherwise. Number of islands = ∑ i X i Expected # islands = E(∑ i X i ) = ∑ i E(X i )

Prob. of an island ending at i E(X i ) = Prob (Island ends at pos. i) = Prob(clone began at position i-L+1 AND no clone began in the next L-T positions) i L T

LW statistics Pr[Island contains exactly j clones]? Consider an island that has already begun. With probability e - c , it will never be continued. Therefore Pr[Island contains exactly j clones]= Expected # j-clone islands

Expected # of clones in an island Why?

Expected length of an island