An evolutionary Monte Carlo algorithm for predicting DNA hybridization Joon Shik Kim et al. (2008) 11.05.06.(Fri) Computational Modeling of Intelligence.

Slides:



Advertisements
Similar presentations
The Helmholtz Machine P Dayan, GE Hinton, RM Neal, RS Zemel
Advertisements

Review Of Statistical Mechanics
CS 678 –Boltzmann Machines1 Boltzmann Machine Relaxation net with visible and hidden units Learning algorithm Avoids local minima (and speeds up learning)
CHAPTER 8 A NNEALING- T YPE A LGORITHMS Organization of chapter in ISSO –Introduction to simulated annealing –Simulated annealing algorithm Basic algorithm.
Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
Stochastic Parameter Optimization for Empirical Molecular Potentials function optimization simulated annealing tight binding parameters.
Lecture 3: Markov processes, master equation
Contextual Classification by Melanie Ganz Lecture 6, Medical Image Analysis 2008.
Suggested readings Historical notes Markov chains MCMC details
BAYESIAN INFERENCE Sampling techniques
Optimization methods Morten Nielsen Department of Systems biology, DTU.
Monte Carlo Simulation Methods - ideal gas. Calculating properties by integration.
Herding: The Nonlinear Dynamics of Learning Max Welling SCIVI LAB - UCIrvine.
Network Goodness and its Relation to Probability PDP Class Winter, 2010 January 13, 2010.
Simulated Annealing Van Laarhoven, Aarts Version 1, October 2000.
Monte Carlo Simulation of Ising Model and Phase Transition Studies
Stochastic Relaxation, Simulating Annealing, Global Minimizers.
Sanger Sequencing. 1) Get Some DNA To Sequence *le pick… *le smash… *le precipitate… *le DNA in le solution.
By Rohit Ray ESE 251.  Most minimization (maximization) strategies work to find the nearest local minimum  Trapped at local minimums (maxima)  Standard.
Elements of the Heuristic Approach
Introduction to Monte Carlo Methods D.J.C. Mackay.
Monte Carlo Simulation of Ising Model and Phase Transition Studies By Gelman Evgenii.
JM - 1 Introduction to Bioinformatics: Lecture XVI Global Optimization and Monte Carlo Jarek Meller Jarek Meller Division of Biomedical.
1 EE381V: Genomic Signal Processing Lecture #13. 2 The Course So Far Gene finding DNA Genome assembly Regulatory motif discovery Comparative genomics.
1 IE 607 Heuristic Optimization Simulated Annealing.
Natural Gradient Works Efficiently in Learning S Amari (Fri) Computational Modeling of Intelligence Summarized by Joon Shik Kim.
Strand Design for Biomolecular Computation
A Modified Meta-controlled Boltzmann Machine Tran Duc Minh, Le Hai Khoi (*), Junzo Watada (**), Teruyuki Watanabe (***) (*) Institute Of Information Technology-Viet.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Simulated Annealing.
The Ising Model Mathematical Biology Lecture 5 James A. Glazier (Partially Based on Koonin and Meredith, Computational Physics, Chapter 8)
Markov Random Fields Probabilistic Models for Images
8. Selected Applications. Applications of Monte Carlo Method Structural and thermodynamic properties of matter [gas, liquid, solid, polymers, (bio)-macro-
Markov Chain Monte Carlo and Gibbs Sampling Vasileios Hatzivassiloglou University of Texas at Dallas.
What is DNA Computing? Shin, Soo-Yong Artificial Intelligence Lab.
CSC2535 Lecture 4 Boltzmann Machines, Sigmoid Belief Nets and Gibbs sampling Geoffrey Hinton.
ChE 452 Lecture 17 Review Of Statistical Mechanics 1.
CHAPTER 17 O PTIMAL D ESIGN FOR E XPERIMENTAL I NPUTS Organization of chapter in ISSO –Background Motivation Finite sample and asymptotic (continuous)
13. Extended Ensemble Methods. Slow Dynamics at First- Order Phase Transition At first-order phase transition, the longest time scale is controlled by.
Computational and experimental analysis of DNA shuffling : Supporting text N. Maheshri and D. V. Schaffer PNAS, vol. 100, no. 6, Summarized by.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
An Introduction to Monte Carlo Methods in Statistical Physics Kristen A. Fichthorn The Pennsylvania State University University Park, PA
Chapter 18 Connectionist Models
Review Session BS123A/MB223 UC-Irvine Ray Luo, MBB, BS.
Lecture 9 State Space Gradient Descent Gibbs Sampler with Simulated Annealing.
Lecture 18, CS5671 Multidimensional space “The Last Frontier” Optimization Expectation Exhaustive search Random sampling “Probabilistic random” sampling.
CS623: Introduction to Computing with Neural Nets (lecture-17) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CSC321: Introduction to Neural Networks and Machine Learning Lecture 17: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
Computational Physics (Lecture 10) PHY4370. Simulation Details To simulate Ising models First step is to choose a lattice. For example, we can us SC,
Quantum Boltzmann Machine
The Monte Carlo Method/ Markov Chains/ Metropolitan Algorithm from sec in “Adaptive Cooperative Systems” -summarized by Jinsan Yang.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Simulated Annealing Chapter
Van Laarhoven, Aarts Version 1, October 2000
POA Simulation MEC Seminar 임희웅.
Theoretical Investigations at
268nm UV spectrophotometry for the Theorem Proving strings
CSC321: Neural Networks Lecture 19: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
By Rohit Ray ESE 251 Simulated Annealing.
Haim Kaplan and Uri Zwick
Computational and experimental analysis of DNA shuffling
(Thu) Computational Models of Intelligence Joon Shik Kim
JSPS Project on Molecular Computing (presentation by Masami Hagiya)
(Fri) Computational Modeling of Intelligence Joon Shik Kim
Boltzmann Machine (BM) (§6.4)
Xin-She Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014
More on HW 2 (due Jan 26) Again, it must be in Python 2.7.
Bioinformatics, Vol.17 Suppl.1 (ISMB 2001)
Simulated Annealing & Boltzmann Machines
Stochastic Methods.
Presentation transcript:

An evolutionary Monte Carlo algorithm for predicting DNA hybridization Joon Shik Kim et al. (2008) (Fri) Computational Modeling of Intelligence Joon Shik Kim 1

2 Neuron and Analog Computing Neuron Analog Computing

3 Spin glass system Spin Glass = Tanh(J +Ø) :Mean field theory

Hopfield Model

5 DNA Computing as a Spin Glass Microbes in deep sea P ∝ Exp (-ΣJ ij S i S j ) Many DNA neighbor molecules in 3D enables the system to resemble the spin glass.

6 Ising model Spin glass Stochastic annealing Deterministic steepest descent Simulated annealing Boltzmann machine Evolutionary MCMC for DNA Hopfield model Natural gradient Adaptive steepest descent

7 I. Simulating the DNA hybridization with evolutionary algorithm of Metropolis and simulated annealing.

8 Introduction We devised a novel evolutionary algorithm applicable to DNA nanoassembly, biochip, and DNA computing. Silicon based results match well the fluorometry and gel electrophoresis biochemistry experiment.

9 Theory (1/2) Boltzmann distribution is the one that maximizes the sum of entropies of both the system and the environment. Metropolis algorithm drives the system into Boltzmann distribution and simulated annealing drives the system into lowest Gibbs free energy state by slow cooling of the whole system.

10 Theory (2/2) We adopted above evolutionary algorithm for simulating the hybridization of DNA molecules. We used only four parameters, ∆H G-C = 9.0 kcal/MBP (mole base pair), ∆H A-T = 7.2 kcal/MBP, ∆H other = 5.4 kcal/MBP, ∆S = 23 cal/(MBP deg). From (Klump and Ackermann, 1971)

11 Algorithm 1. Randomly choose i-th and j-th ssDNA (single stranded DNA). 2. Randomly try an assembly with Metropolis acceptance min(1, e -∆G/kT ). 3. We take into account of the detaching process also with Metropolis acceptance. 4. If whole system is in equilibrium then decrease the temperature and repeat process Inspect the number of target dsDNA and the number of bonds.

12 Target dsDNA (double stranded DNA ) ㄱ Q V ㄱ P V R CGTACGTACGCTGAA CTGCCTTGCGTTGAC TGCGTTCATTGTATG Q V ㄱ T V ㄱ S TTCAGCGTACGTACG TCAATTTGCGTCAAT TGGTCGCTACTGCTT S AAGCAGTAGCGACCA T ATTGACGCAAATTGA P GTCAACGCAAGGCAG ㄱ R CATACAATGAACGCA Axiom Sequence (from 5’ to 3’) 6 types of ssDNA Target dsDNA (The arrows are from 5’ to 3’)

13 Simulation Results (1/2) The number of bonds vs. temperature

14 Simulation Results (2/2) The number of target dsDNA (double stranded DNA) vs. temperature

15 Wet-Lab experiment results (1/2) SYBR Green I fluorescent intensity as the cooling of the system

16 Wet-Lab experiment results (2/2) Gel electrophoresis of cooled DNA solution

17 Why theorem proving? Resolution refutation p→q  ㄱ p v q S Λ T → Q, P Λ Q →R, S, T, P then R? 1. Negate R 2. Make a resolution on every axioms. 3. Target dsDNA is a null and its existence proves the theorem

18 Resolution refutation Resolution tree ( ㄱ Q V ㄱ P V R) Λ Q  ㄱ P V R