Analysis of Exchange Ratio for Exchange Monte Carlo Method Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology Japan.

Slides:



Advertisements
Similar presentations
Introduction to Monte Carlo Markov chain (MCMC) methods
Advertisements

Contrastive Divergence Learning
Motivating Markov Chain Monte Carlo for Multiple Target Tracking
Review Of Statistical Mechanics
Markov Chain Monte Carlo Convergence Diagnostics: A Comparative Review By Mary Kathryn Cowles and Bradley P. Carlin Presented by Yuting Qi 12/01/2006.
VAR METHODS. VAR  Portfolio theory: risk should be measure at the level of the portfolio  not single asset  Financial risk management before 1990 was.
Bayesian Estimation in MARK
Shinichi Nakajima Sumio Watanabe  Tokyo Institute of Technology
Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
Gibbs Sampling Qianji Zheng Oct. 5th, 2010.
Bayesian statistics – MCMC techniques
BAYESIAN INFERENCE Sampling techniques
CS774. Markov Random Field : Theory and Application Lecture 16 Kyomin Jung KAIST Nov
Copyright © 2006 Pearson Addison-Wesley. All rights reserved. Lecture 3: Monte Carlo Simulations (Chapter 2.8–2.10)
Understanding the Accuracy of Assembly Variation Analysis Methods ADCATS 2000 Robert Cvetko June 2000.
Computational statistics 2009 Random walk. Computational statistics 2009 Random walk with absorbing barrier.
The University of Texas at Austin, CS 395T, Spring 2008, Prof. William H. Press IMPRS Summer School 2009, Prof. William H. Press 1 4th IMPRS Astronomy.
Power Series. A power series in x (or centered at 0) is a series of the following form:
Chapter 14 Simulation. Monte Carlo Process Statistical Analysis of Simulation Results Verification of the Simulation Model Computer Simulation with Excel.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Nonlinear Stochastic Programming by the Monte-Carlo method Lecture 4 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO.
Introduction to Monte Carlo Methods D.J.C. Mackay.
Component Reliability Analysis
Ewa Lukasik - Jakub Lawik - Juan Mojica - Xiaodong Xu.
Material Model Parameter Identification via Markov Chain Monte Carlo Christian Knipprath 1 Alexandros A. Skordos – ACCIS,
Particle Filtering in Network Tomography
Free energies and phase transitions. Condition for phase coexistence in a one-component system:
Bayesian parameter estimation in cosmology with Population Monte Carlo By Darell Moodley (UKZN) Supervisor: Prof. K Moodley (UKZN) SKA Postgraduate conference,
Introduction to MCMC and BUGS. Computational problems More parameters -> even more parameter combinations Exact computation and grid approximation become.
Monte Carlo and Statistical Methods in HEP Kajari Mazumdar Course on Particle Physics, TIFR, August, 2009.
Chapter 14 Monte Carlo Simulation Introduction Find several parameters Parameter follow the specific probability distribution Generate parameter.
Probabilistic Mechanism Analysis. Outline Uncertainty in mechanisms Why consider uncertainty Basics of uncertainty Probabilistic mechanism analysis Examples.
Annealing Paths for the Evaluation of Topic Models James Foulds Padhraic Smyth Department of Computer Science University of California, Irvine* *James.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Module 1: Statistical Issues in Micro simulation Paul Sousa.
New calibration procedure in analytical chemistry in agreement to VIM 3 Miloslav Suchanek ICT Prague and EURACHEM Czech Republic.
1 Gil McVean Tuesday 24 th February 2009 Markov Chain Monte Carlo.
Monte Carlo Methods1 T Special Course In Information Science II Tomas Ukkonen
Simulated Annealing.
Doshisha Univ., Kyoto, Japan CEC2003 Adaptive Temperature Schedule Determined by Genetic Algorithm for Parallel Simulated Annealing Doshisha University,
1 A New Method for Composite System Annualized Reliability Indices Based on Genetic Algorithms Nader Samaan, Student,IEEE Dr. C. Singh, Fellow, IEEE Department.
Infinities 1 sequences and series. Sequence – an ordered set of numbers or other objects.
Tokyo Institute of Technology, Japan Yu Nishiyama and Sumio Watanabe Theoretical Analysis of Accuracy of Gaussian Belief Propagation.
Simulation techniques Summary of the methods we used so far Other methods –Rejection sampling –Importance sampling Very good slides from Dr. Joo-Ho Choi.
Improved Cross Entropy Method For Estimation Presented by: Alex & Yanna.
Vaida Bartkutė, Leonidas Sakalauskas
1 Analytic Solution of Hierarchical Variational Bayes Approach in Linear Inverse Problem Shinichi Nakajima, Sumio Watanabe Nikon Corporation Tokyo Institute.
1 Validation of Qualitative Microbiological Test Methods NCS Conference Brugge, October 2014 Pieta IJzerman-Boon (MSD) Edwin van den Heuvel (TUe, UMCG/RUG)
Machine Design Under Uncertainty. Outline Uncertainty in mechanical components Why consider uncertainty Basics of uncertainty Uncertainty analysis for.
One important application of infinite sequences is in representing “infinite summations.” Informally, if {a n } is an infinite sequence, then is an infinite.
9.6 Ratio and Root Tests.
Markov Chain Monte Carlo for LDA C. Andrieu, N. D. Freitas, and A. Doucet, An Introduction to MCMC for Machine Learning, R. M. Neal, Probabilistic.
Components are existing in ONE of TWO STATES: 1 WORKING STATE with probability R 0 FAILURE STATE with probability F R+F = 1 RELIABLEFAILURE F R Selecting.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
MAT 4830 Mathematical Modeling 04 Monte Carlo Integrations
Introduction to Sampling Methods Qi Zhao Oct.27,2004.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Geometric Series. In a geometric sequence, the ratio between consecutive terms is constant. The ratio is called the common ratio. Ex. 5, 15, 45, 135,...
Asymptotic Behavior of Stochastic Complexity of Complete Bipartite Graph-Type Boltzmann Machines Yu Nishiyama and Sumio Watanabe Tokyo Institute of Technology,
Multiple Target Tracking Using Spatio-Temporal Monte Carlo Markov Chain Data Association Qian Yu, Gerard Medioni, and Isaac Cohen Edwin Lei.
Basic Monte Carlo (chapter 3) Algorithm Detailed Balance Other points non-Boltzmann sampling.
Geometric Sequence – a sequence of terms in which a common ratio (r) between any two successive terms is the same. (aka: Geometric Progression) Section.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
HW7: Evolutionarily conserved segments ENCODE region 009 (beta-globin locus) Multiple alignment of human, dog, and mouse 2 states: neutral (fast-evolving),
A Method to Approximate the Bayesian Posterior Distribution in Singular Learning Machines Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Optimization of Monte Carlo Integration
Energy Preserving Non-linear Filters
Jun Liu Department of Statistics Stanford University
Determine whether the sequence converges or diverges. {image}
Presentation transcript:

Analysis of Exchange Ratio for Exchange Monte Carlo Method Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology Japan

Contents Background  Exchange Monte Carlo (EMC) method  Design of EMC method Main result  Settings  Symmetrized Kullback divergence  Average exchange ratio Discussion and Conclusion

Contents Background  Exchange Monte Carlo (EMC) method  Design of EMC method Main result  Settings  Symmetrized Kullback divergence  Average exchange ratio Discussion and Conclusion

Exchange Monte Carlo (EMC) method [Hukushima, 96] huge computational cost! Multi Canonical algorithmSimulated tempering Exchange Monte Carlo (EMC) method

EMC method is to generate the sample sequence from the following joint distribution, :temperatures Target distribution : EMC method Sampling from the following target distribution!

EMC method Carrying out the following two updates alternately. 1. [conventional MCMC sampling] Parallel sampling from each distribution by using conventional MCMC method. 2. [exchange process] The exchange of two position, and, is tried and accepted with the following probability. Hereafter, we call “ exchange ratio ”.

EMC method

EMC method : standard normal distribution

Contents Background  Exchange Monte Carlo (EMC) method  Design of EMC method Main result  Settings  Symmetrized Kullback divergence  Average exchange ratio Discussion and Conclusion

Design of EMC method How should and be set? Temperature has close relation to the exchange ratio.

Design of EMC method Acceptance ratio of exchange process. For efficient EMC method, the average exchange ratio needs to be of and nearly constant for all temperatures.

Design of EMC method : the expectation of over. For efficient EMC method, the symmetrized Kullback divergence needs to be nearly constant over the various temperatures.

Purpose We analytically clarify the symmetrized Kullback divergence and the average exchange ratio in a low temperature limit,. Average exchange ratio Symmetrized Kullback divergence Criteria for the design of EMC method We need previous EMC simulations in order to obtain these values. The accuracy of experimental values are unknown. Purpose

Contents Background  Exchange Monte Carlo (EMC) method  Design of EMC method Main result  Settings  Symmetrized Kullback divergence  Average exchange ratio Discussion and Conclusion

Settings We consider the EMC method between the following two distribution,

Main result The symmetrized Kullback divergence converges to the following value for : rational number

Main result [Watanabe,2001]

Main result The average exchange ratio converges to the following value for : rational number

Main result If,

Contents Background  Exchange Monte Carlo (EMC) method  Design of EMC method Main result  Settings  Symmetrized Kullback divergence  Average exchange ratio Discussion and Conclusion

Discussion Average exchange ratio : Symmetrized Kullback divergence : From these results, we can adjust the temperatures without carrying out the previous EMC simulations. These results can be used as criteria for checking the convergence of EMC simulations.

Discussion Average exchange ratio : geometrical progression!! Symmetrized Kullback divergence :

Discussion Condition of theorem large enough! Not applicable.Applicable.

Conclusion We analytically clarified the symmetrized Kullback divergence and the average exchange ratio in a low temperature limit. As a result, it is clarified that  The set of temperature should be set as a geometrical progression in order to make the average exchange ratio constant over the various temperatures. As the future works,  Verifying the theoretical results in this study experimentally.  Constructing the design of EMC method.