Dynamical Replica Theory for Dilute Spin Systems Jon Hatchett RIKEN BSI In collaboration with I. Pérez Castillo, A. C. C. Coolen & N. S. Skantzos.

Slides:



Advertisements
Similar presentations
Lecture 13: Conformational Sampling: MC and MD Dr. Ronald M. Levy Contributions from Mike Andrec and Daniel Weinstock Statistical Thermodynamics.
Advertisements

Heat flow in chains driven by noise Hans Fogedby Aarhus University and Niels Bohr Institute (collaboration with Alberto Imparato, Aarhus)
Monte Carlo Methods and Statistical Physics
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
Dynamics of Learning VQ and Neural Gas Aree Witoelar, Michael Biehl Mathematics and Computing Science University of Groningen, Netherlands in collaboration.
3) Vector Quantization (VQ) and Learning Vector Quantization (LVQ)
Lecture 14: Spin glasses Outline: the EA and SK models heuristic theory dynamics I: using random matrices dynamics II: using MSR.
Planning under Uncertainty
Violations of the fluctuation dissipation theorem in non-equilibrium systems.
Easy Optimization Problems, Relaxation, Local Processing for a single variable.
SES 2007 A Multiresolution Approach for Statistical Mobility Prediction of Unmanned Ground Vehicles 44 th Annual Technical Meeting of the Society of Engineering.
Breakdown of the adiabatic approximation in low-dimensional gapless systems Anatoli Polkovnikov, Boston University Vladimir Gritsev Harvard University.
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
Planning operation start times for the manufacture of capital products with uncertain processing times and resource constraints D.P. Song, Dr. C.Hicks.
. Expressive Graphical Models in Variational Approximations: Chain-Graphs and Hidden Variables Tal El-Hay & Nir Friedman School of Computer Science & Engineering.
Incomplete Graphical Models Nan Hu. Outline Motivation K-means clustering Coordinate Descending algorithm Density estimation EM on unconditional mixture.
Nino Boccara Highway Car Traffic as a Complex System The Physicist’s Point of view.
Minimum-Delay Load-Balancing Through Non-Parametric Regression F. Larroca and J.-L. Rougier IFIP/TC6 Networking 2009 Aachen, Germany, May 2009.
Absorbing Phase Transitions
Relating computational and physical complexity Computational complexity: How the number of computational steps needed to solve a problem scales with problem.
1 Mohammed M. Olama Seddik M. Djouadi ECE Department/University of Tennessee Ioannis G. PapageorgiouCharalambos D. Charalambous Ioannis G. Papageorgiou.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 7th~10th Belief propagation Appendix Kazuyuki Tanaka Graduate School of Information.
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
Lecture 11: Ising model Outline: equilibrium theory d = 1
F.F. Assaad. MPI-Stuttgart. Universität-Stuttgart Numerical approaches to the correlated electron problem: Quantum Monte Carlo.  The Monte.
Directed-Graph Epidemiological Models of Computer Viruses Presented by: (Kelvin) Weiguo Jin “… (we) adapt the techniques of mathematical epidemiology to.
Basic Monte Carlo (chapter 3) Algorithm Detailed Balance Other points.
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Learning a Small Mixture of Trees M. Pawan Kumar Daphne Koller Aim: To efficiently learn a.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Introduction to Lattice Simulations. Cellular Automata What are Cellular Automata or CA? A cellular automata is a discrete model used to study a range.
KTH/CSC March 10, 2010Erik Aurell, KTH & Aalto University1 Dynamic cavity method and marginals of non-equilibrium stationary states KITPC/ITP-CAS Program.
The Ising Model Mathematical Biology Lecture 5 James A. Glazier (Partially Based on Koonin and Meredith, Computational Physics, Chapter 8)
Daniel Ariosa Ecole Polytechnique Fédérale de Lausanne (EPFL) Institut de Physique de la Matière Complexe CH-1015 Lausanne, Switzerland and Hugo Fort Instituto.
Two Temperature Non-equilibrium Ising Model in 1D Nick Borchers.
自旋玻璃与消息传递算法 Spin Glass and Message-Passing Algorithms 周海军 中国科学院理论物理研究所.
Statistical Mechanics and Multi-Scale Simulation Methods ChBE
Serge Andrianov Theory of Symplectic Formalism for Spin-Orbit Tracking Institute for Nuclear Physics Forschungszentrum Juelich Saint-Petersburg State University,
Outline 1.Critical short-time dynamics ― hot start & cold start ― 2. Application to lattice gauge theory ― extract critical exponents ― 3. Summary Short-Time.
Study on synchronization of coupled oscillators using the Fokker-Planck equation H.Sakaguchi Kyushu University, Japan Fokker-Planck equation: important.
Introduction to Chaos by: Saeed Heidary 29 Feb 2013.
Tensor networks and the numerical study of quantum and classical systems on infinite lattices Román Orús School of Physical Sciences, The University of.
Dynamical Analysis of LVQ type algorithms, WSOM 2005 Dynamical analysis of LVQ type learning rules Rijksuniversiteit Groningen Mathematics and Computing.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 07: BAYESIAN ESTIMATION (Cont.) Objectives:
RIKEN Brain Science Institute
Workshop on Optimization in Complex Networks, CNLS, LANL (19-22 June 2006) Application of replica method to scale-free networks: Spectral density and spin-glass.
1 Mean Field and Variational Methods finishing off Graphical Models – Carlos Guestrin Carnegie Mellon University November 5 th, 2008 Readings: K&F:
Landau Theory Before we consider Landau’s expansion of the Helmholtz free Energy, F, in terms of an order parameter, let’s consider F derived from the.
KPS 2007 (April 19, 2007) On spectral density of scale-free networks Doochul Kim (Department of Physics and Astronomy, Seoul National University) Collaborators:
Information Geometry and Model Reduction Sorin Mitran 1 1 Department of Mathematics, University of North Carolina, Chapel Hill, NC, USA Reconstruction.
13. Extended Ensemble Methods. Slow Dynamics at First- Order Phase Transition At first-order phase transition, the longest time scale is controlled by.
Feedback Stabilization of Nonlinear Singularly Perturbed Systems MENG Bo JING Yuanwei SHEN Chao College of Information Science and Engineering, Northeastern.
Graduate School of Information Sciences, Tohoku University
Javier Junquera Importance sampling Monte Carlo. Cambridge University Press, Cambridge, 2002 ISBN Bibliography.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Discrete, Amorphous Physical Models Erik Rauch Digital Perspectives on Physics Workshop.
Network Science K. Borner A.Vespignani S. Wasserman.
Ginzburg-Landau theory of second-order phase transitions Vitaly L. Ginzburg Lev Landau Second order= no latent heat (ferromagnetism, superfluidity, superconductivity).
Basic Monte Carlo (chapter 3) Algorithm Detailed Balance Other points non-Boltzmann sampling.
Monte Carlo Simulation of Canonical Distribution The idea is to generate states i,j,… by a stochastic process such that the probability  (i) of state.
Computational Physics (Lecture 11) PHY4061. Variation quantum Monte Carlo the approximate solution of the Hamiltonian Time Independent many-body Schrodinger’s.
Computational Physics (Lecture 10) PHY4370. Simulation Details To simulate Ising models First step is to choose a lattice. For example, we can us SC,
Mean Field Methods for Computer and Communication Systems Jean-Yves Le Boudec EPFL Network Science Workshop Hong Kong July
Diffusion over potential barriers with colored noise
Computational Physics (Lecture 10)
Statistical-Mechanical Approach to Probabilistic Image Processing -- Loopy Belief Propagation and Advanced Mean-Field Method -- Kazuyuki Tanaka and Noriko.
Energy dissipation and FDR violation
Lecture 17: Kinetics and Markov State Models
Boltzmann Machine (BM) (§6.4)
Presentation transcript:

Dynamical Replica Theory for Dilute Spin Systems Jon Hatchett RIKEN BSI In collaboration with I. Pérez Castillo, A. C. C. Coolen & N. S. Skantzos

Motivation Order parameter flow in physical systems Non-equilibrium phenomena Temperature cycling Slow relaxations Non-detailed balance systems Biological models Complex networks Analysis of algorithms

Model Details Locally tree-like structure Stochastic dynamics according to local field Parallel Sequential (Glauber, Metropolis) Langevin Ising or soft spins

Evolution of Observables Observables of interest e.g. Want evolution on finite times In general, e.g. depends on

Evolution of Probability State vector Linear equation for E.g. Master equation General set of observables with distribution Obtain Kramers-Moyal expansion for

Assumptions of DRT Retain Liouville term in KM expansion Exact if observables are well-chosen Deterministic evolution of order parameters Self-averaging observables at all times Expect this to be exact (for certain observables) Equipartitioning in the subshell average In general, this is an approximation

Probability Manifolds Manifold of distributions on dim S = 2^N - 1 Identify observables with coordinates M is an exponential family dim M = #observables

Geometry of S and M Two important coordinate systems for M Exponential family coordinates Mixture family coordinates Connected via Legendre transformation Geodesic for exponential family Geodesic for mixture family

What do Assumptions do? S M minimizes m - projection e-flat submanifold

What do Assumptions do? If then theory is exact E.g. at equilibrium For some sets of initial conditions For some simpler systems, observable sets This condition is not necessary for exactness Approximation is “best possible” Since is unknown, the KL divergence is not accessible

Glauber Dynamics Master equation Hamiltonian Evolution of observables

Glauber Dynamics Simple choice of observables (m,e) Find simple ODEs: is the distribution of local fields in a system with magnetisation and energy

Algorithm Given find conjugate fields Generally a challenging inverse problem Work on a given disorder instance Requires belief propagation to converge Given find field distribution Standard equilibrium problem Calculate and Solve odes via standard methods

Comparison with Simulations 3-regular spin glass (rs phase)

Comparison with Simulations Random ferromagnet (average connectivity 2)

Comparison with Simulations 3 regular spin glass, parallel update

Outlook Increase observable set Via intuition (programming problem) Using information geometry (theoretical problem) Examine ways to work in the ensemble Relevant to rsb schemes Many potential applications to specific models

Dynamical Replica Theory for Dilute Spin Systems Jon Hatchett RIKEN BSI In collaboration with I. Pérez Castillo, A. C. C. Coolen & N. S. Skantzos