Physical Fluctuomatics 13th Quantum-mechanical extensions of probabilistic information processing Kazuyuki Tanaka Graduate School of Information Sciences,

Slides:



Advertisements
Similar presentations
Xkcd Xkcd.com. Section 3 Recap ► Angular momentum commutators:  [J x, J y ] = iħJ z etc ► Total ang. Mom. Operator: J 2 = J x 2 + J y 2 +J z 2 ► Ladder.
Advertisements

3 March, 2003University of Glasgow1 Statistical-Mechanical Approach to Probabilistic Inference --- Cluster Variation Method and Generalized Loopy Belief.
Graduate School of Information Sciences, Tohoku University
1 Bayesian Image Modeling by Generalized Sparse Markov Random Fields and Loopy Belief Propagation Kazuyuki Tanaka GSIS, Tohoku University, Sendai, Japan.
Conditional Random Fields
Belief Propagation Kai Ju Liu March 9, Statistical Problems Medicine Finance Internet Computer vision.
Quantum Mechanics from Classical Statistics. what is an atom ? quantum mechanics : isolated object quantum mechanics : isolated object quantum field theory.
24 November, 2011National Tsin Hua University, Taiwan1 Mathematical Structures of Belief Propagation Algorithms in Probabilistic Information Processing.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 2nd Mathematical Preparations (1): Probability and statistics Kazuyuki Tanaka Graduate.
1 物理フラクチュオマティクス論 Physical Fluctuomatics 応用確率過程論 Applied Stochastic Process 第 5 回グラフィカルモデルによる確率的情報処理 5th Probabilistic information processing by means of.
Physics Fluctuomatics / Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 7th “More is different” and.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 7th~10th Belief propagation Appendix Kazuyuki Tanaka Graduate School of Information.
1 October, 2007 ALT&DS2007 (Sendai, Japan ) 1 Introduction to Probabilistic Image Processing and Bayesian Networks Kazuyuki Tanaka Graduate School of Information.
1 Physical Fluctuomatics 5th and 6th Probabilistic information processing by Gaussian graphical model Kazuyuki Tanaka Graduate School of Information Sciences,
3 September, 2009 SSP2009, Cardiff, UK 1 Probabilistic Image Processing by Extended Gauss-Markov Random Fields Kazuyuki Tanaka Kazuyuki Tanaka, Muneki.
Physics Fluctuomatics / Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 2nd Probability and its fundamental.
Physics Fluctuomatics / Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 9th Belief propagation Kazuyuki.
28 February, 2003University of Glasgow1 Cluster Variation Method and Probabilistic Image Processing -- Loopy Belief Propagation -- Kazuyuki Tanaka Graduate.
Physical Fuctuomatics (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 1st Review of probabilistic information processing Kazuyuki.
10 December, 2008 CIMCA2008 (Vienna) 1 Statistical Inferences by Gaussian Markov Random Fields on Complex Networks Kazuyuki Tanaka, Takafumi Usui, Muneki.
September 2007 IW-SMI2007, Kyoto 1 A Quantum-Statistical-Mechanical Extension of Gaussian Mixture Model Kazuyuki Tanaka Graduate School of Information.
Tokyo Institute of Technology, Japan Yu Nishiyama and Sumio Watanabe Theoretical Analysis of Accuracy of Gaussian Belief Propagation.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 12th Bayesian network and belief propagation in statistical inference Kazuyuki Tanaka.
14 October, 2010LRI Seminar 2010 (Univ. Paris-Sud)1 Statistical performance analysis by loopy belief propagation in probabilistic image processing Kazuyuki.
29 December, 2008 National Tsing Hua University, Taiwan 1 Introduction to Probabilistic Image Processing and Bayesian Networks Kazuyuki Tanaka Graduate.
Physics Fluctuomatics/Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 3rd Random variable, probability.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 7th~10th Belief propagation Kazuyuki Tanaka Graduate School of Information Sciences,
Phisical Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 4th Maximum likelihood estimation and EM algorithm Kazuyuki Tanaka Graduate School.
THE MATHEMATICS ENGINEERS USE EVERYDAY IN INDUSTRY W.G. STEENKEN GE AVIATION OHIO MATHEMATICS AND SCIENCE COALITION NOVEMBER 19, 2015.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 3rd Random variable, probability distribution and probability density function Kazuyuki.
Physical Fuctuomatics (Tohoku University) 1 Physical Fluctuomatics 1st Review of probabilistic information processing Kazuyuki Tanaka Graduate School of.
PHY 520 Introduction Christopher Crawford
Graduate School of Information Sciences, Tohoku University
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 2nd Probability and its fundamental properties Kazuyuki Tanaka Graduate School of Information.
Physical Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 13th Quantum-mechanical extensions of probabilistic information processing Kazuyuki.
30 November, 2005 CIMCA2005, Vienna 1 Statistical Learning Procedure in Loopy Belief Propagation for Probabilistic Image Processing Kazuyuki Tanaka Graduate.
ICPR2004 (24 July, 2004, Cambridge) 1 Probabilistic image processing based on the Q-Ising model by means of the mean- field method and loopy belief propagation.
10 October, 2007 University of Glasgow 1 EM Algorithm with Markov Chain Monte Carlo Method for Bayesian Image Analysis Kazuyuki Tanaka Graduate School.
Graduate School of Information Sciences, Tohoku University
マルコフ確率場の統計的機械学習の数理と データサイエンスへの展開 Statistical Machine Learning in Markov Random Field and Expansion to Data Sciences 田中和之 東北大学大学院情報科学研究科 Kazuyuki Tanaka.
Statistical-Mechanical Approach to Probabilistic Image Processing -- Loopy Belief Propagation and Advanced Mean-Field Method -- Kazuyuki Tanaka and Noriko.
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University
Sublinear Computational Time Modeling in Statistical Machine Learning Theory for Markov Random Fields Kazuyuki Tanaka GSIS, Tohoku University, Sendai,
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University, Japan
10. Quantum Monte Carlo Methods
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences Tohoku University, Japan
量子情報処理にむけての クラスター変分法と確率伝搬法の定式化
Graduate School of Information Sciences, Tohoku University
一般化された確率伝搬法の数学的構造 東北大学大学院情報科学研究科 田中和之
Cluster Variation Method for Correlation Function of Probabilistic Model with Loopy Graphical Structure Kazuyuki Tanaka Graduate School of Information.
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences
Physical Fluctuomatics 7th~10th Belief propagation
Expectation-Maximization & Belief Propagation
Graduate School of Information Sciences, Tohoku University
Advanced Mean Field Methods in Quantum Probabilistic Inference
Probabilistic image processing and Bayesian network
Probabilistic image processing and Bayesian network
Graduate School of Information Sciences, Tohoku University
Cluster Variation Method for Correlation Function of Probabilistic Model with Loopy Graphical Structure Kazuyuki Tanaka Graduate School of Information.
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University
Graduate School of Information Sciences, Tohoku University
Kazuyuki Tanaka Graduate School of Information Sciences
Presentation transcript:

Physical Fluctuomatics 13th Quantum-mechanical extensions of probabilistic information processing Kazuyuki Tanaka Graduate School of Information Sciences, Tohoku University kazu@smapip.is.tohoku.ac.jp http://www.smapip.is.tohoku.ac.jp/~kazu/ Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Contents Introduction Quantum System and Density Matrix Transformation between Density Matrix and Probability Distribution by using Suzuki-Trotter Formula Quantum Belief Propagation Summary Physical Fluctuomatics (Tohoku University)

Probability Distribution and Density Matrix Probability Distribution: 2N-tuple summation Density Matrix: Diagonalization of 2N× 2N Matrix Physical Fluctuomatics (Tohoku University)

Mathematical Framework of Probabilistic Information Processing Such computations are difficult in quantum systems. For any matrices A and B, it is not always valid that Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Contents Introduction Quantum System and Density Matrix Transformation between Density Matrix and Probability Distribution by using Suzuki-Trotter Formula Quantum Belief Propagation Summary Physical Fluctuomatics (Tohoku University)

Quantum State of One Node All the possible states in classical Systems are two as follows: 1 1 Two vectors in two-dimensional space Physical Fluctuomatics (Tohoku University)

Quantum State of One Node Classical States are expressed in terms of two position vectors Quantum states are expressed in terms of any position vectors on unit circle. Quantum states are expressed in terms of superpositions of two classical states. 1 1 The coefficients can take complex numbers as well as real numbers. Physical Fluctuomatics (Tohoku University)

Probability Distribution Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Density Matrix Physical Fluctuomatics (Tohoku University)

Quantum State of One Node and Pauli Spin Matrices Physical Fluctuomatics (Tohoku University)

Quantum State of One Node and Pauli Spin Matrices Physical Fluctuomatics (Tohoku University)

Quantum State of One Node and Pauli Spin Matrices Physical Fluctuomatics (Tohoku University)

Quantum State of Two Nodes 1 2 Physical Fluctuomatics (Tohoku University)

Transition Matrix of Two Nodes 1 2 Inner Product of same states provides a diagonal element. Inner Product of different states provides an off-diagonal element. Physical Fluctuomatics (Tohoku University)

Hamiltonian and Density Matrix 1 2 Hamiltonian Density Matrix Physical Fluctuomatics (Tohoku University)

Density Matrix and Probability Distribution Probability Distribution P(x1,x2) 1 2 H is a diagonal matrix and each diagonal element is defined by ln P(x1,x2) Physical Fluctuomatics (Tohoku University)

Computation of Density Matrix 1 2 Statistical quantities of the density matrix can be calculated by diagonalising the Hamiltonian H. Physical Fluctuomatics (Tohoku University)

Probability Distribution and Density Matrix 1 2 Each state and it corresponding probability Classical State Quantum State Physical Fluctuomatics (Tohoku University)

Marginal Probability Distribution and Reduced Density Matrix Sum of random variables of all the nodes except the node i Reduced Density Matrix Partial trace for the freedom of all the nodes except the node i Physical Fluctuomatics (Tohoku University)

Reduced Density Matrix 1 2 Partial trace under fixed state at node 1 Physical Fluctuomatics (Tohoku University)

Reduced Density Matrix 1 2 Partial trace under fixed state at node 2 Physical Fluctuomatics (Tohoku University)

Quantum Heisenberg Model with Two Nodes 1 2 Physical Fluctuomatics (Tohoku University)

Quantum Heisenberg Model with Two Nodes 1 2 Physical Fluctuomatics (Tohoku University)

Eigen States of Quantum Heisenberg Model with Two Nodes 1 2 Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Computation of Density Matrix of Quantum Heisenberg Model with Two Nodes 1 2 Physical Fluctuomatics (Tohoku University)

Representationon of Ising Model with Two Nodes by Density Matrix 1 2 Probability Distribution of Ising Model Density Matrix Diagonal Elements correspond to Probability Distribution of Ising Model. Physical Fluctuomatics (Tohoku University)

Transverse Ising Model Density Matrix 1 2 Physical Fluctuomatics (Tohoku University)

Density Matrix of Three Nodes 1 2 3 = 1 2 3 + 1 2 3 23x23 Matrix Physical Fluctuomatics (Tohoku University)

Density Matrix of Three Nodes 1 2 3 Physical Fluctuomatics (Tohoku University)

Density Matrix of Three Nodes 1 2 3 Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Contents Introduction Quantum System and Density Matrix Transformation between Density Matrix and Probability Distribution by using Suzuki-Trotter Formula Quantum Belief Propagation Summary Physical Fluctuomatics (Tohoku University)

Difficulty of Quantum Systems Addition and Subtraction Formula of Exponential Function is not always valid. Physical Fluctuomatics (Tohoku University)

Suzuki-Trotter Formula n: Trotter number Physical Fluctuomatics (Tohoku University)

Suzuki-Trotter Formula n: Trotter number Probability Distribution Σ ST Formula Density Matrix Physical Fluctuomatics (Tohoku University)

Suzuki-Trotter Formula Quantum System on Chain Graph with Three Nodes Statistical quantities can be computed by using belief propagation of graphical model on 3×n ladder graph Probability Distribution Σ ST Formula Density Matrix Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Contents Introduction Quantum System and Density Matrix Transformation between Density Matrix and Probability Distribution by using Suzuki-Trotter Formula Quantum Belief Propagation Summary Physical Fluctuomatics (Tohoku University)

Density Matrix and Reduced Density Matrix 4 2 3 1 5 6 7 8 9 H{i,j} is a 29×29 matrix. Physical Fluctuomatics (Tohoku University)

Density Matrix and Reduced Density Matrix Reducibility Condition Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Approximate Expressions of Reduced Density Matrices in Quantum Belief Propagation i i j i j i j Physical Fluctuomatics (Tohoku University)

Message Passing Rule of Quantum Belief Propagation j i Output Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Contents Introduction Quantum System and Density Matrix Transformation between Density Matrix and Probability Distribution by using Suzuki-Trotter Formula Quantum Belief Propagation Summary Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) Summary Probability Distribution and Density Matrix Reduced Density Matrix Quantum Heisenberg Model Suzuki Trotter Formula Quantum Belief Propagation Physical Fluctuomatics (Tohoku University)

Physical Fluctuomatics (Tohoku University) My works of Information Processing by using in Quantum Probabilistic Model and Quantum Belief Propagation K. Tanaka and T. Horiguchi: Quantum Statistical-Mechanical Iterative Method in Image Restoration, IEICE Transactions (A), vol.J80-A, no.12, pp.2117-2126, December 1997 (in Japanese); translated in Electronics and Communications in Japan, Part 3: Fundamental Electronic Science, vol.83, no.3, pp.84-94, March 2000. K. Tanaka: Image Restorations by using Compound Gauss-Markov Random Field Model with Quantized Line Fields, IEICE Transactions (D-II), vol.J84-D-II, no.4, pp.737-743, April 2001 (in Japanese); see also Section 5.2 in K. Tanaka, Journal of Physics A: Mathematical and General, vol.35, no.37 , pp.R81-R150, September 2002. K. Tanaka: Mathematical Structures of Loopy Belief Propagation and Cluster Variation Method, Journal of Physics: Conference Series, vol.143, article no.012023, pp.1-18, January 2009 Physical Fluctuomatics (Tohoku University)