Introduction to Belief Propagation and its Generalizations. Max Welling Donald Bren School of Information and Computer and Science University of California.

Slides:

Advertisements

Similar presentations

Mean-Field Theory and Its Applications In Computer Vision1 1.

Advertisements

Bayesian Belief Propagation

Scaling Up Graphical Model Inference

Linear Time Methods for Propagating Beliefs Min Convolution, Distance Transforms and Box Sums Daniel Huttenlocher Computer Science Department December,

Exact Inference. Inference Basic task for inference: – Compute a posterior distribution for some query variables given some observed evidence – Sum out.

Variational Methods for Graphical Models Micheal I. Jordan Zoubin Ghahramani Tommi S. Jaakkola Lawrence K. Saul Presented by: Afsaneh Shirazi.

Section 3: Appendix BP as an Optimization Algorithm 1.

Exact Inference in Bayes Nets

Junction Trees And Belief Propagation. Junction Trees: Motivation What if we want to compute all marginals, not just one? Doing variable elimination for.

Loopy Belief Propagation a summary. What is inference? Given: –Observabled variables Y –Hidden variables X –Some model of P(X,Y) We want to make some.

Convergent Message-Passing Algorithms for Inference over General Graphs with Convex Free Energies Tamir Hazan, Amnon Shashua School of Computer Science.

Introduction of Probabilistic Reasoning and Bayesian Networks

Belief Propagation by Jakob Metzler. Outline Motivation Pearl’s BP Algorithm Turbo Codes Generalized Belief Propagation Free Energies.

Markov Networks.

Belief Propagation on Markov Random Fields Aggeliki Tsoli.

CS774. Markov Random Field : Theory and Application Lecture 04 Kyomin Jung KAIST Sep

Bayesian network inference

1 Graphical Models in Data Assimilation Problems Alexander Ihler UC Irvine Collaborators: Sergey Kirshner Andrew Robertson Padhraic Smyth.

Learning Low-Level Vision William T. Freeman Egon C. Pasztor Owen T. Carmichael.

Conditional Random Fields

Genome evolution: a sequence-centric approach Lecture 6: Belief propagation.

Understanding Belief Propagation and its Applications Dan Yuan June 2004.

Belief Propagation Kai Ju Liu March 9, Statistical Problems Medicine Finance Internet Computer vision.

Today Logistic Regression Decision Trees Redux Graphical Models

Bayesian Networks Alan Ritter.

A Trainable Graph Combination Scheme for Belief Propagation Kai Ju Liu New York University.

Genome Evolution. Amos Tanay 2009 Genome evolution: Lecture 8: Belief propagation.

Machine Learning CUNY Graduate Center Lecture 21: Graphical Models.

24 November, 2011National Tsin Hua University, Taiwan1 Mathematical Structures of Belief Propagation Algorithms in Probabilistic Information Processing.

Computer vision: models, learning and inference

Some Surprises in the Theory of Generalized Belief Propagation Jonathan Yedidia Mitsubishi Electric Research Labs (MERL) Collaborators: Bill Freeman (MIT)

Undirected Models: Markov Networks David Page, Fall 2009 CS 731: Advanced Methods in Artificial Intelligence, with Biomedical Applications.

1 Structured Region Graphs: Morphing EP into GBP Max Welling Tom Minka Yee Whye Teh.

Physics Fluctuomatics / Applied Stochastic Process (Tohoku University) 1 Physical Fluctuomatics Applied Stochastic Process 9th Belief propagation Kazuyuki.

Markov Random Fields Probabilistic Models for Images

Belief Propagation Revisited Adnan Darwiche. Graphical Models Battery Age Alternator Fan Belt Battery Charge Delivered Battery Power Starter Radio LightsEngine.

Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 12th Bayesian network and belief propagation in statistical inference Kazuyuki Tanaka.

Readings: K&F: 11.3, 11.5 Yedidia et al. paper from the class website

Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 7th~10th Belief propagation Kazuyuki Tanaka Graduate School of Information Sciences,

Approximate Inference: Decomposition Methods with Applications to Computer Vision Kyomin Jung ( KAIST ) Joint work with Pushmeet Kohli (Microsoft Research)

1 Mean Field and Variational Methods finishing off Graphical Models – Carlos Guestrin Carnegie Mellon University November 5 th, 2008 Readings: K&F:

Belief Propagation and its Generalizations Shane Oldenburger.

Exact Inference in Bayes Nets. Notation U: set of nodes in a graph X i : random variable associated with node i π i : parents of node i Joint probability:

Pattern Recognition and Machine Learning

Daphne Koller Overview Conditional Probability Queries Probabilistic Graphical Models Inference.

Markov Networks: Theory and Applications Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208

Daphne Koller Overview Maximum a posteriori (MAP) Probabilistic Graphical Models Inference.

Bayesian Belief Propagation for Image Understanding David Rosenberg.

10 October, 2007 University of Glasgow 1 EM Algorithm with Markov Chain Monte Carlo Method for Bayesian Image Analysis Kazuyuki Tanaka Graduate School.

Free Energy Estimates of All-atom Protein Structures Using Generalized Belief Propagation Kamisetty H., Xing, E.P. and Langmead C.J. Raluca Gordan February.

Graduate School of Information Sciences, Tohoku University

Extending Expectation Propagation for Graphical Models

Graduate School of Information Sciences, Tohoku University, Japan

Prof. Adriana Kovashka University of Pittsburgh April 4, 2017

Markov Networks.

Generalized Belief Propagation

Graduate School of Information Sciences, Tohoku University

Graduate School of Information Sciences, Tohoku University

Physical Fluctuomatics 7th~10th Belief propagation

Expectation-Maximization & Belief Propagation

Graduate School of Information Sciences, Tohoku University

Extending Expectation Propagation for Graphical Models

Probabilistic image processing and Bayesian network

Readings: K&F: 11.3, 11.5 Yedidia et al. paper from the class website

Graduate School of Information Sciences, Tohoku University

Markov Networks.

Graduate School of Information Sciences, Tohoku University

Mean Field and Variational Methods Loopy Belief Propagation

Generalized Belief Propagation

Presentation transcript:

Introduction to Belief Propagation and its Generalizations. Max Welling Donald Bren School of Information and Computer and Science University of California Irvine

Graphical Models A ‘marriage’ between probability theory and graph theory Why probabilities? Reasoning with uncertainties, confidence levels Many processes are inherently ‘noisy’  robustness issues Why graphs? Provide necessary structure in large models: - Designing new probabilistic models. - Reading out (conditional) independencies. Inference & optimization: - Dynamical programming - Belief Propagation

Types of Graphical Model Undirected graph (Markov random field) Directed graph (Bayesian network) i j i Parents(i) factor graphs interactions variables

Example 1: Undirected Graph neighborhood information high information regions low information regions air or water ? ? ?

Undirected Graphs (cont’ed) Nodes encode hidden information (patch-identity). They receive local information from the image (brightness, color). Information is propagated though the graph over its edges. Edges encode ‘compatibility’ between nodes.

Example 2: Directed Graphs waranimals computers TOPICS … IraqitheMatlab

Why do we need it? Answer queries : -Given past purchases, in what genre books is a client interested? -Given a noisy image, what was the original image? Learning probabilistic models from examples ( expectation maximization, iterative scaling ) Optimization problems: min-cut, max-flow, Viterbi, … Inference in Graphical Models Example : P( = sea | image) ? Inference: Answer queries about unobserved random variables, given values of observed random variables. More general: compute their joint posterior distribution: learning inference

Approximate Inference Inference is computationally intractable for large graphs (with cycles). Approximate methods: Markov Chain Monte Carlo sampling. Mean field and more structured variational techniques. Belief Propagation algorithms.

Belief Propagation on trees i k k k k i j k k k M ki Compatibilities (interactions) external evidence message belief (approximate marginal probability)

Belief Propagation on loopy graphs i k k k k i j k k k M ki Compatibilities (interactions) external evidence message belief (approximate marginal probability)

Some facts about BP BP is exact on trees. If BP converges it has reached a local minimum of an objective function (the Bethe free energy Yedidia et.al ‘00, Heskes ’02 )  often good approximation If it converges, convergence is fast near the fixed point. Many exciting applications: - error correcting decoding (MacKay, Yedidia, McEliece, Frey) - vision (Freeman, Weiss) - bioinformatics (Weiss) - constraint satisfaction problems (Dechter) - game theory (Kearns) - …

BP Related Algorithms Convergent alternatives (Welling,Teh’02, Yuille’02, Heskes’03) Expectation Propagation (Minka’01) Convex alternatives (Wainwright’02, Wiegerinck,Heskes’02) Linear Response Propagation (Welling,Teh’02) Generalized Belief Propagation (Yedidia,Freeman,Weiss’01) Survey Propagation (Braunstein,Mezard,Weigt,Zecchina’03)

Generalized Belief Propagation Idea: To guess the distribution of one of your neighbors, you ask your other neighbors to guess your distribution. Opinions get combined multiplicatively. BP GBP

Marginal Consistency Solve inference problem separately on each “patch”, then stitch them together using “marginal consistency”.

Region Graphs (Yedidia, Freeman, Weiss ’02) C=1 C=… C=1 Region: collection of interactions & variables. Stitching together solutions on local clusters by enforcing “marginal consistency” on their intersections.