Independence in Markov Networks

Slides:



Advertisements
Similar presentations
Markov Networks Alan Ritter.
Advertisements

Graphical Models BRML Chapter 4 1. the zoo of graphical models Markov networks Belief networks Chain graphs (Belief and Markov ) Factor graphs =>they.
Bayes Networks Markov Networks Noah Berlow. Bayesian -> Markov (Section 4.5.1) Given B, How can we turn into Markov Network? The general idea: – Convert.
Identifying Conditional Independencies in Bayes Nets Lecture 4.
Bayesian Networks. Contents Semantics and factorization Reasoning Patterns Flow of Probabilistic Influence.
EE462 MLCV Lecture Introduction of Graphical Models Markov Random Fields Segmentation Tae-Kyun Kim 1.
Quantum Hammersley-Clifford Theorem Winton Brown CRM-Workshop on quantum information in Quantum many body physics 2011.
Chapter 8-3 Markov Random Fields 1. Topics 1. Introduction 1. Undirected Graphical Models 2. Terminology 2. Conditional Independence 3. Factorization.
PGM 2003/04 Tirgul 3-4 The Bayesian Network Representation.
Bayesian Network Representation Continued
Graphical Models Lei Tang. Review of Graphical Models Directed Graph (DAG, Bayesian Network, Belief Network) Typically used to represent causal relationship.
A probabilistic approach to semantic representation Paper by Thomas L. Griffiths and Mark Steyvers.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
. DAGs, I-Maps, Factorization, d-Separation, Minimal I-Maps, Bayesian Networks Slides by Nir Friedman.
Basic Definitions Positive Matrix: 5.Non-negative Matrix:
EE462 MLCV Lecture (1.5 hours) Segmentation – Markov Random Fields Tae-Kyun Kim 1.
Daphne Koller Variable Elimination Graph-Based Perspective Probabilistic Graphical Models Inference.
Physics Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 12th Bayesian network and belief propagation in statistical inference Kazuyuki Tanaka.
1 Bayesian Networks (Directed Acyclic Graphical Models) The situation of a bell that rings whenever the outcome of two coins are equal can not be well.
Dependency Networks for Collaborative Filtering and Data Visualization UAI-2000 발표 : 황규백.
1 Use graphs and not pure logic Variables represented by nodes and dependencies by edges. Common in our language: “threads of thoughts”, “lines of reasoning”,
1 BN Semantics 2 – The revenge of d-separation Graphical Models – Carlos Guestrin Carnegie Mellon University September 20 th, 2006 Readings: K&F:
Christopher M. Bishop, Pattern Recognition and Machine Learning 1.
Daphne Koller Markov Networks General Gibbs Distribution Probabilistic Graphical Models Representation.
Daphne Koller Wrapup BNs vs MNs Probabilistic Graphical Models Representation.
1 BN Semantics 2 – Representation Theorem The revenge of d-separation Graphical Models – Carlos Guestrin Carnegie Mellon University September 17.
1 BN Semantics 1 Graphical Models – Carlos Guestrin Carnegie Mellon University September 15 th, 2006 Readings: K&F: 3.1, 3.2, 3.3.
Daphne Koller Independencies Bayesian Networks Probabilistic Graphical Models Representation.
Graduate School of Information Sciences, Tohoku University
CHAPTER 16: Graphical Models
The set  of all independence statements defined by (3
Conditional Random Fields
Bayesian Networks (Directed Acyclic Graphical Models)
Markov Networks.
Dependency Models – abstraction of Probability distributions
General Gibbs Distribution
Independence in Markov Networks
Markov Networks Independencies Representation Probabilistic Graphical
General Gibbs Distribution
Complexity Analysis Variable Elimination Inference Probabilistic
Clique Tree & Independence
Bayesian Networks Independencies Representation Probabilistic
Markov Networks.
Pairwise Markov Networks
General Gibbs Distribution
Markov Random Fields Presented by: Vladan Radosavljevic.
I-equivalence Bayesian Networks Representation Probabilistic Graphical
Graduate School of Information Sciences, Tohoku University
Readings: K&F: 5.1, 5.2, 5.3, 5.4, 5.5, 5.6, 5.7 Markov networks, Factor graphs, and an unified view Start approximate inference If we are lucky… Graphical.
Conditional Random Fields
Probabilistic Influence & d-separation
Factorization & Independence
Factorization & Independence
I-maps and perfect maps
Conditional Random Fields
BN Semantics 3 – Now it’s personal! Parameter Learning 1
Markov Networks Independencies Representation Probabilistic Graphical
I-maps and perfect maps
Junction Trees 3 Undirected Graphical Models
Tree-structured CPDs Local Structure Representation Probabilistic
Representation Probabilistic Graphical Models Local Structure Overview.
Independence in Markov Networks
Markov Networks Independencies Representation Probabilistic Graphical
Flow of Probabilistic Influence
Pairwise Markov Networks
Graduate School of Information Sciences, Tohoku University
Markov Networks.
Graduate School of Information Sciences, Tohoku University
BN Semantics 2 – The revenge of d-separation
Exponential Functions and their Graphs
Presentation transcript:

Independence in Markov Networks Representation Probabilistic Graphical Models Markov Networks Independence in Markov Networks

Influence Flow in Undirected Graph

Separation in Undirected Graph A trail X1—X2—… —Xk-1—Xk is active given Z X and Y are separated in H given Z if

Independences in Undirected Graph The independences implied by H I(H) = We say that H is an I-map (independence map) of P if Define I(G)

Factorization P factorizes over H

Factorization  Independence Theorem: If P factorizes over H then H is an I-map for P

B D C A E

Independence  Factorization Theorem: If H is an I-map for P then P factorizes over H

Independence  Factorization Hammersley-Clifford Theorem: If H is an I-map for P, and P is positive, then P factorizes over H

Summary Separation in Markov network H allows us to “read off” independence properties that hold in any Gibbs distribution that factorizes over H Although the same graph can correspond to different factorizations, they have the same independence properties