Functional Data Graphical Models Hongxiao Zhu Virginia Tech July 2, 2015 BIRS Workshop 1 (Joint work with Nate Strawn and David B. Dunson)

Slides:



Advertisements
Similar presentations
CS188: Computational Models of Human Behavior
Advertisements

CSE 473/573 Computer Vision and Image Processing (CVIP) Ifeoma Nwogu Lecture 27 – Overview of probability concepts 1.
Markov Networks Alan Ritter.
A Tutorial on Learning with Bayesian Networks
Graphical Models and Applications CNS/EE148 Instructors: M.Polito, P.Perona, R.McEliece TA: C. Fanti.
CS498-EA Reasoning in AI Lecture #15 Instructor: Eyal Amir Fall Semester 2011.
Graphical Models BRML Chapter 4 1. the zoo of graphical models Markov networks Belief networks Chain graphs (Belief and Markov ) Factor graphs =>they.
Lauritzen-Spiegelhalter Algorithm
The multi-layered organization of information in living systems
Dynamic Bayesian Networks (DBNs)
Gibbs Sampling Qianji Zheng Oct. 5th, 2010.
Introduction to Belief Propagation and its Generalizations. Max Welling Donald Bren School of Information and Computer and Science University of California.
EE462 MLCV Lecture Introduction of Graphical Models Markov Random Fields Segmentation Tae-Kyun Kim 1.
Introduction to probability theory and graphical models Translational Neuroimaging Seminar on Bayesian Inference Spring 2013 Jakob Heinzle Translational.
Overview of Inference Algorithms for Bayesian Networks Wei Sun, PhD Assistant Research Professor SEOR Dept. & C4I Center George Mason University, 2009.
1 Bayesian Image Modeling by Generalized Sparse Markov Random Fields and Loopy Belief Propagation Kazuyuki Tanaka GSIS, Tohoku University, Sendai, Japan.
From: Probabilistic Methods for Bioinformatics - With an Introduction to Bayesian Networks By: Rich Neapolitan.
Chapter 8-3 Markov Random Fields 1. Topics 1. Introduction 1. Undirected Graphical Models 2. Terminology 2. Conditional Independence 3. Factorization.
A Graphical Model For Simultaneous Partitioning And Labeling Philip Cowans & Martin Szummer AISTATS, Jan 2005 Cambridge.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
1 Graphical Models in Data Assimilation Problems Alexander Ihler UC Irvine Collaborators: Sergey Kirshner Andrew Robertson Padhraic Smyth.
A Graph-based Framework for Transmission of Correlated Sources over Multiuser Channels Suhan Choi May 2006.
Bayesian Networks Alan Ritter.
Computer vision: models, learning and inference Chapter 10 Graphical Models.
. Expressive Graphical Models in Variational Approximations: Chain-Graphs and Hidden Variables Tal El-Hay & Nir Friedman School of Computer Science & Engineering.
Latent Tree Models Part II: Definition and Properties
Aspects of Bayesian Inference and Statistical Disclosure Control in Python Duncan Smith Confidentiality and Privacy Group CCSR University of Manchester.
A Brief Introduction to Graphical Models
Probabilistic Graphical Models David Madigan Rutgers University
Bayesian Learning By Porchelvi Vijayakumar. Cognitive Science Current Problem: How do children learn and how do they get it right?
Probabilistic graphical models. Graphical models are a marriage between probability theory and graph theory (Michael Jordan, 1998) A compact representation.
EE462 MLCV Lecture (1.5 hours) Segmentation – Markov Random Fields Tae-Kyun Kim 1.
A Markov Random Field Model for Term Dependencies Donald Metzler W. Bruce Croft Present by Chia-Hao Lee.
Undirected Models: Markov Networks David Page, Fall 2009 CS 731: Advanced Methods in Artificial Intelligence, with Biomedical Applications.
第十讲 概率图模型导论 Chapter 10 Introduction to Probabilistic Graphical Models
Robust Functional Mixed Models for Spatially Correlated Functional Regression -- with Application to Event-Related Potentials for Nicotine-Addicted Individuals.
1 Inferring structure to make substantive conclusions: How does it work? Hypothesis testing approaches: Tests on deviances, possibly penalised (AIC/BIC,
Markov Random Fields Probabilistic Models for Images
10 December, 2008 CIMCA2008 (Vienna) 1 Statistical Inferences by Gaussian Markov Random Fields on Complex Networks Kazuyuki Tanaka, Takafumi Usui, Muneki.
1 Markov Random Fields with Efficient Approximations Yuri Boykov, Olga Veksler, Ramin Zabih Computer Science Department CORNELL UNIVERSITY.
Ch 8. Graphical Models Pattern Recognition and Machine Learning, C. M. Bishop, Revised by M.-O. Heo Summarized by J.W. Nam Biointelligence Laboratory,
CS774. Markov Random Field : Theory and Application Lecture 02
LAC group, 16/06/2011. So far...  Directed graphical models  Bayesian Networks Useful because both the structure and the parameters provide a natural.
An Introduction to Variational Methods for Graphical Models
INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN © The MIT Press, Lecture.
Approximate Inference: Decomposition Methods with Applications to Computer Vision Kyomin Jung ( KAIST ) Joint work with Pushmeet Kohli (Microsoft Research)
Tractable Inference for Complex Stochastic Processes X. Boyen & D. Koller Presented by Shiau Hong Lim Partially based on slides by Boyen & Koller at UAI.
Lecture 2: Statistical learning primer for biologists
1 Use graphs and not pure logic Variables represented by nodes and dependencies by edges. Common in our language: “threads of thoughts”, “lines of reasoning”,
Exact Inference in Bayes Nets. Notation U: set of nodes in a graph X i : random variable associated with node i π i : parents of node i Joint probability:
Maximum Entropy Model, Bayesian Networks, HMM, Markov Random Fields, (Hidden/Segmental) Conditional Random Fields.
Christopher M. Bishop, Pattern Recognition and Machine Learning 1.
Introduction on Graphic Models
Today Graphical Models Representing conditional dependence graphically
Bayesian Belief Propagation for Image Understanding David Rosenberg.
INTRODUCTION TO Machine Learning 2nd Edition
CHAPTER 16: Graphical Models
ICS 280 Learning in Graphical Models
Markov Random Fields with Efficient Approximations
The set  of all independence statements defined by (3
Markov Networks.
Finnish Case Study: Bayesian Network Modelling
Department of Computer Science University of York
Pattern Recognition and Image Analysis
Markov Networks.
General Gibbs Distribution
Markov Random Fields Presented by: Vladan Radosavljevic.
Graduate School of Information Sciences, Tohoku University
Network Inference Chris Holmes Oxford Centre for Gene Function, &,
Markov Networks.
Presentation transcript:

Functional Data Graphical Models Hongxiao Zhu Virginia Tech July 2, 2015 BIRS Workshop 1 (Joint work with Nate Strawn and David B. Dunson)

2 Graphical models. Graphical models for functional data -- a theoretical framework for Bayesian inference. Gaussian process graphical models. Simulation and EEG application. Outline

Graphical models Used to characterize complex systems in a structured, compact way. Model the dependence structures: 3 GenomicsSocial Networks Brain NetworksEconomics Networks

Graphical models 4

Graphical model theory A marriage between probability theory and graph theory (Jordan, 1999). Key idea is to factorize the joint distribution according to the structure of an underlying graph. In particular, there is a one-to-one map between “separation” and conditional independence: 5 P is a Markov distributi on.

Graphical models – some concepts A graph/subgraph is complete if all possible vertices are connected. Maximal complete subgraphs are called cliques. If C is complete and separate A and B, then C is a separator. The pair (A, B ) forms a decomposition of G. 6

7

Graphical models – some concepts 8

Graphical models – the Gaussian case 9 A special case of Hyper- Markov Law defined in Dawid and Lauritzen (93)

Graphical models for functional data Potential applications: 10 Neuroimaging Data ERP Senor Nodes EEG EEG Signals MRI/fMRI Brain Regions MRI 2D Slice

The Construction: Graphical models for multivariate functional data 11

Conditional independence between random functional object 12

Markov distribution of functional objects 13

Construct a Markov distribution 14 This is called a Markov combination of P1 and P2.

Construct a probability distribution with Markov property – Cont’d 15

A Bayesian Framework 16

Hyper Markov Laws 17

Hyper Markov Laws – a Gaussian process example 18

Hyper Markov Laws – a Gaussian process example (cont’d ) 19

Simulation See video.

An application to EEG data (at alpha-frequency band) 21 The posterior modes of alcoholic group (a) and control group (b), the edges with >0.5 difference i n marginal probabilities (c), the boxplots of the number of edges per node (d) and the total numbe r of edges (e), the boxplots of the number of asymmetric pairs per node (f) and the total number o f asymmetric pairs (g).

Reference Zhu, H., Strawn, N. and Dunson, D. B. Bayesian graphical models for multivariate functional data. (arXiv: ) M. I. Jordan, editor. Learning in Graphical Models. MIT Press, Dawid, A. P. and Lauritzen, S. L. (1993). Hyper Markov laws in the statistical analysis of decomposable graphical models. Ann. Statist. 21, 3, 1272– Contact: Hongxiao Zhu Department of Statistics, Virginia Tech 406-A Hutcheson Hall Blacksburg, VA United States