Tractable MAP Problems

Slides:



Advertisements
Similar presentations
POSE–CUT Simultaneous Segmentation and 3D Pose Estimation of Humans using Dynamic Graph Cuts Mathieu Bray Pushmeet Kohli Philip H.S. Torr Department of.
Advertisements

Mean-Field Theory and Its Applications In Computer Vision1 1.
Bayesian Belief Propagation
O BJ C UT M. Pawan Kumar Philip Torr Andrew Zisserman UNIVERSITY OF OXFORD.
Multi-view Stereo via Volumetric Graph-cuts
Indexing DNA Sequences Using q-Grams
Lauritzen-Spiegelhalter Algorithm
GATE Reconstruction from Point Cloud (GATE-540) Dr.Çağatay ÜNDEĞER Instructor Middle East Technical University, GameTechnologies & General Manager.
Constrained Approximate Maximum Entropy Learning (CAMEL) Varun Ganapathi, David Vickrey, John Duchi, Daphne Koller Stanford University TexPoint fonts used.
Introduction to Markov Random Fields and Graph Cuts Simon Prince
EE462 MLCV Lecture Introduction of Graphical Models Markov Random Fields Segmentation Tae-Kyun Kim 1.
Graph-Based Image Segmentation
1 s-t Graph Cuts for Binary Energy Minimization  Now that we have an energy function, the big question is how do we minimize it? n Exhaustive search is.
Discrete-Continuous Optimization for Large-scale Structure from Motion David Crandall, Andrew Owens, Noah Snavely, Dan Huttenlocher Presented by: Rahul.
Rob Fergus Courant Institute of Mathematical Sciences New York University A Variational Approach to Blind Image Deconvolution.
Distributed Message Passing for Large Scale Graphical Models Alexander Schwing Tamir Hazan Marc Pollefeys Raquel Urtasun CVPR2011.
1 Structure from Motion with Unknown Correspondence (aka: How to combine EM, MCMC, Nonlinear LS!) Frank Dellaert, Steve Seitz, Chuck Thorpe, and Sebastian.
P 3 & Beyond Solving Energies with Higher Order Cliques Pushmeet Kohli Pawan Kumar Philip H. S. Torr Oxford Brookes University CVPR 2007.
2010/5/171 Overview of graph cuts. 2010/5/172 Outline Introduction S-t Graph cuts Extension to multi-label problems Compare simulated annealing and alpha-
Multi-view stereo Many slides adapted from S. Seitz.
MRF Labeling With Graph Cut CMPUT 615 Nilanjan Ray.
The plan for today Camera matrix
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Graph Cut based Inference with Co-occurrence Statistics Ľubor Ladický, Chris Russell, Pushmeet Kohli, Philip Torr.
What Energy Functions Can be Minimized Using Graph Cuts? Shai Bagon Advanced Topics in Computer Vision June 2010.
Lecture 19: Optical flow CS6670: Computer Vision Noah Snavely
Hierarchical Graph Cuts for Semi-Metric Labeling M. Pawan Kumar Joint work with Daphne Koller.
Measuring Uncertainty in Graph Cut Solutions Pushmeet Kohli Philip H.S. Torr Department of Computing Oxford Brookes University.
Computer vision: models, learning and inference
Extensions of submodularity and their application in computer vision
Manhattan-world Stereo Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.
A Pattern Matching Method for Finding Noun and Proper Noun Translations from Noisy Parallel Corpora Benjamin Arai Computer Science and Engineering Department.
Reconstructing Relief Surfaces George Vogiatzis, Philip Torr, Steven Seitz and Roberto Cipolla BMVC 2004.
Minimizing Sparse Higher Order Energy Functions of Discrete Variables (CVPR’09) Namju Kwak Applied Algorithm Lab. Computer Science Department KAIST 1Namju.
Graph Cut Algorithms for Binocular Stereo with Occlusions
CS774. Markov Random Field : Theory and Application Lecture 13 Kyomin Jung KAIST Oct
Computer Vision, Robert Pless
Probabilistic Inference Lecture 5 M. Pawan Kumar Slides available online
Functions Section 1.4. Relation The value of one variable is related to the value of a second variable A correspondence between two sets If x and y are.
Graphical Models over Multiple Strings Markus Dreyer and Jason Eisner Dept. of Computer Science, Johns Hopkins University EMNLP 2009 Presented by Ji Zongcheng.
Daphne Koller Message Passing Belief Propagation Algorithm Probabilistic Graphical Models Inference.
Approximate Inference: Decomposition Methods with Applications to Computer Vision Kyomin Jung ( KAIST ) Joint work with Pushmeet Kohli (Microsoft Research)
Tractable Higher Order Models in Computer Vision (Part II) Slides from Carsten Rother, Sebastian Nowozin, Pusohmeet Khli Microsoft Research Cambridge Presented.
Probabilistic Graphical Models seminar 15/16 ( ) Haim Kaplan Tel Aviv University.
Using Combinatorial Optimization within Max-Product Belief Propagation
KNN & Naïve Bayes Hongning Wang Today’s lecture Instance-based classifiers – k nearest neighbors – Non-parametric learning algorithm Model-based.
Daphne Koller Overview Maximum a posteriori (MAP) Probabilistic Graphical Models Inference.
Photoconsistency constraint C2 q C1 p l = 2 l = 3 Depth labels If this 3D point is visible in both cameras, pixels p and q should have similar intensities.
Markov Random Fields in Vision
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
Energy functions f(p)  {0,1} : Ising model Can solve fast with graph cuts V( ,  ) = T[  ] : Potts model NP-hard Closely related to Multiway Cut Problem.
Image segmentation.
Real-Time Hierarchical Scene Segmentation and Classification Andre Uckermann, Christof Elbrechter, Robert Haschke and Helge Ritter John Grossmann.
KNN & Naïve Bayes Hongning Wang
MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4. MRFs (X1,X2) X3 X1 X2 4 (X2,X3,X3) X4.
Spectral Methods for Dimensionality
Computer vision: models, learning and inference
Learning a Region-based Scene Segmentation Model
Summary of “Efficient Deep Learning for Stereo Matching”
Semi-Global Stereo Matching with Surface Orientation Priors
Probabilistic Data Management
Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 18
Efficient Graph Cut Optimization for Full CRFs with Quantized Edges
Binocular Stereo Vision
Pattern Recognition and Image Analysis
Complexity Analysis Variable Elimination Inference Probabilistic
Minimum Spanning Tree Name\Tareq Babaqi.
“Traditional” image segmentation
Motivation State-of-the-art two-stage instance segmentation methods depend heavily on feature localization to produce masks.
Presentation transcript:

Tractable MAP Problems Inference Probabilistic Graphical Models MAP Tractable MAP Problems

Correspondence /data association Xij = 1 if i matched to j 0 otherwise ij = quality of “match” between i and j Find highest scoring matching maximize ij ij Xij subject to mutual exclusion constraint Easily solved using matching algorithms Many applications matching sensor readings to objects matching features in two related images matching mentions in text to entities

Snavely, Seitz, Szeliski

Word Alignment for Translation Wikipedia

Associative potentials Arbitrary network over binary variables using only singleton i and supermodular pairwise potentials ij Exact solution using algorithms for finding minimum cuts in graphs Many related variants admit efficient exact or approximate solutions Metric MRFs 1 a b c d

Example: Depth Reconstruction Scharstein & Szeliski Example: Depth Reconstruction negative score running time

A B C D score 1 Cardinality Factors A factor over arbitrarily many binary variables X1, …,Xk Score(X1, …,Xk) = f(iXi) Example applications: soft parity constraints prior on # pixels in a given category prior on # of instances assigned to a given cluster

Sparse Pattern Factors B C D score 1 Sparse Pattern Factors A factor over variables X1,…,Xk Score(X1, …,Xk) specified for some small # of assignments x1,…,xk Constant for all other assignments Examples: give higher score to combinations that occur in real data In spelling, letter combinations that occur in dictionary 55 image patches that appear in natural images

Convexity Factors Ordered binary variables X1,…,Xk Convexity constraints Examples: Convexity of “parts” in image segmentation Contiguity of word labeling in text Temporal contiguity of subactivities

Summary Many specialized models admit tractable MAP solution Many do not have tractable algorithms for computing marginals These specialized models are useful On their own As a component in a larger model with other types of factors

END END END