Update any set S of nodes simultaneously with step-size We show fixed point update is monotone for · 1/|S| Covering Trees and Lower-bounds on Quadratic.

Slides:



Advertisements
Similar presentations
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London Tutorial at GDR (Optimisation Discrète, Graph Cuts.
Advertisements

1 LP, extended maxflow, TRW OR: How to understand Vladimirs most recent work Ramin Zabih Cornell University.
Solving Markov Random Fields using Second Order Cone Programming Relaxations M. Pawan Kumar Philip Torr Andrew Zisserman.
HOPS: Efficient Region Labeling using Higher Order Proxy Neighborhoods Albert Y. C. Chen 1, Jason J. Corso 1, and Le Wang 2 1 Dept. of Computer Science.
Doc.: IEEE /1387r0 Submission Nov Yan Zhang, et. Al.Slide 1 HEW channel modeling for system level simulation Date: Authors:
O(N 1.5 ) divide-and-conquer technique for Minimum Spanning Tree problem Step 1: Divide the graph into  N sub-graph by clustering. Step 2: Solve each.
Join-graph based cost-shifting Alexander Ihler, Natalia Flerova, Rina Dechter and Lars Otten University of California Irvine Introduction Mini-Bucket Elimination.
ROTAMER OPTIMIZATION FOR PROTEIN DESIGN THROUGH MAP ESTIMATION AND PROBLEM-SIZE REDUCTION Hong, Lippow, Tidor, Lozano-Perez. JCC Presented by Kyle.
An Introduction of Support Vector Machine
ICCV 2007 tutorial Part III Message-passing algorithms for energy minimization Vladimir Kolmogorov University College London.
Scenario Trees and Metaheuristics for Stochastic Inventory Routing Problems DOMinant Workshop, Molde, Norway, September , 2009 Lars Magnus Hvattum.
Convergent Message-Passing Algorithms for Inference over General Graphs with Convex Free Energies Tamir Hazan, Amnon Shashua School of Computer Science.
1 Fast Primal-Dual Strategies for MRF Optimization (Fast PD) Robot Perception Lab Taha Hamedani Aug 2014.
F IXING M AX -P RODUCT : A U NIFIED L OOK AT M ESSAGE P ASSING A LGORITHMS Nicholas Ruozzi and Sekhar Tatikonda Yale University.
Learning to Detect A Salient Object Reporter: 鄭綱 (3/2)
Distributed Message Passing for Large Scale Graphical Models Alexander Schwing Tamir Hazan Marc Pollefeys Raquel Urtasun CVPR2011.
Nonrigid Shape Correspondence using Landmark Sliding, Insertion, and Deletion Theodor Richardson.
1Ellen L. Walker Segmentation Separating “content” from background Separating image into parts corresponding to “real” objects Complete segmentation Each.
Convergent and Correct Message Passing Algorithms Nicholas Ruozzi and Sekhar Tatikonda Yale University TexPoint fonts used in EMF. Read the TexPoint manual.
Abstract We present a model of curvilinear grouping using piecewise linear representations of contours and a conditional random field to capture continuity.
Support Vector Machines Formulation  Solve the quadratic program for some : min s. t.,, denotes where or membership.  Different error functions and measures.
Message Passing Algorithms for Optimization
Efficiently Solving Convex Relaxations M. Pawan Kumar University of Oxford for MAP Estimation Philip Torr Oxford Brookes University.
Graph Cut based Inference with Co-occurrence Statistics Ľubor Ladický, Chris Russell, Pushmeet Kohli, Philip Torr.
Today Logistic Regression Decision Trees Redux Graphical Models
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.
Cue Integration in Figure/Ground Labeling Xiaofeng Ren, Charless Fowlkes and Jitendra Malik, U.C. Berkeley We present a model of edge and region grouping.
The Role of Specialization in LDPC Codes Jeremy Thorpe Pizza Meeting Talk 2/12/03.
MAP Estimation Algorithms in M. Pawan Kumar, University of Oxford Pushmeet Kohli, Microsoft Research Computer Vision - Part I.
1 IEEE Trans. on Smart Grid, 3(1), pp , Optimal Power Allocation Under Communication Network Externalities --M.G. Kallitsis, G. Michailidis.
CS774. Markov Random Field : Theory and Application Lecture 08 Kyomin Jung KAIST Sep
Shape-Based Human Detection and Segmentation via Hierarchical Part- Template Matching Zhe Lin, Member, IEEE Larry S. Davis, Fellow, IEEE IEEE TRANSACTIONS.
Planar Cycle Covering Graphs for inference in MRFS The Typhon Algorithm A New Variational Approach to Ground State Computation in Binary Planar Markov.
Introduction to Job Shop Scheduling Problem Qianjun Xu Oct. 30, 2001.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
Message-Passing for Wireless Scheduling: an Experimental Study Paolo Giaccone (Politecnico di Torino) Devavrat Shah (MIT) ICCCN 2010 – Zurich August 2.
1 CS612 Algorithms for Electronic Design Automation CS 612 – Lecture 8 Lecture 8 Network Flow Based Modeling Mustafa Ozdal Computer Engineering Department,
Probabilistic Graphical Models
1 Optimal Cycle Vida Movahedi Elder Lab, January 2008.
Lena Gorelick joint work with O. Veksler I. Ben Ayed A. Delong Y. Boykov.
Fast Parallel and Adaptive Updates for Dual-Decomposition Solvers Ozgur Sumer, U. Chicago Umut Acar, MPI-SWS Alexander Ihler, UC Irvine Ramgopal Mettu,
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London.
Continuous Variables Write message update equation as an expectation: Proposal distribution W t (x t ) for each node Samples define a random discretization.
Discrete Optimization Lecture 3 – Part 1 M. Pawan Kumar Slides available online
Fast and accurate energy minimization for static or time-varying Markov Random Fields (MRFs) Nikos Komodakis (Ecole Centrale Paris) Nikos Paragios (Ecole.
Probabilistic Inference Lecture 5 M. Pawan Kumar Slides available online
Dynamic Tree Block Coordinate Ascent Daniel Tarlow 1, Dhruv Batra 2 Pushmeet Kohli 3, Vladimir Kolmogorov 4 1: University of Toronto3: Microsoft Research.
Efficient Discriminative Learning of Parts-based Models M. Pawan Kumar Andrew Zisserman Philip Torr
Approximate Inference: Decomposition Methods with Applications to Computer Vision Kyomin Jung ( KAIST ) Joint work with Pushmeet Kohli (Microsoft Research)
CS223 Advanced Data Structures and Algorithms 1 Maximum Flow Neil Tang 3/30/2010.
Integer LP In-class Prob
Using Combinatorial Optimization within Max-Product Belief Propagation
Inference for Learning Belief Propagation. So far... Exact methods for submodular energies Approximations for non-submodular energies Move-making ( N_Variables.
1 CS612 Algorithms for Electronic Design Automation CS 612 – Lecture 8 Lecture 8 Network Flow Based Modeling Mustafa Ozdal Computer Engineering Department,
1 Scale and Rotation Invariant Matching Using Linearly Augmented Tree Hao Jiang Boston College Tai-peng Tian, Stan Sclaroff Boston University.
Join-graph based cost-shifting Alexander Ihler, Natalia Flerova, Rina Dechter and Lars Otten University of California Irvine Introduction Mini-Bucket Elimination.
CS654: Digital Image Analysis Lecture 28: Advanced topics in Image Segmentation Image courtesy: IEEE, IJCV.
Efficient Belief Propagation for Image Restoration Qi Zhao Mar.22,2006.
Tightening LP Relaxations for MAP using Message-Passing David Sontag Joint work with Talya Meltzer, Amir Globerson, Tommi Jaakkola, and Yair Weiss.
IE 312 Review 1. The Process 2 Problem Model Conclusions Problem Formulation Analysis.
Markov Networks: Theory and Applications Ying Wu Electrical Engineering and Computer Science Northwestern University Evanston, IL 60208
A Binary Linear Programming Formulation of the Graph Edit Distance Presented by Shihao Ji Duke University Machine Learning Group July 17, 2006 Authors:
1 Double-Patterning Aware DSA Template Guided Cut Redistribution for Advanced 1-D Gridded Designs Zhi-Wen Lin and Yao-Wen Chang National Taiwan University.
Introduction of BP & TRW-S
Alexander Shekhovtsov and Václav Hlaváč
Efficient Graph Cut Optimization for Full CRFs with Quantized Edges
≠ Particle-based Variational Inference for Continuous Systems
Expectation-Maximization & Belief Propagation
“Traditional” image segmentation
Multidisciplinary Optimization
Presentation transcript:

Update any set S of nodes simultaneously with step-size We show fixed point update is monotone for · 1/|S| Covering Trees and Lower-bounds on Quadratic Assignment Overview & GoalsExperimental Results Quadratic Assignment {jyarkony, fowlkes, Julian Yarkony, Charless Fowlkes, Alexander Ihler University of California, Irvine TRW and Dual Decomposition: Data Set V. Kolmogorov. Convergent tree-reweighted message passing for energy minimization. IEEE Trans. Pattern Anal. Machine Intell., 28(10):1568– 1583, L. Torresani, V. Kolmogorov, and C. Rother. Feature correspondence via graph matching: Models and global optimization. In ECCV, pages 596– 609, M. J. Wainwright, T. Jaakkola, and A. S. Willsky. MAP estimation via agreement on (hyper)trees: message-passing and linear programming approaches. IEEE Trans. Inform. Theory, 51(11):3697–3717, References Optimizing the Covering Tree Bound Convergence of various optimization algorithms on 10 by 10 Ising grids with repulsive potentials Develop new algorithms for determining corresponding points between images Covering Trees A new variational optimization of the tree- reweighted (TRW) bound BAR (Bottleneck Assignment Rounding) use the min-marginals from covering tree to construct an assignment Problem Formulation P parts, L locations X i 2 1…L specifies the location of part i Minimize assignment cost : cost of assigning part i to location X i : pairwise assignment cost i→X i, j→X j : 1-to-1 assignment constraint Select a set of spanning trees Decompose problem µ into { µ T } s.t.   µ T = µ Gives a lower bound on the optimum TRW algorithm optimizes the lower bound over µ Original Graph Collection of trees Constructing a Covering Tree Create a single tree which covers all edges of graph Duplicate nodes as required Achieves the same lower- bound as TRW Minimal representation; no updates of edge parameters Parameters of the covering tree µ CT distribute unary potentials from original problem across copies of the node Bottleneck Assignment Rounding “House” data set 110 views, 30 marked points for correspondence Unary costs: shape context features Pairwise costs: deviation in distance and angle Only consider pairwise potentials between neighboring parts (2,3,4 neighbors per part) We compare our algorithm to "Graph Matching" proposed by Toressani et al. which also uses a dual- decomposition approach. Two parameter optimization updates: Subgradient update Fixed point update : set of copies of node i : indicator of copy t taking on state k : min-marginal of copy t Optimizing state X in the covering tree May not be consistent across all copies May not be a 1-1 assignment “Assignment Rounding” find a valid assignment using CT estimates Construct bound lower bounds cost when part i in location k Find the best assignment consistent with bounds Solving Bottleneck assignment problem Search over all possible bottleneck values Restrict to states less than bottleneck value Check feasibility of value with bipartite matching Correspondence accuracy vs. view separation Focus on large baselines (grey region) Compare CT+BAR to CT alone BAR improves estimate quality Comparing accuracy & timing Fix the number of neighbors in graph Similar accuracy, CT+BAR faster 2 nbr Graph Matching vs. 4 nbr CT+BAR Similar timing, CT+BAR more accurate