Petter Strandmark Fredrik Kahl Lund University. Image denoising Stereo estimation Segmentation Shape fitting from point clouds.

Slides:



Advertisements
Similar presentations
3.6 Support Vector Machines
Advertisements

Computer Vision Group UC Berkeley How should we combine high level and low level knowledge? Jitendra Malik UC Berkeley Recognition using regions is joint.
L3S Research Center University of Hanover Germany
Introduction to Algorithms 6.046J/18.401J/SMA5503
Mean-Field Theory and Its Applications In Computer Vision1 1.
Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London Tutorial at GDR (Optimisation Discrète, Graph Cuts.
1 LP, extended maxflow, TRW OR: How to understand Vladimirs most recent work Ramin Zabih Cornell University.
Spectral Clustering Eyal David Image Processing seminar May 2008.
1 Outline relationship among topics secrets LP with upper bounds by Simplex method basic feasible solution (BFS) by Simplex method for bounded variables.
HOPS: Efficient Region Labeling using Higher Order Proxy Neighborhoods Albert Y. C. Chen 1, Jason J. Corso 1, and Le Wang 2 1 Dept. of Computer Science.
Cuts, Trees, and Electrical Flows Aleksander Mądry.
Generating Classic Mosaics with Graph Cuts Y. Liu, O. Veksler and O. Juan University of Western Ontario, Canada Ecole Centrale de Paris, France.
1 Column Generation. 2 Outline trim loss problem different formulations column generation the trim loss problem master problem and subproblem in column.
COMP 482: Design and Analysis of Algorithms
Algorithm Design Methods Spring 2007 CSE, POSTECH.
1 Scheduling Crossbar Switches Who do we chose to traverse the switch in the next time slot? N N 11.
Local Search Jim Little UBC CS 322 – CSP October 3, 2014 Textbook §4.8
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Minimum Vertex Cover in Rectangle Graphs
1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
ECE Longest Path dual 1 ECE 665 Spring 2005 ECE 665 Spring 2005 Computer Algorithms with Applications to VLSI CAD Linear Programming Duality – Longest.
Bo Hong Electrical and Computer Engineering Department Drexel University
O(N 1.5 ) divide-and-conquer technique for Minimum Spanning Tree problem Step 1: Divide the graph into  N sub-graph by clustering. Step 2: Solve each.
Graph Cut Algorithms for Computer Vision & Medical Imaging Ramin Zabih Computer Science & Radiology Cornell University Joint work with Y. Boykov, V. Kolmogorov,
ICCV 2007 tutorial Part III Message-passing algorithms for energy minimization Vladimir Kolmogorov University College London.
1 s-t Graph Cuts for Binary Energy Minimization  Now that we have an energy function, the big question is how do we minimize it? n Exhaustive search is.
1 Fast Primal-Dual Strategies for MRF Optimization (Fast PD) Robot Perception Lab Taha Hamedani Aug 2014.
This work was supported bu EU projects FP7-ICT NIFTi and FP7-ICT HUMAVIPS and the Czech project 1M0567 CAK July, 2011 EMMCVPR Center.
Object Detection by Matching Longin Jan Latecki. Contour-based object detection Database shapes: …..
Distributed Message Passing for Large Scale Graphical Models Alexander Schwing Tamir Hazan Marc Pollefeys Raquel Urtasun CVPR2011.
Duality Dual problem Duality Theorem Complementary Slackness
Region-based Voting Exemplar 1 Query 1 Exemplar 2.
2010/5/171 Overview of graph cuts. 2010/5/172 Outline Introduction S-t Graph cuts Extension to multi-label problems Compare simulated annealing and alpha-
Comp 775: Graph Cuts and Continuous Maximal Flows Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel Hill.
ECE LP Duality 1 ECE 665 Spring 2005 ECE 665 Spring 2005 Computer Algorithms with Applications to VLSI CAD Linear Programming Duality.
Lecture 10: Support Vector Machines
Linear Programming – Max Flow – Min Cut Orgad Keller.
Normal Estimation in Point Clouds 2D/3D Shape Manipulation, 3D Printing March 13, 2013 Slides from Olga Sorkine.
S I E M E N S C O R P O R A T E R E S E A R C H 1 1 Computing Exact Discrete Minimal Surfaces: Extending and Solving the Shortest Path Problem in 3D with.
Computer Vision James Hays, Brown
1 ESI 6417 Linear Programming and Network Optimization Fall 2003 Ravindra K. Ahuja 370 Weil Hall, Dept. of ISE
CS774. Markov Random Field : Theory and Application Lecture 13 Kyomin Jung KAIST Oct
Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images (Fri) Young Ki Baik, Computer Vision Lab.
Topics in Algorithms 2005 Constructing Well-Connected Networks via Linear Programming and Primal Dual Algorithms Ramesh Hariharan.
Chapter 6 Linear Programming: The Simplex Method Section R Review.
Theory of Computing Lecture 13 MAS 714 Hartmut Klauck.
Graph Cuts Marc Niethammer. Segmentation by Graph-Cuts A way to compute solutions to the optimization problems we looked at before. Example: Binary Segmentation.
Jonathan Dinger 1. Traffic footage example 2  Important step in video analysis  Background subtraction is often used 3.
Fast Parallel and Adaptive Updates for Dual-Decomposition Solvers Ozgur Sumer, U. Chicago Umut Acar, MPI-SWS Alexander Ihler, UC Irvine Ramgopal Mettu,
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London.
Probabilistic Inference Lecture 5 M. Pawan Kumar Slides available online
Problem Reduction So far we have considered search strategies for OR graph. In OR graph, several arcs indicate a variety of ways in which the original.
Lagrangean Relaxation
Outline Standard 2-way minimum graph cut problem. Applications to problems in computer vision Classical algorithms from the theory literature A new algorithm.
Markov Random Fields in Vision
-excesses are pushed towards the sink (T) -deficits are pulled towards the source (S) Active Graph Cuts O. Juan CERTIS, ENPC Marne-La-Vallée, France
BT8118 – Adv. Topics in Systems Biology
Alexander Shekhovtsov and Václav Hlaváč
Max-flow, Min-cut Network flow.
Multiplicative updates for L1-regularized regression
CSCI 3160 Design and Analysis of Algorithms Tutorial 8
Dissertation for the degree of Philosophiae Doctor (PhD)
Max-flow, Min-cut Network flow.
Multiway Cut for Stereo and Motion with Slanted Surfaces
Globally Optimal Generalized Maximum Multi Clique Problem (GMMCP) using Python code for Pedestrian Object Tracking By Beni Mulyana.
Multi-labeling Problems
Lecture 19-Problem Solving 4 Incremental Method
Graphical Solution of Linear Programming Problems
Parallel and Distributed Graph Cuts by Dual Decomposition
Presentation transcript:

Petter Strandmark Fredrik Kahl Lund University

Image denoising Stereo estimation Segmentation Shape fitting from point clouds

S T Minimum cut: 4 1 1

 Delong and Boykov, CVPR 2008  Implementation of push-relabel  Excellent speed-up for 2-8 processors  Method of choice for dense 3D graphs  CUDA-cuts: Vineet and Narayanan, CVGPU CVPR 2008  Push-relabel on GPU  Not clear what range of regularization can be used  L1-norm: Bhusnurmath and Taylor, PAMI 2008  Solves continuous problem on GPU  Not faster than augmenting paths on single processor

 Liu and Sun, CVPR 2010  ” Parallel Graph-cuts by Adaptive Bottom-up Merging”  Splits large graph into several pieces  Augmenting paths found separately  Pieces merged together and search trees reused  Our approach  Graph split into several pieces  Solutions constrained to be equal with dual variables  Shared memory not required See Komodakis et al. in ICCV 2007 for dual decomposition

Two separate problems! Dualize the constraint!

= = = ≠ S T ½ ½

 Zero duality gap  Dual function has a maximum such that the constraints are met  Global solution guaranteed! Original Min-cut Problem Decomposed Min-cut Problem  ? Linear Program  Dual Linear Program Decomposed Linear Program 

Theorem: If the graph weights are even integers, there exists an integer vector maximizing the dual function. This means that the dual problem can be solved without floating point arithmetic.

 Begin with a graph  Split into two parts  Constrained to be equal on the overlap = Independent problems!

Berkeley segmentation database 301 images 2 processors 4 processors

Iteration Differences Time (ms) × 1536

Easy problem: 230 ms Hard problem: 4 s

ST This choice of split severes all possible s/t paths Parallel approach still 30% faster

 LUNARC cluster  401 × 396 × seconds 4 computers  95 × 98 × 30 × 1980-connectivity 12.3 GB4 computers  512 × 512 × connectivity 131 GB36 computers Not much data need to be exchanged, 54kB in the first example 4D MRI data 3D CT data

 Dual decomposition allows:  Faster processing  Solving larger graphs  Open source  C++/Matlab  Python