Applications of parametric max-flow problem in computer vision

Slides:



Advertisements
Similar presentations
Primal-dual Algorithm for Convex Markov Random Fields Vladimir Kolmogorov University College London GDR (Optimisation Discrète, Graph Cuts et Analyse d'Images)
Advertisements

Multi-view Stereo via Volumetric Graph-cuts George Vogiatzis, Philip H. S. Torr Roberto Cipolla.
Approximations of points and polygonal chains
Lena Gorelick Joint work with Frank Schmidt and Yuri Boykov Rochester Institute of Technology, Center of Imaging Science January 2013 TexPoint fonts used.
Computer Vision Lecture 18: Object Recognition II
Introduction to Markov Random Fields and Graph Cuts Simon Prince
Cambridge, Massachusetts Pose Estimation in Heavy Clutter using a Multi-Flash Camera Ming-Yu Liu, Oncel Tuzel, Ashok Veeraraghavan, Rama Chellappa, Amit.
A Gimp Plugin that uses “GrabCut” to perform image segmentation
1 s-t Graph Cuts for Binary Energy Minimization  Now that we have an energy function, the big question is how do we minimize it? n Exhaustive search is.
Pseudo-Bound Optimization for Binary Energies Presenter: Meng Tang Joint work with Ismail Ben AyedYuri Boykov 1 / 27.
1 Minimum Ratio Contours For Meshes Andrew Clements Hao Zhang gruvi graphics + usability + visualization.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
1 Lecture #5 Variational Approaches and Image Segmentation Lecture #5 Hossam Abdelmunim 1 & Aly A. Farag 2 1 Computer & Systems Engineering Department,
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
10/11/2001Random walks and spectral segmentation1 CSE 291 Fall 2001 Marina Meila and Jianbo Shi: Learning Segmentation by Random Walks/A Random Walks View.
1 Can this be generalized?  NP-hard for Potts model [K/BVZ 01]  Two main approaches 1. Exact solution [Ishikawa 03] Large graph, convex V (arbitrary.
Sorting and Searching. Searching List of numbers (5, 9, 2, 6, 3, 4, 8) Find 3 and tell me where it was.
P 3 & Beyond Solving Energies with Higher Order Cliques Pushmeet Kohli Pawan Kumar Philip H. S. Torr Oxford Brookes University CVPR 2007.
2010/5/171 Overview of graph cuts. 2010/5/172 Outline Introduction S-t Graph cuts Extension to multi-label problems Compare simulated annealing and alpha-
Comp 775: Graph Cuts and Continuous Maximal Flows Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel Hill.
Lecture 11: Stereo and optical flow CS6670: Computer Vision Noah Snavely.
Graph-Cut Algorithm with Application to Computer Vision Presented by Yongsub Lim Applied Algorithm Laboratory.
Extensions of submodularity and their application in computer vision
1 Section 2.3 Complexity of Algorithms. 2 Computational Complexity Measure of algorithm efficiency in terms of: –Time: how long it takes computer to solve.
Analysis of Algorithms CPS212 Gordon College. Measuring the efficiency of algorithms There are 2 algorithms: algo1 and algo2 that produce the same results.
Deformable Models Segmentation methods until now (no knowledge of shape: Thresholding Edge based Region based Deformable models Knowledge of the shape.
Computational Geometry Piyush Kumar (Lecture 5: Linear Programming) Welcome to CIS5930.
DEPARTMENT OF COMPUTER SCIENCE UNIVERSITY OF JOENSUU JOENSUU, FINLAND Image Compression Lecture 9 Optimal Scalar Quantization Alexander Kolesnikov.
CS774. Markov Random Field : Theory and Application Lecture 13 Kyomin Jung KAIST Oct
Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images (Fri) Young Ki Baik, Computer Vision Lab.
1 Optimal Cycle Vida Movahedi Elder Lab, January 2008.
Graph Cuts Marc Niethammer. Segmentation by Graph-Cuts A way to compute solutions to the optimization problems we looked at before. Example: Binary Segmentation.
Parametric Max-Flow Algorithms for Total Variation Minimization W.Yin (Rice University) joint with D.Goldfarb (Columbia), Y.Zhang (Rice), Y.Wang (Rice)
A survey of different shape analysis techniques 1 A Survey of Different Shape Analysis Techniques -- Huang Nan.
M3 1.5 Systems of Linear Inequalities M3 1.5 Systems of Linear Inequalities Essential Questions: How can we write and graph a system of linear inequalities.
Steepest Descent Method Contours are shown below.
Pseudo-Bound Optimization for Binary Energies Meng Tang 1 Ismail Ben Ayed 2 Yuri Boykov 1 1 University of Western Ontario, Canada 2 GE Healthcare Canada.
A global approach Finding correspondence between a pair of epipolar lines for all pixels simultaneously Local method: no guarantee we will have one to.
Occlusion Tracking Using Logical Models Summary. A Variational Partial Differential Equations based model is used for tracking objects under occlusions.
Photoconsistency constraint C2 q C1 p l = 2 l = 3 Depth labels If this 3D point is visible in both cameras, pixels p and q should have similar intensities.
Detecting Image Features: Corner. Corners Given an image, denote the image gradient. C is symmetric with two positive eigenvalues. The eigenvalues give.
Energy functions f(p)  {0,1} : Ising model Can solve fast with graph cuts V( ,  ) = T[  ] : Potts model NP-hard Closely related to Multiway Cut Problem.
Normalized Cuts and Image Segmentation Patrick Denis COSC 6121 York University Jianbo Shi and Jitendra Malik.
Honors Track: Competitive Programming & Problem Solving Seminar Topics Kevin Verbeek.
Energy minimization Another global approach to improve quality of correspondences Assumption: disparities vary (mostly) smoothly Minimize energy function:
April 21, 2016Introduction to Artificial Intelligence Lecture 22: Computer Vision II 1 Canny Edge Detector The Canny edge detector is a good approximation.
The Set-covering Problem Problem statement –given a finite set X and a family F of subsets where every element of X is contained in one of the subsets.
CSE332: Data Abstractions Lecture 7: AVL Trees
Growth of Functions & Algorithms
Integer Programming An integer linear program (ILP) is defined exactly as a linear program except that values of variables in a feasible solution have.
The Design and Analysis of Algorithms
Optimization problems such as
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
Scale Invariant Feature Transform (SIFT)
COMP 9517 Computer Vision Segmentation 7/2/2018 COMP 9517 S2, 2017.
Parallel Algorithm Design using Spectral Graph Theory
Haim Kaplan and Uri Zwick
Object detection as supervised classification
Computer Vision Lecture 16: Texture II
Outline H. Murase, and S. K. Nayar, “Visual learning and recognition of 3-D objects from appearance,” International Journal of Computer Vision, vol. 14,
A Faster Algorithm for Computing the Principal Sequence of Partitions
CSE373: Data Structures & Algorithms Lecture 5: AVL Trees
Multi-view reconstruction
Richard Anderson Lecture 16a Dynamic Programming
CS4670: Intro to Computer Vision
Announcements Project 4 out today (due Wed March 10)
Fourier Transform of Boundaries
15th Scandinavian Workshop on Algorithm Theory
Paper Review Zhiqiang 9/21/12
MIRA, SVM, k-NN Lirong Xia. MIRA, SVM, k-NN Lirong Xia.
Presentation transcript:

Applications of parametric max-flow problem in computer vision A parametric max-flow problem: minimize for all l’s Du(l) – linear functions Vuv(xu , xv) – submodular ES algorithm [Eisner & Severence’76], [Gusfield’80] General case: has finite number of breakpoints: - 2K calls to maxflow (K is # of breakpoints) - K may be exponential! Monotonic case: Du(l) are all non-decreasing/all non-increasing - Nestedness property much more efficient implementation of ES - K=O(n) - Worst-case complexity can be improved to that of a single max-flow [Gallo, Grigoriadis, Tarjan’89] Applications Cosegmentation [Rother,Kolmogorov,Minka,Blake’CVPR06] Ratio minimization (*) PDE cuts (*) Co-segmentation (*) Learning Training ….. - Given 2 images, find segmentations so that histograms match - Key subproblem: 1 image + target histogram segmentation - Minimize PDE cuts [BKCD’ECCV06] Trust region graph cuts – TRGC [RKMB’06] - Approximate Ehist(z) as a linear function - Given current x, choose new approximation - Interpolate between current and new : - Compute minimum xl of for - Choose l that minimizes E(xl) Goal: compute “gradient flow” of contour C - gradient descent of some functional F(C) set of contours within small distance e from C C C C’ - best contour in the neighbourhood C’ space of all contours Searching for l: Each step – parametric max-flow problem: A: as in [RKMB’06] (binary search) B: Essentially, first breakpoint in [0,1] C: compute all solutions in [0,1] input image target histogram controls time step - In general: non-monotonic case - This work: smallest detectable move can be computed via monotonic max-flow algorithm (much faster!) strategy A strategy B strategy C