How to and how not to use graph cuts

Slides:



Advertisements
Similar presentations
1 LP, extended maxflow, TRW OR: How to understand Vladimirs most recent work Ramin Zabih Cornell University.
Advertisements

Automatic Photo Pop-up Derek Hoiem Alexei A.Efros Martial Hebert Carnegie Mellon University.
Pose Estimation and Segmentation of People in 3D Movies Karteek Alahari, Guillaume Seguin, Josef Sivic, Ivan Laptev Inria, Ecole Normale Superieure ICCV.
Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance Dhruv Batra, Carnegie Mellon University Adarsh Kowdle, Cornell.
Graph cut Chien-chi Chen.
Introduction to Markov Random Fields and Graph Cuts Simon Prince
Learning with Inference for Discrete Graphical Models Nikos Komodakis Pawan Kumar Nikos Paragios Ramin Zabih (presenter)
I Images as graphs Fully-connected graph – node for every pixel – link between every pair of pixels, p,q – similarity w ij for each link j w ij c Source:
GrabCut Interactive Image (and Stereo) Segmentation Carsten Rother Vladimir Kolmogorov Andrew Blake Antonio Criminisi Geoffrey Cross [based on Siggraph.
Graph-Based Image Segmentation
Stephen J. Guy 1. Photomontage Photomontage GrabCut – Interactive Foreground Extraction 1.
1 s-t Graph Cuts for Binary Energy Minimization  Now that we have an energy function, the big question is how do we minimize it? n Exhaustive search is.
GrabCut Interactive Image (and Stereo) Segmentation Joon Jae Lee Keimyung University Welcome. I will present Grabcut – an Interactive tool for foreground.
Markov Nets Dhruv Batra, Recitation 10/30/2008.
Epipolar lines epipolar lines Baseline O O’ epipolar plane.
Learning using Graph Mincuts Shuchi Chawla Carnegie Mellon University 1/11/2003.
Segmentation of Dog Elbow Bones Using Max Flow/Min Cut Graph Cuts Based on "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization.
1 Can this be generalized?  NP-hard for Potts model [K/BVZ 01]  Two main approaches 1. Exact solution [Ishikawa 03] Large graph, convex V (arbitrary.
Segmentation Using Max Flow/Min Cut Graph Cuts Based on "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision.“
Last Time Pinhole camera model, projection
1 Computer Vision Research  Huttenlocher, Zabih –Recognition, stereopsis, restoration, learning  Strong algorithmic focus –Combinatorial optimization.
Stereo & Iterative Graph-Cuts Alex Rav-Acha Vision Course Hebrew University.
Multiview stereo. Volumetric stereo Scene Volume V Input Images (Calibrated) Goal: Determine occupancy, “color” of points in V.
Lecture 27: Graph Theory in Circuit Analysis Suppose we wish to find the node voltages of the circuit below. We know how to do this by hand. For large-scale.
The plan for today Camera matrix
Lecture 10: Stereo and Graph Cuts
Stereo Computation using Iterative Graph-Cuts
Jeremy Wyatt Thanks to Gavin Brown
Announcements PS3 Due Thursday PS4 Available today, due 4/17. Quiz 2 4/24.
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/31/15.
Michael Bleyer LVA Stereo Vision
Fast Approximate Energy Minimization via Graph Cuts
Mutual Information-based Stereo Matching Combined with SIFT Descriptor in Log-chromaticity Color Space Yong Seok Heo, Kyoung Mu Lee, and Sang Uk Lee.
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/24/10.
Graph Cut Algorithms for Binocular Stereo with Occlusions
CS774. Markov Random Field : Theory and Application Lecture 13 Kyomin Jung KAIST Oct
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
CS 4487/6587 Algorithms for Image Analysis
Feature-Based Stereo Matching Using Graph Cuts Gorkem Saygili, Laurens van der Maaten, Emile A. Hendriks ASCI Conference 2011.
Lecture 19: Solving the Correspondence Problem with Graph Cuts CAP 5415 Fall 2006.
Presenter : Kuang-Jui Hsu Date : 2011/3/24(Thur.).
Lecture 16: Stereo CS4670 / 5670: Computer Vision Noah Snavely Single image stereogram, by Niklas EenNiklas Een.
Gaussian Mixture Models and Expectation-Maximization Algorithm.
Ning Sun, Hassan Mansour, Rabab Ward Proceedings of 2010 IEEE 17th International Conference on Image Processing September 26-29, 2010, Hong Kong HDR Image.
Solving for Stereo Correspondence Many slides drawn from Lana Lazebnik, UIUC.
CS654: Digital Image Analysis Lecture 28: Advanced topics in Image Segmentation Image courtesy: IEEE, IJCV.
A global approach Finding correspondence between a pair of epipolar lines for all pixels simultaneously Local method: no guarantee we will have one to.
Graph Algorithms for Vision Amy Gale November 5, 2002.
Image Stitching Sean M. Arietta Methods and Implementations.
Photoconsistency constraint C2 q C1 p l = 2 l = 3 Depth labels If this 3D point is visible in both cameras, pixels p and q should have similar intensities.
Markov Random Fields in Vision
Energy functions f(p)  {0,1} : Ising model Can solve fast with graph cuts V( ,  ) = T[  ] : Potts model NP-hard Closely related to Multiway Cut Problem.
Energy minimization Another global approach to improve quality of correspondences Assumption: disparities vary (mostly) smoothly Minimize energy function:
Stereo CS4670 / 5670: Computer Vision Noah Snavely Single image stereogram, by Niklas EenNiklas Een.
Alexander Shekhovtsov and Václav Hlaváč
Markov Random Fields with Efficient Approximations
Geometry 3: Stereo Reconstruction
Computer Science 210 Computer Organization
Efficient Graph Cut Optimization for Full CRFs with Quantized Edges
Neural Networks for Vertex Covering
Haim Kaplan and Uri Zwick
Multi-labeling Problems
Automatic User Interaction Correction via Multi-label Graph-cuts
Shortest-Paths Trees Kun-Mao Chao (趙坤茂)
Lecture 31: Graph-Based Image Segmentation
“grabcut”- Interactive Foreground Extraction using Iterated Graph Cuts
Label Name Label Name Label Name Label Name Label Name Label Name
“Traditional” image segmentation
Line Graphs.
Presentation transcript:

How to and how not to use graph cuts Karen Liu and Brett Allen

What graph cuts is good for Suppose you want to label the nodes in a graph: For each node, you have: a data term: D(p, fp) – the cost of labeling node p with label fp a neighbor term, V(fp, fq), the cost of labeling connected nodes p and q with labels fp and fq. You want to minimize:

The algorithm we used an existing min-cut implementation for each α-expansion, we build a graph that expresses the desirability of switching each node’s label to α ( ):

Application 1: Stripe labeling A harder case

Using graph cuts

Results

What went wrong?! True labeling: … 11 12 13 14 15 16 17 18 19 … Current labeling: … 11 12 13 1 2 3 17 18 19 … …any α-expansion will not improve the energy! α-expansion only works if:

Application 2: Stereo

Using graph cuts

Results Ground truth Graph cuts Parameters: 12 labels (12-34 pixel displacement), w = 10

Results

Results (2) Input Graph cuts Ground truth

Results (3)