Self-Validated Labeling of Markov Random Fields for Image segmentation Tzu-Ting Liao ADVISOR: SHENG-JYH WANG W. Feng, J. Y. Jia, and Z. Q. Liu, “Self-validated.

Slides:



Advertisements
Similar presentations
Mean-Field Theory and Its Applications In Computer Vision1 1.
Advertisements

Primal-dual Algorithm for Convex Markov Random Fields Vladimir Kolmogorov University College London GDR (Optimisation Discrète, Graph Cuts et Analyse d'Images)
Mean-Field Theory and Its Applications In Computer Vision2
HOPS: Efficient Region Labeling using Higher Order Proxy Neighborhoods Albert Y. C. Chen 1, Jason J. Corso 1, and Le Wang 2 1 Dept. of Computer Science.
SOFT SCISSORS: AN INTERACTIVE TOOL FOR REALTIME HIGH QUALITY MATTING International Conference on Computer Graphics and Interactive Techniques ACM SIGGRAPH.
Graph cut Chien-chi Chen.
Graph Cut Algorithms for Computer Vision & Medical Imaging Ramin Zabih Computer Science & Radiology Cornell University Joint work with Y. Boykov, V. Kolmogorov,
Interactive Segmentation with Super-Labels Andrew Delong Western Yuri BoykovOlga VekslerLena GorelickFrank Schmidt TexPoint fonts used in EMF. Read the.
I Images as graphs Fully-connected graph – node for every pixel – link between every pair of pixels, p,q – similarity w ij for each link j w ij c Source:
ENSEMBLE SEGMENTATION USING EFFICIENT INTEGER LINEAR PROGRAMMING Ju-Hsin Hsieh Advisor : Sheng-Jyh Wang 2013/07/22 Amir Alush and Jacob Goldberger, “ Ensemble.
S I E M E N S C O R P O R A T E R E S E A R C H 1 1 A Seeded Image Segmentation Framework Unifying Graph Cuts and Random Walker Which Yields A New Algorithm.
GrabCut Interactive Image (and Stereo) Segmentation Carsten Rother Vladimir Kolmogorov Andrew Blake Antonio Criminisi Geoffrey Cross [based on Siggraph.
GrabCut Interactive Foreground Extraction using Iterated Graph Cuts Carsten Rother Vladimir Kolmogorov Andrew Blake Microsoft Research Cambridge-UK.
Graph-based image segmentation Václav Hlaváč Czech Technical University in Prague Faculty of Electrical Engineering Department of Cybernetics Prague, Czech.
GrabCut Interactive Image (and Stereo) Segmentation Joon Jae Lee Keimyung University Welcome. I will present Grabcut – an Interactive tool for foreground.
Self-Validated Labeling of MRFs for Image Segmentation Wei Feng 1,2, Jiaya Jia 2 and Zhi-Qiang Liu 1 1. School of Creative Media, City University of Hong.
1 Hierarchical Image-Motion Segmentation using Swendsen-Wang Cuts Adrian Barbu Siemens Corporate Research Princeton, NJ Acknowledgements: S.C. Zhu, Y.N.
Yung-Lin Huang, Yi-Nung Liu, and Shao-Yi Chien Media IC and System Lab Graduate Institute of Networking and Multimedia National Taiwan University Signal.
Segmentation of Dog Elbow Bones Using Max Flow/Min Cut Graph Cuts Based on "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization.
Learning to Detect A Salient Object Reporter: 鄭綱 (3/2)
Segmentation Using Max Flow/Min Cut Graph Cuts Based on "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision.“
Robust Higher Order Potentials For Enforcing Label Consistency
Hierarchical Region-Based Segmentation by Ratio-Contour Jun Wang April 28, 2004 Course Project of CSCE 790.
P 3 & Beyond Solving Energies with Higher Order Cliques Pushmeet Kohli Pawan Kumar Philip H. S. Torr Oxford Brookes University CVPR 2007.
2010/5/171 Overview of graph cuts. 2010/5/172 Outline Introduction S-t Graph cuts Extension to multi-label problems Compare simulated annealing and alpha-
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Graph-Based Semi-Supervised Learning with a Generative Model Speaker: Jingrui He Advisor: Jaime Carbonell Machine Learning Department
Perceptual Organization: Segmentation and Optical Flow.
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.
A Trainable Graph Combination Scheme for Belief Propagation Kai Ju Liu New York University.
Manhattan-world Stereo Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.
Automatic User Interaction Correction via Multi-label Graph-cuts Antonio Hernández-Vela, Carlos Primo and Sergio Escalera Workshop on Human Interaction.
Graph-based Segmentation
MRFs and Segmentation with Graph Cuts Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/31/15.
Graph Cut & Energy Minimization
Graph-based Segmentation. Main Ideas Convert image into a graph Vertices for the pixels Vertices for the pixels Edges between the pixels Edges between.
Tzu ming Su Advisor : S.J.Wang MOTION DETAIL PRESERVING OPTICAL FLOW ESTIMATION 2013/1/28 L. Xu, J. Jia, and Y. Matsushita. Motion detail preserving optical.
Image Segmentation Seminar III Xiaofeng Fan. Today ’ s Presentation Problem Definition Problem Definition Approach Approach Segmentation Methods Segmentation.
Graph Cut 韋弘 2010/2/22. Outline Background Graph cut Ford–Fulkerson algorithm Application Extended reading.
Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc,
Cut-based & divisive clustering Clustering algorithms: Part 2b Pasi Fränti Speech & Image Processing Unit School of Computing University of Eastern.
City University of Hong Kong 18 th Intl. Conf. Pattern Recognition Self-Validated and Spatially Coherent Clustering with NS-MRF and Graph Cuts Wei Feng.
Jifeng Dai 2011/09/27.  Introduction  Structural SVM  Kernel Design  Segmentation and parameter learning  Object Feature Descriptors  Experimental.
Interactive Graph Cuts for Optimal Boundary & Region Segmentation of Objects in N-D Images (Fri) Young Ki Baik, Computer Vision Lab.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 26, NO. 9, SEPTEMBER 2004 Yuri Boykov, Member, IEEE Vladimir Kolmogorov, Member, IEEE.
1 Markov Random Fields with Efficient Approximations Yuri Boykov, Olga Veksler, Ramin Zabih Computer Science Department CORNELL UNIVERSITY.
Gaussian Mixture Models and Expectation-Maximization Algorithm.
Non-Ideal Iris Segmentation Using Graph Cuts
Ch.8 Efficient Coding of Visual Scenes by Grouping and Segmentation Bayesian Brain Tai Sing Lee and Alan L. Yuille Heo, Min-Oh.
Theory of Object Class Uncertainty and its Application Punam Kumar Saha Professor Departments of ECE and Radiology University of Iowa
CS654: Digital Image Analysis Lecture 28: Advanced topics in Image Segmentation Image courtesy: IEEE, IJCV.
Object Recognition by Integrating Multiple Image Segmentations Caroline Pantofaru, Cordelia Schmid, Martial Hebert ECCV 2008 E.
A global approach Finding correspondence between a pair of epipolar lines for all pixels simultaneously Local method: no guarantee we will have one to.
Efficient Belief Propagation for Image Restoration Qi Zhao Mar.22,2006.
TUMOR BURDEN ANALYSIS ON CT BY AUTOMATED LIVER AND TUMOR SEGMENTATION RAMSHEEJA.RR Roll : No 19 Guide SREERAJ.R ( Head Of Department, CSE)
-excesses are pushed towards the sink (T) -deficits are pulled towards the source (S) Active Graph Cuts O. Juan CERTIS, ENPC Marne-La-Vallée, France
Learning Hierarchical Features for Scene Labeling Cle’ment Farabet, Camille Couprie, Laurent Najman, and Yann LeCun by Dong Nie.
Image segmentation.
ROBUST SUBSPACE LEARNING FOR VISION AND GRAPHICS
Markov Random Fields with Efficient Approximations
Secrets of GrabCut and Kernel K-means
Graph Cut Weizhen Jing
Iterative Optimization
Efficient Graph Cut Optimization for Full CRFs with Quantized Edges
Automatic User Interaction Correction via Multi-label Graph-cuts
Discrete Optimization Methods Basic overview of graph cuts
“Traditional” image segmentation
Problem Image and Volume Segmentation:
Presentation transcript:

Self-Validated Labeling of Markov Random Fields for Image segmentation Tzu-Ting Liao ADVISOR: SHENG-JYH WANG W. Feng, J. Y. Jia, and Z. Q. Liu, “Self-validated labeling of Markov random fields for image segmentation,” IEEE Transactions on PAMI, 2010.

K-labeling Image labeling Number of label K is known. 40 percent Gaussian Noise K-labeling segmentation Normalize Cut(NCut) Labeling quality Labeling Cost

Self-validated labeling Self-labeling segmentation (Previous methods) Self-labeling segmentation (This methods) Split-and-merge

Graph theoretic approach Greig: binary labeling problem(s-t graph mincut/maxflow) Boykov, Kolmogorov: K-labeling problem

Graph formulation of MRF-based segmentation

Optimal Binary Segmentation

Graduated Graph Cuts(GGC)

Tree-structured graph cuts(TSGC)

Algorithm Input Image I Splitting or Retaining Feature Model Final Segment Seg(I) unchange change Overpatitioning problem

Net-structured graph cuts(NSGC)

Input Image I Splitting, Retaining or marging Feature Model Final Segment Seg(I) unchange change

Hierarchical Graph Cuts(HGC) Complexity of s-t graph cut is O(mn 2 ).(n vertices, m arcs) Image pyramid(efficiency)

Graduated Graph Cuts(GGC)

Experimental results

Robustness to noise Preservation of long-range soft boundaries

Robustness to noise Preservation of long-range soft boundaries

Experimental results F-measure score to ground truthAverage number of segments

Experimental results

Conclusion Automatically determine the number of labels. Balance the labeling accuracy, spatial coherence, and the labeling cost. Computationally efficient. Independent to initialization. Converge to good local minima of the objective energy function.