Abstract - Many interactive image processing approaches are based on semi-supervised learning, which employ both labeled and unlabeled data in its training.

Slides:



Advertisements
Similar presentations
Automatic Photo Pop-up Derek Hoiem Alexei A.Efros Martial Hebert Carnegie Mellon University.
Advertisements

Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance Dhruv Batra, Carnegie Mellon University Adarsh Kowdle, Cornell.
SOFT SCISSORS: AN INTERACTIVE TOOL FOR REALTIME HIGH QUALITY MATTING International Conference on Computer Graphics and Interactive Techniques ACM SIGGRAPH.
Data Mining Classification: Alternative Techniques
Learning Techniques for Video Shot Detection Under the guidance of Prof. Sharat Chandran by M. Nithya.
Multiple Frame Motion Inference Using Belief Propagation Jiang Gao Jianbo Shi Presented By: Gilad Kapelushnik Visual Recognition, Spring 2005, Technion.
Lecture 07 Segmentation Lecture 07 Segmentation Mata kuliah: T Computer Vision Tahun: 2010.
Kapitel 13 “Interactive Segmentation” – p. 1 Interactive Segmentation  Live-wire approach  Random walker segmentation TexPoint fonts used in EMF. Read.
S I E M E N S C O R P O R A T E R E S E A R C H 1 1 A Seeded Image Segmentation Framework Unifying Graph Cuts and Random Walker Which Yields A New Algorithm.
A Gimp Plugin that uses “GrabCut” to perform image segmentation
Graph-Based Image Segmentation
Jue Wang Michael F. Cohen IEEE CVPR Outline 1. Introduction 2. Failure Modes For Previous Approaches 3. Robust Matting 3.1 Optimized Color Sampling.
Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging C. Panagiotakis (1), I. Grinias (2) and G. Tziritas (3)
GrabCut Interactive Image (and Stereo) Segmentation Joon Jae Lee Keimyung University Welcome. I will present Grabcut – an Interactive tool for foreground.
Absorbing Random walks Coverage
Self Organizing Maps. This presentation is based on: SOM’s are invented by Teuvo Kohonen. They represent multidimensional.
Self Taught Learning : Transfer learning from unlabeled data Presented by: Shankar B S DMML Lab Rajat Raina et al, CS, Stanford ICML 2007.
Maggie Zhou COMP 790 Data Mining Seminar, Spring 2011
Co-Training and Expansion: Towards Bridging Theory and Practice Maria-Florina Balcan, Avrim Blum, Ke Yang Carnegie Mellon University, Computer Science.
Natural and Seamless Image Composition Wenxian Yang, Jianmin Zheng, Jianfei Cai, Senior Member, IEEE, Susanto Rahardja, Senior Member, IEEE, and Chang.
Example-Based Color Transformation of Image and Video Using Basic Color Categories Youngha Chang Suguru Saito Masayuki Nakajima.
Ensemble Learning: An Introduction
Abstract Extracting a matte by previous approaches require the input image to be pre-segmented into three regions (trimap). This pre-segmentation based.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
A Novel 2D To 3D Image Technique Based On Object- Oriented Conversion.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Image Segmentation by Clustering using Moments by, Dhiraj Sakumalla.
Graph-based consensus clustering for class discovery from gene expression data Zhiwen Yum, Hau-San Wong and Hongqiang Wang Bioinformatics, 2007.
Multilayer Perceptron Classifier Combination for Identification of Materials on Noisy Soil Science Multispectral Images Fabricio A.
Interactive Image Segmentation of Non-Contiguous Classes using Particle Competition and Cooperation Fabricio Breve São Paulo State University (UNESP)
Semi-Supervised Learning with Concept Drift using Particle Dynamics applied to Network Intrusion Detection Data Fabricio Breve Institute of Geosciences.
Particle Competition and Cooperation to Prevent Error Propagation from Mislabeled Data in Semi- Supervised Learning Fabricio Breve 1,2
Exploring the Parameter Space of Image Segmentation Algorithms Talk at NCHU p 1 TexPoint fonts used in EMF. Read the TexPoint manual before you.
Graph-based Segmentation. Main Ideas Convert image into a graph Vertices for the pixels Vertices for the pixels Edges between the pixels Edges between.
Combined Active and Semi-Supervised Learning using Particle Walking Temporal Dynamics Fabricio Department of Statistics, Applied.
Boris Babenko Department of Computer Science and Engineering University of California, San Diego Semi-supervised and Unsupervised Feature Scaling.
Computer Vision Lecture 5. Clustering: Why and How.
Random Walk with Restart (RWR) for Image Segmentation
DATA MINING LECTURE 13 Absorbing Random walks Coverage.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
Particle Competition and Cooperation for Uncovering Network Overlap Community Structure Fabricio A. Breve 1, Liang Zhao 1, Marcos G. Quiles 2, Witold Pedrycz.
Active Learning An example From Xu et al., “Training SpamAssassin with Active Semi- Supervised Learning”
Uncovering Overlap Community Structure in Complex Networks using Particle Competition Fabricio A. Liang
EECS 274 Computer Vision Segmentation by Clustering II.
Combining multiple learners Usman Roshan. Bagging Randomly sample training data Determine classifier C i on sampled data Goto step 1 and repeat m times.
Particle Competition and Cooperation in Networks for Semi-Supervised Learning with Concept Drift Fabricio Breve 1,2 Liang Zhao 2
CVPR2013 Poster Detecting and Naming Actors in Movies using Generative Appearance Models.
Saliency Aggregation: A Data- driven Approach Long Mai Yuzhen Niu Feng Liu Department of Computer Science, Portland State University Portland, OR,
A NOVEL METHOD FOR COLOR FACE RECOGNITION USING KNN CLASSIFIER
Image Emotional Semantic Query Based On Color Semantic Description Wei-Ning Wang, Ying-Lin Yu Department of Electronic and Information Engineering, South.
COP5992 – DATA MINING TERM PROJECT RANDOM SUBSPACE METHOD + CO-TRAINING by SELIM KALAYCI.
October 1, 2013Computer Vision Lecture 9: From Edges to Contours 1 Canny Edge Detector However, usually there will still be noise in the array E[i, j],
Anomaly Detection in GPS Data Based on Visual Analytics Kyung Min Su - Zicheng Liao, Yizhou Yu, and Baoquan Chen, Anomaly Detection in GPS Data Based on.
Nottingham Image Analysis School, 23 – 25 June NITS Image Segmentation Guoping Qiu School of Computer Science, University of Nottingham
Query Rules Study on Active Semi-Supervised Learning using Particle Competition and Cooperation Fabricio Department of Statistics,
Learning with Green’s Function with Application to Semi-Supervised Learning and Recommender System ----Chris Ding, R. Jin, T. Li and H.D. Simon. A Learning.
Online Social Networks and Media Absorbing random walks Label Propagation Opinion Formation.
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
May 2003 SUT Color image segmentation – an innovative approach Amin Fazel May 2003 Sharif University of Technology Course Presentation base on a paper.
Course : T Computer Vision
Semi-supervised Machine Learning Gergana Lazarova
Project Progress and Future Plans By: Matthew Marsh
COMBINED UNSUPERVISED AND SEMI-SUPERVISED LEARNING FOR DATA CLASSIFICATION Fabricio Aparecido Breve, Daniel Carlos Guimarães Pedronette State University.
Lecture 22 Clustering (3).
Haim Kaplan and Uri Zwick
Lecture 31: Graph-Based Image Segmentation
“grabcut”- Interactive Foreground Extraction using Iterated Graph Cuts
Fabricio Breve Department of Electrical & Computer Engineering
IEEE World Conference on Computational Intelligence – WCCI 2010
Problem definition Given a data set X = {x1, x2, …, xn} Rm and a label set L = {1, 2, … , c}, some samples xi are labeled as yi  L and some are unlabeled.
Presentation transcript:

Abstract - Many interactive image processing approaches are based on semi-supervised learning, which employ both labeled and unlabeled data in its training process. In the interactive image segmentation problem, a human specialist labels some pixels of an object while the semi-supervised algorithm labels the remaining pixels of the segment. The particle competition and cooperation model is a recent graph-based semi-supervised learning approach. It employs particles walking in a graph to classify the data items corresponding to graph nodes. Each particle group aims to dominate most unlabeled nodes, spreading their label, and preventing enemy particles invasion. In this paper, the particle competition and cooperation model is extended to perform interactive image segmentation. Each image pixel is converted into a graph node, which is connected to its nearest neighbors according to their visual features and location in the original image. Labeled pixel generates particles that propagate their label to the unlabeled pixels. The particle model also takes the contributions from the adjacent pixels to classify less confident labeled pixels. Computer simulations are performed on real-world images, including images from the Microsoft GrabCut dataset, which allows a straightly comparison with other techniques. The segmentation results show the effectiveness of the proposed approach. Fabricio Breve São Paulo State University (UNESP) Marcos G. Quiles Federal University of São Paulo (UNIFESP) Liang Zhao University of São Paulo (USP) A particle is generated for each labeled node. Particles initial position are set to their corresponding nodes. Particles with same label play for the same team and cooperate with each other. Particles with different labels compete against each other. Computer Simulations Particle Competition and Cooperation An undirected and unweight graph is generated from the image. Each pixel becomes a graph node. Each node is connected to its -nearest neighbors according to some pixel features. Proposed Method Segmentation Example: (a) original image to be segmented (16x16 pixels); (b) original image with user labeling (green and red traces); and (c) graph generated after the original image, where each image pixel corresponds to a graph node. Labeled nodes are colored blue and yellow, and unlabeled nodes are colored grey. Each labeled node will have a particle assigned to it. (a) (b) (c) (a) Nodes have a domination vector. Labeled nodes have ownership set to their respective teams (classes). Unlabeled nodes have ownership levels set equally for each team. (b) When a particle selects a neighbor to visit: it decreases the domination level of the other teams while it increases the domination level of its own team. Exception: labeled nodes domination levels are fixed. (a) (b) (a) Original image, (b) Trimap providing seed regions, and (c) Close-up foreground segmentation results by the proposed method. Close-up foreground segmentation results from the proposed method. ImageDINHPCC (mushroom)3,65%6,19% (children)5,12%7,67% person72,82%1,53% sheep5,85%1,24% (flowers)3,51%1,09% Comparison of the error rates obtained by the Directed Hypergraph Model (DINH) and those obtained by our proposed Particle Competion and Cooperation Method (PCC) A particle gets strong when it selects a node being dominated by its own team, but it gets weak when it selects a node being dominated by another team Random Greedy Walk Each particles randomly chooses a neighbor to visit at each iteration. Nodes which are already dominated by the particle team and closer to particle initial node have higher probabilities of being chosen. (a) Original images from the GrabCut dataset, and (b) The trimaps providing seed regions. (b) (a) (b) (c)