Region-based Voting Exemplar 1 Query 1 Exemplar 2.

Slides:

Advertisements

Similar presentations

Shape Matching and Object Recognition using Low Distortion Correspondence Alexander C. Berg, Tamara L. Berg, Jitendra Malik U.C. Berkeley.

Advertisements

Computer Vision Group UC Berkeley How should we combine high level and low level knowledge? Jitendra Malik UC Berkeley Recognition using regions is joint.

Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.

O BJ C UT M. Pawan Kumar Philip Torr Andrew Zisserman UNIVERSITY OF OXFORD.

Semantic Contours from Inverse Detectors Bharath Hariharan et.al. (ICCV-11)

The Layout Consistent Random Field for detecting and segmenting occluded objects CVPR, June 2006 John Winn Jamie Shotton.

Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.

Spectral graph reduction for image and streaming video segmentation Fabio Galasso 1 Margret Keuper 2 Thomas Brox 2 Bernt Schiele 1 1 Max Planck Institute.

Shape Sharing for Object Segmentation

Scene Labeling Using Beam Search Under Mutex Constraints ID: O-2B-6 Anirban Roy and Sinisa Todorovic Oregon State University 1.

Recovering Human Body Configurations: Combining Segmentation and Recognition Greg Mori, Xiaofeng Ren, and Jitentendra Malik (UC Berkeley) Alexei A. Efros.

UCB Computer Vision Animals on the Web Tamara L. Berg CSE 595 Words & Pictures.

Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification Computer Vision, ICCV IEEE 11th International.

INTRODUCTION Heesoo Myeong, Ju Yong Chang, and Kyoung Mu Lee Department of EECS, ASRI, Seoul National University, Seoul, Korea Learning.

Structural Human Action Recognition from Still Images Moin Nabi Computer Vision Lab. ©IPM - Oct

Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.

1 Building a Dictionary of Image Fragments Zicheng Liao Ali Farhadi Yang Wang Ian Endres David Forsyth Department of Computer Science, University of Illinois.

Boundary Preserving Dense Local Regions

1 P. Arbelaez, M. Maire, C. Fowlkes, J. Malik. Contour Detection and Hierarchical image Segmentation. IEEE Trans. on PAMI, Student: Hsin-Min Cheng.

Groups of Adjacent Contour Segments for Object Detection Vittorio Ferrari Loic Fevrier Frederic Jurie Cordelia Schmid.

Ghunhui Gu, Joseph J. Lim, Pablo Arbeláez, Jitendra Malik University of California at Berkeley Berkeley, CA

Contour Based Approaches for Visual Object Recognition Jamie Shotton University of Cambridge Joint work with Roberto Cipolla, Andrew Blake.

Object Detection by Matching Longin Jan Latecki. Contour-based object detection Database shapes: …..

Biased Normalized Cuts 1 Subhransu Maji and Jithndra Malik University of California, Berkeley IEEE Conference on Computer Vision and Pattern Recognition.

Fast intersection kernel SVMs for Realtime Object Detection

DISCRIMINATIVE DECORELATION FOR CLUSTERING AND CLASSIFICATION ECCV 12 Bharath Hariharan, Jitandra Malik, and Deva Ramanan.

Computer Vision Group University of California Berkeley Estimating Human Body Configurations using Shape Context Matching Greg Mori and Jitendra Malik.

Computer Vision Group University of California Berkeley Shape Matching and Object Recognition using Shape Contexts Jitendra Malik U.C. Berkeley (joint.

Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.

Robust Higher Order Potentials For Enforcing Label Consistency

CS294‐43: Multiple Kernel and Segmentation methods Prof. Trevor Darrell Spring 2009 April 7 th, 2009.

CS335 Principles of Multimedia Systems Content Based Media Retrieval Hao Jiang Computer Science Department Boston College Dec. 4, 2007.

TextonBoost : Joint Appearance, Shape and Context Modeling for Multi-Class Object Recognition and Segmentation J. Shotton*, J. Winn†, C. Rother†, and A.

Segmentation and Perceptual Grouping. The image of this cube contradicts the optical image.

What Energy Functions Can be Minimized Using Graph Cuts? Shai Bagon Advanced Topics in Computer Vision June 2010.

Image Matching via Saliency Region Correspondences Alexander Toshev Jianbo Shi Kostas Daniilidis IEEE Conference on Computer Vision and Pattern Recognition.

Presentation By Michael Tao and Patrick Virtue. Agenda History of the problem Graph cut background Compute graph cut Extensions State of the art Continued.

Hierarchical Subquery Evaluation for Active Learning on a Graph Oisin Mac Aodha, Neill Campbell, Jan Kautz, Gabriel Brostow CVPR 2014 University College.

1 Outline Overview Integrating Vision Models CCM: Cascaded Classification Models Learning Spatial Context TAS: Things and Stuff Descriptive Querying of.

Object Recognition by Discriminative Methods Sinisa Todorovic 1st Sino-USA Summer School in VLPR July, 2009.

What, Where & How Many? Combining Object Detectors and CRFs

Graph-based Segmentation

Describing People: A Poselet-Based Approach to Attribute Classification Lubomir Bourdev 1,2 Subhransu Maji 1 Jitendra Malik 1 1 EECS U.C. Berkeley 2 Adobe.

Performance Evaluation of Grouping Algorithms Vida Movahedi Elder Lab - Centre for Vision Research York University Spring 2009.

Real-time Action Recognition by Spatiotemporal Semantic and Structural Forest Tsz-Ho Yu, Tae-Kyun Kim and Roberto Cipolla Machine Intelligence Laboratory,

Unsupervised Learning of Categories from Sets of Partially Matching Image Features Kristen Grauman and Trevor Darrel CVPR 2006 Presented By Sovan Biswas.

The Three R’s of Vision Jitendra Malik.

Linked Edges as Stable Region Boundaries* Michael Donoser, Hayko Riemenschneider and Horst Bischof This work introduces an unsupervised method to detect.

Machine learning & category recognition Cordelia Schmid Jakob Verbeek.

1 Contours and Junctions in Natural Images Jitendra Malik University of California at Berkeley (with Jianbo Shi, Thomas Leung, Serge Belongie, Charless.

Building local part models for category-level recognition C. Schmid, INRIA Grenoble Joint work with G. Dorko, S. Lazebnik, J. Ponce.

Bag-of-features models. Origin 1: Texture recognition Texture is characterized by the repetition of basic elements or textons For stochastic textures,

Learning Collections of Parts for Object Recognition and Transfer Learning University of Illinois at Urbana- Champaign.

Segmentation and Boundary Detection Using Multiscale Intensity Measurements Eitan Sharon, Meirav Galun, Ronen Basri, Achi Brandt Dept. of Computer Science.

Associative Hierarchical CRFs for Object Class Image Segmentation Ľubor Ladický 1 1 Oxford Brookes University 2 Microsoft Research Cambridge Based on the.

MSRI workshop, January 2005 Object Recognition Collected databases of objects on uniform background (no occlusions, no clutter) Mostly focus on viewpoint.

Computer Vision Group University of California Berkeley On Visual Recognition Jitendra Malik UC Berkeley.

Associative Hierarchical CRFs for Object Class Image Segmentation

Object Recognition by Integrating Multiple Image Segmentations Caroline Pantofaru, Cordelia Schmid, Martial Hebert ECCV 2008 E.

Hybrid Classiﬁers for Object Classiﬁcation with a Rich Background M. Osadchy, D. Keren, and B. Fadida-Specktor, ECCV 2012 Computer Vision and Video Analysis.

Rich feature hierarchies for accurate object detection and semantic segmentation 2014 IEEE Conference on Computer Vision and Pattern Recognition Ross Girshick,

Image segmentation.

Object Detection based on Segment Masks

Learning to Combine Bottom-Up and Top-Down Segmentation

“The Truth About Cats And Dogs”

Saliency detection Donghun Yeo CV Lab..

Brief Review of Recognition + Context

Liyuan Li, Jerry Kah Eng Hoe, Xinguo Yu, Li Dong, and Xinqi Chu

Clustering appearance and shape by Jigsaw, and comparing it with Epitome. Papers (1) Clustering appearance and shape by learning jigsaws (2006 NIPS) (2)

“Traditional” image segmentation

Presentation transcript:

Region-based Voting Exemplar 1 Query 1 Exemplar 2

Region-based Voting Query 2 Exemplar 1 Exemplar 2

Region-based Voting Query Mean Shift Clustering 3 Exemplar 1 Exemplar 2

Computer Vision Group UC Berkeley Discriminative Weight Learning Not all regions are equally important Frome, Singer and Malik. NIPS ‘06 image J exemplar I image K want: D IJ D IK D IK > D IJ Max-margin formulation results in a sparse solution of weights. D IJ = Σ i w i · d i J and d i J =min j χ 2 (f i I, f j J )

Computer Vision Group UC Berkeley Weight Learning Results

Algorithm Pipeline Region matching based voting Verification classifier Constrained segmenter Query Exemplars Images Ground truths Initial HypothesesSegmentation Detection Weight learning 6

Initial Object/Background Labels Initial Labels Exemplar 7 Transformed Mask QueryMatched Part : Object label : Background label : Unknown label + Fully automatic unlike interactive use of Graph Cuts, e.g. Blake et al. ECCV 04

Propagate Object/Background Labels 8 Arbelaez and Cohen. CVPR 08 Initial LabelsFinal Segmentation

Computer Vision Group UC Berkeley ETHZ Shape (Ferrari et al. 06) Contains 255 images of 5 diverse shape-based classes.

Computer Vision Group UC Berkeley Detection Results on ETHZ Hough baseline 1 kAS 1 Shape 2 Ours Det. rate at 0.3FPPI31.0%62.4%67.2%87.1±2.8% 1. Ferrari et al. PAMI Ferrari, Jurie, Schmid. CVPR 2007

Computer Vision Group UC Berkeley Detection Results on ETHZ

Computer Vision Group UC Berkeley Detection Results on ETHZ

Computer Vision Group UC Berkeley Segmentation Results on ETHZ Orig. ImageSegmentation The mean average precision is 75.7±3.2% Orig. ImageSegmentation

Computer Vision Group UC Berkeley Segmentation Results on ETHZ Orig. ImageSegmentation Orig. ImageSegmentation

Computer Vision Group UC Berkeley Segmentation Results on ETHZ Orig. ImageSegmentation Orig. ImageSegmentation

Computer Vision Group UC Berkeley Segmentation Results on ETHZ Orig. ImageSegmentation Orig. ImageSegmentation

Computer Vision Group UC Berkeley Segmentation Results on ETHZ Orig. ImageSegmentation Orig. ImageSegmentation

Computer Vision Group UC Berkeley Complexity Reduction

Computer Vision Group UC Berkeley Caltech 101 results

Computer Vision Group UC Berkeley Context from region tree (ICCV 09)

Computer Vision Group UC Berkeley MSRC dataset

Computer Vision Group UC Berkeley Confusion matrix (mean diagonal 67%)

Computer Vision Group UC Berkeley Concluding Remarks Our approach –Bottom up region segmentation –Hough transform style voting (learned weights) –Top down segmentation –Capture context by region tree Results on ETHZ, Caltech 101, MSRC competitive Lot more needs to be done to produce a robust solution to the problem of combining top down and bottom up information, but I think this is the central problem of vision