Department of Computer Science Center for Visual Computing Bag-of-Feature-Graphs: A New Paradigm for Non-rigid Shape Retrieval Tingbo HOU, Xiaohua HOU,

Slides:

Advertisements

Similar presentations

Complex Networks for Representation and Characterization of Images For CS790g Project Bingdong Li 9/23/2009.

Advertisements

Context-based object-class recognition and retrieval by generalized correlograms by J. Amores, N. Sebe and P. Radeva Discussion led by Qi An Duke University.

Location Recognition Given: A query image A database of images with known locations Two types of approaches: Direct matching: directly match image features.

1 Query Processing in Spatial Network Databases presented by Hao Hong Dimitris Papadias Jun Zhang Hong Kong University of Science and Technology Nikos.

Efficiently searching for similar images (Kristen Grauman)

Indexing 3D Scenes Using the Interaction Bisector Surface Xi Zhao He Wang Taku Komura University of Edinburgh.

1 Michael Bronstein Heat diffusion descriptors deformable Michael Bronstein Weizmann Institute of Science, 4 November 2010 Institute of Computational Science.

1 Overview of Image Retrieval Hui-Ying Wang. 2/42 Reference Smeulders, A. W., Worring, M., Santini, S., Gupta, A.,, and Jain, R “Content-based.

Robust Object Tracking via Sparsity-based Collaborative Model

Global spatial layout: spatial pyramid matching Spatial weighting the features Beyond bags of features: Adding spatial information.

Probabilistic Fingerprints for Shapes Niloy J. MitraLeonidas Guibas Joachim GiesenMark Pauly Stanford University MPII SaarbrückenETH Zurich.

Special Topic on Image Retrieval Local Feature Matching Verification.

Object Detection by Matching Longin Jan Latecki. Contour-based object detection Database shapes: …..

Shape Analysis and Retrieval ( ) (Michael) Misha Kazhdan.

CVPR 2008 James Philbin Ondˇrej Chum Michael Isard Josef Sivic

Lime is… …an interactive visual analysis tool connected to Dynamics NAV Graphical representation of NAV data in your browser Real-time visualization of.

1 Numerical Geometry of Non-Rigid Shapes Feature-based methods & shape retrieval problems Feature-based methods and shape retrieval problems © Alexander.

Bag of Features Approach: recent work, using geometric information.

Effective Image Database Search via Dimensionality Reduction Anders Bjorholm Dahl and Henrik Aanæs IEEE Computer Society Conference on Computer Vision.

Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.

Optimal invariant metrics for shape retrieval

WISE: Large Scale Content-Based Web Image Search Michael Isard Joint with: Qifa Ke, Jian Sun, Zhong Wu Microsoft Research Silicon Valley 1.

Shape-Based Retrieval of Articulated 3D Models Using Spectral Embedding GrUVi Lab, School of Computing Science Simon Fraser University, Burnaby, BC Canada.

Object retrieval with large vocabularies and fast spatial matching

Iterative closest point algorithms

CS335 Principles of Multimedia Systems Content Based Media Retrieval Hao Jiang Computer Science Department Boston College Dec. 4, 2007.

Retrieval Evaluation. Brief Review Evaluation of implementations in computer science often is in terms of time and space complexity. With large document.

Image Annotation using XML and MPEG-7 Manjeet Rege Department of Computer Science Wayne State University

Retrieval Evaluation: Precision and Recall. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity.

Feature-based methods

1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.

Retrieval Evaluation. Introduction Evaluation of implementations in computer science often is in terms of time and space complexity. With large document.

An Integrated Pose and Correspondence Approach to Image Matching Anand Rangarajan Image Processing and Analysis Group Departments of Electrical Engineering.

Agenda Introduction Bag-of-words models Visual words with spatial location Part-based models Discriminative methods Segmentation and recognition Recognition-based.

CAD’11, TaipeiDepartment of Engineering Design, IIT Madras M. Ramanathan Department of Engineering Design Indian Institute of Technology Madras.

Large Scale Recognition and Retrieval. What does the world look like? High level image statistics Object Recognition for large-scale search Focus on scaling.

5 Number Summary Box Plots. The five-number summary is the collection of The smallest value The first quartile (Q 1 or P 25 ) The median (M or Q 2 or.

Object Recognition and Augmented Reality

Performance Evaluation of Grouping Algorithms Vida Movahedi Elder Lab - Centre for Vision Research York University Spring 2009.

Bag-of-Words based Image Classification Joost van de Weijer.

Final Exam Review CS485/685 Computer Vision Prof. Bebis.

AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.

A 3D Model Alignment and Retrieval System Ding-Yun Chen and Ming Ouhyoung.

Shape Analysis and Retrieval Structural Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.

Svetlana Lazebnik, Cordelia Schmid, Jean Ponce

Organizing Heterogeneous Scene Collections through Contextual Focal Points Kai Xu, Rui Ma, Hao Zhang, Chenyang Zhu, Ariel Shamir, Daniel Cohen-Or, Hui.

Efficient Subwindow Search: A Branch and Bound Framework for Object Localization ‘PAMI09 Beyond Sliding Windows: Object Localization by Efficient Subwindow.

Bag-of-Words based Image Classification (week I) Joost van de Weijer.

Roee Litman, Alexander Bronstein, Michael Bronstein

Answering Similar Region Search Queries Chang Sheng, Yu Zheng.

A survey of different shape analysis techniques 1 A Survey of Different Shape Analysis Techniques -- Huang Nan.

A Sparse Texture Representation Using Affine-Invariant Regions Svetlana Lazebnik, Jean Ponce Svetlana Lazebnik, Jean Ponce Beckman Institute University.

Efficient Visual Object Tracking with Online Nearest Neighbor Classifier Many slides adapt from Steve Gu.

Project 3 Results.

Hierarchical Matching with Side Information for Image Classification

Content-based Image Retrieval Mei Wu Faculty of Computer Science Dalhousie University.

A Unified Feature Registration Framework for Brain Anatomical Alignment Haili Chui, Robert Schultz, Lawrence Win, James Duncan and Anand Rangarajan* Image.

Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.

Bundling Features for Large Scale Partial-Duplicate Web Image Search Zhong Wu ∗, Qifa Ke, Michael Isard, and Jian Sun Microsoft Research.

Partial Shape Matching. Outline: Motivation Sum of Squared Distances.

Duc-Tien Dang-Nguyen, Giulia Boato, Alessandro Moschitti, Francesco G.B. De Natale Department to Information and Computer Science –University of Trento.

CENG 789 – Digital Geometry Processing 10- Data-Driven Shape Analysis

1 A Methodology for automatic retrieval of similarly shaped machinable components Mark Ascher - Dept of ECE.

Cross-modal Hashing Through Ranking Subspace Learning

Local Feature Extraction Using Scale-Space Decomposition

Cross-library API Recommendation Using Web Search Engines

Geometric Hashing: An Overview

Large Scale Image Deduplication

Scale-Space Representation for Matching of 3D Models

Scale-Space Representation for Matching of 3D Models

Presentation transcript:

Department of Computer Science Center for Visual Computing Bag-of-Feature-Graphs: A New Paradigm for Non-rigid Shape Retrieval Tingbo HOU, Xiaohua HOU, Ming ZHONG and Hong QIN Department of Computer Science Stony Brook University (SUNY SB) ICPR 2012

Department of Computer Science Center for Visual Computing Nonrigid Shape Retrieval ICPR 2012 … … Shape Query Shape Database Retrieved Shapes

Department of Computer Science Center for Visual Computing Overview of BoFG  Inspired by the ideas from Bag-of-Words (BoW) and Spatial- Sensitive Bag-of-Words (SS-BoW)  Feature-driven  Concise and fast to compute  Spatially informative ICPR 2012

Department of Computer Science Center for Visual Computing Previous Works Relevant to This Project  Bag-of-Words 1.Y. Liu, H. Zha, and H. Qin. CVPR, H. Tabia, M. Daoudi, J. P. Vandeborre, and O. Colot. 3DOR, R. Toldo, U. Castellani, and A. Fusiello. VC, G. Lavoué. 3DOR,  Shape Google (Spatially-Sensitive Bag-of-Words) 1.M. Ovsjanikov, A. M. Bronstein, L. J. Guibas and M. M. Bronstein. NORDIA, (SI-HKS) M. M. Bronstein and I. Kokkinos. CVPR, A. M. Bronstein, M. M. Bronstein, L. J. Guibas, and M. Ovsjanikov. ACM TOG, ICPR 2012

Department of Computer Science Center for Visual Computing Background (1) ICPR 2012

Department of Computer Science Center for Visual Computing Background (2) ICPR 2012

Department of Computer Science Center for Visual Computing Shape-Google Revisit (1) ICPR 2012

Department of Computer Science Center for Visual Computing Shape-Google Revisit (2) ICPR 2012

Department of Computer Science Center for Visual Computing New Paradigm: Bag-of-Feature Graphs (1)  Motivation: Reduce computation complexity  Considering all points on shape -> only considering feature points  Vector/matrix of word frequencies -> feature graphs associated with words ICPR 2012

Department of Computer Science Center for Visual Computing Formulation (1) ICPR 2012 …

Department of Computer Science Center for Visual Computing Formulation (2) ICPR 2012

Department of Computer Science Center for Visual Computing Nonrigid Shapes and Their BoFG Descriptors ICPR 2012

Department of Computer Science Center for Visual Computing Time Complexity of BoW, SS-BOW and BoFG ICPR 2012

Department of Computer Science Center for Visual Computing Experiments ICPR

Department of Computer Science Center for Visual Computing ICPR 2012

Department of Computer Science Center for Visual Computing Experiments ICPR 2012 Time performance (in seconds) of three descriptors on two shapes with 3K and 30k vertices

Department of Computer Science Center for Visual Computing Experiments Precision-recall curves of evaluated methods, with categories of (1) null, (2) scale changes and (3) holes. ICPR 2012 (1)(2) (3)

Department of Computer Science Center for Visual Computing Partial shape retrieval  Query shape is only a part of a complete model  Online feature alignment is required to extract corresponding sub- graphs ICPR 2012

Department of Computer Science Center for Visual Computing Summary  Bag-of-Feature-Graphs (BoFG) is a new paradigm for shape representation  This representation is feature-driven, concise, and spatially-aware  The key idea is to construct graphs of features associated with geometric words  BoFG has much improved time-performance and competitive retrieval results in comparison with other state-of-the-art methods ICPR 2012

Department of Computer Science Center for Visual Computing Future Work  Investigate graph comparison with heavy outliers  Improve the performance on partial shape retrieval  Acknowledgements: Research Grants from National Science Foundation ICPR 2012

Department of Computer Science Center for Visual Computing ICPR 2012