Local Feature Extraction Using Scale-Space Decomposition

Slides:



Advertisements
Similar presentations
Wavelets Fast Multiresolution Image Querying Jacobs et.al. SIGGRAPH95.
Advertisements

November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
Texture Segmentation Based on Voting of Blocks, Bayesian Flooding and Region Merging C. Panagiotakis (1), I. Grinias (2) and G. Tziritas (3)
Image Indexing and Retrieval using Moment Invariants Imran Ahmad School of Computer Science University of Windsor – Canada.
Inter-Surface Mapping John Schreiner, Arul Asirvatham, Emil Praun (University of Utah) Hugues Hoppe (Microsoft Research)
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
Advanced Manufacturing Laboratory Department of Industrial Engineering Sharif University of Technology Session # 4.
GATE D Object Representations (GATE-540) Dr.Çağatay ÜNDEĞER Instructor Middle East Technical University, GameTechnologies & General Manager SimBT.
Topology Matching For Fully Automatic Similarity Matching of 3D Shapes Masaki Hilaga Yoshihisa Shinagawa Taku Kohmura Tosiyasu L. Kunii.
Information Retrieval in Text Part III Reference: Michael W. Berry and Murray Browne. Understanding Search Engines: Mathematical Modeling and Text Retrieval.
Singular Value Decomposition in Text Mining Ram Akella University of California Berkeley Silicon Valley Center/SC Lecture 4b February 9, 2011.
Visual Querying By Color Perceptive Regions Alberto del Bimbo, M. Mugnaini, P. Pala, and F. Turco University of Florence, Italy Pattern Recognition, 1998.
Scale-Space Representations and their Applications to 3D Matching of Solid Models Dmitriy Bespalov † Ali Shokoufandeh † William C. Regli †‡ Wei Sun ‡ Department.
3D Geometry for Computer Graphics
P. Rodríguez, R. Dosil, X. M. Pardo, V. Leborán Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.
Content-based Image Retrieval (CBIR)
Advanced Manufacturing Laboratory Department of Industrial Engineering Sharif University of Technology Session # 17.
3D Models and Matching representations for 3D object models
Fast Subsequence Matching in Time-Series Databases Christos Faloutsos M. Ranganathan Yannis Manolopoulos Department of Computer Science and ISR University.
SVD(Singular Value Decomposition) and Its Applications
Modeling and representation 1 – comparative review and polygon mesh models 2.1 Introduction 2.2 Polygonal representation of three-dimensional objects 2.3.
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University 3D Shape Classification Using Conformal Mapping In.
Chapter 2 Dimensionality Reduction. Linear Methods
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
Recognizing Deformable Shapes Salvador Ruiz Correa Ph.D. Thesis, Electrical Engineering.
Graphics Graphics Korea University cgvr.korea.ac.kr Creating Virtual World I 김 창 헌 Department of Computer Science Korea University
International Conference on Computer Vision and Graphics, ICCVG ‘2002 Algorithm for Fusion of 3D Scene by Subgraph Isomorphism with Procrustes Analysis.
Geometric Modeling using Polygonal Meshes Lecture 1: Introduction Hamid Laga Office: South.
ME5372/7372 Introduction to CAD/CAM Session 2,( August 28, 2008 ) Instructor : Rajeev Dwivedi Department of Mechanical.
HOUGH TRANSFORM Presentation by Sumit Tandon
Shape Analysis and Retrieval Statistical Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.
Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)
Roee Litman, Alexander Bronstein, Michael Bronstein
A survey of different shape analysis techniques 1 A Survey of Different Shape Analysis Techniques -- Huang Nan.
1 CSC 594 Topics in AI – Text Mining and Analytics Fall 2015/16 6. Dimensionality Reduction.
Levels of Image Data Representation 4.2. Traditional Image Data Structures 4.3. Hierarchical Data Structures Chapter 4 – Data structures for.
Hierarchical Error-Driven Approximation of Implicit Surfaces from Polygonal Meshes Takashi Kanai Yutaka Ohtake Kiwamu Kase University of Tokyo RIKEN, VCAD.
Using simplified meshes for crude registration of two partially overlapping range images Mercedes R.G.Márquez Wu Shin-Ting State University of Matogrosso.
1 CS 430/585 Computer Graphics I 3D Modeling: Subdivision Surfaces & Solid Modeling Week 9, Lecture 17 David Breen, William Regli and Maxim Peysakhov Geometric.
Methods for 3D Shape Matching and Retrieval
3D Object Representations 2011, Fall. Introduction What is CG?  Imaging : Representing 2D images  Modeling : Representing 3D objects  Rendering : Constructing.
Riccardo Fellegara University of Genova Genova, Italy
Computer vision. Applications and Algorithms in CV Tutorial 3: Multi scale signal representation Pyramids DFT - Discrete Fourier transform.
Mesh Segmentation via Spectral Embedding and Contour Analysis Speaker: Min Meng
Feature-sensitive 3D Shape Matching Andrei Sharf Tel-Aviv University Ariel Shamir IDC Hertzliya.
Rongjie Lai University of Southern California Joint work with: Jian Liang, Alvin Wong, Hongkai Zhao 1 Geometric Understanding of Point Clouds using Laplace-Beltrami.
3D Object Representations 2009, Fall. Introduction What is CG?  Imaging : Representing 2D images  Modeling : Representing 3D objects  Rendering : Constructing.
Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.
Nonlinear Dimensionality Reduction
Intrinsic Data Geometry from a Training Set
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
We propose a method which can be used to reduce high dimensional data sets into simplicial complexes with far fewer points which can capture topological.
Recognizing Deformable Shapes
3D Object Representations
3D Models and Matching particular matching techniques
Benchmarking CAD Search Techniques
Application Solution: 3D Inspection Automation with SA
4.2 Data Input-Output Representation
Computer Vision Lecture 16: Texture II
Scale-Space Representation of 3D Models and Topological Matching
Scale-Space Representation for Matching of 3D Models
Automated Software Integration
Scale-Space Representation for Matching of 3D Models
Lecture 15: Least Square Regression Metric Embeddings
Overview of Modeling 김성남.
Recognizing Deformable Shapes
DIGITAL PHOTOGRAMMETRY
Presentation transcript:

Local Feature Extraction Using Scale-Space Decomposition Dmitriy Bespalov† Ali Shokoufandeh† William C. Regli†‡ Wei Sun‡ Department of Computer Science† Department of Mechanical Engineering & Mechanics‡ College of Engineering Drexel University 3141 Chestnut Street Philadelphia, PA 19104

Overview Introduction Overview of the approach Experimental results Current and future work

Project Goals Perform content- , feature- and shape-based retrieval of CAD data Develop systematic approaches of evaluating matching techniques Integrate new algorithms with the National Design Repository (http://www.designrepository.org)

Goals of this Work Feature extraction technique Models in polyhedral representation Using local information Tolerance to noise

Side Note: Compare Features Scale Space CAD/CAM

Selected Related Work Surface Feature Extraction on Shape Models (Computer Graphics) Scale-Space features [Bespalov et al., 03] Multi-resolutional Reeb Graphs [Hilaga et al., 01] Feature information on range data [Thompson et al., 96,99] Manufacturing Feature Extraction on Solid Models (Solid Modeling & Engineering) Feature relationship graphs [Elinson et al. 97; Cicirello and Regli 99,00,01,02] Automated generation of GT codes [Ames 91; Shah et al., 89 and Ham et al., 86] Feature Extraction on 2D images (Computer Vision) Scale-Space features using wavelets and Gaussian filters [Lindeberg, 90 and Shokoufandeh, 99]

Traditional CAD Representation Watertight boundary-representation solid Implicit surfaces Analytic surfaces NURBS, etc Topologically and geometrically consistent Produced by kernel modelers and CAD systems

Traditional Shape Representation Usually a mesh or point cloud Usually an approximate representation No explicit in/out Sometimes error prone STL files, acquired data Produced by CAD systems, animation tools, laser scanners, etc

What is a Scale Space Representation? Commonly used for Coarse-to-Fine representations of an object Very popular in computer Vision Constructed via spatial filters: Gaussian pyramids, Wavelets… Basic Idea: At each scale, topologically relevant components will decompose the object into so called salient parts Recursive application of this paradigm will create the object’s scale space hierarchy

Approach to Scale Space Feature Extraction Obtain polyhedral representation Convert CAD model or scan physical part Perform geometry-based decomposition Singular value decomposition Construct “feature” graph Obtain a segmentation into “features”

Algorithm Overview (I) Obtain mesh representation M Define measurement function: Our d is maximum angle on the shortest path between every two faces on M using angular measure. Distance matrix D is constructed. d(t1,t2)

Algorithm Overview (II) 3. Decompose M into relevant components using a singular value decomposition of distance matrix D Note: this creates a clustering based on the angle between a vector Oti and the basis vectors (ck, ck-1)

Algorithm Overview (III) The Eckart-Young Theorem: Given an n by m matrix X of rank r ≤ m ≤ n, and its singular value decomposition, ULV', where U is an n by m matrix, L is an m by m diagonal matrix of singular values, and V is an m by m matrix such that U'U = In and V'V = VV' = Im with the singular values arranged in decreasing sequence λ1 ≥ λ2 ≥ λ3 ≥ ... ≥ λm ≥ 0 then there exists an n by m matrix B of rank s, s ≤ r, which minimizes the sum of the squared error between the elements of X and the corresponding elements of B when B = UΛsV' where the diagonal elements of the m by m diagonal matrix Λs are λ1 ≥ λ2 ≥ λ3 ≥ ... ≥ λs > λs+1 = λs+2 = ... = λm = 0

Algorithm Overview (IV) Recursive feature decomposition using two principle components creates binary feature trees. Use leaf nodes as features.

Algorithm Overview (V) Stopping automatic feature decomposition process. Decomposition of M1 into M2 and M3 is significant if: angle across the border of the cluster is max on the path between most of the pairs of faces in M2 and M3.

Algorithmic Complexity Bisection process: SVD decomposition takes O(n3). Polyhedral representation creates a 3D lattice; if only neighboring vertices are used in construction of the distance matrix, SVD decomposition is faster and takes O(n2).

Experimental Results

Experimental Results – Partial Data

Experimental Results – Partial Data

Experimental Results – Partial Data

Experimental Results – Partial Data

Experimental Results – Partial Data

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of one-to-many correspondence

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of one-to-one correspondence

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of one-to-one correspondence

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of many-to-many correspondence

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of one-to-many correspondence

Experimental Results – Scanned Data From Exact Representation 360° Scan Single Scan An example of one-to-one correspondence

Contributions and Future Work Research Contributions Surface Feature extraction technique Performs on models in polyhedral representation Relatively stable Does not depend on global structure of the model Current and Future Work: Extract approximate B-Rep from polyhedral models Introduce matching technique for extracted features Use Scale-Space features for database indexing Use (partial) scanned data for database queries Explore techniques for feature extraction that resemble traditional CAD features

Q&A For more information http://gicl.cs.drexel.edu http://aal.cs.drexel.edu http://www.designrepository.org Sponsored (in part) by: ONR Grant N00014-01-1-0618 NSF CAREER Award CISE/IIS-9733545