Joshua I. Cohen Brown University September 2001 – May 2002 “Computational Procedures For Extracting Landmarks In Order To Represent The Geometry Of A Sherd”

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints
Advertisements

Binary Shape Clustering via Zernike Moments
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
Shapelets Correlated with Surface Normals Produce Surfaces Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
3D Geometry for Computer Graphics
Developable Surface Fitting to Point Clouds Martin Peternell Computer Aided Geometric Design 21(2004) Reporter: Xingwang Zhang June 19, 2005.
Differential Geometry
The SIFT (Scale Invariant Feature Transform) Detector and Descriptor
PCA + SVD.
Object Recognition using Invariant Local Features Applications l Mobile robots, driver assistance l Cell phone location or object recognition l Panoramas,
Distinctive Image Features from Scale- Invariant Keypoints Mohammad-Amin Ahantab Technische Universität München, Germany.
Image Segmentation some examples Zhiqiang wang
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
Object Recognition with Invariant Features n Definition: Identify objects or scenes and determine their pose and model parameters n Applications l Industrial.
Surface Reconstruction from 3D Volume Data. Problem Definition Construct polyhedral surfaces from regularly-sampled 3D digital volumes.
Computer Graphics Recitation 5.
EE663 Image Processing Edge Detection 2 Dr. Samir H. Abdul-Jauwad Electrical Engineering Department King Fahd University of Petroleum & Minerals.
Object Recognition with Invariant Features n Definition: Identify objects or scenes and determine their pose and model parameters n Applications l Industrial.
Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.
Distinctive image features from scale-invariant keypoints. David G. Lowe, Int. Journal of Computer Vision, 60, 2 (2004), pp Presented by: Shalomi.
Scale Invariant Feature Transform (SIFT)
3D Geometry for Computer Graphics
CS4670: Computer Vision Kavita Bala Lecture 8: Scale invariance.
Camera parameters Extrinisic parameters define location and orientation of camera reference frame with respect to world frame Intrinsic parameters define.
Distinctive Image Features from Scale-Invariant Keypoints David G. Lowe – IJCV 2004 Brien Flewelling CPSC 643 Presentation 1.
Lecture 6: Feature matching and alignment CS4670: Computer Vision Noah Snavely.
Lightseminar: Learned Representation in AI An Introduction to Locally Linear Embedding Lawrence K. Saul Sam T. Roweis presented by Chan-Su Lee.
Normal Estimation in Point Clouds 2D/3D Shape Manipulation, 3D Printing March 13, 2013 Slides from Olga Sorkine.
כמה מהתעשייה? מבנה הקורס השתנה Computer vision.
SVD(Singular Value Decomposition) and Its Applications
Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University
Hubert CARDOTJY- RAMELRashid-Jalal QURESHI Université François Rabelais de Tours, Laboratoire d'Informatique 64, Avenue Jean Portalis, TOURS – France.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2014.
Machine Vision for Robots
October 14, 2014Computer Vision Lecture 11: Image Segmentation I 1Contours How should we represent contours? A good contour representation should meet.
Modal Shape Analysis beyond Laplacian (CAGP 2012) Klaus Hildebrandt, Christian Schulz, Christoph von Tycowicz, Konrad Polthier (brief) Presenter: ShiHao.Wu.
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
Problem of The Day A vector v of length 6 makes a 150 degree angle with the vector [1,0], when they are placed tail-to-tail. Find the components of v.
Wenqi Zhu 3D Reconstruction From Multiple Views Based on Scale-Invariant Feature Transform.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2013.
Normal Curvature of Surface p  N T Local geometry at a surface point p:  surface normal N. The plane containing N and T cuts out a curve  on the surface.
Extracting features from spatio-temporal volumes (STVs) for activity recognition Dheeraj Singaraju Reading group: 06/29/06.
Geometric Modeling using Polygonal Meshes Lecture 3: Discrete Differential Geometry and its Application to Mesh Processing Office: South B-C Global.
Distinctive Image Features from Scale-Invariant Keypoints David Lowe Presented by Tony X. Han March 11, 2008.
Course 8 Contours. Def: edge list ---- ordered set of edge point or fragments. Def: contour ---- an edge list or expression that is used to represent.
A Tutorial on using SIFT Presented by Jimmy Huff (Slightly modified by Josiah Yoder for Winter )
By Pushpita Biswas Under the guidance of Prof. S.Mukhopadhyay and Prof. P.K.Biswas.
Course 5 Edge Detection. Image Features: local, meaningful, detectable parts of an image. edge corner texture … Edges: Edges points, or simply edges,
Introduction to Scale Space and Deep Structure. Importance of Scale Painting by Dali Objects exist at certain ranges of scale. It is not known a priory.
Digital Image Processing CSC331
Camera Calibration Course web page: vision.cis.udel.edu/cv March 24, 2003  Lecture 17.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching.
CSE 554 Lecture 8: Alignment
Image Representation and Description – Representation Schemes
CS262: Computer Vision Lect 09: SIFT Descriptors
Interest Points EE/CSE 576 Linda Shapiro.
Presented by David Lee 3/20/2006
Range Image Segmentation for Modeling and Object Detection in Urban Scenes Cecilia Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter.
Fast Preprocessing for Robust Face Sketch Synthesis
Features Readings All is Vanity, by C. Allan Gilbert,
Face Recognition and Detection Using Eigenfaces
CAP 5415 Computer Vision Fall 2012 Dr. Mubarak Shah Lecture-5
From a presentation by Jimmy Huff Modified by Josiah Yoder
The SIFT (Scale Invariant Feature Transform) Detector and Descriptor
Interest Points & Descriptors 3 - SIFT
Detection of salient points
Feature descriptors and matching
Basic Assembly Constraints
Presentation transcript:

Joshua I. Cohen Brown University September 2001 – May 2002 “Computational Procedures For Extracting Landmarks In Order To Represent The Geometry Of A Sherd”

Introduction  Project  Process - Feature extraction - Reconstruction of the original 3D object using the extracted features  Motivation

Data Collection  Sherd - ShapeGrabber - Polyworks -.mat files

Data Collection Cont’d  Breakcurve  Breakcurve Algorithm (Xavior Orriols) 1. Subdivides sherd into smaller planes recursively starting from centroid 2. Singular value decomposition  3 orthogonal vectors 3. Project points into 2D plane 4. Find edge points.  Breakcurve Algorithm Pitfall

Data Collection Cont’d .iv files (Dongjin Han)

Polynomial Approximation of Curves Containing High Curvature Points  Design Decision  f2D Software  Two Cases To Consider 1. Polynomial Approximation of a High Curvature Segment 2. Polynomial Approximation of a Breakcurve

Polynomial Approximation of a High Curvature Segment Gradient-1Gradient-1 R.R. Degree 4 Degree 11

Polynomial Approximation of a Breakcurve Gradient-1Gradient-1 R.R. Degree 4 Degree 11

Advantages of Corners  Good Landmarks  Segmentation of Breakcurve  Better Representation Locally  Lower Degree Polynomial Fit (3 or 4) - Computation Time - Stability

Landmark Extraction Algorithm  Pre-Processing 1. Find Normals on Breakcurve - Patch - Eigenvector Associated With Minimum Eigenvalue - Check Direction S = M 1 + M 2 + M 3 + … + M k 2. Order Breakcurve Points

Landmark Extraction Algorithm  Corner Detection 1. Concatenate Breakcurve 2. Polynomial Degree One Fitting To Approximate Tangent Vectors - t R and t L - 2 Planes: ax + by + cz + d = 0  x +  y +  z +  = 0 - Eigenvectors associated with 2 smallest eigenvalue - Normalize 3. Ensure Tangent Vectors have the Right Direction Line of Intersection of 2 Planes = [a,b,c] x [ , ,  ] Distance Positive  Distance Negative

Landmark Extraction Algorithm  Corner Detection Cont’d 4. Compute Angle - goodness of fit

Landmark Extraction Algorithm  Corner Detection Cont’d 5. Find Local Minimum Angles (Corners) - smaller than angle of neighbors - smaller than angle threshold Angle Threshold: 145 degreesAngle Threshold: 135 degrees

Landmark Extraction Algorithm  Computing Curvature Extrema 1. Segment Breakcurve at Corners 2. Project Breakcurve into 2D using Local Projection - Global vs Local - B mid, N mid - Rotated perpendicular to [1,0,0], x components are 0

Landmark Extraction Algorithm  Computing Curvature Extrema Cont’d 3. Gradient-1 2D Curve Fitting of Projected Breakcurve Segments - ipfit_ gradient-1 and gradient-1 ridge regression w/specified degree - ipfit_5.3.0 vs f2D Degree = 3

Landmark Extraction Algorithm  Computing Curvature Extrema Cont’d 4. Compute Curvature of Projected Breakcurve Segments - Obtain points on g(x,y) in [B xmin, B xmax, B ymin, B ymax ] - Order according to contour - Compute Curvature

Landmark Extraction Algorithm  Computing Curvature Extrema Cont’d 5. Find Curvature Extrema of Projected Breakcurve Segments - Minima: K < 0, K < Neighbors, K < Threshold - Maxima: K > Neighbors, K > Threshold Threshold = 0.012

Landmark Extraction Algorithm  Computing Curvature Extrema Cont’d 6. Obtain Landmarks by Combining Curvature Extrema of Projected Breakcurve Segments with the Corners

Analysis of Results  Curvature Extrema Not Always Accurate  Problems 1. The Polynomial Fit is Not Always Very Good 2. Points on g(x,y) are Approximate Without Any K Threshold

Conclusion  Correct Curvature Problems - f2D software, g(x,y) = 0 and dotprod(  T,K) = 0  Corners match for p6ed and p10ed  Groundwork of Landmark Detector Established

References 1. Linear Algebra and Its Applications, Gilbert Strang, International Thomson Publishing, 3 rd edition, Numerically Invariant Signature Curves, Mireille Boutin 3. Numerical Recipes 4. Numerical Recipes in C: The Art of Science, William H. Press, Cambridge University Press, 2nd edition, Scientific Computing An Introduction With Parallel Computing, Gene Golub, Academic Press, Wolfram Research Thanks to the following people for all their help: Professor David Cooper Dr. Mireille Boutin Andrew Willis