Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Feature-Aware Filtering for Point-Set Surface Denoising Min Ki Park*Seung.

Slides:



Advertisements
Similar presentations
Scale & Affine Invariant Interest Point Detectors Mikolajczyk & Schmid presented by Dustin Lennon.
Advertisements

CSCE 643 Computer Vision: Template Matching, Image Pyramids and Denoising Jinxiang Chai.
電腦視覺 Computer and Robot Vision I
R. DOSIL, X. M. PARDO, A. MOSQUERA, D. CABELLO Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
DREAM PLAN IDEA IMPLEMENTATION Introduction to Image Processing Dr. Kourosh Kiani
Extended Gaussian Images
Image Denoising using Locally Learned Dictionaries Priyam Chatterjee Peyman Milanfar Dept. of Electrical Engineering University of California, Santa Cruz.
2D/3D Shape Manipulation, 3D Printing
Uncertainty Representation. Gaussian Distribution variance Standard deviation.
Smoothing 3D Meshes using Markov Random Fields
Sam Pfister, Stergios Roumeliotis, Joel Burdick
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
1 Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion (IEEE 2009) Junlan Yang University of Illinois,Chicago.
Uncertainty and Variability in Point Cloud Surface Data Mark Pauly 1,2, Niloy J. Mitra 1, Leonidas J. Guibas 1 1 Stanford University 2 ETH, Zurich.
Pauly, Keiser, Kobbelt, Gross: Shape Modeling with Point-Sampled GeometrySIGGRAPH 2003 Shape Modeling with Point-Sampled Geometry Mark Pauly Richard Keiser.
CSCE 641 Computer Graphics: Image Filtering & Feature Detection Jinxiang Chai.
Shape Modeling International 2007 – University of Utah, School of Computing Robust Smooth Feature Extraction from Point Clouds Joel Daniels ¹ Linh Ha ¹.
Optimal Bandwidth Selection for MLS Surfaces
Algorithms for Noise Removal and the Bilateral Filter Michael Elad Scientific Computing and Computational Mathematics (SCCM) Program Stanford University.
Hardware-Based Nonlinear Filtering and Segmentation using High-Level Shading Languages I. Viola, A. Kanitsar, M. E. Gröller Institute of Computer Graphics.
Efficient simplification of point-sampled geometry Mark Pauly Markus Gross Leif Kobbelt ETH Zurich RWTH Aachen.
Spectral Processing of Point-sampled Geometry
Defining Point Set Surfaces Nina Amenta and Yong Joo Kil University of California, Davis IDAV Institute for Data Analysis and Visualization Visualization.
Computational Photography: Image Processing Jinxiang Chai.
Robust Statistical Estimation of Curvature on Discretized Surfaces Evangelos Kalogerakis Patricio Simari Derek Nowrouzezahrai Karan Singh Symposium on.
Robust Moving Least-squares Fitting with Sharp Features Shachar Fleishman* Daniel Cohen-Or § Claudio T. Silva* * University of Utah § Tel-Aviv university.
Multi-Scale Surface Descriptors Gregory Cipriano, George N. Phillips Jr., and Michael Gleicher.
CSCE 441: Computer Graphics Image Filtering Jinxiang Chai.
Feature Sensitive Bas Relief Generation Jens Kerber 1, Art Tevs 1, Alexander Belyaev 2, Rhaleb Zayer 3, and Hans-Peter Seidel 1 1 Max-Planck-Instut für.
Neighborhood Operations
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
A Local Adaptive Approach for Dense Stereo Matching in Architectural Scene Reconstruction C. Stentoumis 1, L. Grammatikopoulos 2, I. Kalisperakis 2, E.
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
11 July 2002 Reverse Engineering 1 Dr. Gábor Renner Geometric Modelling Laboratory, Computer and Automation Research Institute.
Geographic Information Science
INFORMATIK Mesh Smoothing by Adaptive and Anisotropic Gaussian Filter Applied to Mesh Normals Max-Planck-Institut für Informatik Saarbrücken, Germany Yutaka.
Structured Face Hallucination Chih-Yuan Yang Sifei Liu Ming-Hsuan Yang Electrical Engineering and Computer Science 1.
A Two-level Pose Estimation Framework Using Majority Voting of Gabor Wavelets and Bunch Graph Analysis J. Wu, J. M. Pedersen, D. Putthividhya, D. Norgaard,
Image Enhancement [DVT final project]
Andrew Nealen / Olga Sorkine / Mark Alexa / Daniel Cohen-Or SoHyeon Jeong 2007/03/02.
Independent Component Analysis Algorithm for Adaptive Noise Cancelling 적응 잡음 제거를 위한 독립 성분 분석 알고리즘 Hyung-Min Park, Sang-Hoon Oh, and Soo-Young Lee Brain.
Effective Optical Flow Estimation
CS654: Digital Image Analysis
The 18th Meeting on Image Recognition and Understanding 2015/7/29 Depth Image Enhancement Using Local Tangent Plane Approximations Kiyoshi MatsuoYoshimitsu.
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
Geometric Modeling using Polygonal Meshes Lecture 3: Discrete Differential Geometry and its Application to Mesh Processing Office: South B-C Global.
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities Prof. Charlene Tsai.
Principles of Radar Target Tracking The Kalman Filter: Mathematical Radar Analysis.
Zl1 A sharpness dependent filter for mesh smoothing Chun-Yen Chen Kuo-Young Cheng available in CAGD Vol.22. 5(2005)
The Trilateral Filter for High Contrast Images and Meshes
Bilateral Mesh Denoising Shachar Fleishman Iddo Drori Daniel Cohen-Or Tel Aviv University.
 Present by 陳群元.  Introduction  Previous work  Predicting motion patterns  Spatio-temporal transition distribution  Discerning pedestrians  Experimental.
With Tamal Dey, Qichao Que, Issam Safa, Lei Wang, Yusu Wang Computer science and Engineering The Ohio State University Xiaoyin Ge.
Online Evolutionary Collaborative Filtering RECSYS 2010 Intelligent Database Systems Lab. School of Computer Science & Engineering Seoul National University.
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities May 2, 2005 Prof. Charlene Tsai.
Detection of closed sharp edges in point clouds Speaker: Liuyu Time:
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
CDS 301 Fall, 2008 Domain-Modeling Techniques Chap. 8 November 04, 2008 Jie Zhang Copyright ©
11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.
Miguel Tavares Coimbra
Trilateral Filtering of Range Images Using Normal Inner Products
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities Prof. Charlene Tsai.
Range Image Segmentation for Modeling and Object Detection in Urban Scenes Cecilia Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter.
Unsupervised Riemannian Clustering of Probability Density Functions
A Gentle Introduction to Bilateral Filtering and its Applications
Unsupervised Face Alignment by Robust Nonrigid Mapping
A Gentle Introduction to Bilateral Filtering and its Applications
Spectral processing of point-sampled geometry
Domain-Modeling Techniques
Presented by: Yang Yu Spatiotemporal GMM for Background Subtraction with Superpixel Hierarchy Mingliang Chen, Xing Wei, Qingxiong.
Presentation transcript:

Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Feature-Aware Filtering for Point-Set Surface Denoising Min Ki Park*Seung Joo LeeIn Yeop Jang Yong Yi Lee Kwan H. Lee Gwangju Institute of Science and Technology (GIST) Shape Modeling International 2013 (short paper)

Shape Modeling International 2013 /29 Contents  Introduction  Related work  The proposed method  Experimental results  Conclusion 2

Shape Modeling International 2013 /29 Introduction Point-based surface – No triangulation process – Simple and flexible data structure Measurement noise – Reflection, sensing error, misalignment of partial scans Denoising of a raw dataset is required 3 [Alexa01]

Shape Modeling International 2013 /29 Noise filtering Input surface(signal) – Additive noise Output surface(signal) – Noise free 4 Filtering

Shape Modeling International 2013 /29 Feature-preserving noise filtering Local averaging – Loss of salient features, details 5 Filtering

Shape Modeling International 2013 /29 Related work – Point-set surface denoising Umbrella operator [Pauly02] – Discrete Laplacian of a surface using an umbrella operator – Equal to isotropic diffusion Bilateral filtering [Fleishman03] – Height above surface is regarded as the grayscale intensity – Feature preservation using bilateral weights 6

Shape Modeling International 2013 /29 Related work – Point-set surface denoising Normal filtering [Jones04] – Normal improvement for smooth point rendering using spatial deformation Higher-order filtering [Duguet04] – Extend the bilateral filtering to second-order filtering – Surface curvature approximation using jet estimation 7

Shape Modeling International 2013 /29 Related work – Point-set surface denoising Robust moving least squares [Fleishman05; Őztireli09] – A novel MLS based surface definition via robust statistics – Outlier removal during surface reconstruction Non-local means [Guillemot12] – Improve feature preservation by exploiting self-similarities 8

Shape Modeling International 2013 /29 Problems of previous methods Fail to preserve sharp features during denoising process – Tangent discontinuity – Shallow feature – Highly curved surface Require a considerable computation time – Moving least squares surface reconstruction – Higher-order filtering via jet estimation 9

Shape Modeling International 2013 /29 Goal In this paper, we develop a fast and efficient denoising filter while preserving sharp features and small details 10

Shape Modeling International 2013 /29 Key idea Maintain multiple normals at the tangent discontinuity point after recognizing sharp features The second-order filter based on the curvature information 11

Shape Modeling International 2013 /29 Algorithm overview 12 Noisy surface Feature detectionNormal estimation Second-order filtering

Shape Modeling International 2013 /29 Feature detection Sharp feature detection via tensor voting [Park12] 13 : density : identity matrix : neighborhood : Straight line Spatial neighborhood N(p) Eigen-analysis

Shape Modeling International 2013 /29 Adaptive sub-neighborhood(ASN) 14 Tensor also encodes the local structure similarity ASN

Shape Modeling International 2013 /29 Normal estimation Smooth surface – Classical normal estimation (PCA) – Averaging the local neighborhood Normal at discontinuities – Maintain multiple normals of surface segments – Distance-based normal clustering 15 : Mahalanobis distance : Covariance matrix of all normals within ASN Tangent plane Abrupt change Tangent plane

Shape Modeling International 2013 /29 Vertex position update (previous) First-order surface approximation – [Fleishman03; Jones03; Sun07; Zheng11] – Projecting a point onto a local first-order predictor (tangent plane) – Accurate prediction for a plane, not for a highly curved surface 16 [Jones03]’s predictor [Fleishman03]’s predictor Noisy point Tangent plane of q Tangent plane of p

Shape Modeling International 2013 /29 Second-order prediction 17 Circle of curvature Predictor of p Predictor of p [Jones03]’s predictor [Fleishman03]’s predictor Noisy point

Shape Modeling International 2013 /29 Second-order prediction Second-order surface approximation 18 Our predictor Underlying surface Center of curvature

Shape Modeling International 2013 /29 Our prediction 19 Second-order approximationFirst-order approximation

Shape Modeling International 2013 /29 Proposed denoising filter 20 Spatial kernel Range kernel Predictor

Shape Modeling International 2013 /29 Results CAD-like model 21 Ground-truth Noisy modelBilateral filteringRIMLSOur method 10% Gaussian noise 20% Gaussian noise

Shape Modeling International 2013 /29 Results Free-form surface 22 Ground-truthNoisy modelBilateral filteringRIMLSOur method

Shape Modeling International 2013 /29 Results 23 ModelFandiskBunnyArmadillo Bilateral filtering RIMLS Proposed Bilateral filtering RIMLS Proposed 0% 15% ↑

Shape Modeling International 2013 /29 Comparison (6 algorithms) 24 * Results by MeshLab software [Cignoni]

Shape Modeling International 2013 /29 Comparison (6 algorithms) 25 * Results by MeshLab software [Cignoni]

Shape Modeling International 2013 /29 More results 26 Raw dataBilateral filteringRIMLS Proposed method

Shape Modeling International 2013 /29 Computation time Computation time of our method is comparable to the first-order filtering 27 * Intel i GHz CPU and 4GB RAM, no GPU

Shape Modeling International 2013 /29 Conclusion Novel second-order filtering for point-set denoising – Feature detection – Adaptive sub-neighborhood – Normal clustering – Feature-aware filtering The first- or second-order surface approximation Limitation – Dependent on the point normal estimates 28

Shape Modeling International 2013 /29 Thank you for your attention Q&A Intelligent Design and Graphics Laboratory Gwangju Institute of Science and Technology (GIST) Contact info. 29