Mapping & Warping shapes Geometry Acquisition Zheng Hanlin 2011.07.05 -- Summer Seminar.

Slides:



Advertisements
Similar presentations
Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.
Advertisements

Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
L1 sparse reconstruction of sharp point set surfaces
Yang Yang, Miao Jin, Hongyi Wu Presenter: Buri Ban The Center for Advanced Computer Studies (CACS) University of Louisiana at Lafayette 3D Surface Localization.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Text Scaffolds for Effective Surface Labeling Gregory Cipriano and Michael Gleicher.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
Extended Gaussian Images
Robust Global Registration Natasha Gelfand Niloy Mitra Leonidas Guibas Helmut Pottmann.
Xianfeng Gu, Yaling Wang, Tony Chan, Paul Thompson, Shing-Tung Yau
Model-Driven 3D Content Creation as Variation Hao (Richard) Zhang – 张皓 GrUVi Lab, Simon Fraser University (SFU) HKUST, 04/21/11 TAUZJUNUDT SFU.
Pseudo-Skeleton based ARAP Mesh Deformation M. Zollhöfer, A. Vieweg, J. Süßmuth and G. Greiner Computer Graphics Group, FAU Erlangen-Nuremberg, Germany.
Instructor: Mircea Nicolescu Lecture 13 CS 485 / 685 Computer Vision.
Lapped Textures Emil Praun and Adam Finkelstien (Princeton University) Huges Hoppe (Microsoft Research) SIGGRAPH 2000 Presented by Anteneh.
Reverse Engineering Niloy J. Mitra.
INFORMATIK Differential Coordinates for Interactive Mesh Editing Yaron Lipman Olga Sorkine Daniel Cohen-Or David Levin Tel-Aviv University Christian Rössl.
An Optimization Approach to Improving Collections of Shape Maps Andy Nguyen, Mirela Ben-Chen, Katarzyna Welnicka, Yinyu Ye, Leonidas Guibas Computer Science.
Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.
A Sketch-Based Interface for Detail-Preserving Mesh Editing Andrew Nealen Olga Sorkine Marc Alexa Daniel Cohen-Or.
Example Based 3D Shape Completion Mark Pauly 1,2, Niloy J. Mitra 1, Joachim Giesen 2, Markus Gross 2, Leonidas J. Guibas 1 1 Stanford University 2 ETH,
Pauly, Keiser, Kobbelt, Gross: Shape Modeling with Point-Sampled GeometrySIGGRAPH 2003 Shape Modeling with Point-Sampled Geometry Mark Pauly Richard Keiser.
Correspondence & Symmetry
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
Randomized Cuts for 3D Mesh Analysis
High-Quality Video View Interpolation
Theodoros Athanasiadis Ioannis Fudos Department of Computer Science
FiberMesh: Designing Freeform Surfaces with 3D Curves
Disediakan oleh Suriati bte Sadimon GMM, FSKSM, UTM Graphics modeling.
Accurate, Dense and Robust Multi-View Stereopsis Yasutaka Furukawa and Jean Ponce Presented by Rahul Garg and Ryan Kaminsky.
Nonlinear Dimensionality Reduction Approaches. Dimensionality Reduction The goal: The meaningful low-dimensional structures hidden in their high-dimensional.
Jinhui Tang †, Shuicheng Yan †, Richang Hong †, Guo-Jun Qi ‡, Tat-Seng Chua † † National University of Singapore ‡ University of Illinois at Urbana-Champaign.
Laplacian Surface Editing
Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University
What Does the Scene Look Like From a Scene Point? Donald Tanguay August 7, 2002 M. Irani, T. Hassner, and P. Anandan ECCV 2002.
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Feature-Aware Filtering for Point-Set Surface Denoising Min Ki Park*Seung.
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
Context-based Surface Completion Andrei Sharf, Marc Alexa, Daniel Cohen-Or.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Mesh Deformation Based on Discrete Differential Geometry Reporter: Zhongping Ji
1 Style-Content Separation by Anisotropic Part Scales Kai Xu, Honghua Li, Hao Zhang, Daniel Cohen-Or Yueshan Xiong, Zhi-Quan Cheng Simon Fraser Universtiy.
1 Surface Applications Fitting Manifold Surfaces To 3D Point Clouds, Cindy Grimm, David Laidlaw and Joseph Crisco. Journal of Biomechanical Engineering,
Projecting points onto a point cloud with noise Speaker: Jun Chen Mar 26, 2008.
INFORMATIK Laplacian Surface Editing Olga Sorkine Daniel Cohen-Or Yaron Lipman Tel Aviv University Marc Alexa TU Darmstadt Christian Rössl Hans-Peter Seidel.
Ground Truth Free Evaluation of Segment Based Maps Rolf Lakaemper Temple University, Philadelphia,PA,USA.
Spectral surface reconstruction Reporter: Lincong Fang 24th Sep, 2008.
Andrew Nealen / Olga Sorkine / Mark Alexa / Daniel Cohen-Or SoHyeon Jeong 2007/03/02.
TEMPLATE DESIGN © We presented a simple and effective orienter for defective raw point sets. By seamlessly combining the.
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
David Levin Tel-Aviv University Afrigraph 2009 Shape Preserving Deformation David Levin Tel-Aviv University Afrigraph 2009 Based on joint works with Yaron.
CENG 789 – Digital Geometry Processing 04- Distances, Descriptors and Sampling on Meshes Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Deformation using interpolation CSE 3541 Matt Boggus.
Large-Scale Matrix Factorization with Missing Data under Additional Constraints Kaushik Mitra University of Maryland, College Park, MD Sameer Sheoreyy.
Detection of closed sharp edges in point clouds Speaker: Liuyu Time:
A Part-aware Surface Metric for Shape Analysis Rong Liu 1, Hao Zhang 1, Ariel Shamir 2, and Daniel Cohen-Or 3 1 Simon Fraser University, Canada 2 The Interdisciplinary.
Photoconsistency constraint C2 q C1 p l = 2 l = 3 Depth labels If this 3D point is visible in both cameras, pixels p and q should have similar intensities.
Automated Geo-referencing of Images Dr. Ronald Briggs Yan Li GeoSpatial Information Sciences The University.
Course: Structure-Aware Shape Processing Introduction to Geometric ‘Structure’ Extracting Structures –analysis of Individual Models –analysis of Shape.
Shape2Pose: Human Centric Shape Analysis CMPT888 Vladimir G. Kim Siddhartha Chaudhuri Leonidas Guibas Thomas Funkhouser Stanford University Princeton University.
1 Spherical manifolds for hierarchical surface modeling Cindy Grimm.
Acquiring, Stitching and Blending Diffuse Appearance Attributes on 3D Models C. Rocchini, P. Cignoni, C. Montani, R. Scopigno Istituto Scienza e Tecnologia.
Deformation techniques
Morphing and Shape Processing
Introduction to Graphics Modeling
Fast Preprocessing for Robust Face Sketch Synthesis
The Brightness Constraint
Paper Presentation: Shape and Matching
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
The Brightness Constraint
CSE 554 Lecture 10: Extrinsic Deformations
Presentation transcript:

Mapping & Warping shapes Geometry Acquisition Zheng Hanlin Summer Seminar

Papers Bounded Biharmonic Weight for Real-Time Deformation (SIG11) Biharmonic Distance (TOG11) Blended Intrinsic Maps (SIG11) Photo-Inspired Model-Driven 3D Object Modeling (SIG11) Style-Content Separation by Anisotropic Part Scales (SIGA10) L1-Sparse Reconstruction of Sharp Point Set Surfaces (TOG) GlobFit: Consistently Fitting Primitives by Discovering Global Relations (SIG11) Data-Driven Suggestions for Creativity Support in 3D Modeling (SIGA10)

Bounded Biharmonic Weight for Real-Time Deformation Sig11

Authors Alec Jacobson – Ph.D. Candidate

Authors Ilya Baran – Postdoc. – Disney Research in Zurich

Authors Olga Sorkine Assistant Professor ETH Zurich

The Main Idea Shape deformation – Work freely with the most convenient combination of handle types bone cage points

Motivation(Video) Typical flow for deformation – Bind the object to handles (bind time) – Manipulate the handles (pose time) Different handle types have different advantages and disadvantages Design the weights for a linear blending scheme Real-time responce

Motivations Deformation Type Free-formSkeleton- based Generalized barycentric coordinate Advantage Nature control for rigid limbs Provide smooth weights automatically Disadvantage Require regular structure Less convenient for flexible regions Need (nearly) closed cages

Algorithm Linear blending: Affine transformation of handle Hj New position Old position Handle size Weight function Bounded biharmonic weights

Algorithm Bounded biharmonic weights:

Algorithm Bounded biharmonic weights: – Properties: Smoothness Non-negativity Shape-awareness Partition of unity Locality and sparsity No local maxima

Algorithm Bounded v.s. Unbounded

Results & Comparison

Results

Performance

Limitation The optimization is not fast enough – Bind-time This weights do NOT have the linear precision property

Conclusion Unify all popular types of control armatures Intuitive design of real-time blending deformation

Biharmonic Distance TOG11

Authors Yaron LipmanRaif M. Rustamov Thomas Funkhouser

The Main Idea A new distance measure based on the biharmonic differential operator

Motivation The most important properties for a distance – metric – smooth – Locally isotropic – Globally shape-aware – Isometry invariant – Insensitive to noise – Small topology changes – Parameter free – Practical to compute on a discrete mesh – … Does there exist a measure cover all these properties?

Related works Geodesic distance – Not smooth, insensitive to topology Diffusion distance – Not locally isotropic – Not global shape-aware – Depending on parameter Commute-time distance (Graph) – Cannot define on surfaces – Depending on the conformal structure

Algorithm Continuous cases: Biharmonic: Green’s function

Algorithm Discrete cases Can be proved: Conformal discrete laplacian

Results & Comparisons

Applications Function interpolation on surfaces

Applications Surface matching

Performances

Conclusions A novel surface distance – Has good properties

Blended Intrinsic Maps Sig11

Authors Vladimir G. Kim – Ph.D. Candidate – Princeton Univ. – He has Canadian and Kyrgyz citizenships.

Authors Yaron Lipman Thomas Funkhouser

The Main Idea Find the maps between two genus 0 surfaces

Related Works Inter-surface mapping Finding sparse correspondences Iterative closest points Finding dense correspondences Surface embedding Exploring Mobius Transformations

Algorithm Blended map Candidate maps Smooth blending weights

Algorithm Generating maps (candidate conformal maps) Defining confidence weights – How much distorting is induced Finding consistency weights – Lower values for incorrect matches Blend map

More Details Finding Consistency Weights – Objective Function – Similarity measure – Optimizing

Results & Comparisons

Results & Performances

Limitation & Conclusion Limitations: – Not guaranteed to work in case of partial near-isometric matching – Only for genus zero surfaces now An automatic method for finding a map between surfaces (including non-isometric surfaces)

Photo-Inspired Model-Driven 3D Object Modeling Sig11

The Main Idea Modeling – From single photo

Workflow

Algorithm Model-driven object analysis – Part-based retrieval Silhouette-guided structure-preserving deformation – Controller construction – Structure-preserving controller optimization

Algorithm Model-driven object analysis – Part-based retrieval Silhouette-guided structure-preserving deformation – Controller construction – Structure-preserving controller optimization

Results

Limitations Limitations: – Candidate sets: new geometric variations but not new structure – Only considered reflectional symmetry

Future works More effective means of structure modification and editing fine-detailed features Using model-driven approach to allow more reusability More means to inspire the user in creative 3D modeling

Style-Content Separation by Anisotropic Part Scales SigA10

The Main Idea

Workflow

Results

Limitations & Conclusions Limitation – Input set should be in the same semantic class – The initial segmentation should be sufficiently meaningful – The synthesis method limits itself to creating new variations of an existing example model Analyze a set of 3D objects belonging to the same class while exhibiting significant shape variations, particularly in part scale

L1-Sparse Reconstruction of Sharp Point Set Surfaces Haim Avron Tel-Aviv Univ. Andrei Sharf UC-Davis Chen Greif Univ. of British Columbia Daniel Cohen-Or Tel-Aviv Univ. TOG11

Authors Haim Avron – Postdoctoral T.J. Watson Research Center – Research field: Numerical linear algebra High performance computing

Authors Chen Greif – Associate Professor – Scientific Computing Laboratory Department of Computer UBC – Research Interests: Iterative solvers Saddle-point linear systems Preconditioning techniques PageRank

The Main Idea Reconstruction

Motivation L1-sparsity paradigm avoid the pitfalls such as least squares, namely smoothed out error – L2 norm tends to severely penalize outliers and propagate the residual in the objective function uniformly Sharp features – Outliers are not excessively penalized – Objective function is expected to be more concentrated near the sharp features.

Related Works 3D Surface Reconstruction Sparse Signal Reconstruction continuous signalbasis functions

Workflow Orientation Reconstruction Position Reconstruction

More Details Orientation Reconstruction – Assume the surface can be approximated well by local planes

More Details Position Reconstruction Second-Order Cone Problem(SOCP) Slover: CVX [Grant and Boyd 2009]

Results

Results & Comparisons

Performance

Limitation & Conclusion Limitations: – Difficult to correctly project points lying exactly on edge singularities. – High computational cost A l1-sparse approach for reconstruction of point set surface with sharp features

GlobFit: Consistently Fitting Primitives by Discovering Global Relations Sig11

Authors Yangyan Li ( 李扬彦 ) – Ph.D. Candidate – Visual Computing Center of SIAT – Chinese Academy of Sciences Xiaokun Wu ( 吴晓堃 )

Authors Yiorgos Chrysanthou – Associate Professor – Univ. of Syprus – The head of the Graphics the University of Cyprus – His current research interests: real-time rendering visibility, crowd rendering and simulation virtual and augmented reality and applications to cultural heritage.

Authors Andrei Sharf – Computer Science Department – Ben-Gurion Univ. – Research interests: Geometry processing and 3D modeling Interactive techniques Topology, parallel data structures on the GPU Large scale 3D urban modeling

Authors Daniel Cohen-Or Niloy J. Mitra

The Main Idea Recover the global mutual relations

Related Works Surface Reconstruction Feature Detection Reverse engineering …

The Workflow

Main Contributions A global approach to constrain and optimize the local RANSAC based primitives

More Details Greedy v.s. Global

More Details re-RANSAC

Evaluation Synthetic datasets – Compare face normals and distances Scanned datasets

Results

Limitations Noise will make the results bad

Conclusion A method for incorporating global relations for man-made objects.

Data-Driven Suggestions for Creativity Support in 3D Modeling

Authors Siddhartha Chaudhuri – Ph.D. Student – Stanford Univ. – Research area: Richer tools for 3D content creation

Authors Vladlen Koltun – Assistant Prof. – Stanford Univ. – Research area: Computer graphics Interactive techniques

Thanks!