Tracking Surfaces with Evolving Topology Morten Bojsen-Hansen IST Austria Hao Li Columbia University Chris Wojtan IST Austria.

Slides:



Advertisements
Similar presentations
Image Segmentation with Level Sets Group reading
Advertisements

Complex Networks for Representation and Characterization of Images For CS790g Project Bingdong Li 9/23/2009.
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Yingcai Xiao Chapter 6 Fundamental Algorithms. Types of Visualization Transformation Types 1.Data (Attribute Transformation) 2.Topology (Topological Transformation)
GRAPP, Lisbon, February 2009 University of Ioannina Skeleton-based Rigid Skinning for Character Animation Andreas Vasilakis and Ioannis Fudos Department.
Applications of Euler’s Formula for Graphs Hannah Stevens.
Extended Gaussian Images
Eurographics 2012, Cagliari, Italy GPU based ARAP Deformation using Volumetric Lattices M. Zollhöfer, E. Sert, G. Greiner and J. Süßmuth Computer Graphics.
Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.
Overlay of Two Subdivisions
Modeling the Shape of People from 3D Range Scans
3DSkeleton-based Human Modeling with Metaballs 18 April 2008 Donghun Kim Robot Vision Lab.
A Painting Interface for Interactive Surface Deformations Jason Lawrence Thomas Funkhouser Princeton University.
Xianfeng Gu, Yaling Wang, Tony Chan, Paul Thompson, Shing-Tung Yau
Inter-Surface Mapping John Schreiner, Arul Asirvatham, Emil Praun (University of Utah) Hugues Hoppe (Microsoft Research)
Computer Graphics Group Alexander Hornung Alexander Hornung and Leif Kobbelt RWTH Aachen Robust Reconstruction of Watertight 3D Models from Non-uniformly.
CSE554ContouringSlide 1 CSE 554 Lecture 4: Contouring Fall 2013.
CS447/ Realistic Rendering -- Solids Modeling -- Introduction to 2D and 3D Computer Graphics.
Computing 3D Geometry Directly From Range Images Sarah F. Frisken and Ronald N. Perry Mitsubishi Electric Research Laboratories.
Shape from Contours and Multiple Stereo A Hierarchical, Mesh-Based Approach Hendrik Kück, Wolfgang Heidrich, Christian Vogelgsang.
Asst. Prof. Yusuf Sahillioğlu
A Study of Approaches for Object Recognition
Image Morphing : Rendering and Image Processing Alexei Efros.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin.
Modeling and representation 1 – comparative review and polygon mesh models 2.1 Introduction 2.2 Polygonal representation of three-dimensional objects 2.3.
11/30/04© University of Wisconsin, CS559 Fall 2004 Last Time More modeling: –Hierarchical modeling –Instancing and Parametric Instancing –Constructive.
Computer Graphics Group Tobias Weyand Mesh-Based Inverse Kinematics Sumner et al 2005 presented by Tobias Weyand.
Image Processing and Analysis (ImagePandA) 10 – Shape and Motion Christoph Lampert / Chris Wojtan.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Algorithms for Triangulations of a 3D Point Set Géza Kós Computer and Automation Research Institute Hungarian Academy of Sciences Budapest, Kende u
Geometric Modeling using Polygonal Meshes Lecture 1: Introduction Hamid Laga Office: South.
Reporter: Zhonggui Chen
Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis
Sparse Shape Representation using the Laplace-Beltrami Eigenfunctions and Its Application to Modeling Subcortical Structures Xuejiao Chen.
A 3D Model Alignment and Retrieval System Ding-Yun Chen and Ming Ouhyoung.
Shape Analysis and Retrieval Structural Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.
Geometric Objects and Transformation
A Fast and Accurate Tracking Algorithm of the Left Ventricle in 3D Echocardiography A Fast and Accurate Tracking Algorithm of the Left Ventricle in 3D.
Roee Litman, Alexander Bronstein, Michael Bronstein
Non-Manifold Multi-Tesselations From Meshes to Iconic Representations of Objects L. De Floriani, P. Magillo, E. Puppo, F. Morando DISI - University of.
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
CSE554ContouringSlide 1 CSE 554 Lecture 4: Contouring Fall 2015.
CENG 789 – Digital Geometry Processing 04- Distances, Descriptors and Sampling on Meshes Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
1 CS 430/585 Computer Graphics I 3D Modeling: Subdivision Surfaces & Solid Modeling Week 9, Lecture 17 David Breen, William Regli and Maxim Peysakhov Geometric.
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
CHAPTER 5 CONTOURING. 5.3 CONTOURING Fig 5.7. Relationship between color banding and contouring Contour line (isoline): the same scalar value, or isovalue.
Edge Groups: An Approach to Understanding the Mesh Quality of Marching Methods IEEE Transactions on Visualization and Computer Graphics Authors: Carlos.
Recent Progress in Mesh Parameterization Speaker : ZhangLei.
Advisor : Ku-Yaw Chang Speaker : Ren-Li Shen /6/12.
Occlusion Tracking Using Logical Models Summary. A Variational Partial Differential Equations based model is used for tracking objects under occlusions.
CDS 301 Fall, 2008 Domain-Modeling Techniques Chap. 8 November 04, 2008 Jie Zhang Copyright ©
DPL3/10/2016 CS 551/651: Simplification Continued David Luebke
Reducing Artifacts in Surface Meshes Extracted from Binary Volumes R. Bade, O. Konrad and B. Preim efficient smoothing of iso-surface meshes Plzen - WSCG.
3D Object Representations 2009, Fall. Introduction What is CG?  Imaging : Representing 2D images  Modeling : Representing 3D objects  Rendering : Constructing.
Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.
Image Morphing © Zooface Many slides from Alexei Efros, Berkeley.
We propose a method which can be used to reduce high dimensional data sets into simplicial complexes with far fewer points which can capture topological.
POLYGON MESH Advance Computer Graphics
CS Computer Graphics II
Recognizing Deformable Shapes
Real Time Dense 3D Reconstructions: KinectFusion (2011) and Fusion4D (2016) Eleanor Tursman.
Dynamical Statistical Shape Priors for Level Set Based Tracking
Outline Nonlinear Dimension Reduction Brief introduction Isomap LLE
Domain-Modeling Techniques
Lecture 3 : Isosurface Extraction
Volume Graphics (lecture 4 : Isosurface Extraction)
3D Object Recognition and 2-Simplex Meshes
A Volumetric Method for Building Complex Models from Range Images
Three Step Geometric Pipeline
Overlay of Two Subdivisions
Presentation transcript:

Tracking Surfaces with Evolving Topology Morten Bojsen-Hansen IST Austria Hao Li Columbia University Chris Wojtan IST Austria

Introduction Implicit surfaces are extremely popular for representing time-evolving surfaces Fluid simulation Morphing

Introduction No correspondence information Extracting correspondences between time- varying meshes ?

Input: – time-varying meshes frames Output – Correspondences between mesh frames

The correspondences are useful

Basic idea frame1 Mesh M Deform M to frame n; n=n+1; deformed mesh M’; Save M’; M=M’

Basic idea Let just consider two successive frames – non-rigid alignment – Topological change – Record correspondence information Frame t (M)Frame t+1 (N) alignmentTopological change

Non-Rigid Alignment Hao Li Columbia University Coarse Non-Linear Alignment Fine-Scale Linear Alignment Robust single-view geometry and motion reconstruction,2009,tog

Non-Rigid Alignment M->N 1 deformation graph G – constructed by uniformly sub-sampling M 2 Find affine an affine transformation (Ai; bi) for each graph node. 3 the motion of Xi is defined as a linear combination of the computed graph node transformations

Non-Rigid Alignment M->N (Coarse Non-Linear Alignment)

Non-Rigid Alignment M->N (Fine-Scale Linear Alignment)

Basic idea Let just consider two successive frames – non-rigid alignment – Topological change – Record correspondence information Frame t (M)Frame t+1 (N) alignmentTopological change

Topological Change Deforming meshes that split and merge,2009,TOG Chris Wojtan IST Austria

Topological Change For mesh M – volumetric grid Compute signed distance function – topologically complex cell the intersection of M with the cell is more complex than what can be represented by a marching cubes reconstruction inside the cellmarching cubes – triangles of M inside such cells will be replaced by marching cubes triangles

Topological Change Deforming meshes that split and merge,2009,TOG

Basic idea Let just consider two successive frames – non-rigid alignment – Topological change – Record correspondence information Frame t (M)Frame t+1 (N) alignmentTopological change

Record correspondence information A Few vertices which were created or destroyed due to topology event list – Adding new geometry: propagate information from the vertices on the boundary – Deleting vertices: march inward from the boundary of the deleted vertices and propagate information

Full Pipeline Mesh M = LoadTargetMesh(S1) ImproveMesh(M) for frame n = 2 -> N do { LoadTargetMesh(Sn) ImproveMesh(M) ImproveMesh(M) SaveEventListToDisk(n) SaveMeshToDisk(M) } non-rigid registration changing surface mesh topology CoarseNonRigidAlignment(M, Sn) FineLinearAlignment(M, Sn) Ф(M) := CalculateSignedDistance(M) ConstrainTopology(M; фM ) ф (Sn) := alculateSignedDistance(Sn) ConstrainTopology(M; ф (Sn))

Applications Color

Applications Morph

Applications Displacement Maps

Applications Wave simulation

Applications Performance Capture

Evolution

Time

contributions the first comprehensive framework for tracking a series of closed surfaces where topology can change greatly enhance existing datasets with valuable temporal correspondence information. a novel topology-aware wave simulation algorithm for enhancing the appearance of existing liquid simulations while significantly reducing the noise present in similar approaches. extracts surface information from input data alone, – no assumptions about how the data was generated – no template

unable to track surfaces invariant under our energy functions; a surface with no significant geometric features (like a rotating sphere) will not be tracked accurately limited to closed manifold surfaces limitations

Done Thanks!

triangle mesh improvement Edges become too long split them in half by adding a new vertex at the midpoint

triangle mesh improvement edges become too short; triangle interior angles become too small; dihedral angles become too small – edge collapse by replacing an edge with a single vertex Back

Topological Change Marching cube s/0405/shape/marching_cubes.html back