Qifeng Chen Stanford University Vladlen Koltun Intel Labs.

Slides:



Advertisements
Similar presentations
Discontinuity Preserving Stereo with Small Baseline Multi-Flash Illumination Rogerio Feris 1, Ramesh Raskar 2, Longbin Chen 1, Karhan Tan 3 and Matthew.
Advertisements

Primal-dual Algorithm for Convex Markov Random Fields Vladimir Kolmogorov University College London GDR (Optimisation Discrète, Graph Cuts et Analyse d'Images)
Bayesian Belief Propagation
L1 sparse reconstruction of sharp point set surfaces
Kick-off Meeting, July 28, 2008 ONR MURI: NexGeNetSci Distributed Coordination, Consensus, and Coverage in Networked Dynamic Systems Ali Jadbabaie Electrical.
Constrained Approximate Maximum Entropy Learning (CAMEL) Varun Ganapathi, David Vickrey, John Duchi, Daphne Koller Stanford University TexPoint fonts used.
Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.
ICCV 2007 tutorial Part III Message-passing algorithms for energy minimization Vladimir Kolmogorov University College London.
Discrete Optimization in Computer Vision Nikos Komodakis Ecole des Ponts ParisTech, LIGM Traitement de l’information et vision artificielle.
Screened Poisson Surface Reconstruction
1 Michael Bronstein Heat diffusion descriptors deformable Michael Bronstein Weizmann Institute of Science, 4 November 2010 Institute of Computational Science.
The University of Ontario CS 4487/9687 Algorithms for Image Analysis Multi-Label Image Analysis Problems.
Modeling the Shape of People from 3D Range Scans
Topology-Invariant Similarity and Diffusion Geometry
1 Numerical Geometry of Non-Rigid Shapes Diffusion Geometry Diffusion geometry © Alexander & Michael Bronstein, © Michael Bronstein, 2010 tosca.cs.technion.ac.il/book.
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Discrete geometry Lecture 2 1 © Alexander & Michael Bronstein
Shape reconstruction and inverse problems
Distributed Message Passing for Large Scale Graphical Models Alexander Schwing Tamir Hazan Marc Pollefeys Raquel Urtasun CVPR2011.
Optimal invariant metrics for shape retrieval
CS448f: Image Processing For Photography and Vision Graph Cuts.
An Optimization Approach to Improving Collections of Shape Maps Andy Nguyen, Mirela Ben-Chen, Katarzyna Welnicka, Yinyu Ye, Leonidas Guibas Computer Science.
Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.
Spectral embedding Lecture 6 1 © Alexander & Michael Bronstein
Correspondence & Symmetry
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
Particle filters (continued…). Recall Particle filters –Track state sequence x i given the measurements ( y 0, y 1, …., y i ) –Non-linear dynamics –Non-linear.
1 Numerical geometry of non-rigid shapes Lecture II – Numerical Tools Numerical geometry of shapes Lecture II – Numerical Tools non-rigid Alex Bronstein.
Niloy J. Mitra1, Natasha Gelfand1, Helmut Pottmann2, Leonidas J
Spectral Embedding Alexander Bronstein, Michael Bronstein
Numerical geometry of non-rigid shapes
1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Non-Euclidean Embedding
Research at Intel Distributed Localization of Modular Robot Ensembles Robotics: Science and Systems 25 June 2008 Stanislav Funiak, Michael Ashley-Rollman.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.
1 Numerical Geometry of Non-Rigid Shapes Invariant shape similarity Invariant shape similarity © Alexander & Michael Bronstein, © Michael Bronstein,
1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
1 Bronstein 2 & Kimmel Matching 2D articulated shapes using GMDS AMDO, Puerto de Andratx, 2006 Matching 2D articulated shapes using Generalized Multidimensional.
CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.
1 M. Bronstein Multigrid multidimensional scaling Multigrid Multidimensional Scaling Michael M. Bronstein Department of Computer Science Technion – Israel.
Collaborative Filtering Matrix Factorization Approach
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin.
Evolving Curves/Surfaces for Geometric Reconstruction and Image Segmentation Huaiping Yang (Joint work with Bert Juettler) Johannes Kepler University of.
Computing the shortest path on a polyhedral surface Presented by: Liu Gang
Shape Matching for Model Alignment 3D Scan Matching and Registration, Part I ICCV 2005 Short Course Michael Kazhdan Johns Hopkins University.
Ordinary Least-Squares Emmanuel Iarussi Inria. Many graphics problems can be seen as finding the best set of parameters for a model, given some data Surface.
Coarse-to-Fine Combinatorial Matching for Dense Isometric Shape Correspondence Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul,
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
Spectral Global Intrinsic Symmetry Invariant Functions Hui Wang Shijiazhuang Tiedao University Patricio Simari The Catholic University of America Zhixun.
CSCE 643 Computer Vision: Structure from Motion
Global Parametrization of Range Image Sets Nico Pietroni, Marco Tarini, Olga Sorkine, Denis Zorin.
Algorithms for MAP estimation in Markov Random Fields Vladimir Kolmogorov University College London.
Discrete Optimization Lecture 3 – Part 1 M. Pawan Kumar Slides available online
Roee Litman, Alexander Bronstein, Michael Bronstein
Automatic Locating of Anthropometric Landmarks on 3D Human Models
The 18th Meeting on Image Recognition and Understanding 2015/7/29 Depth Image Enhancement Using Local Tangent Plane Approximations Kiyoshi MatsuoYoshimitsu.
Lecture 19: Solving the Correspondence Problem with Graph Cuts CAP 5415 Fall 2006.
Active Frame Selection for Label Propagation in Videos Sudheendra Vijayanarasimhan and Kristen Grauman Department of Computer Science, University of Texas.
Efficient Belief Propagation for Image Restoration Qi Zhao Mar.22,2006.
Speaker Min-Koo Kang March 26, 2013 Depth Enhancement Technique by Sensor Fusion: MRF-based approach.
Progress Report #2 Alvaro Velasquez. Project Selection I chose to work with Nasim Souly on the project titled “Subspace Clustering via Graph Regularized.
High Dimensional Probabilistic Modelling through Manifolds
Morphing and Shape Processing
Point-wise Map Recovery and Refinement from Functional Correspondence
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
Collaborative Filtering Matrix Factorization Approach
Adaptive Cooperative Systems Chapter 6 Markov Random Fields
Rong Ge, Duke University
Presentation transcript:

Qifeng Chen Stanford University Vladlen Koltun Intel Labs

Intra-subject registration

Inter-subject registration

 Loop closure in dynamic reconstruction  Shape analysis  Propagation of material properties across 3D models  Surface completion

 Intrinsic descriptors  Heat kernel signature [Sun et al. 2009]  Wave kernel signature [Aubry et al. 2011]  Global point signature [Rustamov 2007]  Spectral descriptors [Litman et al. 2014]  Optimal descriptors [Windheuser et al. 2014]

 Generalized multidimensional scaling (GMDS) [Bronstein et al. 2006] Given two surfaces Compute mapping Minimize highly nonconvex objective Optimize by gradient descent Easily stuck at bad local minima (GMDS)

 Let and be points densely sampled over and  Optimize labeling ( is a set of m labels) (GMDS) (Discrete MRF) Continuous Markov random field (MRF)

(Discrete MRF) (Linear program) where

(Linear program) (Dual LP)

(Linear program) (Dual LP) TRW-S [Kolmogorov 2006]

 Penalty  Objective where disambiguates intrinsic symmetry

 Preprocessing  Poisson reconstruction for geodesic distance  farthest point sampling  Global optimization  sample hundreds of points  random permutation of the nodes for best solution  Upsampling and refinement (optional)  upsample mapping to thousands of correspondences  refine the correspondences by fusion moves

FAUST [Bogo et al. 2014]

 Our approach outperforms a large body of prior work by a factor of 3

Blended intrinsic maps [Kim et al. 2011] Random forest [Rodola et al. 2014] Our approach

 Simple but robust  no descriptors  convex optimization  outperforms a large body of prior work by a multiplicative factor  Future work  partial surface registration  joint analysis of non-isometric shapes

 Matlab, C++ code, and data