Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.

Slides:



Advertisements
Similar presentations
Problem solving with graph search
Advertisements

Topology-Invariant Similarity and Diffusion Geometry
Inter-Surface Mapping John Schreiner, Arul Asirvatham, Emil Praun (University of Utah) Hugues Hoppe (Microsoft Research)
Corp. Research Princeton, NJ Computing geodesics and minimal surfaces via graph cuts Yuri Boykov, Siemens Research, Princeton, NJ joint work with Vladimir.
Object Detection by Matching Longin Jan Latecki. Contour-based object detection Database shapes: …..
1 Processing & Analysis of Geometric Shapes Shortest path problems Shortest path problems The discrete way © Alexander & Michael Bronstein, ©
1 Michael Bronstein Computational metric geometry Computational metric geometry Michael Bronstein Department of Computer Science Technion – Israel Institute.
An Optimization Approach to Improving Collections of Shape Maps Andy Nguyen, Mirela Ben-Chen, Katarzyna Welnicka, Yinyu Ye, Leonidas Guibas Computer Science.
CENG 789 – Digital Geometry Processing 01- Introduction Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
CENG 789 – Digital Geometry Processing 05- Smoothing and Remeshing
Asst. Prof. Yusuf Sahillioğlu
All Pairs Shortest Paths and Floyd-Warshall Algorithm CLRS 25.2
CENG 789 – Digital Geometry Processing 06- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Scale Normalization for Isometric Shape Matching Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul, Turkey.
© University of Minnesota Data Mining for the Discovery of Ocean Climate Indices 1 CSci 8980: Data Mining (Fall 2002) Vipin Kumar Army High Performance.
Numerical geometry of non-rigid shapes
1 Bronstein 2 and Kimmel Extrinsic and intrinsic similarity of nonrigid shapes Michael M. Bronstein Department of Computer Science Technion – Israel Institute.
Correspondence & Symmetry
Geometric Spanners for Routing in Mobile Networks Jie Gao, Leonidas Guibas, John Hershberger, Li Zhang, An Zhu.
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
Greedy Algorithms Reading Material: Chapter 8 (Except Section 8.5)
CS CS 175 – Week 2 Processing Point Clouds Registration.
1 Numerical geometry of non-rigid shapes Lecture II – Numerical Tools Numerical geometry of shapes Lecture II – Numerical Tools non-rigid Alex Bronstein.
Visualization and graphics research group CIPIC January 30, 2003Multiresolution (ECS 289L) - Winter MAPS – Multiresolution Adaptive Parameterization.
Tracking Moving Objects in Anonymized Trajectories Nikolay Vyahhi 1, Spiridon Bakiras 2, Panos Kalnis 3, and Gabriel Ghinita 3 1 St. Petersburg State University.
1 Bronstein, Bronstein, and Kimmel Joint extrinsic and intrinsic similarity of non-rigid shapes Rock, paper, and scissors Joint extrinsic and intrinsic.
1 Numerical geometry of non-rigid shapes A journey to non-rigid world objects Numerical methods non-rigid Alexander Bronstein Michael Bronstein Numerical.
Non-Euclidean Embedding
Greedy Algorithms Like dynamic programming algorithms, greedy algorithms are usually designed to solve optimization problems Unlike dynamic programming.
1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.
1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University
Hubert CARDOTJY- RAMELRashid-Jalal QURESHI Université François Rabelais de Tours, Laboratoire d'Informatique 64, Avenue Jean Portalis, TOURS – France.
Algorithms for 3D Isometric Shape Correspondence Yusuf Sahillioğlu Computer Eng. Dept., Koç University, Istanbul, Turkey.
Functional maps: A Flexible Representation of Maps Between Shapes SIGGRAPH 2012 Maks Ovsjanikov 1 Mirela Ben-Chen 2 Justin Solomon 2 Adrian Butscher 2.
1 Numerical geometry of non-rigid shapes Shortest path problems Shortest path problems Lecture 2 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.
Coarse-to-Fine Combinatorial Matching for Dense Isometric Shape Correspondence Yusuf Sahillioğlu and Yücel Yemez Computer Eng. Dept., Koç University, Istanbul,
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
Scalable and Fully Distributed Localization With Mere Connectivity.
Shape Analysis and Retrieval Structural Shape Descriptors Notes courtesy of Funk et al., SIGGRAPH 2004.
Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)
1 The Floyd-Warshall Algorithm Andreas Klappenecker.
Easiest-to-Reach Neighbor Search Fatimah Aldubaisi.
The all-pairs shortest path problem (APSP) input: a directed graph G = (V, E) with edge weights goal: find a minimum weight (shortest) path between every.
Mesh Coarsening zhenyu shu Mesh Coarsening Large meshes are commonly used in numerous application area Modern range scanning devices are used.
Jan Kamenický.  Many features ⇒ many dimensions  Dimensionality reduction ◦ Feature extraction (useful representation) ◦ Classification ◦ Visualization.
Presenter : Kuang-Jui Hsu Date : 2011/3/24(Thur.).
Gene expression & Clustering. Determining gene function Sequence comparison tells us if a gene is similar to another gene, e.g., in a new species –Dynamic.
CENG 789 – Digital Geometry Processing 04- Distances, Descriptors and Sampling on Meshes Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
Routing Topology Algorithms Mustafa Ozdal 1. Introduction How to connect nets with multiple terminals? Net topologies needed before point-to-point routing.
All-Pairs Shortest Paths
1 Numerical geometry of non-rigid shapes Projects Quasi-isometries Project 1 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book Numerical geometry.
Suppose G = (V, E) is a directed network. Each edge (i,j) in E has an associated ‘length’ c ij (cost, time, distance, …). Determine a path of shortest.
Multiple Sequence Alignment Vasileios Hatzivassiloglou University of Texas at Dallas.
Dynamic Programming (DP), Shortest Paths (SP)
CENG 789 – Digital Geometry Processing 07- Rigid-Body Alignment Asst. Prof. Yusuf Sahillioğlu Computer Eng. Dept,, Turkey.
CENG 789 – Digital Geometry Processing 10- Data-Driven Shape Analysis
Spectral Methods for Dimensionality
Algorithms for 3D Isometric Shape Correspondence
CENG 789 – Digital Geometry Processing 08- Rigid-Body Alignment
Hans Bodlaender, Marek Cygan and Stefan Kratsch
Assoc. Prof. Yusuf Sahillioğlu
Morphing and Shape Processing
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
Scale-Space Representation for Matching of 3D Models
Dijkstra Algorithm.
Floyd’s Algorithm (shortest-path problem)
Scale-Space Representation for Matching of 3D Models
Presentation transcript:

Multiple Shape Correspondence by Dynamic Programming Yusuf Sahillioğlu 1 and Yücel Yemez 2 Pacific Graphics 2014 Computer Eng. Depts, 1, 2, Turkey.

Goal: Find correspondences between all shapes in the collection:.. Key: Minimize the overall distortion. Naïve algorithm: Pick the min-distortion map between each consecutive pair.. Problem: No guarantee on the overall distortion, i.e., distortions of the maps between non-consecutive pairs, e.g., and, may be very high. Our dynamic programming algorithm addresses this multiple shape correspondence problem. Problem Statement

Improved pairwise correspondences to better perform Shape interpolation: Attribute transfer: Shape registration: Shape matching: Statistical shape analysis: Applications

Improved pairwise correspondences suggests with a total distortion sum of = = <.196 Contributions VS.

Contributions An algorithm which explicitly minimizes the overall distortion while enforcing consistency*. Dynamic programming. Novel graph structure. No initial set of maps required. No embedding ambiguities and errors. Close approximation to the optimal solution. Much faster than the alternatives. * A set of maps is consistent iff all cycles of maps yield the identity map.

A collection of initially unmatched isometric: or nearly isometric shapes: Scope with arbitrary topology and scaling, as well as potential noise and non-uniform triangulation.

Our method is purely isometric. Intrinsic global property. Similar shapes have similar metric structures. Metric: Geodesic distance g. Isometry Isometric distortion of a map between shapes and g g gg g g g g average for A variant of the isometric distortion measures used in Bronstein et al., SISC, Huang et al., SGP, Sahillioğlu and Yemez, {PAMI, 2012}, {CGF, 2013}.

Same graph used in all multiple shape corresponders so far. Vertices: all shapes. Edges: weighted by the matching cost of the initially assumed pairwise maps. Graph Representation General theme: Replace potentially “bad” maps with compositions of “better” maps. Charpiat, NORDIA’09: Replaces a pairwise map b/w each shape pair by the composition of maps on the shortest path between the two shapes. Nguyen et al., SGP’11: Force all 3-cycles of maps return to identity. Huang et al., SIGGRAPH Asia’12: Cycle consistency plus neighbor-preservation. Huang and Guibas, SGP’13: Cycle consistency as the solution to a semidef. program.

We introduce a novel graph. Vertices: maps between shape extremities. Edges: no weighting (no initial maps required). Graph Representation Optimal path finding on this graph to solve our problem. Accumulate & Use distortion info on growing paths via DP.

All shapes in the collection: Algorithm

Enumerate maps between consecutive shapes as graph vertices: for

Create paths from to and store their overall isometric distortions m=1m=2m=3 m=4 m=M-1. Initially (m=1) a path is just a vertex and its distortion is easy to compute:. 3 rd shape in process.Create paths ending at x-marked vertex. Compute each path distortion via dynamic programming: Eq. 6 Save only the highlighted path with min-distortion. Do the same for the next x-marked graph vertex.And the same for another x-marked vertex. 4 th shape in process. Note that existing paths may change, e.g., subpath to top node in is updated. 5 th shape in process. Last shape in process. Output the path with min-distortion: That is, the vertices/maps on this red path.

Results Huang et al., SIGGRAPH Asia, Our method.

Different map enumarations, e.g., to produce different types of correspondences. Partially isometric. Non-isometric. Dense (currently we match 300- samples on a high-reso and interpolate to full dense map). Future Work New ways of combining maps other than composition.

Rather than improving a given set of initial pairwise maps, explicitly minimize the overall isometric distortion function Isometric distortion minimized in the original 3D Euclidean space wherein isometry is defined, i.e., no embedding. Output: consistent bijections over all pairs of isometric sets. Closely approximates the optimal solution in a fast way. Robust to non-uniform triangulation and noise. No restriction on topology. Conclusion

Assoc. Prof. Yücel Yemez, PhD supervisor Yusuf, Asst. Prof. People