Structure-Aware Shape Processing Part III Example Applications Martin Bokeloh Niloy Mitra Michael Wand Hao Zhang Daniel Cohen-Or Martin Bokeloh.

Slides:



Advertisements
Similar presentations
Coherent Laplacian 3D protrusion segmentation Oxford Brookes Vision Group Queen Mary, University of London, 11/12/2009 Fabio Cuzzolin.
Advertisements

Machine Learning for Vision-Based Motion Analysis Learning pullback metrics for linear models Oxford Brookes Vision Group Oxford Brookes University 17/10/2008.
1/50 Photo-Inspired Model-Driven 3D Object Modeling Kai Xu 1,2 Hanlin Zheng 3 Hao (Richard) Zhang 2 Daniel Cohen-Or 4 Ligang Liu 3 Yueshan Xiong 1 1 National.
Probabilistic Color-by-Numbers: Suggesting Pattern Colorizations Using Factor Graphs Sharon Lin, Daniel Ritchie, Matthew Fisher, Pat Hanrahan.
Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia.
Face Alignment with Part-Based Modeling
3D Shape Representation Tianqiang 04/01/2014. Image/video understanding Content creation Why do we need 3D shapes?
A Probabilistic Model for Component-Based Shape Synthesis Evangelos Kalogerakis, Siddhartha Chaudhuri, Daphne Koller, Vladlen Koltun Stanford University.
GrabCut Interactive Image (and Stereo) Segmentation Carsten Rother Vladimir Kolmogorov Andrew Blake Antonio Criminisi Geoffrey Cross [based on Siggraph.
GrabCut Interactive Foreground Extraction using Iterated Graph Cuts Carsten Rother Vladimir Kolmogorov Andrew Blake Microsoft Research Cambridge-UK.
Foreground Modeling The Shape of Things that Came Nathan Jacobs Advisor: Robert Pless Computer Science Washington University in St. Louis.
Structure Recovery by Part Assembly Chao-Hui Shen 1 Hongbo Fu 2 Kang Chen 1 Shi-Min Hu 1 1 Tsinghua University 2 City University of Hong Kong.
Image Segmentation some examples Zhiqiang wang
Shape Space Exploration of Constrained Meshes Yongliang Yang, Yijun Yang, Helmut Pottmann, Niloy J. Mitra.
1 Minimum Ratio Contours For Meshes Andrew Clements Hao Zhang gruvi graphics + usability + visualization.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
PARAMETRIC RESHAPING OF HUMAN BODIES IN IMAGES SIGGRAPH 2010 Shizhe Zhou Hongbo Fu Ligang Liu Daniel Cohen-Or Xiaoguang Han.
Segmentation into Planar Patches for Recovery of Unmodeled Objects Kok-Lim Low COMP Computer Vision 4/26/2000.
ICIP 2000, Vancouver, Canada IVML, ECE, NTUA Face Detection: Is it only for Face Recognition?  A few years earlier  Face Detection Face Recognition 
Introduction to Data-driven Animation Jinxiang Chai Computer Science and Engineering Texas A&M University.
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
A Study of Approaches for Object Recognition
Correspondence & Symmetry
Andrei Sharf Dan A. Alcantara Thomas Lewiner Chen Greif Alla Sheffer Nina Amenta Daniel Cohen-Or Space-time Surface Reconstruction using Incompressible.
Recovering Articulated Object Models from 3D Range Data Dragomir Anguelov Daphne Koller Hoi-Cheung Pang Praveen Srinivasan Sebastian Thrun Computer Science.
Near-Regular Texture Analysis and Manipulation Written by: Yanxi Liu Yanxi Liu Wen-Chieh Lin Wen-Chieh Lin James Hays James Hays Presented by: Alex Hadas.
Prior Knowledge for Part Correspondence Oliver van Kaick 1, Andrea Tagliasacchi 1, Oana Sidi 2, Hao Zhang 1, Daniel Cohen-Or 2, Lior Wolf 2, Ghassan Hamarneh.
An Illumination Invariant Face Recognition System for Access Control using Video Ognjen Arandjelović Roberto Cipolla Funded by Toshiba Corp. and Trinity.
Abstraction of Man-Made Shapes Ravish Mehra 1,2, Qingnan Zhou 1, Jeremy Long 4, Alla Sheffer 1, Amy Gooch 4, Niloy J. Mitra 2,3 1 Univ. of British Columbia.
Evolving Curves/Surfaces for Geometric Reconstruction and Image Segmentation Huaiping Yang (Joint work with Bert Juettler) Johannes Kepler University of.
Symmetry Hierarchy of Man-Made Objects Yanzhen Wang 1,2, Kai Xu 1,2, Jun Li 2, Hao Zhang 1, Ariel Shamir 3, Ligang Liu 4, Zhiquan Cheng 2, Yueshan Xiong.
Tracking Surfaces with Evolving Topology Morten Bojsen-Hansen IST Austria Hao Li Columbia University Chris Wojtan IST Austria.
Niloy J. Mitra Leonidas J. Guibas Mark Pauly TU Vienna Stanford University ETH Zurich SIGGRAPH 2007.
Use and Re-use of Facial Motion Capture M. Sanchez, J. Edge, S. King and S. Maddock.
An Algebraic Model for Parameterized Shape Editing Martin Bokeloh, Stanford Univ. Michael Wand, Saarland Univ. & MPI Hans-Peter Seidel, MPI Vladlen Koltun,
Texture Mapping by Model Pelting and Blending
Mesh Deformation Based on Discrete Differential Geometry Reporter: Zhongping Ji
7.1. Mean Shift Segmentation Idea of mean shift:
1 Style-Content Separation by Anisotropic Part Scales Kai Xu, Honghua Li, Hao Zhang, Daniel Cohen-Or Yueshan Xiong, Zhi-Quan Cheng Simon Fraser Universtiy.
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
Image-based Plant Modeling Zeng Lanling Mar 19, 2008.
Y. Moses 11 Combining Photometric and Geometric Constraints Yael Moses IDC, Herzliya Joint work with Ilan Shimshoni and Michael Lindenbaum, the Technion.
SPONSORED BY Data-driven Segmentation and Labeling of Freehand Sketches Zhe Huang, Hongbo Fu, Rynson W.H. Lau City University of Hong Kong.
Detecting Curved Symmetric Parts using a Deformable Disc Model Tom Sie Ho Lee, University of Toronto Sanja Fidler, TTI Chicago Sven Dickinson, University.
Style Compatibility For 3D Furniture Models Tianqiang Liu 1 Aaron Hertzmann 2 Wilmot Li 2 Thomas Funkhouser 1 1 Princeton University 2 Adobe Research.
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
Shape Analysis and Deformation Igarashi Lab M2 Akira Ohgawara.
Multifactor GPs Suppose now we wish to model different mappings for different styles. We will add a latent style vector s along with x, and define the.
11/11/20151 Trusses. 11/11/20152 Element Formulation by Virtual Work u Use virtual work to derive element stiffness matrix based on assumed displacements.
Extraction and remeshing of ellipsoidal representations from mesh data Patricio Simari Karan Singh.
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
3D Object Morphing CS5245 Vision and Graphics for Special Effects.
Discussion of Pictorial Structures Pedro Felzenszwalb Daniel Huttenlocher Sicily Workshop September, 2006.
Course: Structure-Aware Shape Processing Hao (Richard) Zhang Simon Fraser University (SFU), Canada Structural Hierarchies Course: Structure-Aware Shape.
Jigsaws: joint appearance and shape clustering John Winn with Anitha Kannan and Carsten Rother Microsoft Research, Cambridge.
A Part-aware Surface Metric for Shape Analysis Rong Liu 1, Hao Zhang 1, Ariel Shamir 2, and Daniel Cohen-Or 3 1 Simon Fraser University, Canada 2 The Interdisciplinary.
Folding meshes: Hierarchical mesh segmentation based on planar symmetry Patricio Simari, Evangelos Kalogerakis, Karan Singh.
1 Review and Summary We have covered a LOT of material, spending more time and more detail on 2D image segmentation and analysis, but hopefully giving.
Stackabilization Honghua Li, Ibraheem Alhashim, Hao Zhang, Ariel Shamir, Daniel Cohen-Or.
Course: Structure-Aware Shape Processing Introduction to Geometric ‘Structure’ Extracting Structures –analysis of Individual Models –analysis of Shape.
1 Double-Patterning Aware DSA Template Guided Cut Redistribution for Advanced 1-D Gridded Designs Zhi-Wen Lin and Yao-Wen Chang National Taiwan University.
Student: Shunan Shi Professor: Hao Zhang CMPT888.
Co-Hierarchical Analysis of Shape Structures Oliver van Kaick 1,4 Kai Xu 2 Hao Zhang 1 Yanzhen Wang 2 Shuyang Sun 1 Ariel Shamir 3 Daniel Cohen-Or 4 4.
MOTION PATTERN PRESERVING IK OPERATING IN THE MOTION PRINCIPAL COEFFICIENTS SPACE Motion Pattern Preserving IK Operating in the Motion Principal Coefficients.
Prior Knowledge for Part Correspondence
Layered Analysis of Irregular Facades via Symmetry Maximization
Optical Flow Estimation and Segmentation of Moving Dynamic Textures
Video Compass Jana Kosecka and Wei Zhang George Mason University
3D Point Capsule Networks Lifting Capsule Networks to Raw 3D Data
Autonomously designed free-form 2D DNA origami
Presentation transcript:

Structure-Aware Shape Processing Part III Example Applications Martin Bokeloh Niloy Mitra Michael Wand Hao Zhang Daniel Cohen-Or Martin Bokeloh

Part III - Overview Shape deformation – Local & global invariants – Learned deformations Shape synthesis by part recombination – Cutting & combination – Learned parts & relations Structure-aware reconstruction Structure-aware design exploration +

SHAPE DEFORMATION

Structure-Aware Deformation physically motivated

Structure-Aware Deformation physically motivated structure- aware

Local Adaptivity Non-homogenuous resizing – Elastic deformation model – Introduce local ‘vulnerability’ term (parameters) Prefer stretch in low curvature/high slippage regions [Kraevoy et al. 2008]

Local Adaptivity Joint-aware deformation – Joint-analysis using slippage direction – Setup deformation cells (parts) Prefer motions along joints in deformation (parameters) [Xu et al. 2009]

Non-local Relations iWires – Extract crease lines (parts) – Detect inter- and intra-wire properties (relations) Parallelity, orthogonality, symmetry – Maintain relations under deformations [Gal et al. 2009]

Non-local Relations iWires [Gal et al. 2009]

Non-local Relations [Gal et al. 2009]

Learning Deformations PCA-based models – Establish dense correspondendes between shapes from a database and a template shape – Fit linear generative model to data Assume low-dimensional linear subspace [Blanz and Vetter 1999]

PART RECOMBINATION

Modeling by example User focused method – User defines parts and accepts suggestions from the database Method assists in composition [Funkhouser et al. 2004]

Fixed-sized tiles Provide parts Find compatible boundaries MRF-based reassembling [Merrell 2007]

Fixed-sized tiles [Merrell 2007] Input

Docking Sites Cut model at symmetry boundaries Symmetric boundaries yield replacement rules Precompute shape grammar Docking Sites [Bokeloh et al. 2010]

Docking Sites [Bokeloh et al. 2010]

Docking Sites [Bokeloh et al. 2010]

Pattern-aware Deformation Combine docking sites with structure-aware deformation Specific to regular patterns [Bokeloh et al. 2011]

Retargeting of Irregular Facades User provides rectangular parts – Additionally specifies resizing parameters Formulate 2D-retargeting as sequence of 1D problems [Lin et al. 2011]

Probabilistic Shape Model Learning parameters & relations – Input: Segmented shape database – Learn probabilistic model [Kalogerakis et al. 2012] Shape style Component style

Probabilistic Shape Model [Kalogerakis et al. 2012]

Set Evolution Define mutation operator – Cross-shape Evolve a set of shapes – User defines fitness – Additionally: Diversity [Xu et al. 2012]

Set Evolution [Xu et al. 2012] Input Generation 5 Generation 10Generation 15

STRUCTURE-AWARE RECONSTRUCTION

Point Set Structuring Detect planes Build primitve graph Construct a structured point set Reconstruct using graph cut optimization [Lafarge and Alliez 2013]

Structure recovery through part assembly Reconstruct kinect data with high quality 3d database (labeled) [Shen et al. 2012]

STRUCTURE-AWARE DESIGN EXPLORATION

Constrained meshes Explore shape space w.r.t. specific constraints (implicit non-linear constraints) [Yang et al. 2011]

Structural optimization Improve structural stability of 3d masonry buildings – Apply local changes to stabilize [Whiting et al. 2012]