Computer Graphics Group Tobias Weyand Mesh-Based Inverse Kinematics Sumner et al 2005 presented by Tobias Weyand.

Slides:



Advertisements
Similar presentations
Real-Time Template Tracking
Advertisements

Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Computer Graphics Lecture 4 Geometry & Transformations.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 10: Extrinsic Deformations Fall 2014.
SGP 2008 A Local/Global Approach to Mesh Parameterization Ligang Liu Lei Zhang Yin Xu Zhejiang University, China Craig Gotsman Technion, Israel Steven.
Animation Following “Advanced Animation and Rendering Techniques” (chapter 15+16) By Agata Przybyszewska.
Computer vision: models, learning and inference
Modeling the Shape of People from 3D Range Scans
3D Graphics for Game Programming (J. Han) Chapter XI Character Animation.
Forward and Inverse Kinematics CSE 3541 Matt Boggus.
Pseudo-Skeleton based ARAP Mesh Deformation M. Zollhöfer, A. Vieweg, J. Süßmuth and G. Greiner Computer Graphics Group, FAU Erlangen-Nuremberg, Germany.
CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.
1Notes  Handing assignment 0 back (at the front of the room)  Read the newsgroup!  Planning to put 16mm films on the web soon (possibly tomorrow)
INFORMATIK Differential Coordinates for Interactive Mesh Editing Yaron Lipman Olga Sorkine Daniel Cohen-Or David Levin Tel-Aviv University Christian Rössl.
1 Geometrical Transformation 2 Outline General Transform 3D Objects Quaternion & 3D Track Ball.
A Study of Approaches for Object Recognition
Curve-Fitting Regression
Character Animation CSE 191A: Seminar on Video Game Programming Lecture 5: Character Animation UCSD, Spring, 2003 Instructor: Steve Rotenberg.
CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.
Kinematics. ILE5030 Computer Animation and Special Effects2 Kinematics The branch of mechanics concerned with the motions of objects without regard to.
CS CS 175 – Week 7 Parameterization Boundary, Non-Linear, and Global Methods.
FiberMesh: Designing Freeform Surfaces with 3D Curves
CSCE 689: Forward Kinematics and Inverse Kinematics
3D Geometry for Computer Graphics
Der, Sumner, and Popović Inverse Kinematics for Reduced Deformable Models Kevin G. Der Robert W. Sumner 1 Jovan Popović Computer Science and Artificial.
1cs426-winter-2008 Notes  SIGGRAPH crunch time - my apologies :-)
INTRODUCTION TO DYNAMICS ANALYSIS OF ROBOTS (Part 5)
Chapter 5.2 Character Animation. CS Overview Fundamental Concepts Animation Storage Playing Animations Blending Animations Motion Extraction Mesh.
Laplacian Surface Editing
CSE554Laplacian DeformationSlide 1 CSE 554 Lecture 8: Laplacian Deformation Fall 2012.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Kinematic Linkages.
Geometric Transformation. So far…. We have been discussing the basic elements of geometric programming. We have discussed points, vectors and their operations.
Simulation and Animation
CSC418 Computer Graphics n Animation Principles n Keyframe Animation.
Mesh Deformation Based on Discrete Differential Geometry Reporter: Zhongping Ji
Week 5 - Wednesday.  What did we talk about last time?  Project 2  Normal transforms  Euler angles  Quaternions.
Medical Image Analysis Image Registration Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.
Multimedia System and Networking UTD Slide- 1 University of Texas at Dallas B. Prabhakaran Rigging.
Andrew Nealen / Olga Sorkine / Mark Alexa / Daniel Cohen-Or SoHyeon Jeong 2007/03/02.
CS-378: Game Technology Lecture #13: Animation Prof. Okan Arikan University of Texas, Austin Thanks to James O’Brien, Steve Chenney, Zoran Popovic, Jessica.
AS-RIGID-AS-POSSIBLE SHAPE MANIPULATION
Image Deformation Using Moving Least Squares Scott Schaefer, Travis McPhail, Joe Warren SIGGRAPH 2006 Presented by Nirup Reddy.
3D Object Morphing CS5245 Vision and Graphics for Special Effects.
1cs426-winter-2008 Notes  Will add references to splines on web page.
CS 450: COMPUTER GRAPHICS ANIMATION SPRING 2015 DR. MICHAEL J. REALE.
Animation CS418 Computer Graphics John C. Hart.
Skuller: A volumetric shape registration algorithm for modeling skull deformities Yusuf Sahillioğlu 1 and Ladislav Kavan 2 Medical Image Analysis 2015.
Skeletal Animation and Skinning A (hardware friendly) software approach By: Brandon Furtwangler.
Inverse Kinematics for Reduced Deformable Models Keven G. Der, Stanford Robert W. Sumner, ETH Jovan Popovic, MIT to appear in proceeding of SIGGRAPH 2006.
1. Systems of Linear Equations and Matrices (8 Lectures) 1.1 Introduction to Systems of Linear Equations 1.2 Gaussian Elimination 1.3 Matrices and Matrix.
Mesh-Based Inverse Kinematics Robert W. Sumner Matthias Zwicker. Jovan Popovic MIT Craig Gotsman Harvard University.
CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.
Physically-Based Motion Synthesis in Computer Graphics
CSCE 441: Computer Graphics Forward/Inverse kinematics
Character Animation Forward and Inverse Kinematics
Bones Skeletal Unity-2D How & When
Morphing and Shape Processing
You can check broken videos in this slide here :
Sparse Rig Parameter Optimization for Character Animation
CSE 554 Lecture 9: Laplacian Deformation
Animation Lecture 10 Slide 1.
CSC4820/6820 Computer Graphics Algorithms Ying Zhu Georgia State University Transformations.
CSCE 441: Computer Graphics Forward/Inverse kinematics
Projective Transformations for Image Transition Animations
UMBC Graphics for Games
CSE 554 Lecture 10: Extrinsic Deformations
Presentation transcript:

Computer Graphics Group Tobias Weyand Mesh-Based Inverse Kinematics Sumner et al 2005 presented by Tobias Weyand

Computer Graphics Group Tobias Weyand 2 What is Inverse Kinematics? Articulated body Which angles for a certain configuration? Forward kinematics Specify angles Inverse kinematics Specify limb position 11 22 33 11 22 33

Computer Graphics Group Tobias Weyand 3 IK in Computer Graphics © NVidia Modelling Meaningful deformations Animation Realistic movement Problems: Skinning time consuming Not everything has bones

Computer Graphics Group Tobias Weyand 4 Mesh-based Inverse Kinematics Idea: Learn deformations from examples

Computer Graphics Group Tobias Weyand 5 Overview Introduction Related work MeshIK Feature Vectors Linear Feature Space Nonlinear Feature Space Accelerations Results and Conclusion

Computer Graphics Group Tobias Weyand 6 Related work: Deformation Transfer Deformation Transfer for Triangle Meshes Transfer source deformations to target Sumner et al 2004

Computer Graphics Group Tobias Weyand 7 Related work: Deformation Transfer Triangle deformations:  Least squares problem: But: Limited to example poses

Computer Graphics Group Tobias Weyand 8 Related work: Shape Interpolation As-rigid-as-possible Shape Interpolation Morphing of 2D and 3D meshes Considers mesh interior as rigid Alexa et al. 2000

Computer Graphics Group Tobias Weyand 9 Related work: Shape Interpolation Triangulate source and target shapes Find locally optimal triangle interpolations But: Limited to 2 meshes Expensive: Compatible dissection Computations on interior and exterior Better: Use only surface

Computer Graphics Group Tobias Weyand 10 Mesh-based Inverse Kinematics Goal: Provide a set of example meshes. MeshIK learns meaningful deformations. Directly move a subset of the mesh vertices. MeshIK finds a suitable deformation according to the example meshes.

Computer Graphics Group Tobias Weyand 11 Feature Vectors Given: Base mesh P 0, deformed mesh P Deformation: set of affine mappings Deformation gradient: Jacobian of  Discard translation

Computer Graphics Group Tobias Weyand 12 Feature Vectors Feature vector: concatentaion of deformation gradients

Computer Graphics Group Tobias Weyand 13 Feature Vectors Calculation of f for mesh P P → mesh-vector x: Construct G such that:

Computer Graphics Group Tobias Weyand 14 Feature Vectors Properties of G: - Block-diagonal structure - Sparse - Only depends on P 0

Computer Graphics Group Tobias Weyand 15 Feature Vectors Extracting a mesh from a feature vector: Fix one vertex in x: Set corresponding rows in G to 0. Add product of these rows with x.

Computer Graphics Group Tobias Weyand 16 Multiple Vertex Constraints Transform to least squares problem:  Properties of x: Close relation to the feature vector Fulfills the vertex constraints

Computer Graphics Group Tobias Weyand 17 Linear Feature Space Linear combination of features: Vector notation:  Least squares problem Minimize for optimal weights and mesh

Computer Graphics Group Tobias Weyand 18 Linear Feature Space: Problems Unnatural interpolation of rotations Goal: Correctly capture rotations

Computer Graphics Group Tobias Weyand 19 Transformation Interpolation Linear Combinations of Transformations Scalar product: Addition: Combination: Alexa 2002

Computer Graphics Group Tobias Weyand 20 Possible Nonlinear Feature Space But: Practically produces singularities Linear scales and shears suffice MeshIK interpolation: Scales and skews: linear Rotations: above formula

Computer Graphics Group Tobias Weyand 21 Extracting Rotations Matrix Animation and Polar Decomposition Method for factoring a transformation T T=RS  New transformation combination Shoemake and Duff 1992

Computer Graphics Group Tobias Weyand 22 Nonlinear Feature Space New nonlinear least squares problem: Properties: Fulfills vertex constraints Close to nonlinear feature space Natural rotation interpolation Efficient solver required!

Computer Graphics Group Tobias Weyand 23 Gauss-Newton in MeshIK Goal: minimize Approach with Gauss-Newton: Transform into locally linear equation Solve linear least squares problem

Computer Graphics Group Tobias Weyand 24 Gauss-Newton in MeshIK Linearize M(w) with Taylor expansion  Linear least squares problem Reduce to one variable: 

Computer Graphics Group Tobias Weyand 25 Gauss-Newton in MeshIK Set = 0 !  Iteration steps: Solve the normal equation for Update But: Far too slow! Optimization needed!

Computer Graphics Group Tobias Weyand 26 Cholesky Factorization Linear system: Decompose: Method:

Computer Graphics Group Tobias Weyand 27 Cholesky Factorization Further acceleration: Exploit structure of A T A and C T C: Note: R T R=g T g Precompute R T R Only calculate R 1, R 2, R 3, R S  Interactive speed

Computer Graphics Group Tobias Weyand 28 Performance MeshTrisExamplesPreprocessSolve Flag Lion9, Horse16, Elephant 84,

Computer Graphics Group Tobias Weyand 29 Results

Computer Graphics Group Tobias Weyand 30 Video

Computer Graphics Group Tobias Weyand 31 Comparison: Shape Interpolation Arap.MeshIK 2 meshesn meshes Needs compatible dissection of meshes → expensive Needs meshes with same topology Operates on exterior and interior Operates only on surface

Computer Graphics Group Tobias Weyand 32 Comparison: Shape Interpolation

Computer Graphics Group Tobias Weyand 33 Future work Different mesh representation like subdivision surfaces multiresolution hierarchies Different feature vectors Capture mesh properties better Accelerate system solving Better feature space for many examples Simulate physical effects like inertia

Computer Graphics Group Tobias Weyand 34 Conclusion MeshIK provides IK without skeleton more direct and dynamic runs at interactive speeds compares well to other approaches eg As-Rigid-As-Possible shape interpolation

Computer Graphics Group Tobias Weyand 35 Thank you for your attention!