Manifold Valued Statistics, Exact Principal Geodesic Analysis and the Effect of Linear Approximations ECCV 2010 Stefan Sommer 1, François Lauze 1, Søren.

Slides:

Advertisements

Similar presentations

Nonlinear Shape Modelling John Ashburner. Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London, UK.

Advertisements

Learning Riemannian metrics for motion classification Fabio Cuzzolin INRIA Rhone-Alpes Computational Imaging Group, Pompeu Fabra University, Barcellona.

Machine Learning for Vision-Based Motion Analysis Learning pullback metrics for linear models Oxford Brookes Vision Group Oxford Brookes University 17/10/2008.

Arc-length computation and arc-length parameterization

Stochastic Systems Group Some Rambling (Müjdat) and Some More Serious Discussion (Ayres, Junmo, Walter) on Shape Priors.

Active Contours, Level Sets, and Image Segmentation

Lena Gorelick Joint work with Frank Schmidt and Yuri Boykov Rochester Institute of Technology, Center of Imaging Science January 2013 TexPoint fonts used.

1/20 Using M-Reps to include a-priori Shape Knowledge into the Mumford-Shah Segmentation Functional FWF - Forschungsschwerpunkt S092 Subproject 7 „Pattern.

Princeton University Using the computer to select the right variables Rationale: Lake Carnegie, Princeton, NJ Straight Line Distance Actual transition.

Modeling the Shape of People from 3D Range Scans

Shape From Light Field meets Robust PCA

4/15/2017 Using Gaussian Process Regression for Efficient Motion Planning in Environments with Deformable Objects Barbara Frank, Cyrill Stachniss, Nichola.

University of Joensuu Dept. of Computer Science P.O. Box 111 FIN Joensuu Tel fax Isomap Algorithm.

Corp. Research Princeton, NJ Computing geodesics and minimal surfaces via graph cuts Yuri Boykov, Siemens Research, Princeton, NJ joint work with Vladimir.

Bayesian Robust Principal Component Analysis Presenter: Raghu Ranganathan ECE / CMR Tennessee Technological University January 21, 2011 Reading Group (Xinghao.

CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.

Dimensionality Reduction and Embeddings

3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)

CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.

Manifold Learning: ISOMAP Alan O'Connor April 29, 2008.

Three Algorithms for Nonlinear Dimensionality Reduction Haixuan Yang Group Meeting Jan. 011, 2005.

A Global Geometric Framework for Nonlinear Dimensionality Reduction Joshua B. Tenenbaum, Vin de Silva, John C. Langford Presented by Napat Triroj.

Lecture # 32 (Last) Dr. SOHAIL IQBAL

Dimensionality Reduction

1 Numerical geometry of non-rigid shapes Non-Euclidean Embedding Non-Euclidean Embedding Lecture 6 © Alexander & Michael Bronstein tosca.cs.technion.ac.il/book.

Dimensionality Reduction. Multimedia DBs Many multimedia applications require efficient indexing in high-dimensions (time-series, images and videos, etc)

Nonlinear Dimensionality Reduction by Locally Linear Embedding Sam T. Roweis and Lawrence K. Saul Reference: "Nonlinear dimensionality reduction by locally.

Gender and 3D Facial Symmetry: What’s the Relationship ? Xia BAIQIANG (University Lille1/LIFL) Boulbaba Ben Amor (TELECOM Lille1/LIFL) Hassen Drira (TELECOM.

Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University

8/16/99 Computer Vision and Modeling. 8/16/99 Principal Components with SVD.

Presented By Wanchen Lu 2/25/2013

EMIS 8381 – Spring Netflix and Your Next Movie Night Nonlinear Programming Ron Andrews EMIS 8381.

Visual Tracking Conventional approach Build a model before tracking starts Use contours, color, or appearance to represent an object Optical flow Incorporate.

A Challenging Example Male Pelvis –Bladder – Prostate – Rectum.

PROJECTIVE CONSTRAINT VIOLATION STABILIZATION METHOD FOR MULTIBODY SYSTEMS ON MANIFOLDS Prof. dr. Zdravko Terze Dept. of Aeronautical Engineering, Faculty.

NUMERICAL ERROR Student Notes ENGR 351 Numerical Methods for Engineers Southern Illinois University Carbondale College of Engineering Dr. L.R. Chevalier.

Relativity Discussion 4/19/2007 Jim Emery. Einstein and his assistants, Peter Bergmann, and Valentin Bargmann, on there daily walk to the Institute for.

Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)

CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.

Non-Euclidean Example: The Unit Sphere. Differential Geometry Formal mathematical theory Work with small ‘patches’ –the ‘patches’ look Euclidean Do calculus.

Nonlinear Learning Using Local Coordinate Coding K. Yu, T. Zhang and Y. Gong, NIPS 2009 Improved Local Coordinate Coding Using Local Tangents K. Yu and.

Mingyang Zhu, Huaijiang Sun, Zhigang Deng Quaternion Space Sparse Decomposition for Motion Compression and Retrieval SCA 2012.

ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane.

GRASP Learning a Kernel Matrix for Nonlinear Dimensionality Reduction Kilian Q. Weinberger, Fei Sha and Lawrence K. Saul ICML’04 Department of Computer.

Non-Isometric Manifold Learning Analysis and an Algorithm Piotr Dollár, Vincent Rabaud, Serge Belongie University of California, San Diego.

CSC2535: Computation in Neural Networks Lecture 12: Non-linear dimensionality reduction Geoffrey Hinton.

Object Orie’d Data Analysis, Last Time SiZer Analysis –Zooming version, -- Dependent version –Mass flux data, -- Cell cycle data Image Analysis –1 st Generation.

Common Property of Shape Data Objects: Natural Feature Space is Curved I.e. a Manifold (from Differential Geometry) Shapes As Data Objects.

3D Face Recognition Using Range Images

Information Geometry and Model Reduction Sorin Mitran 1 1 Department of Mathematics, University of North Carolina, Chapel Hill, NC, USA Reconstruction.

CSE4334/5334 DATA MINING CSE4334/5334 Data Mining, Fall 2014 Department of Computer Science and Engineering, University of Texas at Arlington Chengkai.

Math 285 Project Diffusion Maps Xiaoyan Chong Department of Mathematics and Statistics San Jose State University.

CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.

Classification Categorization is the process in which ideas and objects are recognized, differentiated and understood. Categorization implies that objects.

Manifold Learning JAMES MCQUEEN – UW DEPARTMENT OF STATISTICS.

Rongjie Lai University of Southern California Joint work with: Jian Liang, Alvin Wong, Hongkai Zhao 1 Geometric Understanding of Point Clouds using Laplace-Beltrami.

1 Bilinear Classifiers for Visual Recognition Computational Vision Lab. University of California Irvine To be presented in NIPS 2009 Hamed Pirsiavash Deva.

SigClust Statistical Significance of Clusters in HDLSS Data When is a cluster “really there”? Liu et al (2007), Huang et al (2014)

Support Vector Machines (SVMs) Chapter 5 (Duda et al.) CS479/679 Pattern Recognition Dr. George Bebis.

Spectral Methods for Dimensionality

Unsupervised Riemannian Clustering of Probability Density Functions

Morphing and Shape Processing

Machine Learning Basics

Non-Euclidean Example: The Unit Sphere

ISOMAP TRACKING WITH PARTICLE FILTERING

Copyright © Cengage Learning. All rights reserved.

CS4670: Intro to Computer Vision

Dept. of Aeronautical Engineering,

Differential Equations

NonLinear Dimensionality Reduction or Unfolding Manifolds

Presentation transcript:

Manifold Valued Statistics, Exact Principal Geodesic Analysis and the Effect of Linear Approximations ECCV 2010 Stefan Sommer 1, François Lauze 1, Søren Hauberg 1, Mads Nielsen 1,2 1 : Department of Computer Science, University of Copenhagen 2 : Nordic Bioscience Imaging, Herlev, Denmark

2 A Glimpse of Manifold Valued Statistics ● Importance of Non-Linearity in Modeling ● Statistics and Computations on Manifolds ● Principal Geodesic Analysis (PGA) ● Computing it Right: Exact PGA ● The Indicators: How Linear is It? ● Example: Modeling Human Poses in End- Effector Space

3 Non-linearity in Modeling ● (Riemannian) manifolds generalizes Euclidean spaces ● Examples: m-rep models, motion capture data, diffeomorphisms in neuroimaging, shapes... ● When non-linearity is present, manifolds are needed: linearity is not compatible Images from: Fletcher et al. '04, Sommer et al. '09/'10, Wikipedia

4 Statistics on Manifolds is Complex Problems: ● Generalizing Euclidean statistics ● no vector space structure ● kNN, PGA, SVM, regression ● lots of unsolved problems ● Computations ● exponential map, geodesics, ● distances ● optimization on geodesics: ● Sommer et al. 2010b ● provides optimization tools

5 Principal Geodesic Analysis (PGA) ● PGA generalizes PCA ● dependent on manifold: ● curvature, metric, etc. ● finds geodesic subspaces ● (PCA finds linear subspaces) ● localized to intrinsic mean ● PCA: ● orthogonal projections in vector space ● PGA: ● projections using manifold distances

6 Computing it Right: Exact PGA ● standard approximation: linearized PGA ● approximation amounts to PCA in tangent space: ● no approximation: exact PGA ● optimization problem in tangent space ● previously unsolved for general manifolds ● Sommer et. al 2010b provides optimization tools – calculate gradients using IVPs for Jacobi fields and 2. order derivatives – perform gradient descent or similar optimization ● computationally heavy ● reveals numerous interesting non-Euclidean effects ● (residual/variance formulation, decreasing variance, orthogonality, ● see Sommer et. al 2010a/b) first principal direction (variance formulation) data points

7 ● difference between exact and linearized PGA ● curvature in relation to spread of data ● can we estimate the magnitude? ● save resources when linearized is sufficient ● improve precision when difference is significant ● understand effect of curvature on statistics ● indicators for fast prediction ● indicator: orthogonal/manifold projection difference ● indicator: exact/linearized difference The Indicators: How Linear is It? geodesic distance tangent space distance manifold projection orthogonal projection

8 Example: Human Pose Manifold ● spatial coordinates of end-effectors ● fixed bone lengths introduces constraints ● implicitly represented manifold ● indicators against true differences: Camera output superimposed with tracking result Pose with end-effectors

9 Example: Human Pose Manifold ● Dataset: movement of right arm ● First principal direction: Difference: exact PGA: blue linearized PGA: red movement along first exact principal direction

10 Concluding Remarks ● solve general optimization problems involving ● geodesics, including exact PGA ● pitfalls, e.g. orthogonality and variance: ● difference between exact and linearized PGA when both curvature and spread is present ● indicators predict the difference ● linear/exact: commonly occuring theme in manifold statistics References: ( available at ● Sommer et al. 2010a: “Manifold Valued Statistics, Exact Principal Geodesic Analysis and the Effect of Linear Approximations” Stefan Sommer, François Lauze, Søren Hauberg, Mads Nielsen ECCV 2010 ● Sommer et al. 2010b: “The Differential of the Exponential Map, Jacobi Fields, and Exact Principal Geodesic Analysis” Stefan Sommer, François Lauze, Mads Nielsen (Preprint)