Nonlinear Shape Modelling John Ashburner. Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London, UK.

Slides:



Advertisements
Similar presentations
Pattern Recognition and Machine Learning
Advertisements

Sarang Joshi #1 Computational Anatomy: Simple Statistics on Interesting Spaces Sarang Joshi, Tom Fletcher Scientific Computing and Imaging Institute Department.
DARTEL John Ashburner 2008.
VBM Susie Henley and Stefan Klöppel Based on slides by John Ashburner
A Fast Diffeomorphic Image Registration Algorithm
Computational Anatomy: VBM and Alternatives
A Growing Trend Larger and more complex models are being produced to explain brain imaging data. Bigger and better computers allow more powerful models.
SPM5 Segmentation. A Growing Trend Larger and more complex models are being produced to explain brain imaging data. Bigger and better computers allow.
ENS Workshop John Ashburner Functional Imaging Lab, 12 Queen Square, London, UK.
Experiments on a New Inter- Subject Registration Method John Ashburner 2007.
Machine Learning for Vision-Based Motion Analysis Learning pullback metrics for linear models Oxford Brookes Vision Group Oxford Brookes University 17/10/2008.
Real-Time Template Tracking
VBM Voxel-based morphometry
SPM 2002 Experimental Design Daniel Glaser Institute of Cognitive Neuroscience, UCL Slides from: Rik Henson, Christian Buchel, Karl Friston, Chris Frith,
DTAM: Dense Tracking and Mapping in Real-Time
SHAPE THEORY USING GEOMETRY OF QUOTIENT SPACES: STORY STORY SHAPE THEORY USING GEOMETRY OF QUOTIENT SPACES: STORY STORY ANUJ SRIVASTAVA Dept of Statistics.
Linear Regression.
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
Brain Morphometrics from MRI Scans John Ashburner The Wellcome Trust Centre for Neuroimaging 12 Queen Square, London, UK.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Pattern Recognition and Machine Learning
Computer vision: models, learning and inference Chapter 8 Regression.
Voxel-Based Analysis of Quantitative Multi-Parameter Mapping (MPM) Brain Data for Studying Tissue Microstructure, Macroscopic Morphology and Morphometry.
OverviewOverview Motion correction Smoothing kernel Spatial normalisation Standard template fMRI time-series Statistical Parametric Map General Linear.
Pre-processing for “Voxel- Based Morphometry” John Ashburner The Wellcome Trust Centre for Neuroimaging 12 Queen Square, London, UK.
Chapter 4: Linear Models for Classification
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
Handwriting: Registration and Differential Equations.
x – independent variable (input)
Motion Analysis (contd.) Slides are from RPI Registration Class.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
CS443: Digital Imaging and Multimedia Filters Spring 2008 Ahmed Elgammal Dept. of Computer Science Rutgers University Spring 2008 Ahmed Elgammal Dept.
Preprocessing II: Between Subjects John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.
Voxel-Based Morphometry John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.
Classification and Prediction: Regression Analysis
TSTAT_THRESHOLD (~1 secs execution) Calculates P=0.05 (corrected) threshold t for the T statistic using the minimum given by a Bonferroni correction and.
Anatomical Measures John Ashburner zSegmentation zMorphometry zSegmentation zMorphometry.
DTU Medical Visionday May 27, 2009 Generative models for automated brain MRI segmentation Koen Van Leemput Athinoula A. Martinos Center for Biomedical.
S. Kurtek 1, E. Klassen 2, Z. Ding 3, A. Srivastava 1 1 Florida State University Department of Statistics 2 Florida State University Department of Mathematics.
Coregistration and Spatial Normalisation
Current work at UCL & KCL. Project aim: find the network of regions associated with pleasant and unpleasant stimuli and use this information to classify.
Medical Image Analysis Image Registration Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Recognizing Action at a Distance Alexei A. Efros, Alexander C. Berg, Greg Mori, Jitendra Malik Computer Science Division, UC Berkeley Presented by Pundik.
Generalized Tensor-Based Morphometry (TBM) for the analysis of brain MRI and DTI Natasha Leporé, Laboratory of Neuro Imaging at UCLA.
Algorithms for Image Registration: Advanced Normalization Tools (ANTS) Brian Avants, Nick Tustison, Gang Song, James C. Gee Penn Image Computing and Science.
BCS547 Neural Decoding. Population Code Tuning CurvesPattern of activity (r) Direction (deg) Activity
Linear Models for Classification
1  The Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
All Hands Meeting 2005 Semi-Automated Shape Analysis (SASHA)
Implicit Active Shape Models for 3D Segmentation in MR Imaging M. Rousson 1, N. Paragio s 2, R. Deriche 1 1 Odyssée Lab., INRIA Sophia Antipolis, France.
Factorising large image datasets John Ashburner. Principal Component Analysis Need to reduce dimensions for data mining –Reduced feature set that explains.
An Area-Preserving Cortical Flattening Method Yuefeng Lu 1, Moo K. Chung 1,2,3,, Steve Robbins 4, Alan C. Evans 4 1 Department of Statistics, 2 W.M. Keck.
Geodesic image regression with a sparse parameterization of diffeomorphisms James Fishbaugh 1 Marcel Prastawa 1 Guido Gerig 1 Stanley Durrleman 2 1 Scientific.
- 1 Parallel Transport with the Pole Ladder: Application to Deformations of time Series of Images Marco Lorenzi, Xavier Pennec Asclepios research group.
Lecture 10: Image alignment CS4670/5760: Computer Vision Noah Snavely
CSE 554 Lecture 8: Alignment
Medical Image Analysis
LINEAR CLASSIFIERS The Problem: Consider a two class task with ω1, ω2.
Morphological Appearance Manifolds for Computational Anatomy: Group-wise Registration and Morphological Analysis Christos Davatzikos Director, Section.
Moo K. Chung1,3, Kim M. Dalton3, Richard J. Davidson2,3
Detection of Local Cortical Asymmetry via Discriminant Power Analysis
Outline Nonlinear Dimension Reduction Brief introduction Isomap LLE
Keith Worsley Keith Worsley
Computational Neuroanatomy for Dummies
Model-based Symmetric Information Theoretic Large Deformation
Mathematical Foundations of BME Reza Shadmehr
Detecting Gray Matter Maturation via Tensor-based Surface Morphometry
Anatomical Measures John Ashburner
Mixture Models with Adaptive Spatial Priors
Presentation transcript:

Nonlinear Shape Modelling John Ashburner. Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London, UK.

Motivation Imaging Biomarkers may be derived using pattern recognition methods. –Provide examples of scans and outcomes. –Learn to predict clinical outcomes from scans. Work with similarity measures among scans. –Many ways of measuring similarity. –Include prior knowledge and biological plausibility in similarity model.

A simple multivariate morphometry illustration: Body Mass Index BMI = weight / height 2 log(BMI) = log(weight) – 2 log(height)

Inter-subject Variability... diverse and dissimilar fish [brains] can be referred as a whole to identical functions of very different coordinate systems... Suggests a generative model, whereby diverse and dissimilar brains are modeled by a common template ( identical functions ) deformed according to various spatial transformations ( very different coordinate systems ). DArcy Thompson (1917). GROWTH AND FORM.

Encoding Relative Shapes Most shape models involve adding a smooth displacement field to an identity transform. –This is the small deformation approximation. –Assumes that deformations can be added and subtracted linearly – which is not the case. Should use a model that assumes that deformations are composed – not added.

Small Displacements Small Deformation Model

Simple Small Deformation Registration Estimate u that minimizes: E = ½ || L u || 2 + ½ ||f – μ(φ)|| 2 where φ = x + u and L may be something like a Laplacian operator Regularization Matching term – sum of squares difference

Larger Displacements Bigger Small Deformation Model

Diffeomorphisms A diffeomorphism is a smooth continuous one- to-one mapping. Diffeomorphisms form a mathematical group under composition (warping one deformation by another). –Composition of group members is another group member –The members have inverses –There is an identity member –The composition operations are associative

Diffeomorphic Model

Diffeomorphic Registration Estimate v (a series of velocity fields over unit time) that minimizes: E = ½ t=0 ||Lv t || 2 dt + ½ ||f – μ(φ 1 )|| 2 where dφ t /dt= v t (φ t ) φ 0 = Id. Regularization – minimizes a geodesic distance Matching term 1 c.f. Hamiltons principle of stationary action

In practice Modeled by the composition of a series of small deformations. Each is one-to-one, so their composition should also be one-to-one. E = (||Lv 1 || 2 + ||Lv 1 || 2 +… ||Lv K || 2 )/2K + ½ ||f – μ o (x+v 1 /K) o (x+v 2 /K) o…o (x+v K /K)|| 2 This is the Large Deformation Diffeomorphic Metric Mapping (LDDMM) algorithm of Beg et al., which is optimized using gradient descent.

An initial value formulation It turns out that the dynamical system is determined from its initial conditions as: (L L)v t = |D φt | (D φt ) T ((L L)v 0 ) o φ t dφ t /dt= v t (φ t ) These EPDiff equations are used for modeling fluid dynamics. This integration procedure is a form of exponential map.

vertical horizontal Velocity Field (v) Momentum (Av) Convolve with Greens Function of Differential Operator (K = A + ) Apply Differential Operator (A = L L)

Some 2D Examples

Deformations

Inverse Deformations

Jacobian Determinants

Residuals

Reconstructed from Template & Residuals

Original Examples

Grey Matter (550 IXI Brains)

White Matter (550 IXI Brains)

Template: Grey Matter

Template: White Matter

Template: Other

Aligned IXI Brains

Diffeomorphic Eigenwarps 550 scans from the IXI dataset, registered to a common average using a diffeomorphic registration model. Eigen-decomposition of initial velocities/momenta. Exaggerated warps generated by a geodesic shooting method. - Preserves one-to-one mapping. 1st 3rd 10th - +

Predictions Brain shapes can be used to make predictions about individuals. This figure shows predictions of subjects ages made from IXI dataset using Tippings Relevance Vector Regression (a kernel method). More useful predictions may be possible from other data. Cross-validation results for age predictions.

Caricatured Differences Used multivariate logistic regression to determine the initial velocity that best separates male from female brains. –Similar principles to Gaussian Process Classification, but with kernel matrix related to that of: Wang, L., Beg, M., Ratnanather, J., Ceritoglu, C., Younes, L., Morris, J.C., Csernansky, J.G. & Miller, M.I. Large deformation diffeomorphism and momentum based hippocampal shape discrimination in dementia of the Alzheimer type. IEEE Transactions on Medical Imaging 26(4):462 (2007). Diffeomorphic shooting to obtain exaggerated deformations. Average brain deformed using these exaggerated deformations.

Another example Predicting the logarithm of the brain/CSF ratio. Used a Gaussian Process Regression approach. Deformed average, from a brain with very little CSF, to one with a lot.

Some References M. F. Beg, M. I. Miller, A.Trouve & L. Younes. "Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms". International Journal Of Computer Vision (2003). M. I. Miller, A. Trouve, & L. Younes. "Geodesic Shooting for Computational Anatomy". Journal of Mathematical Imaging and Vision (2004) L. Wang, M. F. Beg, J. T. Ratnanather, C. Ceritoglu, L. Younes, J. C. Morris, J. G. Csernansky & M. I. Miller. "Large Deformation Diffeomorphism and Momentum Based Hippocampal Shape Discrimination in Dementia of the Alzheimer Type". IEEE Trans. Med Imaging (2006) L. Younes, F. Arrate & M. I. Miller. "Evolution Equations in Computational Anatomy". Neuroimage (2008)

Enjoy your retirement Vin.

Metrics It is useful if distance measures between scans have the properties of metrics. Requirements are: Non-negativity:d(A,B) 0 Triangle Inequality:d(A,C) d(A,B) + d(B,C) Symmetry:d(A,B) = d(B,A) Identity of discernibles:d(A,B) = 0 iff A=B These are not satisfied by the small deformation approximation, but they are using the diffeomorphism framework of Miller, Younes et al.