Geodesic image regression with a sparse parameterization of diffeomorphisms James Fishbaugh 1 Marcel Prastawa 1 Guido Gerig 1 Stanley Durrleman 2 1 Scientific.

Slides:



Advertisements
Similar presentations
Sarang Joshi #1 Computational Anatomy: Simple Statistics on Interesting Spaces Sarang Joshi, Tom Fletcher Scientific Computing and Imaging Institute Department.
Advertisements

Nonlinear Shape Modelling John Ashburner. Wellcome Trust Centre for Neuroimaging, UCL Institute of Neurology, London, UK.
Experiments on a New Inter- Subject Registration Method John Ashburner 2007.
NA-MIC National Alliance for Medical Image Computing Longitudinal and Time- Series Analysis Everyone in NA-MIC Core 1 and 2.
Active Appearance Models
Object Recognition from Local Scale-Invariant Features David G. Lowe Presented by Ashley L. Kapron.
Active Shape Models Suppose we have a statistical shape model –Trained from sets of examples How do we use it to interpret new images? Use an “Active Shape.
National Alliance for Medical Image Computing Slide 1 NAMIC at UNC DTI, Shape and Longitudinal registration Closely linked with Utah.
SE263 Video Analytics Course Project Initial Report Presented by M. Aravind Krishnan, SERC, IISc X. Mei and H. Ling, ICCV’09.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Active Contours, Level Sets, and Image Segmentation
Robust Object Tracking via Sparsity-based Collaborative Model
NAMIC: UNC – PNL collaboration- 1 - October 7, 2005 Fiber tract-oriented quantitative analysis of Diffusion Tensor MRI data Postdoctoral fellow, Dept of.
Deformable Contours Dr. E. Ribeiro.
Computing 3D Geometry Directly From Range Images Sarah F. Frisken and Ronald N. Perry Mitsubishi Electric Research Laboratories.
Thresholding Otsu’s Thresholding Method Threshold Detection Methods Optimal Thresholding Multi-Spectral Thresholding 6.2. Edge-based.
Sponsor: Prof. Sidney Spector Computational anatomy to assess growth pattern of early brain development in healthy and disease populations Guido Gerig.
Introduction to Volume Visualization Mengxia Zhu Fall 2007.
Medical Image Synthesis via Monte Carlo Simulation James Z. Chen, Stephen M. Pizer, Edward L. Chaney, Sarang Joshi Medical Image Display & Analysis Group,
Preliminary Results Longitudinal Change Conclusions Acknowledgements The most striking result of the longitudinal growth analysis between 2 and 4 years.
12-Apr CSCE790T Medical Image Processing University of South Carolina Department of Computer Science 3D Active Shape Models Integrating Robust Edge.
Markus Strohmeier Sparse MRI: The Application of
Comp 775: Deformable models: snakes and active contours Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel.
Variable Selection for Optimal Decision Making Susan Murphy & Lacey Gunter University of Michigan Statistics Department Artificial Intelligence Seminar.
Preprocessing II: Between Subjects John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.
Scale-Invariant Feature Transform (SIFT) Jinxiang Chai.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
Voxel Based Morphometry
General Linear Model & Classical Inference
Transfer Learning From Multiple Source Domains via Consensus Regularization Ping Luo, Fuzhen Zhuang, Hui Xiong, Yuhong Xiong, Qing He.
National Alliance for Medical Image Computing – Algorithms Core (C1a) Five investigators: –A. Tannenbaum (BU), P. Golland (MIT), M. Styner.
Data Mining to Aid Beam Angle Selection for IMRT Stuart Price-University of Maryland Bruce Golden- University of Maryland Edward Wasil- American University.
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
Introduction to variable selection I Qi Yu. 2 Problems due to poor variable selection: Input dimension is too large; the curse of dimensionality problem.
Sparse Shape Representation using the Laplace-Beltrami Eigenfunctions and Its Application to Modeling Subcortical Structures Xuejiao Chen.
S. Kurtek 1, E. Klassen 2, Z. Ding 3, A. Srivastava 1 1 Florida State University Department of Statistics 2 Florida State University Department of Mathematics.
NA-MIC National Alliance for Medical Image Computing ABC: Atlas-Based Classification Marcel Prastawa and Guido Gerig Scientific Computing.
NA-MIC National Alliance for Medical Image Computing NAMIC UNC Site Update Site PI: Martin Styner Site NAMIC folks: Clement Vachet, Gwendoline.
MIT Computer Science and Artificial Intelligence Laboratory
Haibin Ling and David Jacobs, Deformation Invariant Image Matching, ICCV, Oct. 20, 2005 Deformation Invariant Image Matching Haibin Ling and David W. Jacobs.
Spatio-Temporal Free-Form Registration of Cardiac MR Image Sequences Antonios Perperidis s /02/2006.
A New Method of Probability Density Estimation for Mutual Information Based Image Registration Ajit Rajwade, Arunava Banerjee, Anand Rangarajan. Dept.
NA-MIC National Alliance for Medical Image Computing Segmentation Core 1-3 Meeting, May , SLC, UT.
Mitsubishi Electric Research Labs Progressively Refined Reflectance Fields from Natural Illumination Wojciech Matusik Matt Loper Hanspeter Pfister.
Guest lecture: Feature Selection Alan Qi Dec 2, 2004.
A Unified Feature Registration Framework for Brain Anatomical Alignment Haili Chui, Robert Schultz, Lawrence Win, James Duncan and Anand Rangarajan* Image.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
Course14 Dynamic Vision. Biological vision can cope with changing world Moving and changing objects Change illumination Change View-point.
NA-MIC National Alliance for Medical Image Computing NAMIC UNC Site Update Site PI: Martin Styner UNC Site NAMIC folks: C Vachet, G Roger,
CS Statistical Machine learning Lecture 12 Yuan (Alan) Qi Purdue CS Oct
References [1] Coupé et al., An optimized blockwise nonlocal means denoising filter for 3-D magnetic resonance images. IEEE TMI, 27(4):425–441, 2008.
Implicit Active Shape Models for 3D Segmentation in MR Imaging M. Rousson 1, N. Paragio s 2, R. Deriche 1 1 Odyssée Lab., INRIA Sophia Antipolis, France.
Statistical Shape Analysis of Multi-object Complexes June 2007, CVPR 2007 Funding provided by NIH NIBIB grant P01EB and NIH Conte Center MH
NA-MIC National Alliance for Medical Image Computing Engineering a Segmentation Framework Marcel Prastawa.
Analysis of Longitudinal Shape Variability via Subject Specific Growth Modeling James Fishbaugh 1 Marcel Prastawa 1 Stanley Durrleman 2 Joseph Piven 3.
Air Systems Division Definition of anisotropic denoising operators via sectional curvature Stanley Durrleman September 19, 2006.
NA-MIC National Alliance for Medical Image Computing UNC/Utah-II Core 1 Guido Gerig, Casey Goodlett, Marcel Prastawa, Sylvain Gouttard.
Strong Supervision From Weak Annotation Interactive Training of Deformable Part Models ICCV /05/23.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching.
Martina Uray Heinz Mayer Joanneum Research Graz Institute of Digital Image Processing Horst Bischof Graz University of Technology Institute for Computer.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
- 1 Parallel Transport with the Pole Ladder: Application to Deformations of time Series of Images Marco Lorenzi, Xavier Pennec Asclepios research group.
NA-MIC National Alliance for Medical Image Computing Modeling Populations and Pathology Kayhan N. Batmanghelich PI: Polina Golland MIT.
Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of Short- term conversion to AD: Results from ADNI Xuejiao.
Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching Link: singhashwini.mesinghashwini.me.
Statistical Analysis of Anatomy from Medical Images Tom Fletcher School of Computing University of Utah National Alliance for Medical Image Computing.
Pathology Spatial Analysis February 2017
Linear Regression.
Tobias Heimann - DKFZ Ipek Oguz - UNC Ivo Wolf - DKFZ
Presentation transcript:

Geodesic image regression with a sparse parameterization of diffeomorphisms James Fishbaugh 1 Marcel Prastawa 1 Guido Gerig 1 Stanley Durrleman 2 1 Scientific Computing and Imaging Institute, University of Utah 2 INRIA/ICM, Pitié Salpêtrière Hospital, Paris, France

Image Regression 6 months12 months18 months8 months14 months16 months10 months Why image regression? Extrapolation for change prediction Align images and cognitive scores acquired at different times Align subjects with scans acquired at different times Improved understanding of normal and pathological brain changes 1 of 18

Previous Work Kernel regressionGeodesic regression Davis et al. ICCV 2007Niethammer et al. MICCAI 2011Singh et al. ISBI 2013 Require to store many model parameters ~ number of voxels Image evolution described by considerably fewer parameters Concentrated in areas undergoing most dynamic changes 2 of 18

Motivation for Sparsity Fewer parameters Location of parameters Potential for greater statistical power – less noise in description Concentrated in areas undergoing the most dynamic changes Number of parameters should reflect complexity of anatomical changes, not the sampling of the images Localize potential biomarkers 3 of 18

Compact and generative statistical model of growth Geodesic Image Regression Geodesic path on a sub-group of diffeomorphisms (Dupuis 98, Trouvè 95,98) 4 of 18

Geodesic Image Regression S 0 = {c 0, α 0 } I0I0 O1O1 O3O3 O2O2 5 of 18

Geodesic shooting to evolve control points S 0 = {c 0, α 0 } Methods: Shooting 6 of 18

Trajectory of control points defines flow of diffeomorphisms Physical pixel coordinates y follow the trajectory which evolves in time as Methods: Flow (5, 5, 60.25) Deformed images constructed by interpolation 7 of 18

Summary Of Method 1) Shoot control points2) Trajectory defines flow 3) Flow pixel locations4) Interpolate in baseline image 8 of 18

Subject to Shoot Flow Regression Criterion 9 of 18

Method Overview Gradient with respect to control points and initial momenta Gradient with respect to initial image Gradient of Regression Criterion 1) Flow voxel Y k (t) to time t and compute residual 2) Grey value in residual is distributed to neighboring voxels with weights from trilinear interoplation 3) Grey values accumulated for every observed image 10 of 18

Method Overview Sparsity on Initial Momenta Fast Iterative Shrinkage-Thresholding Algorithm (Beck 09)  Use previous gradient of criterion without L 1 penalty  Threshold momentum vectors with small magnitude Select a small subset of momenta which best describe the dynamics of image evolution 11 of 18  Used in context of atlas building (Durrleman 12,13)

Synthetic Evolution (2D) Generated by shooting baseline with 79,804 predefined momenta Time 1Time 2Time 3Time 4Time 5 Impact of sparsity parameter on model estimation 12 of 18

Synthetic Evolution (2D) From 79,804 to 67 momenta 13 of 18

Pediatric Brain Development (2D) Models estimated backwards in time with varying sparsity T1W image of same child over time 14 of 18

Method Overview Pediatric Brain Development (2D) From 45,435 to 47 momenta 15 of 18

Brain Atrophy in Alzheimer's Disease (3D) T1W image of same patient over time years71.38 years71.78 years72.79 years Six years predicted brain atrophy with 35,937 momenta 98% decrease in number of parameters 16 of 18

Conclusions Geodesic image regression framework:  Decouples deformation parameters from image representation  L 1 penalty which selects optimal subset of initial momenta Number of parameters reduced with only minimal cost in terms of matching target data Future work:  Kernels at multiple scales (Sommer 11)  Other image matching metrics, LCC (Avants 07, Lorenzi 13)  Combine with a framework for longitudinal analysis 17 of 18

This work was supported by: NIH (NINDS) 1 U01 NS (4D shape HD) NIH (NICHD) RO1 HD (ACE, project IBIS) NIH (NIBIB) 2U54 EB (NA-MIC) Acknowledgments Thank you 18 of 18