A Big Thanks Prof. Jason Bohland Quantitative Neuroscience Laboratory Boston University Dr. Luis Ibanez Open Source Proponent,

Slides:



Advertisements
Similar presentations
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Advertisements

NA-MIC National Alliance for Medical Image Computing Slicer3 Tutorial / Registration Library: Case 03 - DTI aligning low-resolution diffusion.
Gordon Wright & Marie de Guzman 15 December 2010 Co-registration & Spatial Normalisation.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Developable Surface Fitting to Point Clouds Martin Peternell Computer Aided Geometric Design 21(2004) Reporter: Xingwang Zhang June 19, 2005.
Stereotaxic Surgery Histology
Basics of fMRI Preprocessing Douglas N. Greve
OverviewOverview Motion correction Smoothing kernel Spatial normalisation Standard template fMRI time-series Statistical Parametric Map General Linear.
Image Segmentation Image segmentation (segmentace obrazu) –division or separation of the image into segments (connected regions) of similar properties.
Realigning and Unwarping MfD
With support from: NSF DUE in partnership with: George McLeod Prepared by: Geospatial Technician Education Through Virginia’s Community Colleges.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
CSci 6971: Image Registration Lecture 3: Images and Transformations January 20, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart,
Extraction and comparison of gene expression patterns from 2D RNA in situ hybridization images BIOINFORMATICS Gene expression Vol. 26, no. 6, 2010, pages.
Non-Rigid Registration. Why Non-Rigid Registration  In many applications a rigid transformation is sufficient. (Brain)  Other applications: Intra-subject:
CSci 6971: Image Registration Lecture 26: BSpline Transforms April 20, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart, RPI.
Motion Analysis (contd.) Slides are from RPI Registration Class.
CSci 6971: Image Registration Lecture 4: First Examples January 23, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart, RPI Dr.
CSci 6971: Image Registration Lecture 8: Registration Components February 6, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart,
Estimating 3D Respiratory Motion from Orbiting Views Rongping Zeng, Jeffrey A. Fessler, James M. Balter The University of Michigan Oct Funding provided.
Curve Analogies Aaron Hertzmann Nuria Oliver Brain Curless Steven M. Seitz University of Washington Microsoft Research Thirteenth Eurographics.
CSci 6971: Image Registration Lecture 9: Registration Components February 10, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart,
Haskins fMRI Workshop Part I: Data Acquisition & Preprocessing.
An Integrated Pose and Correspondence Approach to Image Matching Anand Rangarajan Image Processing and Analysis Group Departments of Electrical Engineering.
Intro to FreeSurfer Jargon
National Alliance for Medical Image Computing Registration in Slicer3 Julien Jomier Kitware Inc.
Supplemental Material
Next. A Big Thanks Again Prof. Jason Bohland Quantitative Neuroscience Laboratory Boston University.
Integrating digital atlases of the brain: atlas services with WPS Ilya Zaslavsky San Diego Supercomputer Center, UCSD Lead of the INCF Digital Atlasing.
Preprocessing of FMRI Data fMRI Graduate Course October 23, 2002.
Multimodal Interaction Dr. Mike Spann
ITK The Insight Segmentation & Registration Toolkit Martin Urschler Institute for Computer Graphics and Vision Graz University of Technology.
Digital Image Processing Lecture 7: Geometric Transformation March 16, 2005 Prof. Charlene Tsai.
Building Prostate Statistical Atlas using Large-Deformation Image Registration Eric Hui University of Waterloo – MIAMI Bi-weekly.
Sparse Shape Representation using the Laplace-Beltrami Eigenfunctions and Its Application to Modeling Subcortical Structures Xuejiao Chen.
CSci 6971: Image Registration Lecture 3: Images and Transformations March 1, 2005 Prof. Charlene Tsai.
Coregistration and Spatial Normalisation
Jan Kamenický Mariánská  We deal with medical images ◦ Different viewpoints - multiview ◦ Different times - multitemporal ◦ Different sensors.
A Novel Image Registration Pipeline for 3- D Reconstruction from Microscopy Images Kun Huang, PhD; Ashish Sharma, PhD; Lee Cooper, MS; Kun Huang, PhD;
MEDICAL IMAGE REGISTRATION BY MAXIMIZATION OF MUTUAL INFORMATION Dissertation Defense by Chi-hsiang Lo June 27, 2003 PRESENTATION.
Image Registration as an Optimization Problem. Overlaying two or more images of the same scene Image Registration.
Medical Image Analysis Image Registration Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Feature based deformable registration of neuroimages using interest point and feature selection Leonid Teverovskiy Center for Automated Learning and Discovery.
Spatio-Temporal Free-Form Registration of Cardiac MR Image Sequences Antonios Perperidis s /02/2006.
One enters the NeuroMaps Mapper through BrainInfo (
Statistical Parametric Mapping Lecture 11 - Chapter 13 Head motion and correction Textbook: Functional MRI an introduction to methods, Peter Jezzard, Paul.
SPM Pre-Processing Oli Gearing + Jack Kelly Methods for Dummies
Image registration aligns the common features of two images. The open-source Insight Toolkit (ITK, funded by the National Library of Medicine) provides.
Atlas Interoperablity I & II: progress to date, requirements gathering Session I: 8:30 – 10am Session II: 10:15 – 12pm.
Image Registration Lecture 9: Registration Components March 22, 2005 Prof. Charlene Tsai.
Intro to FreeSurfer Jargon. voxel surface volume vertex surface-based recon cortical, subcortical parcellation/segmentation registration, morph, deform,
Ki-Chang Kwak. Average Brain Templates Used for Registration.
Three-Dimension (3D) Whole-slide Histological Image Analytics
Pathology Spatial Analysis February 2017
Intro to FreeSurfer Jargon
Paper Presentation: Shape and Matching
Stereotaxic Surgery Histology
Intro to FreeSurfer Jargon
Computational Neuroanatomy for Dummies
Image Preprocessing for Idiots
Intro to FreeSurfer Jargon
Intro to FreeSurfer Jargon
SimpleITK Fundamental Concepts
SimpleITK Fundamental Concepts
Image Registration 박성진.
James G. Heys, Krsna V. Rangarajan, Daniel A. Dombeck  Neuron 
Volume 88, Issue 3, Pages (November 2015)
Anatomical Measures John Ashburner
Image Registration  Mapping of Evolution
Review and Importance CS 111.
Presentation transcript:

A Big Thanks Prof. Jason Bohland Quantitative Neuroscience Laboratory Boston University Dr. Luis Ibanez Open Source Proponent, ITK Kitware Inc.

Supplemental Material

Genome-wide atlas of gene expression throughout the mouse brain (N=1,2 or a few mice/gene) 56 day-old (young adult) C57BL/6J mice High-throughput experiments using in situ hybridization Pipeline - sectioning, ISH, digital microscopy, image analysis, atlas registration Allen Mouse Brain Atlas

The Process Construction and representation of the Anatomic Gene Expression Atlas (AGEA).

Nissl-Stained Atlas – Ground Truth (a) Level 53 coronal plate (bregma mm) from the The Allen Reference Atlas (ARA) delineating 2D anatomic boundaries of a Nissl-stained mouse brain section.

Bregma – Neurological Context bregma located at the intersection of the coronal and sagittal sutures. Level 53 coronal plate (bregma mm)

Image

Nissl Nissl-stained histological section through the rodent hippocampus showing various classes of cells (neurons and glia). Motor nerve cell from ventral horn of medulla spinalis of rabbit. The angular ande spindle- shaped Nissl bodies are well shown Nissl stains the cell body esp. endoplasmic reticulum. Basic dyes (e.g. aniline, thionine, or cresyl violet) to stain negatively charged RNA blue, Nissl substance (rough endoplasmic reticulum) appears dark blue from ribosomal RNA DNA stains a similar color

Atlas Assembly (b) 3D assembly of high-level ARA structures formed by 3D reconstruction of the Nissl sections. The 3D ARA space is partitioned into 200-mm^3 voxels forming the smallest spatial unit for analysis. New annotated anatomical reference atlas (Hong-Wei Dong, 2007) 528 coronal Nissl sections: unfixed, frozen mouse brain (25μm thick) 132 sections, with 100μm spacing, annotated over1000 brain All image data are mapped to common coordinate space Waxholm -

Creating Geometry from Images Placenta H+E SlidesAlignment Segmentation Visualization/Surface Extraction Aperio

Digital Placenta

Virtual Cellular Reconstructions Before using cellular segmentationUsing cellular segmentations

Plane-by-Plane Reconstruction Mammary duct segmentationVisualization: N-point function feature space

What We Did …

Sub-Sampling by Half Origin (Ox,Oy) New Origin (O’x,O’y) New Spacing S’y New Spacing S’x

Resampling in ITK Transform Interpolator Origin Spacing Region Start Region Size Resample Filter

Image Registration

Formulation Assume correspondences are known Find such f() and g() such that the images are best matched I 2 (x,y)=g(I 1 (f(x,y)) f() – spatial transformation g() – intensity transformation

24 General Formulation The general formulation for registration with regularization is: where is the Error term is the regularization parameter is the penalty term

Registration Fixed Image Moving Image Metric Transform Interpolator Optimizer

Image Metrics Mean Squares Normalized Correlation Mean Reciprocal Square Difference Mutual Information - Viola-Wells - Mattes - Histogram based - Histogram normalized

Plotting the Metric Mean Squared Differences Transform Parametric Space

Plotting the Metric Mean Squared Differences Transform Parametric Space

Plotting the Metric Mean Squared Differences – A PROBLEM Transform Parametric Space

Registration Fixed Image Moving Image Metric Transform Interpolator Optimizer

Transforms Translation Scaling Rotation Rigid3D Rigid2D Affine BSplines Splines: TPS, EBS, VS

Rigid Transformation Rotation(R) Translation(t) Similarity(scale)

Registration Fixed Image Moving Image Metric Transform Interpolator Optimizer

Interpolators Nearest Neighbor Linear BSpline

Optimizers Gradient Descent Regular Step Gradient Descent Conjugate Gradient Levenberg-Marquardt One plus One Evolutionary Algorithm

Gradient Descent Optimizer f( x, y ) S = L ∙ G( x, y ) f( x, y ) ∆ G( x, y ) =

Gradient Descent Optimizer f( x, y ) S = L ∙ G( x, y ) f( x, y ) ∆ G( x, y ) = L too large

Gradient Descent Optimizer f( x, y ) S = L ∙ G( x, y ) f( x, y ) ∆ G( x, y ) = L too small

Registration in ITK Image Registration Framework Multi Resolution Registration Framework PDE Based Registration FEM Based Registration Components

Construction of ARA and ISH

Allen Reference Atlas

3D Nissl volume comes from rigid reconstruction Each section reoriented to match adjacent images as closely as possible A 1.5T low resolution 3D average MRI volume used to ensure reconstruction is realistic Reoriented Nissl section down-sampled, converted to grayscale Isotropic 25μm grayscale volume.

Anatomy 208 large structures and structural groupings extracted Projected & smoothed onto 3D atlas volume to for structural annotation Additional decomposition of cortex into an intersection of 202 regions and areas