A Survey of Medical Image Registration J.B.Maintz,M.A Viergever Medical Image Analysis,1998.

Slides:



Advertisements
Similar presentations
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Advertisements

Medical Imaging and Anatomy Mike Houston, Anthony Sherbondy, Ruwen Hess.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
Automatic Feature Extraction for Multi-view 3D Face Recognition
Intensity-based deformable registration of 2D fluoroscopic X- ray images to a 3D CT model Aviv Hurvitz Advisor: Prof. Leo Joskowicz.
Frequency-Domain Range Data Registration for 3-D Space Modeling in Robotic Applications By Phillip Curtis.
Tuesday Seminar Deformable Image Registration
Semi-automatic Range to Range Registration: A Feature-based Method Chao Chen & Ioannis Stamos Computer Science Department Graduate Center, Hunter College.
Reverse Engineering Niloy J. Mitra.
Medical Image Registration Dept. of Biomedical Engineering Biomedical Image Analysis
CSci 6971: Image Registration Lecture 3: Images and Transformations January 20, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart,
Non-Rigid Registration. Why Non-Rigid Registration  In many applications a rigid transformation is sufficient. (Brain)  Other applications: Intra-subject:
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
3D Augmented Reality for MRI-Guided Surgery Using Integral Videography Autostereoscopic Image Overlay Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi.
Yujun Guo Kent State University August PRESENTATION A Binarization Approach for CT-MR Registration Using Normalized Mutual Information.
Image Registration Narendhran Vijayakumar (Naren) 12/17/2007 Department of Electrical and Computer Engineering 1.
Medical Image Registration
P. Rodríguez, R. Dosil, X. M. Pardo, V. Leborán Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
Multimodal Visualization for neurosurgical planning CMPS 261 June 8 th 2010 Uliana Popov.
Introduction to Medical Imaging
Preprocessing II: Between Subjects John Ashburner Wellcome Trust Centre for Neuroimaging, 12 Queen Square, London, UK.
Multimodal Registration of Medical Data Prof. Leo Joskowicz School of Computer Science and Engineering The Hebrew University of Jerusalem.
Department of Informatics, Aristotle University of Thessaloniki, May 4, 2001 ARISTOTLE UNIVERSITY OF THESSALONIKI. DEPARTMENT OF INFORMATICS Stelios Krinidis.
July 2010 Image Registration Techniques, Benchmarking, Strategy Surgical Planning Laboratory Center for Neurological Imaging July 2010 Lidwien Veugen Supervision.
3D Rigid/Nonrigid RegistrationRegistration 1)Known features, correspondences, transformation model – feature basedfeature based 2)Specific motion type,
Image Guided Surgery in Prostate Brachytherapy Rohit Saboo.
National Alliance for Medical Image Computing Registration in Slicer3 Julien Jomier Kitware Inc.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2014.
Multimodal Interaction Dr. Mike Spann
Image Segmentation and Registration Rachel Jiang Department of Computer Science Ryerson University 2006.
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
Medical Image Analysis Image Reconstruction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
CSci 6971: Image Registration Lecture 3: Images and Transformations March 1, 2005 Prof. Charlene Tsai.
Coregistration and Spatial Normalisation
Jan Kamenický Mariánská  We deal with medical images ◦ Different viewpoints - multiview ◦ Different times - multitemporal ◦ Different sensors.
A Novel Image Registration Pipeline for 3- D Reconstruction from Microscopy Images Kun Huang, PhD; Ashish Sharma, PhD; Lee Cooper, MS; Kun Huang, PhD;
MEDICAL IMAGE REGISTRATION BY MAXIMIZATION OF MUTUAL INFORMATION Dissertation Defense by Chi-hsiang Lo June 27, 2003 PRESENTATION.
MEDICAL IMAGE ANALYSIS Marek Brejl Vital Images, Inc.
Image Registration as an Optimization Problem. Overlaying two or more images of the same scene Image Registration.
A Frequency-Domain Approach to Registration Estimation in 3-D Space Phillip Curtis Pierre Payeur Vision, Imaging, Video and Autonomous Systems Research.
Medical Image Analysis Image Registration Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Feature based deformable registration of neuroimages using interest point and feature selection Leonid Teverovskiy Center for Automated Learning and Discovery.
Medical Image Analysis Sebastian Thrun, Gary Bradski, Daniel Russakoff Stanford CS223B Computer Vision
CS-378: Game Technology Lecture #13: Animation Prof. Okan Arikan University of Texas, Austin Thanks to James O’Brien, Steve Chenney, Zoran Popovic, Jessica.
Spatio-Temporal Free-Form Registration of Cardiac MR Image Sequences Antonios Perperidis s /02/2006.
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2013.
PRINCIPLES AND APPROACHES 3D Medical Imaging. Introduction (I) – Purpose and Sources of Medical Imaging Purpose  Given a set of multidimensional images,
Adaptive Rigid Multi-region Selection for 3D face recognition K. Chang, K. Bowyer, P. Flynn Paper presentation Kin-chung (Ryan) Wong 2006/7/27.
Image Registration with Hierarchical B-Splines Z. Xie and G. Farin.
A B C D E F A ABSTRACT A novel, efficient, robust, feature-based algorithm is presented for intramodality and multimodality medical image registration.
Statistical Parametric Mapping Lecture 11 - Chapter 13 Head motion and correction Textbook: Functional MRI an introduction to methods, Peter Jezzard, Paul.
C O R P O R A T E T E C H N O L O G Y Information & Communications Neural Computation Machine Learning Methods on functional MRI Data Siemens AG Corporate.
SPM Pre-Processing Oli Gearing + Jack Kelly Methods for Dummies
Image-Based 3-D Spinal Navigation Using Intra-Operative Fluoroscopic Registration R. Grzeszczuk, S. Chin, M. Murphy, R. Fahrig, H. Abbasi, D. Kim, J.R.
776 Computer Vision Jan-Michael Frahm Spring 2012.
Reformatting registration Fiducials segmentation registration dataset1 dataset2 dataset1 dataset2 transformation reformatted dataset transformation reformatted.
Introduction to Medical Imaging Regis Introduction to Medical Imaging Registration Alexandre Kassel Course
Ki-Chang Kwak. Average Brain Templates Used for Registration.
The past and future of virtual reality simulation in neurologic surgery Longwei F
CSE 554 Lecture 8: Alignment
University of Ioannina
CNRS applications in medical imaging
Multi-modality image registration using mutual information based on gradient vector flow Yujun Guo May 1,2006.
Computational Neuroanatomy for Dummies
Registration and Its Medical Applications
CSE 554 Lecture 10: Extrinsic Deformations
Image Registration 박성진.
MultiModality Registration using Hilbert-Schmidt Estimators
Computed Tomography (C.T)
Presentation transcript:

A Survey of Medical Image Registration J.B.Maintz,M.A Viergever Medical Image Analysis,1998

Medical Image  SPECT (Single Photon Emission Computed Tomography)  PET (Positron Emission Tomography)  MRI (Magnetic Resonance Image)  CT (Computed Tomography)

Image Modalities Anatomical Depicting primarily morphology (MRI,CT,X-ray) Functional Depicting primarily information on the metabolism of the underlying anatomy (SPECT,PET)

Medical Image Integration Registration Bring the modalities involved into spatial alignment Fusion Integrated display of the data involved Matching, Integration,Correlation,…

Registration procedure Problem statement Registration paradigm Optimization procedure Pillars and criteria are heavily interwined and have many cross-influences

Classification of Registration Methods Dimensionality Nature of Registration basis Nature of transformation Domain of transformation Interaction Optimization procedure Modalities involved SubjectObject

Dimensionality Spatial dimensions only 2D/2D 2D/3D 3D/3D Time series(more than two images), with spatial dimensions 2D/2D 2D/3D 3D/3D

Spatial registration methods 3D/3D registration of two images 2D/2D registration Less complex by an order of magnitude both where the number of parameters and the volume of the data are concerned. 2D/3D registration Direct alignment of spatial data to projective data, or the alignment of a single tomographic slice to spatial data

Registration of time series Time series of images are required for various reasons Monitoring of bone growth in children (long time interval) Monitoring of tumor growth (medium interval) Post-operative monitoring of healing (short interval) Observing the passing of an injected bolus through a vessel tree (ultra-short interval) Two images need to be compared.

Nature of registration basis Image based Extrinsic based on foreign objects introduced into the imaged space Intrinsic based on the image information as generated by the patient Non-image based (calibrated coordinate systems)

Extrinsic registration methods Advantage registration is easy, fast, and can be automated. no need for complex optimization algorithms. Disadvantage Prospective character must be made in the pre-acquisition phase. Often invasive character of the marker objects. Non-invasive markers can be used, but less accurate.

Extrinsic registration methods Invasive Stereotactic frame Fiducials (screw markers) Non-invasive Mould,frame,dental adapter,etc Fiducials (skin markers)

Extrinsic registration methods The registration transformation is often restricted to be rigid (translations and rotations only) Rigid transformation constraint, and various practical considerations, use of extrinsic 3D/3D methods are limited to brain and orthopedic imaging

Intrinsic registration methods Landmark based Segmentation based Voxel property based

Landmark based registration Anatomical salient and accurately locatable points of the morphology of the visible anatomy, usually identified by the user Geometrical points at the locus of the optimum of some geometric property,e.g.,local curvature extrema,corners,etc, generally localized in an automatic fashion.

Landmark based registration The set of registration points is sparse ---fast optimization procedures Optimize Measures Average distance between each landmark Closest counterpart (Procrustean Metric) Iterated minimal landmark distances Algorithm Iterative closest point (ICP) Procrustean optimum Quasi-exhaustive searches, graph matching and dynamic programming approaches

Segmentation based registration Rigid model based Anatomically the same structures(mostly surfaces) are extracted from both images to be registered, and used as the sole input for the alignment procedure. Deformable model based An extracted structure (also mostly surfaces, and curves) from one image is elastically deformed to fit the second image.

Rigid model based “head-hat” method rely on the segmentation of the skin surface from CT,MR, and PET images of the head Chamfer matching alignment of binary structures by means of a distance transform

Deformable model based Deformable curves Snakes, active contours,nets(3D) Data structure Local functions, i.e., splines Deformable model approach Template model defined in one image template is deformed to match second image segmented structure unsegmented

Voxel property based registration Operate directly on the image grey values Two approaches: Immediately reduce the image grey value content to a representative set of scalars and orientations Use the full image content throughout the registration process

Principal axes and moments based Image center of gravity and its principal orientations (principal axes) are computed from the image zeroth and first order moment Align the center of gravity and the principal orientations Principal axes :Easy implementation, no high accuracy Moment based: require pre-segmentation

Full image content based Use all of the available information throughout the registration process. Automatic methods presented

Paradigms reported Cross-correlation Fourier domain based.. Minimization of variance of grey values within segmentation Minimization of the histogram entropy of difference images Histogram clustering and minimization of histogram dispersion Maximization of mutual information Minimization of the absolute or squared intensity differences …

Non-image based registration Calibrated coordinate system If the imaging coordinate systems of the two scanners involved are somehow calibrated to each other, which necessitates the scanners to be brought in to he same physical location Registering the position of surgical tools mounted on a robot arm to images

Nature of Transformation Rigid Affine Projective Curved

Domain of transformation Global Apply to entire image Local Subsections have their own

Rigid case equation Rigid or affine 3D transformation equation

Rotation matrix rotates the image around axis i by an angle

Transformation Many methods require a pre- registration (initialization) using a rigid or affine transformation Global rigid transformation is used most frequently in registration applications Application: Human head

Interaction Interactive Semi-automatic Automatic Minimal interaction and speed, accuracy, or robustness

Interaction Extrinsic methods Automated Semi-automatic Intrinsic methods Semi-automatic Anatomical landmark Segmentation based Automated Geometrical landmark Voxel property based

Optimization procedure Parameters for registration transformation Parameters computed Parameters searched for

Optimization techniques Powell’s method Downhill simplex method Levenberg-Marquardt optimization Simulated annealing Genetic methods Quasi-exhaustive searching

Optimization techniques Frequent additions: Multi-resolution and multi-scale approaches More than one techniques Fast & coarse one followed by accurate & slow one

Modalities involved Monomodal Multimodal Modality to model Patient to modality

Subject Intrasubject Intersubject Atlas

Object Different areas of the body

Related issues How to use the registration Registration & visualization Registration & segmentation Validation Validation of the registration Accuracy,…