 Interactive Segmentation For Image Guided Therapy Ohad Shitrit & Tsachi Hershkovich Superviser: Dr. Tammy Riklin Raviv Ben-Gurion University of the Negev.

Slides:



Advertisements
Similar presentations
Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance Dhruv Batra, Carnegie Mellon University Adarsh Kowdle, Cornell.
Advertisements

Graph cut Chien-chi Chen.
Robust statistical method for background extraction in image segmentation Doug Keen March 29, 2001.
Automatic Segmentation and Volume Estimation of Lung Cancer Nodules using Computed Tomography Timothy R. Tuinstra, PhD Candidate.
K-means clustering Hongning Wang
Automatic Identification of Bacterial Types using Statistical Image Modeling Sigal Trattner, Dr. Hayit Greenspan, Prof. Shimon Abboud Department of Biomedical.
D contour based local manual correction of liver segmentations1Institute for Medical Image Computing 3D contour based local manual correction.
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
Medical Imaging Mohammad Dawood Department of Computer Science University of Münster Germany.
BMME 560 & BME 590I Medical Imaging: X-ray, CT, and Nuclear Methods Tomography Part 4.
ECE 501 Introduction to BME ECE 501 Dr. Hang. Part VI Medical Imaging Computed Tomography ECE 501 Dr. Hang.
First introduced in 1977 Lots of mathematical derivation Problem : given a set of data (data is incomplete or having missing values). Goal : assume the.
MRI Image Segmentation for Brain Injury Quantification Lindsay Kulkin 1 and Bir Bhanu 2 1 Department of Biomedical Engineering, Syracuse University, Syracuse,
Estimating 3D Respiratory Motion from Orbiting Views Rongping Zeng, Jeffrey A. Fessler, James M. Balter The University of Michigan Oct Funding provided.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Yujun Guo Kent State University August PRESENTATION A Binarization Approach for CT-MR Registration Using Normalized Mutual Information.
12-Apr CSCE790T Medical Image Processing University of South Carolina Department of Computer Science 3D Active Shape Models Integrating Robust Edge.
Expectation Maximization for GMM Comp344 Tutorial Kai Zhang.
An Iterative Optimization Approach for Unified Image Segmentation and Matting Hello everyone, my name is Jue Wang, I’m glad to be here to present our paper.
P. Rodríguez, R. Dosil, X. M. Pardo, V. Leborán Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
MSc project Janneke Ansems Intensity and Feature Based 3D Rigid Registration of Pre- and Intra-Operative MR Brain Scans Committee: Prof. dr.
Pattern Recognition. Introduction. Definitions.. Recognition process. Recognition process relates input signal to the stored concepts about the object.
Back Projection Reconstruction for CT, MRI and Nuclear Medicine
3D CT Image Data Visualize Whole lung tissues Using VTK 8 mm
Application of Digital Signal Processing in Computed tomography (CT)
Automatic User Interaction Correction via Multi-label Graph-cuts Antonio Hernández-Vela, Carlos Primo and Sergio Escalera Workshop on Human Interaction.
Demetrios J. Halazonetis Cone-beam Computed Tomography in Orthodontics: Limitations and future directions.
2008/10/02H704 - DYU1 Active Contours and their Utilization at Image Segmentation Author : Marián Bakoš Source : 5th Slovakian-Hungarian Joint Symposium.
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
Design and simulation of micro-SPECT: A small animal imaging system Freek Beekman and Brendan Vastenhouw Section tomographic reconstruction and instrumentation.
DTU Medical Visionday May 27, 2009 Generative models for automated brain MRI segmentation Koen Van Leemput Athinoula A. Martinos Center for Biomedical.
BMME 560 & BME 590I Medical Imaging: X-ray, CT, and Nuclear Methods Tomography Part 1.
Computed Tomography References The Essential Physics of Medical Imaging 2 nd ed n. Bushberg J.T. et.al Computed Tomography 2 nd ed n : Seeram Physics of.
Medical Image Analysis Image Reconstruction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
MRI Image Segmentation for Brain Injury Quantification Lindsay Kulkin BRITE REU 2009 Advisor: Bir Bhanu August 20, 2009.
AUTOMATIZATION OF COMPUTED TOMOGRAPHY PATHOLOGY DETECTION Semyon Medvedik Elena Kozakevich.
Jan Kamenický Mariánská  We deal with medical images ◦ Different viewpoints - multiview ◦ Different times - multitemporal ◦ Different sensors.
DISCRIMINATIVE TRAINING OF LANGUAGE MODELS FOR SPEECH RECOGNITION Hong-Kwang Jeff Kuo, Eric Fosler-Lussier, Hui Jiang, Chin-Hui Lee ICASSP 2002 Min-Hsuan.
Image Reconstruction from Projections Antti Tuomas Jalava Jaime Garrido Ceca.
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Supervised Learning of Edges and Object Boundaries Piotr Dollár Zhuowen Tu Serge Belongie.
Medical Image Analysis Dr. Mohammad Dawood Department of Computer Science University of Münster Germany.
MultiModality Registration Using Hilbert-Schmidt Estimators By: Srinivas Peddi Computer Integrated Surgery II April 27 th, 2001 Final Presentation.
Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1.
AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University Automatic 3D Image Segmentation of Internal Lung Structures.
A split-and-merge framework for 2D shape summarization D. Gerogiannis, C. Nikou and A. Likas Department of Computer Science, University of Ioannina, Greece.
An Algorithm to Compute Independent Sets of Voxels for Parallelization of ICD-based Statistical Iterative Reconstruction Sungsoo Ha and Klaus Mueller Department.
MultiModality Registration Using Hilbert-Schmidt Estimators By: Srinivas Peddi Computer Integrated Surgery II April 6 th, 2001.
Photoconsistency constraint C2 q C1 p l = 2 l = 3 Depth labels If this 3D point is visible in both cameras, pixels p and q should have similar intensities.
Kim HS Introduction considering that the amount of MRI data to analyze in present-day clinical trials is often on the order of hundreds or.
RECONSTRUCTION OF MULTI- SPECTRAL IMAGES USING MAP Gaurav.
Gaussian Mixture Model-based EM Algorithm for Instrument Occlusion in Tool Detection from Imagery of Laparoscopic Robot-Assisted Surgery 1 Interdisciplinary.
Segmentation of 3D microPET Images of the Rat Brain by Hybrid GMM and KDE Tai-Been Chen Department of Medical Imaging and Radiological Science,
The Optimization of Reconstruction Method Reducing Partial Volume Effect in PET/CT 3D Image Acquisition Department of Nuclear Medicine, Samsung Medical.
You Zhang, Jeffrey Meyer, Joubin Nasehi Tehrani, Jing Wang
Interior Tomography Approach for MRI-guided
Degradation/Restoration Model
CNRS applications in medical imaging
Single Photon Emission Tomography
Multi-modality image registration using mutual information based on gradient vector flow Yujun Guo May 1,2006.
PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD
Automatic User Interaction Correction via Multi-label Graph-cuts
“grabcut”- Interactive Foreground Extraction using Iterated Graph Cuts
Seam Carving Project 1a due at midnight tonight.
Video Compass Jana Kosecka and Wei Zhang George Mason University
Image Registration 박성진.
My name is Shijian Liu, a Lecture from Fujian University of Technology
Multiple Organ detection in CT Volumes - Week 3
Computed Tomography (C.T)
Presentation transcript:

 Interactive Segmentation For Image Guided Therapy Ohad Shitrit & Tsachi Hershkovich Superviser: Dr. Tammy Riklin Raviv Ben-Gurion University of the Negev

What are we going to speak about? Tsachi H. & Ohad S.  Computed Tomography  Motivation  Mathematical introduction  Problem definition  Energy  Gradient Descent  The system  Results  Conclusion & Future work

Tsachi H. & Ohad S. Computed Tomography (CT) Spiral Cone-Beam Scanning for Computed Tomography. Ge Wang, 2003 (All rights reserved)

Tsachi H. & Ohad S. Computed Tomography (CT) Spiral Cone-Beam Scanning for Computed Tomography. Ge Wang, 2003 (All rights reserved)  X-Ray Projection using radon transform

Tsachi H. & Ohad S. Computed Tomography (CT)  Radon transform as one dimensional Fourier transform  Reconstructing the image with the inverse Fourier transform

Why is there any need for interactive segmentation ? Tsachi H. & Ohad S.

Why is there any need for interactive segmentation?  Volume estimation is critical for further treatment  Therapist knowledge is essential for final decisions  Fast and accurate analysis might save life Tsachi H. & Ohad S.

“Active Contour” But first things first… Tsachi H. & Ohad S.

Probabilistic Model Based on Gaussian Mixture(GM) Tsachi H. & Ohad S.  We will define the Probability of a Voxel (3D pixel) to belong to the Object Or to the Background:

A CT scan Histogram of a brain with Cerebral hemorrhage Tsachi H. & Ohad S.

Level Set Function -

Tsachi H. & Ohad S. Mathematical Issues

Tsachi H. & Ohad S. [Riklin Raviv, Van Leemput, Menze, Wells, Golland, Medical Image Analysis, 2011]

Tsachi H. & Ohad S. To achieve the optimized segmentation we maximize the joint distribution: [Riklin Raviv, Van Leemput, Menze, Wells, Golland, Medical Image Analysis, 2011]

Tsachi H. & Ohad S. Energy Functional  Using the following relationship :  Allows us to formulate our problem as an energy minimization problem  Summing all contributions from each voxel

Tsachi H. & Ohad S. Image Likelihood Term  Assuming Gaussian Mixtures Model (GMM)

Tsachi H. & Ohad S. Smoothness Term  Objects in nature are continuous  Trade off between smoothness and sensitivity  Fine tuning is needed

Tsachi H. & Ohad S. User Interaction Term

Tsachi H. & Ohad S. Gradient Descent The gradient descent is an iterative process which leads to the minimum of the Energy term.

Tsachi H. & Ohad S. Block Diagram – Entire System [Riklin Raviv, Van Leemput, Menze, Wells, Golland, Medical Image Analysis, 2011]

Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Entire System 3D

Tsachi H. & Ohad S. Performance DiceSensitivitySpecificityAccuracy Automatic 0.874± ± ± ± With user interaction 0.905± ± ± ±0.0022

Tsachi H. & Ohad S. Data  Provided by Dr. Ilan Shelef, Department of Radiology, Soroka University Medical Center and Zlotowski Center for Neuroscience, Ben- Gurion University of the Negev.  Modality: CT Brilliance 64  Resolution: 512x512xZ (Z = ) X x Y x Z = 0.48 x 0.48 x 3 [mm]  Z axis with 1.5[mm] overlap

Conclusion  Semi-automatic segmentation tool  Probabilistic model  User Interface  Collaboration with Soroka Medical Center Tsachi H. & Ohad S.

Future work  Adjustments to other modalities (MRI)  Handle with various of structures  User-Machine dialog in the medical world Tsachi H. & Ohad S.

User Interface

Questions? Thank you. Demo -