Clustering on Local Appearance for Deformable Model Segmentation Joshua V. Stough, Robert E. Broadhurst, Stephen M. Pizer, Edward L. Chaney MIDAG, UNC-Chapel.

Slides:

Advertisements

Similar presentations

Yinyin Yuan and Chang-Tsun Li Computer Science Department

Advertisements

Distinctive Image Features from Scale-Invariant Keypoints David Lowe.

The Normal Distribution

CSCE643: Computer Vision Bayesian Tracking & Particle Filtering Jinxiang Chai Some slides from Stephen Roth.

MRI preprocessing and segmentation.

Independent Component Analysis Personal Viewpoint: Directions that maximize independence Motivating Context: Signal Processing “Blind Source Separation”

System Challenges in Image Analysis for Radiation Therapy Stephen M. Pizer Kenan Professor Medical Image Display & Analysis Group University.

Patch to the Future: Unsupervised Visual Prediction

Identifying Image Spam Authorship with a Variable Bin-width Histogram-based Projective Clustering Song Gao, Chengcui Zhang, Wei Bang Chen Department of.

These improvements are in the context of automatic segmentations which are among the best found in the literature, exceeding agreement between experts.

Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.

Computer Vision Group, University of BonnVision Laboratory, Stanford University Abstract This paper empirically compares nine image dissimilarity measures.

Model: Parts and Structure. History of Idea Fischler & Elschlager 1973 Yuille ‘91 Brunelli & Poggio ‘93 Lades, v.d. Malsburg et al. ‘93 Cootes, Lanitis,

Model-Based Organ Segmentation: Recent Methods Jiun-Hung Chen General Exam Paper

Thresholding Otsu’s Thresholding Method Threshold Detection Methods Optimal Thresholding Multi-Spectral Thresholding 6.2. Edge-based.

HMM-BASED PATTERN DETECTION. Outline  Markov Process  Hidden Markov Models Elements Basic Problems Evaluation Optimization Training Implementation 2-D.

Hierarchical Statistical Modeling of Boundary Image Profiles Sean Ho Department of Computer Science University of North Carolina, Chapel Hill, NC, USA.

A Study of Approaches for Object Recognition

Multiscale Profile Analysis Joshua Stough MIDAG PI: Chaney, Pizer July, 2003 Joshua Stough MIDAG PI: Chaney, Pizer July, 2003.

Medial Object Shape Representations for Image Analysis & Object Synthesis Stephen M. Pizer Kenan Professor Medical Image Display & Analysis Group.

University of North Carolina Comparison of Human and M-rep Kidneys Segmented from CT Images James Chen, Gregg Tracton, Manjari Rao, Sarang Joshi, Steve.

Medical Image Synthesis via Monte Carlo Simulation James Z. Chen, Stephen M. Pizer, Edward L. Chaney, Sarang Joshi Medical Image Display & Analysis Group,

Clustering on Image Boundary Regions for Deformable Model Segmentation Joshua Stough, Stephen M. Pizer, Edward L. Chaney, Manjari Rao Medical Image Display.

The Uses of Object Shape from Images in Medicine Stephen M. Pizer Kenan Professor Medical Image Display & Analysis Group University of North.

Image Registration Narendhran Vijayakumar (Naren) 12/17/2007 Department of Electrical and Computer Engineering 1.

Visualizing Image Model Statistics for the Human Kidney Liz Dolan, Joshua Stough COMP December 2, 2003.

Medical Image Synthesis via Monte Carlo Simulation An Application of Statistics in Geometry & Building a Geometric Model with Correspondence.

1 Stephen Pizer, Sarang Joshi, Guido Gerig Medical Image Display & Analysis Group (MIDAG) University of North Carolina, USA with credit to P. T. Fletcher,

Run-time correction of MRI inhomogeneities to enhance warping accuracy Evan Fletcher.

ANALYSIS OF A LOCALLY VARYING INTENSITY TEMPLATE FOR SEGMENTATION OF KIDNEYS IN CT IMAGES MANJARI I RAO UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL.

Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.

Statistics of Anatomic Geometry Stephen Pizer, Kenan Professor Medical Image Display & Analysis Group University of North Carolina This tutorial.

Object Recognition by Parts Object recognition started with line segments. - Roberts recognized objects from line segments and junctions. - This led to.

Li Wang1, Feng Shi1, Gang Li1, Weili Lin1, John H

Image Guided Surgery in Prostate Brachytherapy Rohit Saboo.

National Alliance for Medical Image Computing – Algorithms Core (C1a) Five investigators: –A. Tannenbaum (BU), P. Golland (MIT), M. Styner.

Parameter selection in prostate IMRT Renzhi Lu, Richard J. Radke 1, Andrew Jackson 2 Rensselaer Polytechnic Institute 1,Memorial Sloan-Kettering Cancer.

Analyzing Configurations of Objects in Images via

7 July, 2003 AZ/Manchester Knees Meeting 1 AstraZeneca & University of Manchester Knees Project Project Meeting ISBE, University of Manchester 7 th July.

Enhanced Correspondence and Statistics for Structural Shape Analysis: Current Research Martin Styner Department of Computer Science and Psychiatry.

A Challenging Example Male Pelvis –Bladder – Prostate – Rectum.

MEDICAL IMAGE ANALYSIS Marek Brejl Vital Images, Inc.

How natural scenes might shape neural machinery for computing shape from texture? Qiaochu Li (Blaine) Advisor: Tai Sing Lee.

NA-MIC National Alliance for Medical Image Computing Non-Parametric Statistical Permutation Tests for Local Shape Analysis Martin Styner, UNC Dimitrios.

Author : Williams, T.G. Taylor, C.J. Waterton, J.C. Holmes, A Source : Macro to Nano, 2004.IEEE International Symposium on Macro to Nano, 2004.IEEE International.

Copyright © 2010 Siemens Medical Solutions USA, Inc. All rights reserved. Hierarchical Segmentation and Identification of Thoracic Vertebra Using Learning-based.

CS654: Digital Image Analysis

Focal Analysis of Knee Articular Cartilage Quantity and Quality Dr. Tomos G. Williams Imaging Science and Biomedical Engineering University of Manchester.

Real-Time Detection, Alignment and Recognition of Human Faces Rogerio Schmidt Feris Changbo Hu Matthew Turk Pattern Recognition Project June 12, 2003.

Object Orie’d Data Analysis, Last Time SiZer Analysis –Zooming version, -- Dependent version –Mass flux data, -- Cell cycle data Image Analysis –1 st Generation.

Topic Models Presented by Iulian Pruteanu Friday, July 28 th, 2006.

Common Property of Shape Data Objects: Natural Feature Space is Curved I.e. a Manifold (from Differential Geometry) Shapes As Data Objects.

CSE 185 Introduction to Computer Vision Feature Matching.

Uncertainty Quantification in Climate Prediction Charles Jackson (1) Mrinal Sen (1) Gabriel Huerta (2) Yi Deng (1) Ken Bowman (3) (1)Institute for Geophysics,

1 UNC, Stat & OR Hailuoto Workshop Object Oriented Data Analysis, I J. S. Marron Dept. of Statistics and Operations Research, University of North Carolina.

Cell Segmentation in Microscopy Imagery Using a Bag of Local Bayesian Classifiers Zhaozheng Yin RI/CMU, Fall 2009.

1 Review and Summary We have covered a LOT of material, spending more time and more detail on 2D image segmentation and analysis, but hopefully giving.

Anatomic Geometry & Deformations and Their Population Statistics (Or Making Big Problems Small) Stephen M. Pizer, Kenan Professor Medical Image.

SigClust Statistical Significance of Clusters in HDLSS Data When is a cluster “really there”? Liu et al (2007), Huang et al (2014)

Clustering on Image Boundary Regions for Deformable Model Segmentation Joshua Stough, Stephen M. Pizer, Edward L. Chaney, Manjari Rao, Gregg.

Landmark Based Shapes As Data Objects

Segmentation of Single-Figure Objects by Deformable M-reps

Model-Based Organ Segmentation in CT Scans

Model-Based Organ Segmentation: Recent Methods

“good visual impression”

Histogram Probability distribution of the different grays in an image.

Liyuan Li, Jerry Kah Eng Hoe, Xinguo Yu, Li Dong, and Xinqi Chu

The Normal Distribution

Anatomical Measures John Ashburner

CSE 185 Introduction to Computer Vision

Presentation transcript:

Clustering on Local Appearance for Deformable Model Segmentation Joshua V. Stough, Robert E. Broadhurst, Stephen M. Pizer, Edward L. Chaney MIDAG, UNC-Chapel Hill ISBI 2007, SA-AM-OS2b April 14, 2007 MIDAG, UNC-Chapel Hill ISBI 2007, SA-AM-OS2b April 14, 2007

Deformable Model Segmentation Deformable Model Segmentation

Problem: Bladder and Prostate in CT Problem: Bladder and Prostate in CT ä Low contrast ä Variability across days. ä Low contrast ä Variability across days.

Clustering on Local Appearance for Deformable Model Segmentation ä Bayesian Deformable Model Segmentation ä Appearance / Image Match ä Clustering on Local Appearance ä Results on bladders and prostates in CT ä Conclusions ä Bayesian Deformable Model Segmentation ä Appearance / Image Match ä Clustering on Local Appearance ä Results on bladders and prostates in CT ä Conclusions

Deformable Model Segmentation (DMS) for Radiation Treatment Planning ä Segmentation is challenging and high cost for clinicians. ä Bayesian DMS ä Image match trained on expert segmentations ä Segmentation is challenging and high cost for clinicians. ä Bayesian DMS ä Image match trained on expert segmentations

Deformable Model and Locality Deformable Model and Locality ä M-rep provides: ä Boundary rep. with normals ä Correspondence ä Statistical deformation p(m) ä p(I | m), image match ä We consider appearance at local patches. ä M-rep provides: ä Boundary rep. with normals ä Correspondence ä Statistical deformation p(m) ä p(I | m), image match ä We consider appearance at local patches. Atom grid Implied Surface [Pizer et al., IJCV 55 (2) 2003] [Fletcher et al., TMI 23 (8) 2004]

Image Match p(I | m): Related Work Image Match p(I | m): Related Work ä Profile-based, voxel-scale correspondence ä AAM, [Cootes et al., CVIU 61 (1) 1995] ä AAM +, [Scott et al., IPMI 2003] ä Intensity Profile Clustering, [Stough et al., ISBI 2004] ä Region-based ä Intensity Ranges, [Zhu et al., PAMI 18 (9) 1996] ä Summary Statistics ä [Tsai et al., TMI 22 (2) 2003] ä [Chan et al., TIP 10 (2) 2001] ä Histogram Metrics ä [Rubner et al., CVIU ] ä [Freedman et al., TMI 24 (3) 2005] ä Statistics on Distributions, [Broadhurst et al., ISBI 2006] ä Profile-based, voxel-scale correspondence ä AAM, [Cootes et al., CVIU 61 (1) 1995] ä AAM +, [Scott et al., IPMI 2003] ä Intensity Profile Clustering, [Stough et al., ISBI 2004] ä Region-based ä Intensity Ranges, [Zhu et al., PAMI 18 (9) 1996] ä Summary Statistics ä [Tsai et al., TMI 22 (2) 2003] ä [Chan et al., TIP 10 (2) 2001] ä Histogram Metrics ä [Rubner et al., CVIU ] ä [Freedman et al., TMI 24 (3) 2005] ä Statistics on Distributions, [Broadhurst et al., ISBI 2006]

Appearance: Regional Intensity Quantile Functions (RIQFs) ä Inverse cumulative distribution function. ä Suited to PCA. ä Regional – local object-relative image extent. ä Example: probability density and quantile function. ä Inverse cumulative distribution function. ä Suited to PCA. ä Regional – local object-relative image extent. ä Example: probability density and quantile function. [Levina, UC-Berkeley 2002] [Broadhurst et al., ISBI 2006]

Question: Which Image Match Produces Best Segmentations? Global regions Versus geometrically defined local regions Versus regions defined by RIQF clusters. Global regions Versus geometrically defined local regions Versus regions defined by RIQF clusters.

Determine Region Types Determine Region Types ä Pool RIQFs over all regions and training images. ä Fuzzy C-Means Clustering ä Example: C = 2 on bladder exterior. ä Pool RIQFs over all regions and training images. ä Fuzzy C-Means Clustering ä Example: C = 2 on bladder exterior. [Bezdec 1981]

Partition the Boundary by Cluster Type Eig. 1 Z-score Eig. 2 Z-score ä For each patch, choose most popular cluster. ä PCA on cluster populations. ä For each patch, choose most popular cluster. ä PCA on cluster populations.

Bladder Partition for C = 2 Bladder Partition for C = 2 ä Confirming evidence ä Bladder: mostly fat with prostate and bone ä Prostate: dense tissue with bone and bladder, some fat ä Confirming evidence ä Bladder: mostly fat with prostate and bone ä Prostate: dense tissue with bone and bladder, some fat

Experimental Setup Experimental Setup 1. Determine local RIQF-types in training data 2. Construct Gaussian models on each type 3. Build a template of optimal types ä 5 patient image sets, ~16 images per patient. ä UNC RadOnc and William Beaumont, Michigan. ä 512   0.98  3 mm ä 5 patient image sets, ~16 images per patient. ä UNC RadOnc and William Beaumont, Michigan. ä 512   0.98  3 mm

Results Summary, Global v Clustered Results Summary, Global v Clustered Bladder GlobDSCClustDSCGlobASDClustASD 191.0% mm ProstateGlobDSCClustDSCGlobASDClustASD190.2% mm RIQF clustered image match compares favorably with global.

Future Directions: ä Improved clustering ä Modeling mixtures ä Region shifting Future Directions: ä Improved clustering ä Modeling mixtures ä Region shifting Conclusions: ä Local-clustered regions lead to improved segmentations ä Already approaching expert quality, exceeding agreement between experts. Conclusions: ä Local-clustered regions lead to improved segmentations ä Already approaching expert quality, exceeding agreement between experts.

Prostate Arm

BowelBowel

A walk in the projected space of local intensity distributions

Cluster statistics are not specific enough. ä Evidence for modeling each patch separately.