Hierarchical Statistical Modeling of Boundary Image Profiles Sean Ho Department of Computer Science University of North Carolina, Chapel Hill, NC, USA.

Slides:

Advertisements

Similar presentations

Active Shape Models Suppose we have a statistical shape model –Trained from sets of examples How do we use it to interpret new images? Use an “Active Shape.

Advertisements

Image Repairing: Robust Image Synthesis by Adaptive ND Tensor Voting IEEE Computer Society Conference on Computer Vision and Pattern Recognition Jiaya.

Independent Component Analysis Personal Viewpoint: Directions that maximize independence Motivating Context: Signal Processing “Blind Source Separation”

IIIT Hyderabad ROBUST OPTIC DISK SEGMENTATION FROM COLOUR RETINAL IMAGES Gopal Datt Joshi, Rohit Gautam, Jayanthi Sivaswamy CVIT, IIIT Hyderabad, Hyderabad,

Detecting the Inferior Thoracic Aperture using Statistical Shape Models Pahal Dalal Department of Computer Science & Engineering, University of South Carolina.

Texture. Edge detectors find differences in overall intensity. Average intensity is only simplest difference. many slides from David Jacobs.

Digital Image Processing

These improvements are in the context of automatic segmentations which are among the best found in the literature, exceeding agreement between experts.

Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.

Wangfei Ningbo University A Brief Introduction to Active Appearance Models.

Image Segmentation and Active Contour

Deformable Contours Dr. E. Ribeiro.

Model: Parts and Structure. History of Idea Fischler & Elschlager 1973 Yuille ‘91 Brunelli & Poggio ‘93 Lades, v.d. Malsburg et al. ‘93 Cootes, Lanitis,

Level-Set Evolution with Region Competition: Automatic 3-D Segmentation of Brain Tumors 1 Sean Ho, 2 Elizabeth Bullitt, and 1;3 Guido Gerig 1 Department.

A Study of Approaches for Object Recognition

Multiscale Profile Analysis Joshua Stough MIDAG PI: Chaney, Pizer July, 2003 Joshua Stough MIDAG PI: Chaney, Pizer July, 2003.

Exploring subjective probability distributions using Bayesian statistics Tom Griffiths Department of Psychology Cognitive Science Program University of.

Medial Object Shape Representations for Image Analysis & Object Synthesis Stephen M. Pizer Kenan Professor Medical Image Display & Analysis Group.

Multiple Human Objects Tracking in Crowded Scenes Yao-Te Tsai, Huang-Chia Shih, and Chung-Lin Huang Dept. of EE, NTHU International Conference on Pattern.

Clustering on Image Boundary Regions for Deformable Model Segmentation Joshua Stough, Stephen M. Pizer, Edward L. Chaney, Manjari Rao Medical Image Display.

12-Apr CSCE790T Medical Image Processing University of South Carolina Department of Computer Science 3D Active Shape Models Integrating Robust Edge.

Clustering on Local Appearance for Deformable Model Segmentation Joshua V. Stough, Robert E. Broadhurst, Stephen M. Pizer, Edward L. Chaney MIDAG, UNC-Chapel.

Texture Reading: Chapter 9 (skip 9.4) Key issue: How do we represent texture? Topics: –Texture segmentation –Texture-based matching –Texture synthesis.

Comp 775: Deformable models: snakes and active contours Marc Niethammer, Stephen Pizer Department of Computer Science University of North Carolina, Chapel.

Caudate Shape Discrimination in Schizophrenia Using Template-free Non-parametric Tests Y. Sampath K. Vetsa 1, Martin Styner 1, Stephen M. Pizer 1, Jeffrey.

Multiple Object Class Detection with a Generative Model K. Mikolajczyk, B. Leibe and B. Schiele Carolina Galleguillos.

Towards a Multiscale Figural Geometry Stephen Pizer Andrew Thall, Paul Yushkevich Medical Image Display & Analysis Group.

PhD Thesis. Biometrics Science studying measurements and statistics of biological data Most relevant application: id. recognition 2.

Li Wang1, Feng Shi1, Gang Li1, Weili Lin1, John H

3D-Assisted Facial Texture Super-Resolution Pouria Mortazavian, Josef Kittler, William Christmas 10 September 2009 Centre for Vision, Speech and Signal.

Image Representation Gaussian pyramids Laplacian Pyramids

Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.

Multimodal Interaction Dr. Mike Spann

Techniques for Estimating Layers from Polar Radar Imagery Jerome E. Mitchell, Geoffrey C. Fox, and David J. Crandall :: CReSIS NSF Site Visit :: School.

Optical Flow Donald Tanguay June 12, Outline Description of optical flow General techniques Specific methods –Horn and Schunck (regularization)

OPTIMIZATION OF FUNCTIONAL BRAIN ROIS VIA MAXIMIZATION OF CONSISTENCY OF STRUCTURAL CONNECTIVITY PROFILES Dajiang Zhu Computer Science Department The University.

Enhanced Correspondence and Statistics for Structural Shape Analysis: Current Research Martin Styner Department of Computer Science and Psychiatry.

MEDICAL IMAGE ANALYSIS Marek Brejl Vital Images, Inc.

Copyright © 2010 Siemens Medical Solutions USA, Inc. All rights reserved. Hierarchical Segmentation and Identification of Thoracic Vertebra Using Learning-based.

Segmentation: Region Based Methods Region-based methods –iterative methods based on region merging and/or splitting based on the degree of similarity of.

Statistical Group Differences in Anatomical Shape Analysis using Hotelling T 2 metric February 2006, SPIE Medical Imaging 2006 Funding provided by UNC.

Automatic Locating of Anthropometric Landmarks on 3D Human Models

Chapter 5: Neighborhood Processing

UNC Shape Analysis Pipeline

Object Orie’d Data Analysis, Last Time SiZer Analysis –Zooming version, -- Dependent version –Mass flux data, -- Cell cycle data Image Analysis –1 st Generation.

Ventricular shape of monozygotic twins discordant for schizophrenia reflects vulnerability 2 M Styner, 1,2 G Gerig, 3 DW Jones, 3 DR Weinberger, 1 JA Lieberman.

Paper Reading Dalong Du Nov.27, Papers Leon Gu and Takeo Kanade. A Generative Shape Regularization Model for Robust Face Alignment. ECCV08. Yan.

Common Property of Shape Data Objects: Natural Feature Space is Curved I.e. a Manifold (from Differential Geometry) Shapes As Data Objects.

Lateralized change of ventricular shape in monozygotic twins discordant for schizophrenia 2 M Styner, 1,2 G Gerig, 3 DW Jones, 3 DR Weinberger, 1 JA Lieberman.

Corpus Callosum Probabilistic Subdivision based on Inter-Hemispheric Connectivity May 2005, UNC Radiology Symposium Original brain images for the corpus.

Computer vision. Applications and Algorithms in CV Tutorial 3: Multi scale signal representation Pyramids DFT - Discrete Fourier transform.

Object Orie’d Data Analysis, Last Time PCA Redistribution of Energy - ANOVA PCA Data Representation PCA Simulation Alternate PCA Computation Primal – Dual.

Level Set Segmentation ~ 9.37 Ki-Chang Kwak.

Age and treatment related local hippocampal changes in schizophrenia explained by a novel shape analysis method 1,2 G Gerig, 2 M Styner, 3 E Kistner, 3.

NA-MIC National Alliance for Medical Image Computing Analysis and Results of Brockton VA study: Controls vs Schizophrenics Personality Disorder Martin.

Data Modeling Patrice Koehl Department of Biological Sciences

Segmentation of Single-Figure Objects by Deformable M-reps

Corpus Callosum Probabilistic Subdivision based on Inter-Hemispheric Connectivity Martin Styner1,2, Ipek Oguz1, Rachel Gimpel Smith2, Carissa Cascio2,

Chapter 10 Image Segmentation

D Nain1, M Styner3, M Niethammer4, J J Levitt4,

Moo K. Chung1,3, Kim M. Dalton3, Richard J. Davidson2,3

Dynamical Statistical Shape Priors for Level Set Based Tracking

Detection of Local Cortical Asymmetry via Discriminant Power Analysis

Markov Random Fields for Edge Classification

Tobias Heimann - DKFZ Ipek Oguz - UNC Ivo Wolf - DKFZ

Subjects and image data

PRAKASH CHOCKALINGAM, NALIN PRADEEP, AND STAN BIRCHFIELD

Spherical harmonic representation of anatomical boundary

Fall 2018, COMP 562 Poster Session

Filtering An image as a function Digital vs. continuous images

Presentation transcript:

Hierarchical Statistical Modeling of Boundary Image Profiles Sean Ho Department of Computer Science University of North Carolina, Chapel Hill, NC, USA Supported by NIH-NCI P01 CA47982.

Bayesian image segmentation Geometric prior Image match log p(m | I) = log p(m) + log [p(I | m) / p(I)]

Model-based segmentation Shape representation Shape representation PDM, SPHARM, M- rep, level-set, etc. PDM, SPHARM, M- rep, level-set, etc. Probabilistic model Probabilistic model Likelihood of a given shape Likelihood of a given shape Shape typicality (“prior”) Image representation Image representation Global (no corresp.) Global (no corresp.) Local (req. corresp.) Local (req. corresp.) Probabilistic model Probabilistic model Fit of a given shape in a given image Fit of a given shape in a given image Model-to-image match

Example: corpus callosum Automatic segmentation Automatic segmentation Shape rep: 2D Fourier (Staib et al) Shape rep: 2D Fourier (Staib et al) Image rep: 1D profiles normal to boundary (Cootes et al) Image rep: 1D profiles normal to boundary (Cootes et al) Each profile independent of its neighbors Each profile independent of its neighbors 100 profiles => 100 separate PCAs 100 profiles => 100 separate PCAs (movie) (movie)movie

Some examples of related work Snakes: gradient magnitude Snakes: gradient magnitude Also region-based inside/outside snakes Also region-based inside/outside snakes Template matching, correlation Template matching, correlation ASM/SPHARM: independent profiles ASM/SPHARM: independent profiles AAM: hierarchical over whole image AAM: hierarchical over whole image

Object-intrinsic coordinates Use SPHARM parameterization to sample image in collar around object boundary Use SPHARM parameterization to sample image in collar around object boundary

Profiles in normalized coords Along-boundary direction Across-bdy

Across-boundary model

Driving Questions fine sampling necessary? fine sampling necessary? pyramid pyramid object specific object specific how do we deal with noise? how do we deal with noise? would like to blur along boundary would like to blur along boundary local statistical model local statistical model

Along-boundary model Gaussian profile pyramid Gaussian profile pyramid outinoutin arclength

Laplacian profile pyramid   - =

Laplacian, local differences  u  u

Profiles in 3D Use SPHARM parameter space of unit sphere Use SPHARM parameter space of unit sphere Recursive subdivision with icosahedron Recursive subdivision with icosahedron 0 th level: 20 profiles 0 th level: 20 profiles 1 st level: 20*4 profiles 1 st level: 20*4 profiles 1-way Markov chain 1-way Markov chain

Profiles along 1 object in 3D Profiles along red meridian line InsideOutside Inside Outside All profiles Left Hippocampus

Profiles around 1 hippocampus InsideOutside

Profiles: at 1 point on boundary 1 corresponding point on population of 10 hippocampi 1 corresponding point on population of 10 hippocampi Step-edge visible Step-edge visible More variability outside More variability outside case numbers

At another point on boundary Large variability across subjects Large variability across subjects Mean profile nearly flat: low confidence Mean profile nearly flat: low confidence case numbers

Current / ongoing work SPHARM segmentation framework: SPHARM segmentation framework: Standard ASM-like independent profiles Standard ASM-like independent profiles New hierarchical along-boundary model New hierarchical along-boundary model New statistical model (local PCA, MRF) New statistical model (local PCA, MRF) Testbed in 2D with 71 corpora callosa Testbed in 2D with 71 corpora callosa Testbed in 3D with: Testbed in 3D with: 90 caudates (L/R) 90 caudates (L/R) 90 hippocampi (L/R) 90 hippocampi (L/R)

Average of 20 Average of 20 multiscale along boundary multiscale along boundary Image match model for segmentation Image match model for segmentation Profile Pyramid