1. National Alliance for Medical Image Computing http://na-mic.org Segmentation Foundations Easy Segmentation –Tissue/Air (except bone in MR) –Bone in CT Feasible Segmentation –White Matter/Gray Matter: MRI –M.S. White Matter Lesions: MRI

2. National Alliance for Medical Image Computing http://na-mic.org Statistical Classification Probabilistic model of intensity as a function of (tissue) class Intensity data Prior model Classification of voxels [Duda, Hart 78][MRI: MikeVannier late 80s]

3. National Alliance for Medical Image Computing http://na-mic.org Measurement Model Characterize sensor p(x|tissue class J) probability density intensity Tissue class conditional model of signal intensity mean for tissue J

4. National Alliance for Medical Image Computing http://na-mic.org A bit of notation… Estimate  by finding the one that maximizes the function f

5. National Alliance for Medical Image Computing http://na-mic.org Maximum Likelihood (ML) Estimation Estimate parameters to maximize probability of observed data conditioned on parameters. y o : observed data p(y|  ) : Measurement Model  Model Parameters

6. National Alliance for Medical Image Computing http://na-mic.org Example intensity p(x|gray matter) p(x|white matter)

7. National Alliance for Medical Image Computing http://na-mic.org Example - revisited white matter threshold gray matter

8. National Alliance for Medical Image Computing http://na-mic.org Multiple Sclerosis PDw T2w Provided by S Warfield

9. National Alliance for Medical Image Computing http://na-mic.org Dual Echo MRI Feature Space csf severe lesions gm wm air T2 Intensity PD Intensity

10. National Alliance for Medical Image Computing http://na-mic.org Detail MS Lesions are “graded phenomenon” in MRI, and can be anywhere on the curve gm wm lesions csf healthy mild severe

11. National Alliance for Medical Image Computing http://na-mic.org Multiple Sclerosis PDw T2w Segmentation Provided by S Warfield

12. National Alliance for Medical Image Computing http://na-mic.org Maximum A-Posteriori (MAP) Estimation Estimate parameters to maximize posterior probability model parameters conditioned on observed data Use Baye’s rule – ignore denominator p(  ) : Prior Model

13. National Alliance for Medical Image Computing http://na-mic.org Multiple Sclerosis PDw T2w kNNSVC Provided by S Warfield

14. National Alliance for Medical Image Computing http://na-mic.org Background: Intensity Inhomogeneities in MRI MRI signal derived from RF signals… Intra Scan Inhomogeneities –“Shading” … from coil imperfections –interaction with tissue? Inter Scan Inhomogeneities –Auto Tune –Equipment Upgrades

15. National Alliance for Medical Image Computing http://na-mic.org ML Estimation – with missing data x : missing data (true labeling) y 0 : observed intensities  : (parameters of) bias field

16. National Alliance for Medical Image Computing http://na-mic.org ML Estimation – EM Approach E []: Expected value under p(x|y o,  ) Take expectation of objective function with respect to the missing data, conditioned on everything we know x : missing data (true labeling) y 0 : observed intensities  : (parameters of) bias field

17. National Alliance for Medical Image Computing http://na-mic.org EM Algorithm General exponential family Iterate to convergence: E step: M step:

18. National Alliance for Medical Image Computing http://na-mic.org EM Algorithm: Example Measurement Model –Tissue intensity properties with bias correction Missing Data –Unknown true classification Prior Models –Tissue Frequencies –Intensity Correction is Low Frequency ML estimate of bias

19. National Alliance for Medical Image Computing http://na-mic.org Estimate intensity correction using residuals based on current posteriors. Compute tissue posteriors using current intensity correction. M-Step E-Step EM-Segmentation Provided by T Kapur

20. National Alliance for Medical Image Computing http://na-mic.org EM Segmentation… PD, T2 Data Seg Result w/o EM Seg Result With EM

21. National Alliance for Medical Image Computing http://na-mic.org EM Segmentation… External Surface of Brain

22. National Alliance for Medical Image Computing http://na-mic.org EM Segmentation… WM Surface with EMWM Surface w/o EM

23. National Alliance for Medical Image Computing http://na-mic.org EM Segmentation: MS Example Data provided by Charles Guttmann PDT2

24. National Alliance for Medical Image Computing http://na-mic.org EM Segmentation: MS Example Seg w/o EMSeg with EM

25. National Alliance for Medical Image Computing http://na-mic.org Prior Probability Models Simple: Frequency of Tissues More Interesting: –Powerful Mechanism for Incorporating Domain Knowledge into Segmentation Tissue properties Relative Location of Structures Atlases

26. National Alliance for Medical Image Computing http://na-mic.org Prior Model Example: EM-MF Segmentation Tina Kapur PhD thesis EM Segmentation, augmented with –Ising prior of tissue homogeneity Solved with Mean Field Approxomation –Prior on relative position of organs Spatially Conditioned Models

27. National Alliance for Medical Image Computing http://na-mic.org Prior Models: Ising Model Ising Model can capture the phenomenon of piecewise-homogeneity. Initially used in Statistical Physics to model the magnetic domains in Ferromagnetism. Used in Medical Image Processing to model the piecewise-homogeneity of Tissue.

28. National Alliance for Medical Image Computing http://na-mic.org Prior Models: Ising Model Ising Model relaxes spatial independence assumption Voxels depend conditionally on (only) their neighbors More probable to agree with neighbor

29. National Alliance for Medical Image Computing http://na-mic.org Define the Neighborhood 2 nd Order Lattice 26 Neighbors 1 st Order Lattice 6 Neighbors Reduce calculation cost => use 1 st order Lattice Neighbors = {East, South, West, North, Up, Down} Provided by K Pohl

30. National Alliance for Medical Image Computing http://na-mic.org Potts Model Potts model generalizes Ising model so that each lattice site takes on several values (more than two). Frequently used to model tissues (e.g. White Matter, Gray Matter, CSF, Fat, Air, etc.)

31. National Alliance for Medical Image Computing http://na-mic.org Some Results EM EM-MF Provided by T Kapur

32. National Alliance for Medical Image Computing http://na-mic.org More Results Noisy MRIEM Segmentation EM-MF Segmentation Provided by T Kapur

33. National Alliance for Medical Image Computing http://na-mic.org Posterior Probabilities (EM) White matter Gray matter Provided by T Kapur

34. National Alliance for Medical Image Computing http://na-mic.org Posterior Probabilities (EM- MF) White matter Gray matter Provided by T Kapur

35. National Alliance for Medical Image Computing http://na-mic.org Segmentation of 31 Structures Kilian Pohl PhD (defense several weeks ago)

36. National Alliance for Medical Image Computing http://na-mic.org Segmentation of 31 Structures Lower Front Provided by Kilian Pohl

37. National Alliance for Medical Image Computing http://na-mic.org Segmentation of 31 Structures Superior Temporal Gyrus Provided by Kilian Pohl

38. National Alliance for Medical Image Computing http://na-mic.org The End