1. An Interactive Segmentation Approach Using Color Pre- processing Marisol Martinez Escobar Ph.D Candidate Major Professor: Eliot Winer Department of Mechanical Engineering & Human-Computer Interaction December 9, 2009

2. Outline Introduction Background –Segmentation methods –Colorization methods Methodology –DICOM colorization method –Segmentation approach Results –Statistical analysis of results –Comparison between grayscale & colorization Conclusions Future Work

3. Introduction MRI Hand Scan *University of Exter http://centres.exeter.ac.uk/pmrrc/gallery/hand/hand.html First X-ray *Wikipedia X-ray http://en.wikipedia.org/wiki/X-ray

4. Introduction Medical Images –Diagnosis, planning, treatment and education Medical Scan –Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) –Non-invasive

5. Medical Data Stored as Hounsfield Units (HU) –Tissue density relative to water –Usually ranges -1000 HU (air) – +1000 HU (bone) Windowing Process –Reduces HU values to a 0-255 range TissueValue (HU) Fat-90 Water0 Muscle+44 Bone+1005 255 0 -1000+1000 Width Center HU Intensity

6. Segmentation Delineation of regions of interest from an image Complex process since tumors have different shapes, sizes, tissue densities, and locations

7. Segmentation Approches Classical Methods (Hojjatoleslami et al 1998, Pole et al, Zhang et al 2001) Advanced Methods (Vincken et al 1997, Xu et al 2000, Kaus et al 2004) Hybrid Methods (Gibou et al 2005, Atkins et al 1998).

8. Limitation in Segmentation Approaches

9. Color Segmentation Classical techniques (Lin et al), advanced techniques (Chent et al, Verikas et al) Hybrid approaches (Cremers et al) Limitations –Not applied for internal tumor segmentation –RGB source files –Mostly applied to non-medical segmentation

10. Colorization Process of adding color to a grayscale image by the use of a computer –Add color channels to the image from 1 channel to 3 channels –Possible number of colors from 256 to 16 million. –No unique solution Adding information can improve segmentation

11. Examples of Colorization User initial paint (Levin et al, Tzeng et al ) Initial color source (Welsh et al 2002) Color seed (Takahiko et al)

12. Research Issues Improve the accuracy of tumor segmentation from medical image data using color pre-processing and interactive user inputs. To provide an easy to use tool that will aid in the Medical field

13. Methodology Development Region of interest selection and colorization Seed selection for first slice and segmentation Post-processing and interactive adjustements

14. Colorization User selects region of interest The region of interest determines the HU range HU Min HU Max Midpoint RedGreenBlue 25 5 0 0 0 0 0 0

15. Colorization

16. Segmentation User selects a seed Segmentation is based on distance and color –Tp = pixel threshold, –C = Color component, –D = Distance component –R = search radius

17. Segmentation Color Component Distance Component

18. Segmentation ROI Seed R MAX

19. Post-processing Morphological Operations

20. Interactive Adjustements 2D Textures –Array of 512x512 sent to the GPU Allows for real time visualization of the results Allows tweaking of parameters

21. Interface Framework Open source libraries –DCMTK –OpenGL –VTK –VRJuggler –wxWidgets Medical Desktop VisualizationSegmentationCollaboration Transverse, Sagittal, and Coronal 2D Views Volume Rendering Pseudo-coloring Windowing Connection to Virtual Reality Environment

22. Segmentation tab Sliders Apply all Plenty of screenshots

23. Other features

24. Test Cases Description 10 different test cases with different levels of difficulty Several runs of each test cases

25. Results Gold Standard –Two radiologists manually segmented the results False positive and false negative were calculated

26. Results

27. Results – Colorization Easy cases have low FN and FP because of different tissue densities 10 out of the 20 test cases gave false positives of 25% or less, and 10 out of the 20 test runs gave false negatives of 25% or less.

28. Results- Cases A Low FN and FP because of difference between tumor and healthy tissues

29. Results Cases B & C Low FN in calcified cases because algorithm selects tumor tissues correctly High FN because tumor tissues that vary are not selected

30. Comparison Grayscale vs. Color Same test cases FP of up to 52% on the easy cases up to 284% on the difficult cases FN of up to 14% on the easy cases and up to 99% on the difficult cases. Colorization prior to segmentation yields better results GrayscaleColor Test Case# Level FPFNFPFN 1 A 21.880714.25511.083714.0453 5 B 23.667293.07740.398131.7252 6 B 224.64199.54518.816130.1461 7 C 19.250892.2185.909957.6397

31. Summary Results Adding color to the original HU values improves segmentation –Half of the test cases show less than 25% FP and FN for a simple thresholding technique –Same grayscale methods show up to 284% FP and 99% FN

32. Future Work Different and more complex segmentation algorithms using color information Different colorization methods Shaders to increase the speed of the results Improve the user interface.

33. Thank You