Vision and Image Analysis Group (VIA) Anthony P. Reeves School of Electrical and Computer Engineering Cornell University © A. P. Reeves 2007

VIA Group Research Program Mission: A. Accurate measurements from multi- dimensional images B. Computer methods for image analysis Collaborative programs: Web-based collaborative research in clinical studies with Weill Medical College and over 40 medical institutions world-wide. (computer-aided diagnosis) Web-based collaborative programs in Biological research involving image analysis

Web-based image management VIA Image analysis research ELCAP Clinical Studies and Drug Trials Experimental Biology Research … Individual Research Projects (Individual protocols) ELCAP remote sites (Standardized Protocols)

Clinical Studies © A. P. Reeves 2007

Early Lung Cancer Action Program (ELCAP) ELCAP Management System (EMS) Goals: To facilitate data pooling between different cancer studies To advance the state-of-the art in web-based clinical trials Study Coordinator Principal Investigator CT Scanner/ PACS Institution k EMS Coordinating Center Institution 1 Institution 2 Institution n All study information Including images in a single database Center Personnel: Study Monitoring

Computer-aided diagnosis for Lung cancer Web-accessible capabilities for Clinical Studies Detecting pulmonary nodules in CT scans (are there abnormalities present?) Measuring growth rates of pulmonary nodules (is it cancer?) Measuring emphysema from CT images Ongoing Research Characterizing pulmonary nodules from shape features (is it cancer?) Evaluating coronary arteries …

Interactive Image Review Interactive review of all study image data Radiology, Pathology, etc. Web integrated

Automated Nodule Detection Nodule candidates presented on coronal image Clicking on a location links to the nodule analysis Web integrated

3D Nodule Analysis Web integrated (A) Image segmentation

(B) Axial visualizations at three times T1 T2T3 Web integrated 3D Nodule Analysis

(C) Nodule growth Analysis T1 T2 T3 T1-T2 T1-T3 T2-T3 Web integrated 3D Nodule Analysis

Measuring Emphysema from CT Images Example CT scan slice, red denotes emphysematous areas under -910 H.U. ~25% for this scan Emphysema Index (EI) measures the percentage of lung volume less than a certain density, attempting to measure the amount of dead air-space present in the lung Web integrated

Symbiotic Collaboration Web-based study management system with image capabilities –Well controlled multi-center studies that can pool all the data for clinical results (ELCAP) –A large document image database is established for CAD tools development (VIA) –New CAD tools made available to clinical studies via the web system (ELCAP and VIA)

Research: Can we diagnose cancer from a single CT scan Much more difficult problem than growth measurement Research is limited by the lack of appropriate documented image databases BenignMalignant Ongoing Research

Image Analysis Applications © A. P. Reeves 2007

Observer studies on lesion marking Web integrated

Vessel Diameter Tracking in Intravital Microscopy Image Sequences Automatic tracking of image sequence Investigate causes of capillary dilation Study effects of various stimuli on vessels Web integrated Web system replaces tedious manual measurements and provides more accurate results

Bacteria Enumeration in Florescent Microscope Images Enterrococcus Bacteria Results Web integrated Web system replaces tedious manual counting

Shear Cell Tracking Tracking colliding spheres In microgravity conditions Completed Research

3D Image Visualization Original CT image sequence3D Volume rendered sequence Ongoing Research 3D visualization is becoming essential for image interpretation

VIA Research Summary Theme: accurate measurements from medical and biological images Issue: How to improve measurement accuracy when the exact answer (ground truth) is not known. Web Site Recent Papers Account: via Password: papers21 Web-based image tools Research Collaboration Interests: Image analysis, computer or manual and web-based image archive