XIP In-Vivo Imaging Workspace Software SIG February 7, 2007.

Slides:



Advertisements
Similar presentations
Medical Image Resource Center. What is MIRC? Medical Image Resource Center Makes it easier to locate and share electronic medical images and related information.
Advertisements

CVRG Presenter Disclosure Information Tahsin Kurc, PhD Center for Comprehensive Informatics Emory University CardioVascular Research Grid Core Infrastructure.
A DICOM Import Module for XIP Alex Shnayder Lafayette College Easton, PA Supervisor: Dr. Dave Channin We gratefully acknowledge the support of: Pat Mongkolwat,
Integrating XIP into a FOSS clinical workstation Final Presentation Max Meltser Advisors: David Channin, Pat Mongkolwatt With much help from Vlad Kleper.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
Presented by IBM developer Works ibm.com/developerworks/ 2006 January – April © 2006 IBM Corporation. Making the most of Creating Eclipse plug-ins.
The cancer Biomedical Informatics Grid™ (caBIG™): In Vivo Imaging Workspace Projects Fred Prior, Ph.D. Mallinckrodt Institute of Radiology Washington University.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering End-user Platform Steve Pieper Isomics, Inc.
OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
Lawrence Tarbox, Ph.D. Washington University in St. Louis School of Medicine Mallinckrodt Institute of Radiology, Electronic Radiology Lab 12/1/
NA-MIC National Alliance for Medical Image Computing NAMIC-Kit Update Will Schroeder Jim Miller Bill Lorensen.
Joel Bapaga on Web Design Strategies Technologies Commercial Value.
XIP In-Vivo Imaging Workspace Software SIG February 7, 2007.
OpenMDR: Alternative Methods for Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
XIP: The eXtensible Imaging Platform Development Program Fred Prior, Ph.D. Mallinckrodt Institute of Radiology Washington University in St. Louis.
Imaging Workspace An Overview and Roadmap Eliot L. Siegel, MD Imaging Workspace Lead SME January 23, 2008.
XIP™ – the eXtensible Imaging Platform A rapid application development and deployment platform Lawrence Tarbox, Ph.D. September, 2010.
Department of Biomedical Informatics Service Oriented Bioscience Cluster at OSC Umit V. Catalyurek Associate Professor Dept. of Biomedical Informatics.
LexEVS Overview Mayo Clinic Rochester, Minnesota June 2009.
material assembled from the web pages at
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.
The National Biomedical Imaging Archive (NBIA) In Action: An Introduction for Users A Tool Demonstration from caBIG® Presented by: Eliot Siegel, MD Maryland.
CHAPTER TEN AUTHORING.
NOVA Networked Object-based EnVironment for Analysis P. Nevski, A. Vaniachine, T. Wenaus NOVA is a project to develop distributed object oriented physics.
Ashish Sharma, Tony Pan, Barla Cambazoglu, Joel Saltz Ohio State University, Columbus, OH (ashish, tpan, October 10, 2007 caBIG In Vivo.
Lawrence Tarbox, Ph.D. Washington University in St. Louis School of Medicine Mallinckrodt Institute of Radiology, Electronic Radiology Lab.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Copyright © 2008 Siemens Corporate Research – All rights reserved1/12 eXtensible Imaging Platform (Xip) Sylvain Jaume – Sep 2008 Siemens Corporate Research.
NA-MIC National Alliance for Medical Image Computing Process-, Work-Flow in Medical Image Processing Guido Gerig
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
IHE Workshop – June 2006What IHE Delivers 1 Todd Kantchev, Siemens Molecular Imaging Jerold Wallis, Mallinckrodt Institute of Radiology Kevin O’Donnell,
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
What is NCIA? National Cancer Imaging Archive Searchable repository of in vivo cancer images in DICOM format Publicly available at no cost over the Internet.
XIP™/AVT Project Plans 2012 A report to the caBIG® In-Vivo Imaging Workspace Lawrence Tarbox, Ph.D.. December 2011.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Computational Platform Jim Miller GE Research.
In Vivo Imaging Middleware and Applications RSNA 2007 Berkant Barla Cambazoglu The Ohio State University Department of Biomedical Informatics.
Application Hosting Lawrence Tarbox, Ph.D. Mallinckrodt Institute of Radiology Washington University in St. Louis School of Medicine.
The National Cancer Imaging Archive (NCIA) In Action: An Introduction for Users A Tool Demonstration from caBIG™ Carl Jaffe, MD NCI-Cancer Imaging Program.
Imaging Workspace An Overview and Roadmap Eliot L. Siegel, MD Imaging Workspace Lead SME January 23, 2008.
Tony Pan, Stephen Langella, Shannon Hastings, Scott Oster, Ashish Sharma, Metin Gurcan, Tahsin Kurc, Joel Saltz Department of Biomedical Informatics The.
CTTI PROJECT Emory University, Quality Assurance and Review Center (QARC) and Washington University in St. Louis.
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
Introduction Results Methods Conclusions Acknowledgements
A Generic Toolkit for Electronic Editions of Medieval Manuscripts
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
Business System Development
(on behalf of the POOL team)
PLM, Document and Workflow Management
Overview – SOE PatchTT November 2015.
Open Source distributed document DB for an enterprise
Overview – SOE PatchTT December 2013.
Modern Systems Analysis and Design Third Edition
Fred Prior, Ph.D. Mallinckrodt Institute of Radiology
Ch > 28.4.
System And Application Software
Increased Efficiency and Effectiveness
Tools of Software Development
Analytic Workflow: From Images to Reports
Module 01 ETICS Overview ETICS Online Tutorials
What's New in eCognition 9
Lawrence Tarbox, Ph. D. Washington University in St
CAD DESK PRIMAVERA PRESENTATION.
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
What's New in eCognition 9
Modern Systems Analysis and Design Third Edition
What's New in eCognition 9
Presentation transcript:

XIP In-Vivo Imaging Workspace Software SIG February 7, 2007

The eXtensible Imaging Platform (XIP) is an open source environment for rapidly developing medical imaging applications from an extensible set of modular elements. Researchers will be able to easily develop and evaluate new approaches to medical imaging problems, and use them in a translational research setting. caGrid makes it possible to develop an XIP architecture that allows users to choose between remotely hosted grid-based components and data sources as well as locally available components and sources. Components may include analytic services, e.g. CAD algorithms, algorithms for quantifying changes in consecutive imaging studies, algorithms associated with a 3-D visualization pipeline etc) Available data sources include NCIA DICOM data repositories Local databases What is ?

Why ? One of the goals of the In Vivo Imaging Workspace is to “focus on identifying the ways in which the wealth of information provided by … imaging, performed at academic and other research centers across the country, can be shared, optimized, and most effectively integrated into the ongoing effort to relieve suffering and death from cancer.” To facilitate the increasing use of imaging based end points in clinical trials, the Workspace has identified the need for an easily extensible open source platform to support image analysis and visualization. This platform will make it easier and less expensive to access specific post-processing applications at multiple sites, simplifying clinical trials, and most importantly, increasing the uniformity of imaging and analysis. Imaging applications developed by research groups will more easily be accessible within the clinical operating environment, simplifying workflows and speeding data processing and analysis. Once validated, the software should be readily transitioned into products through streamlined Federal Drug Administration, (FDA), approval processes due to the re-use of already approved libraries and open source development processes.

XIP Use Cases Four Use Cases defined by the caBIG IVI Workspace, Software SIG (F. Prior, B. Erickson), in the XIP Requirements Document Imaging as a bio-marker for drug therapy trials with centralized data analysis within a Cooperative Group: NCCTG Imaging as a bio-marker for research and drug therapy trials using distributed analysis within a Cooperative Group: COG, NANT Standardizing and translating emerging imaging methods in a Translational Research Network: NTROI Annotation of tumors as part of curation process for an image archive to be used for algorithm development: NCIA These Use Cases illustrate the spectrum of uses of XIP – the Software SIG will guide the prioritization and roll-out of features to meet the needs of such representative users Clinical Translation 

Imaging as a Bio-marker, Classical Phase 2/3 (NCCTG) Use Case: Trial to assess effect on brain tumor of drug with & without radiation Brain MRI at 2 mo. intervals, collected in central review facility Functionality needed in XIP Imaging Application: Query DICOM worklist created for each rater Visualize baseline (pre-gad, post-gad, T2, FLAIR) and current scan Image registration (rigid body) to improve accuracy and reliability Presentation with linked cursors and multi-planar reformats Measurement of tumor size based on margin outlines (T2 and/or FLAIR), both RECIST and volume Controlled order of case presentation to reduce bias Quickly find cases with significant inter-reader differences for adjudication

Viewer for assessing temporal change Imaging as a Bio-marker, Classical Phase 2/3 (NCCTG)

Use Case: Evaluation of cases of Peripheral Neuroblastic Tumors (PNTs), integrating radiological and pathological images, patient demographics, … Emphasis on MR perfusion analysis as bio-marker for tumor growth rate Functionality needed in XIP Imaging Application: “Virtual Workbench” for PNT research based on original data, derived results, annotations, and mark-ups of PNT data based on the Cooperative Group Grid resources Interactive and integrated radiological and pathological image analysis of PNT’s Publishing of analysis results to Grid Storage systems Querying of grid-based data systems for discovery of outcome correlations Imaging as a Bio-marker in Cooperative Group Trials (COG, NANT)

DSC-MR perfusion of intrinsic brainstem (pontine) glioma compared to a bithalamic glioma (left) and methodology Example of the kind of DCE-MR perfusion processing needed from XIP Figure courtesy of Stephan Erberich, USC.

Imaging as a Bio-marker in Cooperative Group Trials (COG, NANT) Figure courtesy of Stephan Erberich, USC. Example of the kind of Support for Distributed Data Storage Needed from XIP

Standardizing Imaging in a Translational Research Network (NTROI) Use Case Standardization and validation of optical imaging methods for breast cancer screening and therapy monitoring Starting point is collaborative validation of physiological measures of unique instruments at each university End point is trial using common, validated instrument Functionality Needed in XIP Imaging Application Multi-modal registration, visual fusion, tumor segmentation Measurement of tumor volume, optically-derived physiological parameters

GUI for Optical/MR Visualization and Analysis Standardizing Imaging in a Translational Research Network (NTROI)

Computations for Optical/MR Visualization and Analysis Standardizing Imaging in a Translational Research Network (NTROI)

Annotation of tumors for an image archive (NCIA) Use Case Remote and on-site expert 3D segmentation and rigorously defined annotation of tumors in National Cancer Image Archive Annotated images used both to develop and test CAD and other algorithms by academia and industry Functionality Needed in XIP Imaging Application Advanced thin-client 3D visualization and navigation tools for remote curation by domain experts Mark-up, segmentation, annotation and measurement of tumor volume using a variety of 2D and 3D metrics, using rigorously defined vocabularies

Annotation of tumors for an image archive (NCIA) Figure courtesy of John Freymann, NCI.

What is Included in XIP Rapid Application Development Tools and Libraries (RAD) Development and application build environment Extensive and extensible set of libraries for imaging and visualization Uses Open Inventor framework Includes code generating wizards to create new objects and wrap existing libraries XIP Workstation (WS) A reference implementation of a medical imaging workstation developed using XIP RAD Integrated via middleware into caGRID Optimized to support basic cancer research use cases Includes two key components: XIP Application – a use case specific “plug-in” application integrated via the DICOM WG-23 Interface XIP Host – the hosting environment that provides XIP Applications with access to services such as data stores, remote processing, etc.

XIP WS - Reference Implementation XIP Host WG-23 API (Socket) WG-23 API (Plug) XIP Application CustomXIPClassesStandard XIP Library Classes

Categories of Users XIP Host WG-23 API (Socket) WG-23 API (Plug) XIP Application CustomXIPClassesStandard XIP Library Classes XIP Application Developer XIP Library Developer XIP Host Developer XIP Applcation User

DICOM WG23 Plug-in Framework WG-23 addresses clinical integration and vendor inter-operability by defining standardized “plugs” and “sockets” (APIs) caBIG XIP addresses an open-architecture, integrated development environment for rapid prototyping & collaboration based on WG 23 APIs. Unix, Mac, PCInternet ServerCommercial Vendor #2 … Commercial Vendor #1  Clinical   Prototype & Collaboration  XIP developed Application Standard API

XIP Framework & Architecture XIP Application (Can be replaced with any WG23-compatible Host) XIP Host Adapter API XIP LIBITKVTK... Host-Specific Plugin Libraries Remote Processing caGrid Analytical Svc. Data Access caGrid Data Svc. Annotation and Markup AIM MetaData... XIP Modules Host Independent WG23 XIP Development Tools XIP Host WG23 (Enables rapid development of applications)

Who is Contributing to ? The caBIG In Vivo Imaging Workspace, Software SIG Released the XIP RFP Provides primary feedback to the XIP development team Washington University in St. Louis, Electronic Radiology Lab Main coordinating site Actively involved in caBIG, DICOM, IHE, and serves as imaging core for several clinical trials Siemens Corporate Research (SCR) Contributing a suite of tools – ivRAD – that will form the basis for XIP Experienced in moving ideas from prototypes to commercial reality DICOM WG-23 Standardizing the interfaces between a hosting system (e.g. workstation) and hosted post-processing applications (a.k.a. “Plug-ins”) Representation from both vendors and user communities ITK/VTK community Providing image processing and visualization libraries with the assistance of Kitware

What does ivRAD bring to the table? Application development framework following the Open Inventor API Scene graphs coupled to processing pipelines and manipulators Well established, well documented, open source, free Easy to extend create custom Open Inventor-style objects create Open Inventor-style wrappers around existing libraries Extensions to support medical visualization and image processing Import of medical image data sets (e.g. DICOM, raw) Manipulation of medical image data (e.g. registration, fusion, segmentation) Multi-dimensional visualization (e.g. cine, MPR, MIP, Shaded-surface display, Volume Rendering) Tools for wrapping 3rd party class libraries into Open Inventor objects Used to incorporate the open source ITK (Insight ToolKit) into ivRAD Hides peculiarities of the underlying host system from the application Allows the same application to run stand-alone on MS Windows, or within various versions of Siemens’ medical workstations Since the interfaces that the application sees remain constant, the application is unaware of the differences in the underlying system

Open Inventor Open Inventor ® is an object-oriented 3D toolkit offering a comprehensive solution to interactive graphics programming problems. URL: It presents a programming model based on the Model/View/Controller design pattern and the concept of Pipelines. Open Inventor: is built on top of OpenGL® defines a standard file format for 3D data interchange introduces a simple event model for 3D interaction provides animation objects called Engines provides high performance object picking is window system and platform independent is a cross-platform 3D graphics development system encourages programmers to create new customized objects

Open Inventor modules in XIP C++ modules represent Engines, Nodes and Manipulators Engines enable the creation of processing pipelines Nodes support the concept of scene graphs, which are hierarchical structures of objects describing what needs to be visualized in 2D/3D Manipulators handle input devices, measurements and coordinate transforms in response to user interaction

Integrating existing toolkits into Wrapped ITK functions include Region Growing, Neighborhood, Isolated, Confidence, Watershed, Thresholding, Edge Detection, Laplacian, Gaussian, … Support for ITK Data Meshes and Vector Fields Automatic Wrapper generation for 2D/3D libraries/toolkits such as ITK and VTK Example: ITK for image processing, segmentation, registration User can review parsed results and choose to support only the desired data types, hide some methods, exclude some classes, etc.

Flexible Application Deployment Standalone Application Web-based Application Commercial Workstation Development IDE

XIP modules extend Open Inventor to facilitate medical imaging application development: Database access (read/write) DICOM query/retrieve Image/Volume types Lookup tables Transfer function editor MPR intersection lines/manipulators camera control (pan/zoom/rotate) 2D Image display ROIs, Annotations, Measurements … Modules for DICOM loading and 2D/3D Display XIP Features Modules for DICOM loading and 2D/3D Display

Modules for Fused Volume Rendering XIP Features Modules for Fused Volume Rendering Features: Volumes are stored separately and fused at rendering time, not as a preprocessing step Support for unlimited number of fused large volumes Each volume has independent control of: Transformation (rot, trans, scale, shear … ) Color/opacity Transfer function Crop box Cut-planes Rendering mode (VRT, MIP, MinIP, DRR, SSD) Voxel Resolution Sampling rate Performance 20 frames/sec during interactivity 1 sec for final diagnostic-quality update

 Visual creation and configuration of distributed services Thin Client and Smart Client configurations are supported Support for caGRID remote grid computing services XIP modules for DICOM Query, Sorting, remote data transmission XIP can serialize the entire state to a file, thereby facilitating support for client/server state management and recovery as well as workflow management. Modules for Client/Server Remote Visualization XIP Features Modules for Client/Server Remote Visualization

Fused MPRs (screen shot of live demo)

Fused Volume Rendering (screen shot of live demo)

Animal Imaging Prototype (screen shot of live demo)

Lymphnode Segmentation (screen shot of live demo)

ROI Tools, Measurement and Filtering (screen shot of live demo)

4D Beating Heart (screen shot of live demo)

ITK Demos: Level Set Networks (screen shot of live demo)

ivRAD to Strip out Siemens-proprietary classes Siemens-proprietary visualization and processing functions Functions for Siemens-specific data sources Siemens ‘look-and-feel’ Change copyright notices to support an open source license Replace Siemens-proprietary classes with open-source classes Continued use of ITK (Insight ToolKit) Continued use of open source DICOM toolkits (e.g. DCMTK) Add visualization via VTK and other open-source classes Modify the host – application interaction per the DICOM WG-23 APIs Add support for new functionality caGRID via the IVI Middleware software Annotations and markup via the AIM project Additional platforms (e.g. Linux, MAC) Other data formats and functions requested in the RFP

XIP Development Plan Phase 1 – Planning and RSNA/caBIG demonstrations (3 months) Planning done in parallel with RSNA/caBIG demonstration creation RSNA/caBIG demo done utilizing Siemens-internal proprietary development tools Source not released until phase 2. RSNA/caBIG demo serves as discussion point for generating use cases and requirements for ongoing development. Phase 2 – Conversion of base Siemens SW to open source (4 months) Largely utilizes the existing code pool, stripping out proprietary references and preparing the code for open source distribution Final output will be similar to, though not exactly the same as the RSNA/caBIG demonstration. May include some new additions, but may not fulfill all of the requirements listed in the SOW. Intermediate releases of documentation and code with partial feature sets during the course of conversion. Becomes the first prototype implementation Phase 3 – Addition of new features to XIP, creation of sample reference applications (3 months) Drafts of all documents available with all implemented features available at the end of this phase Intermediate releases available throughout the phase to foster discussion, review, and use. Prototype code with all implemented features at the end of this phase Phase 4 – Finalization of the year’s work products (2 months) No new features added after the start of this phase Bug fixes and documentation corrections as needed Final testing, review, and approvals

XIP Development Team Washington University in St. Louis Lawrence Tarbox Jaroslaw Krych David Maffitt Steve Moore Fred Prior Others Other Consultants Siteman Cancer Center Kitware Collaborative Projects IVI Middleware Annotation and Image Markup NCIA MIRC Siemens Corporate Research Gianluca Paladini Thomas Moeller Daphne Yu Klaus Engel John Pearson Others NCI caBIG IVI David Kupferschmid Booz Allen Hamilton Paul Mulhern

An Open Platform for Cancer Research

Q & A