2 University of Iowa Iowa City, IA 52246 2 University of Iowa Iowa City, IA 52246 William E. Higgins 1,2 Anthony J. Sherbondy 1 James P. Helferty 1 Atilla.

Slides:

Advertisements

Similar presentations

3-D. 3-D IMAGING IN MEDICINE IS A METHOD IN WHICH A SET OF DATA IS COLLECTED FROM A 3- D OBJECT, PROCESSED BY A COMPUTER, AND DISPALAYED ON A 2-D COMPUTER.

Advertisements

Diagnosis and Palliation for lung Cancer

Surgical Planning Laboratory Brigham and Women’s Hospital Boston, Massachusetts USA a teaching affiliate of Harvard Medical School User Interfaces and.

Lower Dosage CT-guided Lung Biopsy Protocol Maintains Quality, Minimizes Exposure Jeremy Collins, MD Pegah E, Lewandowski RJ, Yaghmai V, Nemcek jr AA,

Path Planning in Virtual Bronchoscopy Mohamadreza Negahdar Supervisor : Dr. Ahmadian Co-supervisor : Prof. Navab Tehran University of Medical Sciences.

Figure 1: Nasal Anatomy. Olfactory Cilia Superior Turbinate Internal Naris Nasopharynx Nasal Valve Middle Turbinate Inferior Turbinate Nostril © Philip.

Improved Techniques for Fast Sliding Thin-Slab Volume Visualization

Laser Needle Guide for the Sonic Flashlight David Wang 1,3,4, Bing Wu 2,3, George Stetten 1,2,3,4,5 1 Department of Biomedical Engineering, Carnegie Mellon.

Use of Integrated Virtual-Bronchoscopic Analysis During Live Bronchoscopy William E. Higgins, 1,2 Atilla P. Kiraly, 1 Anthony J. Sherbondy, 1 Janice Z.

CT-Video Registration Accuracy for Virtual Guidance of Bronchoscopy 1 Penn State University, University Park, PA Lockheed-Martin, King of Prussia,

2 University of Iowa Iowa City, IA James P. Helferty 1 Anthony J. Sherbondy 1 Atilla P. Kiraly 1 Janice Z Turlington 1 Eric A. Hoffman 2 Geoffrey.

Testing and Modelling of a Severely Tapered Composite Specimen

3D Augmented Reality for MRI-Guided Surgery Using Integral Videography Autostereoscopic Image Overlay Hongen Liao, Takashi Inomata, Ichiro Sakuma and Takeyoshi.

Computational flow modeling of the equine upper airway

Special Imaging Techniques Chapter 6 Bushong. Dynamic Computed Tomography (DCT) Dynamic scanning implies 15 or more scans in rapid sequence within one.

1 QED In Vivo USB Input Output Box configuration This tutorial contains a number of instructions embedded in a great deal of explanation. Procedures that.

Virtual Bronchoscopic approach for combining 3D CT and endoscopic video Anthony J. Sherbondy, 1 Atilla P. Kiraly, 1 Allen L. Austin, 1 James P. Helferty,

I NTERACTIVE V OLUME R ENDERING FOR V IRTUAL C OLONOSCOPY IEEE Proceedings of Visualization, Phoenix, U.S.A., Oct. 1997, pp. 433 – 436 Presented.

CT Quality Control for CT Scanners. Quality Control in CT A good idea? Yes Required for accreditation? Sometimes Improves image quality? Sometimes Depends.

Four patients underwent a PET/CT scan with a Philips True Flight Gemini PET/CT scanner. We manually identified a total of 26 central-chest lesions on the.

Multigenerational Analysis And Visualization of Large 3D Vascular Images Shu-Yen Wan Department of Information Management, Chang Gung University, Taiwan,

MRI Guided Radiation Therapy: Brachytherapy

System for Live Virtual-Endoscopic Guidance of Bronchoscopy

Image-guided therapy and medical robotics tutorial using a LEGO Mindstorms NXT robot and 3D Slicer Danielle F. Pace, B.CmpH Ron Kikinis, M.D. Nobuhiko.

Technician-Free Image-Guided Bronchoscopy System: A Human Study W. E. Higgins, 1 R. Khare, 1 D. C. Cornish, 1 P.D. Byrnes, 1 R. Cheirsilp, 1 X. Zang, 1.

BIOMEDICAL IMAGING PROGRAM NATIONAL CANCER INSTITUTE.

An Interactive Virtual Endoscopy Tool With Automated Path Generation Delphine Nain, MIT AI Laboratory. Thesis Advisor : W. Eric. L Grimson, MIT AI Laboratory.

Figure 6.1 A scan (or point cloud) created by a laser scanner.

Virtual Bronchoscopy for 3D Pulmonary Image Assessment: Visualization and Analysis William E. Higgins, 1,2 Krishnan Ramaswamy, 1 Geoffrey McLennan, 2 Eric.

Semi-Automatic Central-Chest Lymph-Node Definition from 3D MDCT Images Kongkuo Lu and William E. Higgins Penn State University University Park and Hershey,

AUTOMATIZATION OF COMPUTED TOMOGRAPHY PATHOLOGY DETECTION Semyon Medvedik Elena Kozakevich.

WS8.1-1 ANSYS, Inc. Proprietary © 2009 ANSYS, Inc. All rights reserved. April 28, 2009 Inventory # Workshop 8.1 Line and Surface Bodies DesignModeler.

3D Image Fusion and Guidance for Computer-Assisted Bronchoscopy William E. Higgins, Lav Rai, Scott A. Merritt, Kongkuo Lu, Nicholas T. Linger, and Kun-Chang.

Ultrathin Laser Scanning Bronchoscope and Guidance System for the Peripheral Lung Future Guided Bronchoscopy in the Peripheral Lung Ultrathin Laser + Scanning-Fiber.

Chapter 4: CS6891 Computational Medical Imaging Analysis Chapter 4: Image Visualization Jun Zhang Laboratory for Computational Medical Imaging & Data Analysis.

Integrated System for Planning Peripheral Bronchoscopic Procedures Jason D. Gibbs, Michael W. Graham, Kun-Chang Yu, and William E. Higgins Penn State University.

Radiology started with simple traditional x-ray technology.

Physician-Controlled System for Image-Guided Bronchoscopy W. E. Higgins, 1 R. Khare, 1 D. C. Cornish, 1 and R. Bascom 2 Penn State University, 1 College.

AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University Automatic 3D Image Segmentation of Internal Lung Structures.

A B C D E F A ABSTRACT A novel, efficient, robust, feature-based algorithm is presented for intramodality and multimodality medical image registration.

S Pyatt UV glue dispensing studies on the Dima Dotmaster 1.

CT IMAGE RECONSTRUCTION  Hounsfield envisioned dividing a slice into a matrix of 3-dimensional rectangular boxes (voxels) of material (tissue). Conventionally,

We consented and enrolled 30 patients with focal lesions, suspected lung cancer and available MDCT scans. The chest scans, generated by either a Siemens.

CT QUALITY MANAGEMENT. SPATIAL RESOLUTION CONTRAST RESOLUTION NOISE IMAGE ARTIFACTS RADIATION DOSE.

Conclusions Simulated fMRI phantoms with real motion and realistic susceptibility artifacts have been generated and tested using SPM2. Image distortion.

Part No...., Module No....Lesson No

3D Human Airway Segmentation for Virtual Bronchoscopy

Quality Control Bushong Chapter 10.

Revised OSDV Tools and Processes LFA PSM expert workshop 28-30January 2014.

User Manual for Tmaptool – T1 ρ processing tool Guruprasad Krishnamoorthy Chetana Bayas Gargi Pednekar.

Date of download: 5/29/2016 Copyright © 2016 SPIE. All rights reserved. Experimental setup. (a) Schematic drawing of the optoacoustic translate-rotate.

OPTIMAL GRAPH SEARCH BASED SEGMENTATION OF AIRWAY TREE DOUBLE SURFACES ACROSS BIFURICATION Prepared by: Rosebud Roy Roll No:21,MTech CSE Guided by: Prof.Sreeraj.

Date of download: 6/25/2016 Copyright © 2016 SPIE. All rights reserved. (a) Schematic of the interventional multispectral photoacoustic imaging system.

Development of elements of 3D planning program for radiotherapy Graphical editor options  automated enclose of contour  correction of intersections 

Stents Are Associated With Increased Risk of Respiratory Infections in Patients Undergoing Airway Interventions for Malignant Airways Disease Horiana B.

Automated airway evaluation system for multi-slice computed tomography using airway lumen diameter, airway wall thickness and broncho-arterial ratio B.

From: Automated voxel classification used with atlas-guided diffuse optical tomography for assessment of functional brain networks in young and older adults.

Breast MRI – How we got Here

Volume 131, Issue 1, Pages (January 2007)

Cardio Navigation: Planning, Simulation, and Augmented Reality in Robotic Assisted Endoscopic Bypass Grafting Volkmar Falk, MD, PhD, Fabien Mourgues,

Physics Testing for ACRIN 6678 Protocol version 3.0 QIBA Group 1C

Pathology Digital Radiology

Recent Advances in Bronchoscopic Treatment of Peripheral Lung Cancers

Use of virtual assisted lung mapping (VAL-MAP), a bronchoscopic multispot dye- marking technique using virtual images, for precise navigation of thoracoscopic.

Ultrasound-Guided Percutaneous Breast Biopsy

Virtual endobronchial ultrasound for transbronchial needle aspiration

Cardio Navigation: Planning, Simulation, and Augmented Reality in Robotic Assisted Endoscopic Bypass Grafting Volkmar Falk, MD, PhD, Fabien Mourgues,

The effect of vertical centering and scout direction on automatic tube voltage selection in chest CT: a preliminary phantom study on two different CT.

Volume 22, Issue 18, Pages (September 2012)

a) Axial computed tomography (CT) images at the level of the carina.

Presentation transcript:

2 University of Iowa Iowa City, IA University of Iowa Iowa City, IA William E. Higgins 1,2 Anthony J. Sherbondy 1 James P. Helferty 1 Atilla P. Kiraly 1 Geoffrey McLennan 2 Eric A. Hoffman 2 Janice Z Turlington 1 William E. Higgins 1,2 Anthony J. Sherbondy 1 James P. Helferty 1 Atilla P. Kiraly 1 Geoffrey McLennan 2 Eric A. Hoffman 2 Janice Z Turlington 1 RSNA 2000 Chicago, IL 26 November 2000 RSNA 2000 Chicago, IL 26 November Penn State University University Park, PA

1.Introduce the feasibility of PC-based virtual endoscopy for both 3D CT assessment and live bronchoscopy. 2.Demonstrate the concept of a multimedia case study for CT-based report generation and bronchoscopic guidance. 3.Describe a method for linking 3D CT data to live bronchoscopic video. 1.Introduce the feasibility of PC-based virtual endoscopy for both 3D CT assessment and live bronchoscopy. 2.Demonstrate the concept of a multimedia case study for CT-based report generation and bronchoscopic guidance. 3.Describe a method for linking 3D CT data to live bronchoscopic video. (1 of 32)

1.Overview of virtual bronchoscopy and our system (Virtual Navigator) 2.Stage-1 CT-only Analysis: Human case 3.Stage-2 Bronchoscopy examples: a.Human case b.Phantom and animal studies 1.Overview of virtual bronchoscopy and our system (Virtual Navigator) 2.Stage-1 CT-only Analysis: Human case 3.Stage-2 Bronchoscopy examples: a.Human case b.Phantom and animal studies (2 of 32)

 virtual copy of chest anatomy Input:Input: high-resolution 3D radiologic chest image  permits unlimited “exploration”  no risk to patient  permits unlimited “exploration”  no risk to patient Explore:Explore: the virtual anatomy using computer (3 of 32)

 Permit CT-only analysis No link to follow-on live bronchoscopy No link to follow-on live bronchoscopy  Limited quantitative path planning to interesting sites  Do not provide complete examination package  Often require expensive computers  Permit CT-only analysis No link to follow-on live bronchoscopy No link to follow-on live bronchoscopy  Limited quantitative path planning to interesting sites  Do not provide complete examination package  Often require expensive computers (4 of 32)

(5 of 32)  Complete CT examination  Guide live bronchoscopy  Automate steps in CT assessment  Inexpensive, PC-based  Complete CT examination  Guide live bronchoscopy  Automate steps in CT assessment  Inexpensive, PC-based

 Build with Graphics/Processing Tools 3D CT assessment Guide bronchoscopy  Supplemental plan  Multimedia report (6 of 32)

3.Reporting Abstractions  Snapshots  Plots  Movies  Case Notes  Measurements 3.Reporting Abstractions  Snapshots  Plots  Movies  Case Notes  Measurements 1.Data Sources  3D CT Image  Bronchoscopic Video Video 1.Data Sources  3D CT Image  Bronchoscopic Video Video 2.Data Abstractions  Root Site  Key Sites  Paths  Tree 2.Data Abstractions  Root Site  Key Sites  Paths  Tree (7 of 32)

VirtualscopeVirtualscope 3D Surface Tool Study Manager Projection Tools (8 of 32)

Sliding Slab Depth Tools Plot Tool Oblique Cross Sections Slicer Tools (MPR Views) (9 of 32)

CT-Video Live Match Tool Cube Tool Tube Viewer Notes Tool (10 of 32)

Examine case and plan bronchoscopy Virtual CT guidance of live bronchoscopy Stage 1: CT Assessment Stage 2: BronchoscopyBronchoscopy (11 of 32)

1. Create new Case Study. 2. Compute guidance data. 3. Build complete Case Study. 1. Create new Case Study. 2. Compute guidance data. 3. Build complete Case Study. Stage 1: CT Assessment 1. Load Case Study. 2. Set up graphical tools. 3. Perform virtual-guided bronchoscopy. 1. Load Case Study. 2. Set up graphical tools. 3. Perform virtual-guided bronchoscopy. Stage 2: BronchoscopyBronchoscopy (12 of 32)

a.Build Case Study registry B B Create Case Create Case b.Set up for computing guidance data S S Set up Set up 1.Create new Case Study. 2. Automatically compute guidance data. 3. Build complete Case Study. A A B B (13 of 32)

Determine global 3D interior detail Travel through virtual airway paths. View structure relations within their environment. Study interior path dynamics. Extract paths through airways. Render airway tree with paths, traverse pathways. (14 of 32)

Patient underwent EBCT scan (Electron Beam): single 20-sec breath-holdsingle 20-sec breath-hold 133 contiguous slices133 contiguous slices Reconstructed 3D CT image: Slice = 512X512 voxelsSlice = 512X512 voxels Slice thickness =1.5mmSlice thickness =1.5mm axial-plane [x-y] resolution = 0.586mm.axial-plane [x-y] resolution = 0.586mm. Patient underwent EBCT scan (Electron Beam): single 20-sec breath-holdsingle 20-sec breath-hold 133 contiguous slices133 contiguous slices Reconstructed 3D CT image: Slice = 512X512 voxelsSlice = 512X512 voxels Slice thickness =1.5mmSlice thickness =1.5mm axial-plane [x-y] resolution = 0.586mm.axial-plane [x-y] resolution = 0.586mm. Virtual Navigator shows Characteristics of collapseCharacteristics of collapse Condition of extended bronchial pathwaysCondition of extended bronchial pathways Virtual Navigator shows Characteristics of collapseCharacteristics of collapse Condition of extended bronchial pathwaysCondition of extended bronchial pathways (15 of 32)

(16 of 32) MPR Views Indicate Global 3D position MPR Views Indicate Global 3D position Depth- weighted Slab shows geometry Depth- weighted Slab shows geometry Same 3D site focused on by all tools.

(17 of 32) Selected 3D site (BLUE DOT) Highlighted on Five different tools at once. Selected 3D site (BLUE DOT) Highlighted on Five different tools at once.

Bottom to top view of collapse Site #99 Near carina, leaving collapse Approaching collapse Site #20 Site #47 Within tracheal collapse Site #86 Leaving trachea (18 of 32)

drop in area Approaching collapse Site #20 Within tracheal collapse Site #47 Plot clearly shows section where blockage occurs (19 of 32)

Pathology documented by captured Depth-Slab snapshots. Extent of collapse shown in rendered Airway tree. Extent of collapse shown in rendered Airway tree. (20 of 32)

Virtual Navigator shows Details of existing stentDetails of existing stent Basis for intervention analysisBasis for intervention analysis (laser therapy was performed) Virtual Navigator shows Details of existing stentDetails of existing stent Basis for intervention analysisBasis for intervention analysis (laser therapy was performed) Patient underwent EBCT scan (Electron Beam): single 20-sec breath-holdsingle 20-sec breath-hold 133 contiguous slices133 contiguous slices Reconstructed 3D CT image: Slice = 512X512 voxelsSlice = 512X512 voxels Slice thickness =1.5mmSlice thickness =1.5mm axial-plane [x-y] resolution = 0.586mm.axial-plane [x-y] resolution = 0.586mm. Patient underwent EBCT scan (Electron Beam): single 20-sec breath-holdsingle 20-sec breath-hold 133 contiguous slices133 contiguous slices Reconstructed 3D CT image: Slice = 512X512 voxelsSlice = 512X512 voxels Slice thickness =1.5mmSlice thickness =1.5mm axial-plane [x-y] resolution = 0.586mm.axial-plane [x-y] resolution = 0.586mm. (21 of 32)

(22 of 32) Stent visible In this and other views Stent visible In this and other views Same 3D site focused on by all tools.

(23 of 32) Stent encroaching on main carina

3. Perform virtual-guided bronchoscopy. 2. Set up graphical tools. 1. Load Case Study. L L Load Case Load Case S S Graphical Tools Graphical Tools P P Virtual Guidance Virtual Guidance (24 of 32)

2.LIVE bronchoscope video Video Match Tool shows a matched point between 3.Corresponding videobronchoscopy ( ROI superimposed) Virtual data guides airway traversal. airway traversal. Virtual data guides airway traversal. airway traversal. Coronal Projection shows extracted airway tree 1.CT rendering of airway region ( ROI rendered) 1.CT rendering of airway region ( ROI rendered) (25 of 32)

1.Phantom 2.Animal 3.Human 1.Phantom 2.Animal 3.Human

Rubber phantom Experimental set-up: physician was blind to phantom physician was blind to phantom Experimental set-up: physician was blind to phantom physician was blind to phantom (26 of 32)

Extracted tree and paths Matched video frame with ROI RegisteredvirtualshotRegisteredvirtualshot (27 of 32)

Physician #1 (trial 1) Physician #1 (trial 2) Physician #2 Distance (mm) Time sec. Distance (mm) Time sec. Distance (mm) Time sec  Average biopsy error: 1.98 mm  Average match time: sec.  Average biopsy error: 1.98 mm  Average match time: sec. Average Std Dev Distance and time measured to match each ROI target. Distance measured from line extrapolated from the needle direction to metal bead edge. Note: (28 of 32)

Registered virtual shot Registered LiveEndoscopicvideoLiveEndoscopicvideo Matched video frame with ROI (29 of 32)

Snapshots are misaligned to compensate for differing placement during CT scanning. Note: Actual site after guided dye marker placement. Planned site from CT analysis. (30 of 32)

(31 of 32)

(32 of 32) Bronchoscope video matched to rendered CT during live procedure.

National Center for Research Resources of the NIH (grant RR11800) National Center for Research Resources of the NIH (grant RR11800) Whitaker Foundation National Cancer Institute of the NIH (grant CA74325) National Cancer Institute of the NIH (grant CA74325) (End)(End)