Presentation is loading. Please wait.

Presentation is loading. Please wait.

Applications of Capsules

Similar presentations


Presentation on theme: "Applications of Capsules"— Presentation transcript:

1 Applications of Capsules
Segmentation

2 Presentation Outline Capsule Segmentation Challenges & Solutions
Applications of Segmentation Capsules Lung Tissue, Retinal Vessels, Handling Transformations. Code Demo University of Central Florida | Center for Research in Computer Vision (CRCV)

3 Capsule Segmentation Challenges
Typically larger image sizes & dense output Required more GPU memory Balance global & local information Requires even more GPU memory University of Central Florida | Center for Research in Computer Vision (CRCV)

4 Overcoming the Memory Burden
Locally-constrained dynamic routing Transformation matrix sharing “Deconvolutional” capsules Encoder-decoder networks University of Central Florida | Center for Research in Computer Vision (CRCV)

5 Locally-Constrained Dynamic Routing
University of Central Florida | Center for Research in Computer Vision (CRCV)

6 Transformation Matrix Sharing
Convolutional capsule layers use different transformation matrices for each member of the grid as well as for each type of capsule. Sharing transformation matrices across members of the grid can further reduce parameters. Still have different matrices for each capsule type. University of Central Florida | Center for Research in Computer Vision (CRCV)

7 “Deconvolutional” Capsules
Prediction vectors formed using transposed convolutions. Routing is computed the same. University of Central Florida | Center for Research in Computer Vision (CRCV)

8 Example Segmentation Architectures
University of Central Florida | Center for Research in Computer Vision (CRCV)

9 University of Central Florida | Center for Research in Computer Vision (CRCV)

10 Example Applications Retinal Blood Vessels Pathological Lungs
Ground-glass opacity Nodule Emphysema University of Central Florida | Center for Research in Computer Vision (CRCV)

11 Lung Segmentation University of Central Florida | Center for Research in Computer Vision (CRCV)

12 Retinal Vessel Segmentation
University of Central Florida | Center for Research in Computer Vision (CRCV)

13 Handling Transformations
Credit to Cheng-Lin Li: University of Central Florida | Center for Research in Computer Vision (CRCV)

14 Handling Transformations
R. Varghese, S. Sharma and M. Premalatha, "Transforming Auto-Encoder and Decoder Network for Pediatric Bone Image Segmentation using a State-of-the-art Semantic Segmentation network on Bone Radiographs," 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Bangkok, 2018, pp Handling Transformations Input Image U-Net Output SegCaps Output University of Central Florida | Center for Research in Computer Vision (CRCV)

15 Code Demo Google Colab Notebook
/drive/folders/1MhebBrD sh3N5HSntj2Zl5edx56_IkXk N?usp=sharing Can download and use Jupyter Notebook University of Central Florida | Center for Research in Computer Vision (CRCV)

16 Code is Publically Available
Thank You! Questions and Discussions Comment on project page Project Page Code is Publically Available University of Central Florida | Center for Research in Computer Vision (CRCV)


Download ppt "Applications of Capsules"

Similar presentations


Ads by Google