1. Development of NSCLC Precise Puncture Prototype based on CT Images Using Augmented Reality Navigation
Speaker: Zhibao Qin
Supervisor: Junsheng Shi
Unit: Yunnan Normal University
Laboratory: Institute of Color and Image Vision

2. Outline 2. Flow chart 3. The segmentation of lung tumor
1. Related background
2. Flow chart
3. The segmentation of lung tumor
4. The 3-dimensional reconstruction of organs and tissues
5. 4D heat map reconstruction of lung tumor
6. Precise puncture based on AR navigation

3. 1. Related background
1) Because of the space heterogeneity of lung tumor, it can’t represent the characteristics of the whole tumor that a small number of tissue sample obtained randomly for lung puncture biopsy. And it will reduce the diagnostic rate of pathological examination. 2) We put forward a precise puncture method to obtain the representative puncture point.

4. 2. Flow chart

5. 3. The segmentation of lung tumor
We did segmentation of lung tumor with the method of semi-automatic and threshold segmentation.

6. 4. The 3-dimensional reconstruction of organs and tissues
1) We reconstructed the models of skin, bone, lung and tumor by surface reconstruction algorithm. 2) We adjusted the transparency appropriately.

7. 5. 4D heat map reconstruction of lung tumor
1) We used Matlab to reconstruct the 4D heat map model for lung tumor by volume reconstruction algorithm. 2) We choosed the representative point Q.

8. 6. Precise puncture based on AR navigation
1) We imported 3D reconstruct models into Unity3d, and did a registration on 3D models and real patient. 2) We utilized the needle path model to navigate puncture operation. 3) Finally we obtained a satisfactory result.

9. Future works
1) We will add the three-dimensional model of blood vessels. 2) We will create a 5D model of lung tumor.

10. Thank you！