3D Reconstruction Based on 3D/2D Registration Longwei Fang 29/1/2016.

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Reconstruction from Voxels (GATE-540)
Simultaneous surveillance camera calibration and foot-head homology estimation from human detection 1 Author : Micusic & Pajdla Presenter : Shiu, Jia-Hau.
QR Code Recognition Based On Image Processing
Caroline Rougier, Jean Meunier, Alain St-Arnaud, and Jacqueline Rousseau IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 21, NO. 5,
Validation of Blood Flow Simulations in Intracranial Aneurysms Yue Yu Brown University.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Automatic Feature Extraction for Multi-view 3D Face Recognition
Intensity-based deformable registration of 2D fluoroscopic X- ray images to a 3D CT model Aviv Hurvitz Advisor: Prof. Leo Joskowicz.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
3D Skeletons Using Graphics Hardware Jonathan Bilodeau Chris Niski.
A Versatile Depalletizer of Boxes Based on Range Imagery Dimitrios Katsoulas*, Lothar Bergen*, Lambis Tassakos** *University of Freiburg **Inos Automation-software.
Localization of Piled Boxes by Means of the Hough Transform Dimitrios Katsoulas Institute for Pattern Recognition and Image Processing University of Freiburg.
Silhouettes in Multiview Stereo Ian Simon. Multiview Stereo Problem Input: – a collection of images of a rigid object (or scene) – camera parameters for.
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
A 3D Approach for Computer-Aided Liver Lesion Detection Reed Tompkins DePaul Medix Program 2008 Mentor: Kenji Suzuki, Ph.D. Special Thanks to Edmund Ng.
Shadow Volumes on Programmable Graphics Hardware Speaker: Alvin Date: 2003/11/3 EUROGRAPHICS 2003.
P. Rodríguez, R. Dosil, X. M. Pardo, V. Leborán Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
Intro to FreeSurfer Jargon
Brain segmentation and Phase unwrapping in MRI data ECE 738 Project JongHoon Lee.
An Interactive Segmentation Approach Using Color Pre- processing Marisol Martinez Escobar Ph.D Candidate Major Professor: Eliot Winer Department of Mechanical.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Introduction EE 520: Image Analysis & Computer Vision.
CS654: Digital Image Analysis Lecture 8: Stereo Imaging.
Image Processing and Pattern Recognition Jouko Lampinen.
MEDICAL IMAGE ANALYSIS Marek Brejl Vital Images, Inc.
Segmentation & Modeling ImagesSegmented Images Models.
Copyright © 2010 Siemens Medical Solutions USA, Inc. All rights reserved. Hierarchical Segmentation and Identification of Thoracic Vertebra Using Learning-based.
Human pose recognition from depth image MS Research Cambridge.
SECURITY IMAGING Prof. Charles A. Bouman Vertical Integrated Projects (VIP) Spring 2011, Call-Out.
Clinical case studies Volumetric Measurements Visualization & Change Tracking Perfusion Analysis PET/CT Image Analysis Volumetric Analysis using 3D Slicer:
Blood Vessel Modeling using 2D/3D Level Set Method
Vertices, Edges and Faces By Jordan Diamond. Vertices In geometry, a vertices is a special kind of point which describes the corners or intersections.
PROJECT#3(b) Astrocyte Analysis
Figure 6. Parameter Calculation. Parameters R, T, f, and c are found from m ij. Patient f : camera focal vector along optical axis c : camera center offset.
Yannick FranckenChris HermansPhilippe Bekaert Hasselt University – tUL – IBBT Expertise Centre for Digital Media, Belgium
3D Reconstruction Using Image Sequence
NA-MIC National Alliance for Medical Image Computing Engineering a Segmentation Framework Marcel Prastawa.
Complete Distance Field Representation 報告者:陳陸剛. Outline Introduction Generate Volume Data Compute Distance Method Complete Distance Definition Distance.
Advisor : Ku-Yaw Chang Speaker : Ren-Li Shen /6/12.
Intro to FreeSurfer Jargon voxel surface volume vertex surface-based recon cortical, subcortical parcellation/segmentation registration, morph, deform,
Intro to FreeSurfer Jargon. voxel surface volume vertex surface-based recon cortical, subcortical parcellation/segmentation registration, morph, deform,
A 2D/3D correspondence building method for reconstruction of a 3D bone surface model Longwei Fang
{ Constructions Duplicating and Line and an Angle.
Automated OTMS Raghav Malik.
Source: Pattern Recognition, 37(5), P , 2004
Computed Tomography Image Reconstruction
Reconstruction For Rendering distribution Effect
Intro to FreeSurfer Jargon
CSc4730/6730 Scientific Visualization
Machine Vision Acquisition of image data, followed by the processing and interpretation of these data by computer for some useful application like inspection,
Intro to FreeSurfer Jargon
3D Rendering Pipeline Hidden Surface Removal 3D Primitives
Level Set Tree Feature Detection
Considerations in measuring cartilage thickness using MRI: factors influencing reproducibility and accuracy  S. Koo, M.S., G.E. Gold, M.D., T.P. Andriacchi,
Intro to FreeSurfer Jargon
Lecture 3 : Isosurface Extraction
Volume Graphics (lecture 4 : Isosurface Extraction)
Intro to FreeSurfer Jargon
眼動儀與互動介面設計 廖文宏 6/26/2009.
A Volumetric Method for Building Complex Models from Range Images
CSE 554 Lecture 10: Extrinsic Deformations
Presentation by: Lillian Lau
Chapter 11: Stereopsis Stereopsis: Fusing the pictures taken by two cameras and exploiting the difference (or disparity) between them to obtain the depth.
Multi-Information Based GCPs Selection Method
Radial Thickness Calculation and Visualization for Volumetric Layers
Presentation transcript:

3D Reconstruction Based on 3D/2D Registration Longwei Fang 29/1/2016

Outline Background Methods Experiments and Results Discussion and Conclusion

Background

Point Distribution Model → Silhouette+ ICP Statistic Shape Model +Camera calibration 3 X-Ray Images 2 X-Ray Images Limits: Relay on edge detection heavily Using a few edge points to deform the model

Methods

Methods - Input CT image of vertebral model Resolution:0.24mm*0.24mm*0.7mm 13 marks on vertebral model Two X-ray images One on coronal position One on sagittal position

Methods – Projection parameters

Reconstruction part segmentation Live-ware segmentation Label the markers manually Rigid registration based on markers

Methods – Point pair

Input : Vertebral CT 、 projection parameters and intensity threshold Output : DRR images and intersect point coordinate and pixel location while ( calculate the each pixel intensity of projection ) { intersect_flag=0 while (ray go through the volume){ If (volume intensity > threshod && intersect_flag==0){ Store intersect point and pixel location; intersect_flay=1; } If (volume intensity < threshod && intersect_flag==1){ Store intersect point and pixel location; intersect_flay=0; } Calculate pixel intensity; }

Methods – Point pair 1.Extract the surface mesh of vertebral model MITK 3500 vertexes 2. Point pair on two DRR images 3. Deformable registration

Methods - Reconstruction

Experiments and Results Golden standardResult X-ray images MD: 1.23mm SD: 0.98

Discussion and Conclusion Innovation points Do not need to construct SSM The reconstruction time do not increase much when the vertexes in the mesh increase The point pairs not limited in image boundary The deformation is on 2D images, not in 3D model, less computation Reconstruction very fast, in less than 40s Discussion The influence of point number in vertebral mesh to reconstruction The influence of the amount of x-ray images to reconstruction accuracy The influence of projection parameters to reconstruction