Lijuan Zhao Advisors: Prof. Fatima Merchant Prof. Shishir Shah.

Slides:



Advertisements
Similar presentations
3D Model Matching with Viewpoint-Invariant Patches(VIP) Reporter :鄒嘉恆 Date : 10/06/2009.
Advertisements

CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 10: Extrinsic Deformations Fall 2014.
Extended Gaussian Images
Comparison Methodologies. Evaluating the matching characteristics Properties of the similarity measure Robustness of the similarity measure – Low variation.
Intensity-based deformable registration of 2D fluoroscopic X- ray images to a 3D CT model Aviv Hurvitz Advisor: Prof. Leo Joskowicz.
Amir Hosein Omidvarnia Spring 2007 Principles of 3D Face Recognition.
Proportion Priors for Image Sequence Segmentation Claudia Nieuwenhuis, etc. ICCV 2013 Oral.
Jeroen Hermans, Frederik Maes, Dirk Vandermeulen, Paul Suetens
3D Skeletons Using Graphics Hardware Jonathan Bilodeau Chris Niski.
Active Contours / Planes Sebastian Thrun, Gary Bradski, Daniel Russakoff Stanford CS223B Computer Vision Some slides.
Learning similarity measure for natural image retrieval with relevance feedback Reporter: Francis 2005/3/3.
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Nonrigid Shape Correspondence using Landmark Sliding, Insertion, and Deletion Theodor Richardson.
Final Class: Range Data registration CISC4/689 Credits: Tel-Aviv University.
Non-Rigid Registration. Why Non-Rigid Registration  In many applications a rigid transformation is sufficient. (Brain)  Other applications: Intra-subject:
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
Human Posture Recognition with Convex Programming Hao Jiang, Ze-Nian Li and Mark S. Drew School of Computing Science Simon Fraser University Burnaby, BC,
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
Detecting Image Region Duplication Using SIFT Features March 16, ICASSP 2010 Dallas, TX Xunyu Pan and Siwei Lyu Computer Science Department University.
Automatic 2D-3D Registration Student: Lingyun Liu Advisor: Prof. Ioannis Stamos.
Non-Rigid Registration on SPIE 2002 First Part: TPS.
P. Rodríguez, R. Dosil, X. M. Pardo, V. Leborán Grupo de Visión Artificial Departamento de Electrónica e Computación Universidade de Santiago de Compostela.
1 Bronstein 2 & Kimmel An isometric model for facial animation and beyond AMDO, Puerto de Andratx, 2006 An isometric model for facial animation and beyond.
3D full object reconstruction from kinect Yoni Choukroun Elie Semmel Advisor: Yonathan Afflalo.
Quan Yu State Key Lab of CAD&CG Zhejiang University
Robust estimation Problem: we want to determine the displacement (u,v) between pairs of images. We are given 100 points with a correlation score computed.
An Integrated Pose and Correspondence Approach to Image Matching Anand Rangarajan Image Processing and Analysis Group Departments of Electrical Engineering.
Lijuan Zhao Advisors: Prof. Fatima Merchant Prof. Shishir Shah.
Image Guided Surgery in Prostate Brachytherapy Rohit Saboo.
My Research Experience Cheng Qian. Outline 3D Reconstruction Based on Range Images Color Engineering Thermal Image Restoration.
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Automatic Posing of a Meshed Human Model Using Point Clouds Lei Wang Joint work with Tamal K. Dey, Huamin.
Matching 3D Shapes Using 2D Conformal Representations Xianfeng Gu 1, Baba Vemuri 2 Computer and Information Science and Engineering, Gainesville, FL ,
Gwangju Institute of Science and Technology Intelligent Design and Graphics Laboratory Multi-scale tensor voting for feature extraction from unstructured.
1 SEGMENTATION OF BREAST TUMOR IN THREE- DIMENSIONAL ULTRASOUND IMAGES USING THREE- DIMENSIONAL DISCRETE ACTIVE CONTOUR MODEL Ultrasound in Med. & Biol.,
Multi-Modal Quantitative Analysis of Pediatric Focal Epilepsy Andy Eow Medical Vision Group CSAIL, MIT.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Xiaoguang Han Department of Computer Science Probation talk – D Human Reconstruction from Sparse Uncalibrated Views.
ALIGNMENT OF 3D ARTICULATE SHAPES. Articulated registration Input: Two or more 3d point clouds (possibly with connectivity information) of an articulated.
Reihaneh Rostami, Zeyun Yu Computer Science Department University of Wisconsin – Milwaukee Objective -3D Point Matching is the process of finding a point.
Enhanced Correspondence and Statistics for Structural Shape Analysis: Current Research Martin Styner Department of Computer Science and Psychiatry.
Methods Validation with Simulated Data 1.Generate random linear objects in the model coordinate system. 2.Generate a random set of points on each linear.
Image Registration as an Optimization Problem. Overlaying two or more images of the same scene Image Registration.
Ray Divergence-Based Bundle Adjustment Conditioning for Multi-View Stereo Mauricio Hess-Flores 1, Daniel Knoblauch 2, Mark A. Duchaineau 3, Kenneth I.
Prostate Registration USEFUL CONCEPTS AND TOOLS C. Antonio Sánchez Dept of Elec & Comp Eng University of British Columbia Vancouver, BC, Canada
Roee Litman, Alexander Bronstein, Michael Bronstein
Adaptive Rigid Multi-region Selection for 3D face recognition K. Chang, K. Bowyer, P. Flynn Paper presentation Kin-chung (Ryan) Wong 2006/7/27.
Stereoscopic Video Overlay with Deformable Registration Balazs Vagvolgyi Prof. Gregory Hager CISST ERC Dr. David Yuh, M.D. Department of Surgery Johns.
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
Blood Vessel Modeling using 2D/3D Level Set Method
A B C D E F A ABSTRACT A novel, efficient, robust, feature-based algorithm is presented for intramodality and multimodality medical image registration.
Using simplified meshes for crude registration of two partially overlapping range images Mercedes R.G.Márquez Wu Shin-Ting State University of Matogrosso.
A Unified Feature Registration Framework for Brain Anatomical Alignment Haili Chui, Robert Schultz, Lawrence Win, James Duncan and Anand Rangarajan* Image.
CSE 185 Introduction to Computer Vision Feature Matching.
Group-wise Registration in NAMIC-kit Serdar K Balci (MIT) Lilla Zöllei (MGH) Kinh Tieu (BWH) Mert R Sabuncu (MIT) Polina Golland (MIT)
Affine Registration in R m 5. The matching function allows to define tentative correspondences and a RANSAC-like algorithm can be used to estimate the.
Reverse Engineering of Point Clouds to Obtain Trimmed NURBS Lavanya Sita Tekumalla Advisor: Prof. Elaine Cohen School of Computing University of Utah Masters.
CDS 301 Fall, 2008 Domain-Modeling Techniques Chap. 8 November 04, 2008 Jie Zhang Copyright ©
3D Face Recognition Using Range Images Literature Survey Joonsoo Lee 3/10/05.
CENG 789 – Digital Geometry Processing 10- Data-Driven Shape Analysis
A 2D/3D correspondence building method for reconstruction of a 3D bone surface model Longwei Fang
Deformation Modeling for Robust 3D Face Matching Xioguang Lu and Anil K. Jain Dept. of Computer Science & Engineering Michigan State University.
C. P. Loizou1, C. Papacharalambous1, G. Samaras1, E. Kyriakou2, T
CENG 789 – Digital Geometry Processing 10- Least-Squares Solutions
Unsupervised Face Alignment by Robust Nonrigid Mapping
Spectral processing of point-sampled geometry
CSE 554 Lecture 10: Extrinsic Deformations
Comparing Images Using Hausdorff Distance
CENG 789 – Digital Geometry Processing 11- Least-Squares Solutions
Presentation transcript:

Lijuan Zhao Advisors: Prof. Fatima Merchant Prof. Shishir Shah

OUTLINE Motivation Computational Problem Challenges Literature Review Future Work

Motivation Breast Reconstruction - Breast cancer is the most life-threatening disease in women - Breast cancer treatments usually lead to complete or partial breast removal - Breast reconstruction can help breast cancer survivors regain their quality of life

Motivation (cont’d) Measurements of breast aesthetics - Volume, symmetry, ptosis, projection, etc - Limitations: only estimate surgical results unable to give guidance for surgery Analysis of change for each point on breast - Better evaluation of surgical outcomes - Provide guidance for surgery

Computational Problem Example of 3D torso image Point cloud Triangular mesh surface 2D texture image mapped onto surface

Computational Problem (cont’d) Visit 1Visit 2Visit 3 Retrieve breast data from 3D torso images Analyze breast changes for different visits for same patient

Challenges Chest walls are not matched for different visits - Coordinate systems may not be same - Patient weight change - 3D corresponding are required

Challenges (cont’d) Manually retrieve data may change points coordinates The transformations of the breast data are non-rigid

Literature Review (1) Robust point set registration using Gaussian mixture models Using Gaussian mixture models to represent point sets Divergence measure: L2 distance Deformation model: thin-plate splines (TPS)+ gaussian radial basis functions (GRBF) Cost function: PROS: efficient and robust CONS: only works for pair-wise point set

Literature Review (cont’d) (2) Group-wise point-set registration using a novel CDF-based Havrda-Charvat divergence Using Dirac mixture models to represent point sets Divergence measure: CDF-HC divergence Deformation model: thin-plate splines (TPS) Cost function: PROS: efficient and simple to implement; works for group-wise point sets CONS: not robust for noise and outliers

Future Work Step 1: chest wall calibration - Choose some fiducial points and connect them - Choose same points on different images - Construct the mathematical model

Future Work (cont’d) Step 2: automatically retrieve the breast data - Based on mathematical model, calculate the corresponding coordinates for points on chest wall - Using curvature property retrieve the breast data

Future Work (cont’d) Step 3: using 3D group-wise point sets non-rigid registration to analyze breast changes. - Down sampling point cloud (if necessary) VTK - Propose new method with good cost function and optimization scheme suitable model to represent point sets divergence measure deformable model