Registering retinal images

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints
Advertisements

Ter Haar Romeny, FEV MIT AI Lab Automatic Polyp Detection.
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Face Recognition and Biometric Systems Eigenfaces (2)
RGB-D object recognition and localization with clutter and occlusions Federico Tombari, Samuele Salti, Luigi Di Stefano Computer Vision Lab – University.
Neusoft Group Ltd. Medical Systems Centerline detection of (cardiac) vessels in CT images Martin Korevaar Supervisors: Shengjun Wang Han van Triest Yan.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
AGE ESTIMATION: A CLASSIFICATION PROBLEM HANDE ALEMDAR, BERNA ALTINEL, NEŞE ALYÜZ, SERHAN DANİŞ.
Chapter 8 Content-Based Image Retrieval. Query By Keyword: Some textual attributes (keywords) should be maintained for each image. The image can be indexed.
Distinctive Image Features from Scale- Invariant Keypoints Mohammad-Amin Ahantab Technische Universität München, Germany.
Automatic Feature Extraction for Multi-view 3D Face Recognition
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Automatic in vivo Microscopy Video Mining for Leukocytes * Chengcui Zhang, Wei-Bang Chen, Lin Yang, Xin Chen, John K. Johnstone.
Xianfeng Gu, Yaling Wang, Tony Chan, Paul Thompson, Shing-Tung Yau
66: Priyanka J. Sawant 67: Ayesha A. Upadhyay 75: Sumeet Sukthankar.
Lecture 6: Feature matching CS4670: Computer Vision Noah Snavely.
Iterative closest point algorithms
Am Analysis of Coronary Microvessel Structures on the Enhancement and Detection of Microvessels in 3D Cryomicrotome Data Master’s project by Edwin Bennink.
Quantification of collagen orientation in 3D engineered tissue
Scale Invariant Feature Transform (SIFT)
Distinctive Image Features from Scale-Invariant Keypoints David G. Lowe – IJCV 2004 Brien Flewelling CPSC 643 Presentation 1.
Lilong Shi, Brian Funt, and Ghassan Hamarneh School of Computing Science, Simon Fraser University.
Overview Introduction to local features
VEHICLE NUMBER PLATE RECOGNITION SYSTEM. Information and constraints Character recognition using moments. Character recognition using OCR. Signature.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
A fully automated method for segmentation and thickness determination of hip joint cartilage from 3D MR data Authors: Yoshinobu Sato,et al. Source: Proceedings.
AUTOMATIC ANNOTATION OF GEO-INFORMATION IN PANORAMIC STREET VIEW BY IMAGE RETRIEVAL Ming Chen, Yueting Zhuang, Fei Wu College of Computer Science, Zhejiang.
Recognition and Matching based on local invariant features Cordelia Schmid INRIA, Grenoble David Lowe Univ. of British Columbia.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Overview Harris interest points Comparing interest points (SSD, ZNCC, SIFT) Scale & affine invariant interest points Evaluation and comparison of different.
Local invariant features Cordelia Schmid INRIA, Grenoble.
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Invariants to affine transform What is affine transform ?
Fuhai Li, Ph.D. BBP-TMHRI, Feb D Tumor Stem Cell Niche Image Analysis NCI-ICBP CMCD U54 Progress Report.
* Challenge the future Graduation project 2014 Exploring Regularities for Improving Façade Reconstruction from Point Cloud Supervisors Dr. Ben Gorte Dr.
Danny Ruijters 17 April D-3D intra-interventional registration of coronary arteries.
CSCE 643 Computer Vision: Extractions of Image Features Jinxiang Chai.
Dengsheng Zhang and Melissa Chen Yi Lim
Local invariant features Cordelia Schmid INRIA, Grenoble.
Distinctive Image Features from Scale-Invariant Keypoints Ronnie Bajwa Sameer Pawar * * Adapted from slides found online by Michael Kowalski, Lehigh University.
Kylie Gorman WEEK 1-2 REVIEW. CONVERTING AN IMAGE FROM RGB TO HSV AND DISPLAY CHANNELS.
CS654: Digital Image Analysis Lecture 36: Feature Extraction and Analysis.
Overview Introduction to local features Harris interest points + SSD, ZNCC, SIFT Scale & affine invariant interest point detectors Evaluation and comparison.
Features, Feature descriptors, Matching Jana Kosecka George Mason University.
ELE 488 Fall 2006 Image Processing and Transmission ( )
A Tutorial on using SIFT Presented by Jimmy Huff (Slightly modified by Josiah Yoder for Winter )
Face Detection and Gender Recognition EE368 Project Report Michael Bax Chunlei Liu Ping Li 28 May 2003.
Folding meshes: Hierarchical mesh segmentation based on planar symmetry Patricio Simari, Evangelos Kalogerakis, Karan Singh.
Pixel Parallel Vessel Tree Extraction for a Personal Authentication System 2010/01/14 學生:羅國育.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
CS262: Computer Vision Lect 09: SIFT Descriptors
Personalized graph reconstruction of coronary artery network
Distinctive Image Features from Scale-Invariant Keypoints
3D Vision Interest Points.
Image Primitives and Correspondence
Image Stitching Slides from Rick Szeliski, Steve Seitz, Derek Hoiem, Ira Kemelmacher, Ali Farhadi.
Coarse Classification
Level Set Tree Feature Detection
From a presentation by Jimmy Huff Modified by Josiah Yoder
Aim of the project Take your image Submit it to the search engine
Spectral Clustering Eric Xing Lecture 8, August 13, 2010
Spectral Transformation
ECE 692 – Advanced Topics in Computer Vision
Principal Component Analysis
Lecture 5: Feature invariance
SIFT SIFT is an carefully designed procedure with empirically determined parameters for the invariant and distinctive features.
Recognition and Matching based on local invariant features
Lecture 5: Feature invariance
Find the limit {image} ,024 2,160 -1,
Presentation transcript:

Registering retinal images July 15, 2011 Registering retinal images Babak Ghafaryasl Universitat Pompeu Fabra Csaba Molnár University of Szeged Antonio R. Porras Universitat Pompeu Fabra Arie Shaus Tel Aviv University http://www.inf.u-szeged.hu/projectdirs/ssip2011/teamG

Vascular tree extraction Overview Vessel enhancement Vascular tree extraction Feature extraction Registration

Vessel enhancement - Scale Space representation “Multiscale vessel enhancement filtering”, Frangi et al, 1998 - Scale Space representation Local image descriptors - Eigenvalues of Hessain (2nd derivative) matrix Tubular, plate-like and spherical structures

Vascular tree extraction Original images Vessel enhancement Thresholding + Skeletonization Largest connected components

From bifurcation point to bifurcation structure… “Feature-Based Retinal Image Registration Using Bifurcation Structures”, Chen & Zhang, 2009 L2 L3 But… L’s are normalized to sum up to 1. The α triplets sum up to 360. Therefore we can remove some redundancy. L1 We can measure a distance between such structures!

From bifurcation structures to registration… Step 1: Find bifurcation structures in both images. Step 2: Find the best match between two bifurcation structures. The match between 4 points (3 are enough) determines the affine transformation. Step 3: Find next best matches (taking the transformation into account); refine the affine transformation with more points.

Results: feature extration All candidates Vessel registration Matching candidates

Results: retinal registration (I)

Results: retinal registration (II)

Results: bad news...

Questions?