Correspondence-Free Determination of the Affine Fundamental Matrix 2007. 2. 6 (Tue) Young Ki Baik, Computer Vision Lab.

Slides:



Advertisements
Similar presentations
Image Registration  Mapping of Evolution. Registration Goals Assume the correspondences are known Find such f() and g() such that the images are best.
Advertisements

The fundamental matrix F
Lecture 11: Two-view geometry
3D reconstruction.
Presented by Xinyu Chang
MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.
Mapping: Scaling Rotation Translation Warp
Structure from motion.
Active Calibration of Cameras: Theory and Implementation Anup Basu Sung Huh CPSC 643 Individual Presentation II March 4 th,
3D reconstruction class 11
Lecture 11: Structure from motion, part 2 CS6670: Computer Vision Noah Snavely.
Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Uncalibrated Geometry & Stratification Sastry and Yang
Image Enhancement in the Frequency Domain Part I Image Enhancement in the Frequency Domain Part I Dr. Samir H. Abdul-Jauwad Electrical Engineering Department.
CS485/685 Computer Vision Prof. George Bebis
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
3D reconstruction of cameras and structure x i = PX i x’ i = P’X i.
Lecture 11: Structure from motion CS6670: Computer Vision Noah Snavely.
Planar Matchmove Using Invariant Image Features Andrew Kaufman.
© 2003 by Davi GeigerComputer Vision October 2003 L1.1 Structure-from-EgoMotion (based on notes from David Jacobs, CS-Maryland) Determining the 3-D structure.
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Camera parameters Extrinisic parameters define location and orientation of camera reference frame with respect to world frame Intrinsic parameters define.
Stockman MSU/CSE Math models 3D to 2D Affine transformations in 3D; Projections 3D to 2D; Derivation of camera matrix form.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
3-D Scene u u’u’ Study the mathematical relations between corresponding image points. “Corresponding” means originated from the same 3D point. Objective.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
Automatic Camera Calibration
Lecture 11 Stereo Reconstruction I Lecture 11 Stereo Reconstruction I Mata kuliah: T Computer Vision Tahun: 2010.
1 Preview At least two views are required to access the depth of a scene point and in turn to reconstruct scene structure Multiple views can be obtained.
Local invariant features Cordelia Schmid INRIA, Grenoble.
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
IMAGE MOSAICING Summer School on Document Image Processing
Dynamic 3D Scene Analysis from a Moving Vehicle Young Ki Baik (CV Lab.) (Wed)
CSCE 643 Computer Vision: Structure from Motion
Geometric Camera Models
Phase Congruency Detects Corners and Edges Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Acquiring 3D models of objects via a robotic stereo head David Virasinghe Department of Computer Science University of Adelaide Supervisors: Mike Brooks.
Two-view geometry Epipolar geometry F-matrix comp. 3D reconstruction
© 2005 Martin Bujňák, Martin Bujňák Supervisor : RNDr.
HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication.
Local invariant features Cordelia Schmid INRIA, Grenoble.
A minimal solution to the autocalibration of radial distortion Young Ki Baik (CV Lab.) (Wed)
1 Camera calibration based on arbitrary parallelograms 授課教授:連震杰 學生:鄭光位.
A Flexible New Technique for Camera Calibration Zhengyou Zhang Sung Huh CSPS 643 Individual Presentation 1 February 25,
EECS 274 Computer Vision Affine Structure from Motion.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Feature Matching. Feature Space Outlier Rejection.
3D reconstruction from uncalibrated images
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
Computer vision: models, learning and inference M Ahad Multiple Cameras
776 Computer Vision Jan-Michael Frahm & Enrique Dunn Spring 2013.
Visual Odometry David Nister, CVPR 2004
Lecture 9 Feature Extraction and Motion Estimation Slides by: Michael Black Clark F. Olson Jean Ponce.
3D Reconstruction Using Image Sequence
MASKS © 2004 Invitation to 3D vision Uncalibrated Camera Chapter 6 Reconstruction from Two Uncalibrated Views Modified by L A Rønningen Oct 2008.
John Morris Stereo Vision (continued) Iolanthe returns to the Waitemata Harbour.
Digital Image Processing Additional Material : Imaging Geometry 11 September 2006 Digital Image Processing Additional Material : Imaging Geometry 11 September.
Media Processor Lab. Media Processor Lab. Trellis-based Parallel Stereo Matching Media Processor Lab. Sejong univ.
EECS 274 Computer Vision Projective Structure from Motion.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
René Vidal and Xiaodong Fan Center for Imaging Science
Epipolar geometry.
3D Photography: Epipolar geometry
Structure from motion Input: Output: (Tomasi and Kanade)
Uncalibrated Geometry & Stratification
Structure from motion Input: Output: (Tomasi and Kanade)
Project Presentation – Week 6
Presentation transcript:

Correspondence-Free Determination of the Affine Fundamental Matrix (Tue) Young Ki Baik, Computer Vision Lab.

2 Correspondence-Free Determination of the Affine fundamental Matrix References Correspondence-Free Determination of the Affine Fundamental Matrix Stefan Lehmann et. al. PAMI 2007 Radon-based Structure from Motion Without Correspondences Ameesh Makadia et. al. CVPR 2005 Robust Fundamental Matrix Determination without Correspondences Stefan Lehmann et. al. APRS 2005

3 Correspondence-Free Determination of the Affine fundamental Matrix Contents The conventional method of SfM Features of the proposed method Theory of the proposed algorithm Experimental results Discussion

4 Conventional SfM Image Sequence Feature Extraction/ Matching Relating Image Projective Reconstruction Auto-Calibration Dense Matching 3D Model Building Correspondence-Free Determination of the Affine fundamental Matrix

5 The Problem of conventional SfM The high sensitivity of fundamental matrix Noise and outlier correspondences in feature data severely affect the precision of the fundamental matrix Incomplete 3D reconstruction

6 Correspondence-Free Determination of the Affine fundamental Matrix The Key Feature Correspondence-free Finding Correspondence (X) Illumination changes-free (?) Intensity value (X) Position of features (O) Limitation Occlusion ? (X) Affine camera only!!

7 Correspondence-Free Determination of the Affine fundamental Matrix Parallel projection Orthographic projection

8 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Assumption We have 3-dimensional N features. The 3D feature space is represented by,

9 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Assumption Parallel projection model determines the 2D feature projections along the lines that are running parallel to the view axis (z-axis) of the camera. The model considers a continuous projection plane with infinite extent. The corresponding 2D projection data is…

10 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Fourier spectra The Fourier spectra of and can be denoted as

11 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model 2-view case The 3D correspondence feature point Relation between images The 3D frequency vector

12 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model 2-view case Relation between 3D spectrums The equation shows that rotation R also establishes the transformation between corresponding frequency indices in the 3D Fourier spaces of the original and the transformed spectrum or scene.

13 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Matching line The magnitudes of two spectra along these lines will be identical, while the phases will show a linear offset dependent upon the translational component of transformation. The proposed method is to detect these matching lines.

14 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Matching line angle pair Angle pair of the matching lines with respect to the axes of the frequency spectra F and F’, respectively.

15 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Analysis of the transformation parameters as the corresponding frequency locations along the matching lines of the spectrum F of the first and the spectrum F’ of the second set of 2D features, respectively. It follows that,

16 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Analysis of the transformation parameters

17 Correspondence-Free Determination of the Affine fundamental Matrix Mathematical Model Derivation of a 3D rotation matrix

18 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of the fundamental matrix By using 3D rotation matrix, we can obtain the relation between 2D projection point (x’,y’) of a 3D feature (x,y,z) with translation.

19 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of the fundamental matrix In the orthographic projection case, all epipolar lines are parallel. Then we can denote the epipolar line of 2D feature point (x,y) as

20 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of the fundamental matrix

21 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of the fundamental matrix

22 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of matching line angle For the practical purpose, corresponding discrete spectra should be defined as follows.

23 Correspondence-Free Determination of the Affine fundamental Matrix Estimation of matching line angle The final object function Discrete Fourier-Mellin transformation method To find out the matching line (According to the well known shift theorem of the FT, a shift in the space domain corresponds to a phase shift in the frequency domain.)

24 Correspondence-Free Determination of the Affine fundamental Matrix Overall flow

25 Correspondence-Free Determination of the Affine fundamental Matrix Experimental result test images : telephoto lens Feature points : Harris corner detection method Ideal epipolar lines are the horizontal lines. The proposed method shows us good result relative to conventional methods.

26 Camera Calibration Methods for Wide Angle view Discussion Key feature Correspondence-free method for obtaining the fundamental matrix is presented. Matching line exists between the Fourier transformed data. Limitation Proposed method Considers only affine projection model Does not treat occlusion problem Future work Applying projective projection model