The Perspective View of 3 Points

Slides:



Advertisements
Similar presentations
Zhengyou Zhang Vision Technology Group Microsoft Research
Advertisements

3D reconstruction.
Computer vision: models, learning and inference
1 pb.  camera model  calibration  separation (int/ext)  pose Don’t get lost! What are we doing? Projective geometry Numerical tools Uncalibrated cameras.
The Perspective View of 3 Points bill wolfe CSUCI.
Chapter 6 Feature-based alignment Advanced Computer Vision.
3D M otion D etermination U sing µ IMU A nd V isual T racking 14 May 2010 Centre for Micro and Nano Systems The Chinese University of Hong Kong Supervised.
Jan-Michael Frahm, Enrique Dunn Spring 2012
Multi-model Estimation with J-linkage Jeongkyun Lee.
Camera Calibration. Issues: what are intrinsic parameters of the camera? what is the camera matrix? (intrinsic+extrinsic) General strategy: view calibration.
Fisheye Camera Calibration Arunkumar Byravan & Shai Revzen University of Pennsylvania.
Camera calibration and epipolar geometry
Structure from motion.
Accurate Non-Iterative O( n ) Solution to the P n P Problem CVLab - Ecole Polytechnique Fédérale de Lausanne Francesc Moreno-Noguer Vincent Lepetit Pascal.
Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Uncalibrated Geometry & Stratification Sastry and Yang
Epipolar Geometry and the Fundamental Matrix F
Multiple-view Reconstruction from Points and Lines
3D reconstruction of cameras and structure x i = PX i x’ i = P’X i.
Many slides and illustrations from J. Ponce
COMP322/S2000/L221 Relationship between part, camera, and robot (cont’d) the inverse perspective transformation which is dependent on the focal length.
Calibration Dorit Moshe.
Object Recognition Using Geometric Hashing
Sebastian Thrun and Jana Kosecha CS223B Computer Vision, Winter 2007 Stanford CS223B Computer Vision, Winter 2007 Lecture 4 Camera Calibration Professors.
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Single-view geometry Odilon Redon, Cyclops, 1914.
Camera Calibration CS485/685 Computer Vision Prof. Bebis.
Advanced Computer Vision Structure from Motion. Geometric structure-from-motion problem: using image matches to estimate: The 3D positions of the corresponding.
Random Sample Consensus: A Paradigm for Model Fitting with Application to Image Analysis and Automated Cartography Martin A. Fischler, Robert C. Bolles.
Fitting.
Multi-view geometry. Multi-view geometry problems Structure: Given projections of the same 3D point in two or more images, compute the 3D coordinates.
776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2013.
Chapter 6 Feature-based alignment Advanced Computer Vision.
Introduction à la vision artificielle III Jean Ponce
Advanced Computer Vision Feature-based Alignment Lecturer: Lu Yi & Prof. Fuh CSIE NTU.
© 2005 Yusuf Akgul Gebze Institute of Technology Department of Computer Engineering Computer Vision Geometric Camera Calibration.
Computer Vision : CISC 4/689 Going Back a little Cameras.ppt.
Computer Vision Lecture #10 Hossam Abdelmunim 1 & Aly A. Farag 2 1 Computer & Systems Engineering Department, Ain Shams University, Cairo, Egypt 2 Electerical.
Single-view geometry Odilon Redon, Cyclops, 1914.
Source: Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on Author: Paucher, R.; Turk, M.; Adviser: Chia-Nian.
A Flexible New Technique for Camera Calibration Zhengyou Zhang Sung Huh CSPS 643 Individual Presentation 1 February 25,
EECS 274 Computer Vision Geometric Camera Calibration.
EECS 274 Computer Vision Affine Structure from Motion.
Single-view geometry Odilon Redon, Cyclops, 1914.
EECS 274 Computer Vision Projective Structure from Motion.
Calibrating a single camera
Geometric Camera Calibration
Computer vision: models, learning and inference
렌즈왜곡 관련 논문 - 기반 논문: R.Y. Tsai, An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision. Proceedings of IEEE Conference on Computer.
Robot & Vision Lab. Wanjoo Park (revised by Dong-eun Seo)
Epipolar geometry.
3D Photography: Epipolar geometry
Interval Estimation.
Fitting.
Estimating 2-view relationships
Advanced Computer Vision
Multiple View Geometry for Robotics
Uncalibrated Geometry & Stratification
Linear Algebra Lecture 3.
Fitting CS 678 Spring 2018.
Single-view geometry Odilon Redon, Cyclops, 1914.
Computational Photography
Camera Calibration from Planar Patterns
Calibration and homographies
Back to equations of geometric transformations
Image Stitching Linda Shapiro ECE/CSE 576.
Image Stitching Linda Shapiro ECE P 596.
Presentation transcript:

The Perspective View of 3 Points bill wolfe CSUCI

Fischler and Bolles 1981 “Random Sample Consensus” Communications of the ACM, Vol. 24, Number 6, June, 1981 Cartography application Interpretation of sensed data Pre-defined models and Landmarks Noisy measurements Averaging/smoothing does not always work Inaccurate feature extraction Gross errors vs. Random Noise

Example (Fischler and Bolles) RANDSAC Poison Point Least Squares

Location Determination Problem image position and orientation of camera in world frame camera world landmarks Location Determination Problem

Location Determination Problem Variations: Pose estimation Inverse perspective Camera Calibration Location Determination Triangulation

Applications Computer Vision Robotics Cartography Computer Graphics Photogrammetry

Assumptions Intrinsic camera parameters are known. Location of landmarks in world frame are known. Correspondences between landmarks and their images are known. Single camera view. Passive sensing.

Strategy camera measured/calculated world landmarks known

How Many Points are Enough? 1 Point: infinitely many solutions. 2 Points: infinitely many solutions, but bounded. 3 Points: (no 3 colinear) finitely many solutions (up to 4). 4 Points: non coplanar (no 3 colinear): finitely many. coplanar (no 3 colinear): unique solution! 5 Points: can be ambiguous. 6 Points: unique solutions (“general view”).

1 Point

2 Points A CP B

Inscribed Angles are Equal http://www. ies. co CP CP q CP q q A B

3 Points s1 s2 s3 LA A B C LB LC

Bezout’s Theorem Number of solutions limited by the product of the degrees of the equations: 2x2x2 = 8. But, since each term in the equations is of degree 2, each solution L1, L2, L3 generates another solution by taking the negative values -L1, -L2, -L3. Therefore, there can be at most 4 physically realizable solutions.

Algebraic Approach reduce to 4th order equation (Fischler and Bolles, 1981) http://planetmath.org/encyclopedia/QuarticFormula.html

Iterative Approach s3 s2 s1 slide

Iterative Projections http://faculty.csuci.edu/william.wolfe/csuci/articles/TNN_Perspective_View_3_pts.pdf

Geometric Approach CP

The Orthocenter of a Triangle http://www.mathopenref.com/triangleorthocenter.html

4 solutions when CP is directly over the orthocenter

The Danger Cylinder CP Why is the Danger Cylinder Dangerous in the P3P Problem? C. Zhang, Z. Hu, Acta Automatiica Sinica, Vol. 32, No. 4, July, 2006.

“A General Sufficient Condition of Four Positive Solutions of the P3p Problem” C. Zhang, Z. Hu, 2005

“Complete Solution Classification for the Perspective-Three-Point Problem” X. Gao, X. Hou, J. Tang, H. Cheng IEEE Trans PAMI Vol. 25, NO. 8, August 2003

4 Coplanar Points (no 3 colinear) “Passive Ranging to Known Planar Point Sets” Y. Hung, P. Yeh, D. Harwood IEEE Int’l Conf Robotics and Automation, 1985. Camera CP Q0 Q1 Q3 Q2 Object P0 P1 P3 P2 W L

P0_Cam = k0*Q0_Cam P0_Obj = <0,0,0> P1_Cam = k1*Q1_Cam P1_Obj = <L,0,0> P2_Obj = <0,W,0> P3_Obj = <L,W,0> Camera CP Q0 Q1 Q3 Q2 Object P0 P1 P3 P2 k0*Q0_Cam = P0_Cam W L

(P1_Cam - P0_Cam) + (P2_Cam - P0_Cam) = (P3_Cam - P0_Cam) Camera Object P2_Cam P3_Cam CP P0_Cam P1_Cam

(P1_Cam - P0_Cam) + (P2_Cam - P0_Cam) = (P3_Cam - P0_Cam) P0_Cam = k0*Q0_Cam P1_Cam = k1*Q1_Cam P2_Cam = k2*Q2_Cam P3_Cam = k3*Q3_Cam (P1_Cam - P0_Cam) + (P2_Cam - P0_Cam) = (P3_Cam - P0_Cam) (k1*Q1_Cam - k0*Q0_Cam) + (k2*Q2_Cam - k0*Q_Cam) = (k3*Q3_Cam - k0*Q0_Cam) (k1*Q1_Cam) + (k2*Q2_Cam - k0*Q_Cam) = (k3*Q3_Cam) let ki’ = ki/k3 (k1’*Q1_Cam) + (k2’*Q2_Cam - k0’*Q0_Cam) = Q3_Cam k0’*Q0_Cam + k1’*Q1_Cam + k2’*Q2_Cam = Q3_Cam Three linear equations in the 3 unknowns: k0’, k1’, k2’

Camera Object P0 P1 P3 P2 CP W L | P3_Obj - P0_Obj | = |P3_Cam - P0_Cam| = | k3*Q3_Cam - k0*Q0_Cam | k3 = | P3_Obj| / | k0’ * Q0_Cam - Q3_Cam |

Orientation Unit_x = (P1_Cam - P0_Cam)/ | P1_Cam - P0_Cam | Unit_y = (P2_Cam - P0_Cam) / |P2_Cam - P0_Cam| Unit_z = Unit_x X Unit_y

Homgeneous Transformation Unit_x Unit_y Unit_x P0_Cam 1 H =

Summary Reviewed location determination problems with 1, 2, 3, 4 points. Algebraic vs. Geometric vs. Iterative methods. 3 points can have up to 4 solutions. Iterative solution method for 3 points. 4 coplanar points has unique solution. Complete solution for 4 rectangular points. Many unsolved geometric issues.

References Random Sample Consensus, Martin Fischler and Robert Bolles, Communications of the ACM, Vol. 24, Number 6, June, 1981 Passive Ranging to Known Planar Point Sets, Y. Hung, P. Yeh, D. Harwood, IEEE Int’l Conf Robotics and Automation, 1985. The Perspective View of 3 Points, W. Wolfe, D. Mathis, C. Sklair, M. Magee. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 13, No. 1, January 1991. Review and Analysis of Solutions of the Three Point Perspective Pose Estimation Problem. R. Haralick, C. Lee, K. Ottenberg, M. Nolle. Int’l Journal of Computer Vision, 13, 3, 331-356, 1994. Complete Solution Classification for the Perspective-Three-Point Problem, X. Gao, X. Hou, J. Tang, H. Cheng, IEEE Trans PAMI Vol. 25, NO. 8, August 2003. A General Sufficient Condition of Four Positive Solutions of the P3P Problem, C. Zhang, Z. Hu, J. Comput. Sci. & Technol., Vol. 20, N0. 6, pp. 836-842, 2005. Why is the Danger Cylinder Dangerous in the P3P Problem? C. Zhang, Z. Hu, Acta Automatiica Sinica, Vol. 32, No. 4, July, 2006.