Projective 2D & 3D geometry course 2

Slides:



Advertisements
Similar presentations
Epipolar Geometry.
Advertisements

More on single-view geometry
Invariants (continued).
1 A camera is modeled as a map from a space pt (X,Y,Z) to a pixel (u,v) by ‘homogeneous coordinates’ have been used to ‘treat’ translations ‘multiplicatively’
3D reconstruction.
Computer Graphics Lecture 4 Geometry & Transformations.
Primitives Behaviour at infinity HZ 2.2 Projective DLT alg Invariants
Recovery of affine and metric properties from images in 2D Projective space Ko Dae-Won.
Projective Geometry- 3D
Recovering metric and affine properties from images
Camera Models A camera is a mapping between the 3D world and a 2D image The principal camera of interest is central projection.
Structure from motion.
Recovering metric and affine properties from images
Multiple View Geometry Projective Geometry & Transformations of 2D Vladimir Nedović Intelligent Systems Lab Amsterdam (ISLA) Informatics Institute,
1 Basic geometric concepts to understand Affine, Euclidean geometries (inhomogeneous coordinates) projective geometry (homogeneous coordinates) plane at.
The 2D Projective Plane Points and Lines.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Geometry of Images Pinhole camera, projection A taste of projective geometry Two view geometry:  Homography  Epipolar geometry, the essential matrix.
Projective 2D geometry (cont’) course 3
Projective geometry- 2D Acknowledgements Marc Pollefeys: for allowing the use of his excellent slides on this topic
Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Uncalibrated Geometry & Stratification Sastry and Yang
CS485/685 Computer Vision Prof. George Bebis
Projective geometry Slides from Steve Seitz and Daniel DeMenthon
CSCE 590E Spring 2007 Basic Math By Jijun Tang. Applied Trigonometry Trigonometric functions  Defined using right triangle  x y h.
Multiple View Geometry
Projective 2D geometry Appunti basati sulla parte iniziale del testo
Projective 3D geometry. Singular Value Decomposition.
Homogeneous coordinates
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
3D photography Marc Pollefeys Fall 2007
Projective Geometry and Camera model Class 2
The Image Formation Pipeline
3D photography Marc Pollefeys Fall 2004 / Comp Tue & Thu 9:30-10:45
Projective 2D geometry course 2 Multiple View Geometry Comp Marc Pollefeys.
Structure Computation. How to compute the position of a point in 3- space given its image in two views and the camera matrices of those two views Use.
Project Geometry Jiecai He (Jake)
Projective 2D geometry course 2 Multiple View Geometry Comp Marc Pollefeys.
Projective Geometry and Camera Models
Projective Geometry and Geometric Invariance in Computer Vision Babak N. Araabi Electrical and Computer Eng. Dept. University of Tehran Workshop on image.
Robot Vision SS 2008 Matthias Rüther 1 ROBOT VISION Lesson 2: Projective Geometry Matthias Rüther Slides courtesy of Marc Pollefeys Department of Computer.
Transformations Dr. Amy Zhang.
Homogeneous Coordinates (Projective Space) Let be a point in Euclidean space Change to homogeneous coordinates: Defined up to scale: Can go back to non-homogeneous.
Pole/polar consider projective geometry again we may want to compute the tangents of a curve that pass through a point (e.g., visibility) let C be a conic.
Projective Geometry. Projection Vanishing lines m and n.
Projective geometry ECE 847: Digital Image Processing Stan Birchfield Clemson University.
Objects at infinity used in calibration
Geometric Camera Models
Single View Geometry Course web page: vision.cis.udel.edu/cv April 9, 2003  Lecture 20.
Two-view geometry Epipolar geometry F-matrix comp. 3D reconstruction
Computer Vision cmput 499/615
Multi-linear Systems and Invariant Theory in the Context of Computer Vision and Graphics CS329 Amnon Shashua.
Two-Dimensional Geometric Transformations ch5. 참조 Subjects : Basic Transformations Homogeneous Coordinates Composite Transformations Other Transformations.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Geometric Transformations
Projective Geometry Hu Zhan Yi. Entities At Infinity The ordinary space in which we lie is Euclidean space. The parallel lines usually do not intersect.
Computer vision: models, learning and inference M Ahad Multiple Cameras
1 Overview Introduction to projective geometry 1 view geometry (calibration, …) 2-view geometry (stereo, motion, …) 3- and N-view geometry Autocalibration.
Projective 2D geometry (cont’) course 3 Multiple View Geometry Modified from Marc Pollefeys’s slides.
Projective 2D geometry course 2 Multiple View Geometry Comp Marc Pollefeys.
Projective geometry ECE 847: Digital Image Processing Stan Birchfield Clemson University.
3. Transformation
Lecture 3 Jitendra Malik
Projective geometry ECE 847: Digital Image Processing Stan Birchfield
Homogeneous Coordinates (Projective Space)
Epipolar geometry.
CS Visual Recognition Projective Geometry Projective Geometry is a mathematical framework describing image formation by perspective camera. Under.
Geometric Camera Models
3D reconstruction class 11
Presentation transcript:

Projective 2D & 3D geometry course 2

The projective plane Why do we need homogeneous coordinates? represent points at infinity, homographies, perspective projection, multi-view relationships What is the geometric intuition? a point in the image is a ray in projective space image plane (x,y,1) -y (sx,sy,s) (0,0,0) x -z Each point (x,y) on the plane is represented by a ray (sx,sy,s) all points on the ray are equivalent: (x, y, 1)  (sx, sy, s)

Perspective projection camera world f y z y’ Cartesian coordinates: We have, by similar triangles, that (x, y, z) -> (f x/z, f y/z, -f) Ignore the third coordinate, and get

Projective 2D Geometry Points, lines & conics Transformations & invariants 1D projective geometry and the Cross-ratio

Homogeneous coordinates Homogeneous representation of lines equivalence class of vectors, any vector is representative Set of all equivalence classes in R3(0,0,0)T forms P2 Homogeneous representation of points on if and only if The point x lies on the line l if and only if xTl=lTx=0 Homogeneous coordinates Inhomogeneous coordinates but only 2DOF

Points from lines and vice-versa Intersections of lines The intersection of two lines and is Line joining two points The line through two points and is Example

Ideal points and the line at infinity Intersections of parallel lines Example tangent vector normal direction Ideal points Their inner product is zero Line at infinity Note that in P2 there is no distinction between ideal points and others In projective plane, two distinct lines meet in a single point and Two distinct points lie on a single line  not true in R^2

A model for the projective plane Points in P^2 are represented by rays passing through origin in R^3. Lines in P^2 are represented by planes passing through origin Points and lines obtained by intersecting rays and planes by plane x3 = 1 Lines lying in the x1 – x2 plane are ideal points; x1-x2 plane is l_{infinity}

Duality Roles of points and lines can be interchanged Duality principle: To any theorem of 2-dimensional projective geometry there corresponds a dual theorem, which may be derived by interchanging the role of points and lines in the original theorem

Conics Curve described by 2nd-degree equation in the plane or homogenized or in matrix form with 5DOF:

Five points define a conic For each point the conic passes through or stacking constraints yields

Tangent lines to conics The line l tangent to C at point x on C is given by l=Cx l x C

Dual conics Conic C, also called, “point conic” defines an equation on points Apply duality: dual conic or line conic defines an equation on lines A line tangent to the conic C satisfies C* is the adjoint of Matrix C; defined in Appendix 4 of H&Z For nonsingular symmetric matrix, : Dual conics = line conics = conic envelopes Points lie on a point lines are tangent conic to the point conic C; conic C is the envelope of lines l

Degenerate conics A conic is degenerate if matrix C is not of full rank e.g. two lines (rank 2) e.g. repeated line (rank 1) Degenerate line conics: 2 points (rank 2), double point (rank1) Note that for degenerate conics

Projective transformations Definition: A projectivity is an invertible mapping h from P2 to itself such that three points x1,x2,x3 lie on the same line if and only if h(x1),h(x2),h(x3) do. ( i.e. maps lines to lines in P2) A mapping h:P2P2 is a projectivity if and only if there exist a non-singular 3x3 matrix H such that for any point in P2 reprented by a vector x it is true that h(x)=Hx Theorem: Definition: Projective transformation: linear transformation on homogeneous 3 vectors represented by a non singular matrix H or 8DOF projectivity=collineation=projective transformation=homography Projectivity form a group: inverse of projectivity is also a projectivity; so is a composition of two projectivities.

(application of theorem) Projection along rays through a common point, (center of projection) defines a mapping from one plane to another Central projection maps points on one plane to points on another plane Projection also maps lines to lines : consider a plane through projection center that intersects the two planes  lines mapped onto lines  Central projection is a projectivity  central projection may be expressed by x’=Hx (application of theorem)

Removing projective distortion Central projection image of a plane is related to the originial plane via a projective transformation  undo it by applying the inverse transformation Let (x,y) and (x’,y’) be inhomogeneous Coordinates of a pair of matching points x and x’ in world and image plane select four points in a plane with known coordinates (linear in hij) (2 constraints/point, 8DOF  4 points needed) Remark: no calibration at all necessary, better ways to compute (see later) Sections of the image of the ground are subject to another projective distortion  need another projective transformation to correct that.

More examples Proj. trans. Between the image of a plane Projective transformation between two images Induced by a world plane  concatenation of two Pojective transformations is also a proj. trans. Proj. trans. Between the image of a plane (end of the building) and the image of its Shadow onto another plane (ground plane) Proj. trans. Between two images with the same camera center e.g. a camera rotating about its center

Transformation of lines and conics For points on a line l, the transformed points under proj. trans. also lie on a line; if point x is on line l, then transforming x, transforms l For a point transformation Transformation for lines Transformation for conics Transformation for dual conics

A hierarchy of transformations Group of invertible nxn matrices with real elements  general linear group on n dimensions GL(n); Projective linear group: matrices related by a scalar multiplier PL(n); three subgroups: Affine group (last row (0,0,1)) Euclidean group (upper left 2x2 orthogonal) Oriented Euclidean group (upper left 2x2 det 1) Alternative, characterize transformation in terms of elements or quantities that are preserved or invariant e.g. Euclidean transformations (rotation and translation) leave distances unchanged Similarity Affine projective Similarity: circle imaged as circle; square as square; parallel or perpendicular lines have same relative orientation Affine: circle becomes ellipse; orthogonal world lines not imaged as orthogonoal; But, parallel lines in the square remain parallel Projective: parallel world lines imaged as converging lines; tiles closer to camera larger image than those further away.

Class I: Isometries: preserve Euclidean distance (iso=same, metric=measure) orientation preserving:  Euclidean transf. i.e. composition of translation and rotation  forms a group orientation reversing:  reflection  does not form a group R is 2x2 rotation matrix; (orthogonal, t is translation 2-vector, 0 is a null 2-vector 3DOF (1 rotation, 2 translation)  trans. Computed from two point correspondences special cases: pure rotation, pure translation Invariants: length (distance between 2 pts) , angle between 2 lines, area

Class II: Similarities: isometry composed with an isotropic scaling (isometry + scale) 4DOF (1 scale, 1 rotation, 2 translation)  2 point correspondences Scalar s: isotropic scaling also known as equi-form (shape preserving) metric structure = structure up to similarity (in literature) Invariants: ratios of length, angle, ratios of areas, parallel lines Metric Structure means structure is defined up to a similarity

Class III: Affine transformations: non singular linear transformation followed by a translation Rotation by theta R(-phi) D R(phi) scaling directions in the deformation are orthogonal Can show: Rotation by phi, scale by D, rotation by – phi, rotation by theta 6DOF (2 scale, 2 rotation, 2 translation) 3 point correspondences non-isotropic scaling! Invariants: parallel lines, ratios of parallel lengths, ratios of areas Affinity is orientation preserving if det (A) is positive  depends on the sign of the scaling

Class IV: Projective transformations: general non singular linear transformation of homogenous coordinates Hp has nine elements; only their ratio significant  8 Dof  4 correspondences Not always possible to scale the matrix to make v unity: might be zero Action non-homogeneous over the plane Invariants: cross-ratio of four points on a line (ratio of ratio of length)

Action of affinities and projectivities on line at infinity Affine Line at infinity stays at infinity, but points move along line Proj. trans. Line at infinity becomes finite, allows to observe/model vanishing points, horizon,

Decomposition of projective transformations Decomposition valid if v not zero, and unique (if chosen s>0) Useful for partial recovery of a transformation upper-triangular, Example:

Number of invariants? The number of functional invariants is equal to, or greater than, the number of degrees of freedom of the configuration less the number of degrees of freedom of the transformation e.g. configuration of 4 points in general position has 8 dof (2/pt) and so 4 similarity, 2 affinity and zero projective invariants

Overview transformations Concurrency, collinearity, order of contact (intersection, tangency, inflection, etc.), cross ratio Projective 8dof Parallellism, ratio of areas, ratio of lengths on parallel lines (e.g midpoints), linear combinations of vectors (centroids). The line at infinity l∞ Affine 6dof Ratios of lengths, angles. The circular points I,J Similarity 4dof Euclidean 3dof lengths, areas.

Projective geometry of 1D: P1 Homogeneous coordinates of point x on line Ideal point of a line Projective transformation of a line: 3DOF (2x2-1)  three corresponding points The cross ratio Is invariant under projective transformations in P^1. Four sets of four collinear points; each set is related to the others by a line projectivity Since cross ratio is an invariant under projectivity, the cross ratio has the same value for all the sets shown

Concurrent Lines Four concurrent lines l_i intersect the line l in the four points x_i; The cross ratio of these points is an invariant to the projective transformation of the plane Coplanar points x_i are imaged onto a line by a projection with center C. The cross ratio of the image points x_i is invariant to the position of the image line l