Geometric Camera Models

Slides:



Advertisements
Similar presentations
C280, Computer Vision Prof. Trevor Darrell Lecture 2: Image Formation.
Advertisements

Single-view geometry Odilon Redon, Cyclops, 1914.
Computer Vision, Robert Pless
Invariants (continued).
Computer vision: models, learning and inference
Camera Calibration. Issues: what are intrinsic parameters of the camera? what is the camera matrix? (intrinsic+extrinsic) General strategy: view calibration.
Camera calibration and epipolar geometry
Camera Models A camera is a mapping between the 3D world and a 2D image The principal camera of interest is central projection.
1 Basic geometric concepts to understand Affine, Euclidean geometries (inhomogeneous coordinates) projective geometry (homogeneous coordinates) plane at.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Announcements. Projection Today’s Readings Nalwa 2.1.
Used slides/content with permission from
Lecture 5: Projection CS6670: Computer Vision Noah Snavely.
Uncalibrated Geometry & Stratification Sastry and Yang
CS485/685 Computer Vision Prof. George Bebis
3-D Geometry.
Many slides and illustrations from J. Ponce
Camera model Relation between pixels and rays in space ?
Announcements Mailing list Project 1 test the turnin procedure *this week* (make sure it works) vote on best artifacts in next week’s class Project 2 groups.
Computer Vision : CISC4/689
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Calibration Dorit Moshe.
Lecture 13: Projection, Part 2
Lecture 6: Image Warping and Projection CS6670: Computer Vision Noah Snavely.
Single-view geometry Odilon Redon, Cyclops, 1914.
The Pinhole Camera Model
Panoramas and Calibration : Rendering and Image Processing Alexei Efros …with a lot of slides stolen from Steve Seitz and Rick Szeliski.
The Image Formation Pipeline
CS223b, Jana Kosecka Rigid Body Motion and Image Formation.
CS4670 / 5670: Computer Vision KavitaBala Lecture 15: Projection “The School of Athens,” Raphael.
Cameras, lenses, and calibration
Image formation & Geometrical Transforms Francisco Gómez J MMS U. Central y UJTL.
Instance-level recognition I. - Camera geometry and image alignment Josef Sivic INRIA, WILLOW, ENS/INRIA/CNRS UMR 8548 Laboratoire.
776 Computer Vision Jan-Michael Frahm, Enrique Dunn Spring 2013.
Lecture 14: Projection CS4670 / 5670: Computer Vision Noah Snavely “The School of Athens,” Raphael.
Euclidean cameras and strong (Euclidean) calibration Intrinsic and extrinsic parameters Linear least-squares methods Linear calibration Degenerate point.
Camera Geometry and Calibration Thanks to Martial Hebert.
Epipolar geometry The fundamental matrix and the tensor
Projective cameras Motivation Elements of Projective Geometry Projective structure from motion Planches : –
Homogeneous Coordinates (Projective Space) Let be a point in Euclidean space Change to homogeneous coordinates: Defined up to scale: Can go back to non-homogeneous.
Geometric Camera Models and Camera Calibration
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
Geometric Models & Camera Calibration
CSE 681 Review: Transformations. CSE 681 Transformations Modeling transformations build complex models by positioning (transforming) simple components.
Vision Review: Image Formation Course web page: September 10, 2002.
Lecture 03 15/11/2011 Shai Avidan הבהרה : החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
Affine Structure from Motion
Single-view geometry Odilon Redon, Cyclops, 1914.
A Flexible New Technique for Camera Calibration Zhengyou Zhang Sung Huh CSPS 643 Individual Presentation 1 February 25,
EECS 274 Computer Vision Geometric Camera Calibration.
EECS 274 Computer Vision Affine Structure from Motion.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Reconnaissance d’objets et vision artificielle Jean Ponce Equipe-projet WILLOW ENS/INRIA/CNRS UMR 8548 Laboratoire.
Computer vision: models, learning and inference M Ahad Multiple Cameras
Single-view geometry Odilon Redon, Cyclops, 1914.
Robotics Chapter 6 – Machine Vision Dr. Amit Goradia.
Lecture 14: Projection CS4670 / 5670: Computer Vision Noah Snavely “The School of Athens,” Raphael.
Lecture 18: Cameras CS4670 / 5670: Computer Vision KavitaBala Source: S. Lazebnik.
Image Warping 2D Geometric Transformations
CSE 185 Introduction to Computer Vision
CS682, Jana Kosecka Rigid Body Motion and Image Formation Jana Kosecka
Nazar Khan PUCIT Lecture 19
CS5670: Computer Vision Lecture 9: Cameras Noah Snavely
Homogeneous Coordinates (Projective Space)
GEOMETRIC CAMERA MODELS
Geometric Camera Models
Lecturer: Dr. A.H. Abdul Hafez
Announcements Midterm out today Project 1 demos.
Single-view geometry Odilon Redon, Cyclops, 1914.
The Pinhole Camera Model
Presentation transcript:

Geometric Camera Models EECS 274 Computer Vision Geometric Camera Models

Geometric Camera Models Elements of Euclidean geometry Intrinsic camera parameters Extrinsic camera parameters General form of perspective projection Reading: Chapter 1 of FP, Chapter 2 of S

Geometric camera calibration Euclidean Geometry

Euclidean coordinate system

Planes homogenous coordinate

Pure translation OBP = OBOA + OAP , BP = BOA+ AP AP: point P in frame A

Pure rotation 1st column: iA in the basis of (iB, jB, kB) 3rd row: kB in the basis of (iA, jA, kA)

Rotation about z axis

Rotation matrix Elementary rotation R=R x R y R z , described by three angles

Properties of rotation matrix Its inverse is equal to its transpose, R-1=RT , and Its determinant is equal to 1. Or equivalently: Its rows (or columns) form a right-handed orthonormal coordinate system.

Rotation group and SO(3) Rotation group: the set of rotation matrices, with matrix product Closure, associativity, identity, invertibility SO(3): the rotation group in Euclidean space R3 whose determinant is 1 Preserve length of vectors Preserve angles between two vectors Preserve orientation of space

Pure rotations

Rigid transformation

Block matrix manipulation What is AB ? Homogeneous Representation of Rigid Transformations

Rigid transformations as mappings

Rotation about the k Axis

Affine transformation Images are subject to geometric distortion introduced by perspective projection Alter the apparent dimensions of the scene geometry

Affine transformation In Euclidean space, preserve Collinearity relation between points 3 points lie on a line continue to be collinear Ratio of distance along a line |p2-p1|/|p3-p2| is preserved

Shear matrix Horizontal shear Vertical shear

2D planar transformations See Szeliski Chapter 2  

2D planar transformations  

2D planar transformations

3D transformation

Idealized coordinate system

Camera parameters Intrinsic: relate camera’s coordinate system to the idealized coordinated system Extrinsic: relate the camera’s coordinate system to a fix world coordinate system Ignore the lens and nonlinear aberrations for the moment

Intrinsic camera parameters Units: k,l : pixel/m f : m (See EXIF tags) a,b: pixel Physical Image Coordinates (f ≠1) Normalized Image Coordinates Scale parameters: k, l (image sensor may not be square) Offset: u0, v0 Manufacturing error: θ

Intrinsic camera parameters Calibration matrix κ The perspective projection Equation

In reality Physical size of pixel and skew are always fixed for a given camera, and in principal known during manufacturing Some parameters often available in EXIF tag Focal length may vary for zoom lenses when optical axis is not perpendicular to image plane Change focus affects the magnification factor From now on, assume camera is focused at infinity

Extrinsic camera parameters

Explicit form of projection Matrix denotes the i-th row of R, tx, ty, tz, are the coordinates of t can be written in terms of the corresponding angles R can be written as a product of three elementary rotations, and described by three angles M is 3 × 4 matrix with 11 parameters 5 intrinsic parameters: α, β, u0, v0, θ 6 extrinsic parameters: 3 angles defining R and 3 for t

Explicit form of projection Matrix : i-th row of R Note: M is only defined up to scale in this setting!!

Theorem (Faugeras, 1993)

Camera parameters A camera is described by several parameters Translation T of the optical center from the origin of world coords Rotation R of the image plane focal length f, principle point (x’c, y’c), pixel size (sx, sy) blue parameters are called “extrinsics,” red are “intrinsics” Projection equation The projection matrix models the cumulative effect of all parameters Useful to decompose into a series of operations projection intrinsics rotation translation identity matrix Definitions are not completely standardized especially intrinsics—varies from one book to another

Camera calibration toolbox Matlab toolbox by Jean-Yves Bouguet http://www.vision.caltech.edu/bouguetj/calib_doc/ Extract corner points from checkerboard