Geometric Camera Models

Slides:



Advertisements
Similar presentations
C280, Computer Vision Prof. Trevor Darrell Lecture 2: Image Formation.
Advertisements

Computer Vision, Robert Pless
Invariants (continued).
Primitives Behaviour at infinity HZ 2.2 Projective DLT alg Invariants
Computer vision: models, learning and inference
Camera Calibration. Issues: what are intrinsic parameters of the camera? what is the camera matrix? (intrinsic+extrinsic) General strategy: view calibration.
Camera calibration and epipolar geometry
Camera Models A camera is a mapping between the 3D world and a 2D image The principal camera of interest is central projection.
Structure from motion.
1 Basic geometric concepts to understand Affine, Euclidean geometries (inhomogeneous coordinates) projective geometry (homogeneous coordinates) plane at.
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Announcements. Projection Today’s Readings Nalwa 2.1.
Lecture 5: Projection CS6670: Computer Vision Noah Snavely.
Uncalibrated Geometry & Stratification Sastry and Yang
CS485/685 Computer Vision Prof. George Bebis
Many slides and illustrations from J. Ponce
Camera model Relation between pixels and rays in space ?
Announcements Mailing list Project 1 test the turnin procedure *this week* (make sure it works) vote on best artifacts in next week’s class Project 2 groups.
Computer Vision : CISC4/689
Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.
Calibration Dorit Moshe.
Lecture 13: Projection, Part 2
Lecture 6: Image Warping and Projection CS6670: Computer Vision Noah Snavely.
The Pinhole Camera Model
The Image Formation Pipeline
CS223b, Jana Kosecka Rigid Body Motion and Image Formation.
CS4670 / 5670: Computer Vision KavitaBala Lecture 15: Projection “The School of Athens,” Raphael.
Cameras, lenses, and calibration
Lecture 14: Projection CS4670 / 5670: Computer Vision Noah Snavely “The School of Athens,” Raphael.
Camera Geometry and Calibration Thanks to Martial Hebert.
Transformations Dr. Amy Zhang.
Epipolar geometry The fundamental matrix and the tensor
Homogeneous Coordinates (Projective Space) Let be a point in Euclidean space Change to homogeneous coordinates: Defined up to scale: Can go back to non-homogeneous.
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
Geometric Models & Camera Calibration
CSE 681 Review: Transformations. CSE 681 Transformations Modeling transformations build complex models by positioning (transforming) simple components.
Geometric Camera Models
Vision Review: Image Formation Course web page: September 10, 2002.
Lecture 03 15/11/2011 Shai Avidan הבהרה : החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.
Affine Structure from Motion
Single-view geometry Odilon Redon, Cyclops, 1914.
A Flexible New Technique for Camera Calibration Zhengyou Zhang Sung Huh CSPS 643 Individual Presentation 1 February 25,
EECS 274 Computer Vision Affine Structure from Motion.
1 Chapter 2: Geometric Camera Models Objective: Formulate the geometrical relationships between image and scene measurements Scene: a 3-D function, g(x,y,z)
Reconnaissance d’objets et vision artificielle Jean Ponce Equipe-projet WILLOW ENS/INRIA/CNRS UMR 8548 Laboratoire.
Computer vision: models, learning and inference M Ahad Multiple Cameras
Uncalibrated reconstruction Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration.
CS559: Computer Graphics Lecture 9: 3D Transformation and Projection Li Zhang Spring 2010 Most slides borrowed from Yungyu ChuangYungyu Chuang.
Robotics Chapter 6 – Machine Vision Dr. Amit Goradia.
Lecture 14: Projection CS4670 / 5670: Computer Vision Noah Snavely “The School of Athens,” Raphael.
Lecture 18: Cameras CS4670 / 5670: Computer Vision KavitaBala Source: S. Lazebnik.
Image Warping 2D Geometric Transformations
Modeling Transformation
CS682, Jana Kosecka Rigid Body Motion and Image Formation Jana Kosecka
Nazar Khan PUCIT Lecture 19
CS5670: Computer Vision Lecture 9: Cameras Noah Snavely
3. Transformation
Review: Transformations
Review: Transformations
Homogeneous Coordinates (Projective Space)
CS Visual Recognition Projective Geometry Projective Geometry is a mathematical framework describing image formation by perspective camera. Under.
ECE 383/ME 442: Intro to Robotics and Automation
GEOMETRIC CAMERA MODELS
Chapter IV Spaces and Transforms
Announcements Midterm out today Project 1 demos.
2D Geometric Transformations
Credit: CS231a, Stanford, Silvio Savarese
Single-view geometry Odilon Redon, Cyclops, 1914.
TWO DIMENSIONAL TRANSFORMATION
The Pinhole Camera Model
Presentation transcript:

Geometric Camera Models EECS 274 Computer Vision Geometric Camera Models

Geometric Camera Models Elements of Euclidean geometry Intrinsic camera parameters Extrinsic camera parameters General Form of the Perspective projection equation Reading: Chapter 2 of FP, Chapter 2 of S

Quantitative Measurements and Calibration Euclidean Geometry

Euclidean Coordinate Systems

Planes homogenous coordinate

OBP = OBOA + OAP , BP = BOA+ AP Coordinate Changes: Pure Translations OBP = OBOA + OAP , BP = BOA+ AP

Coordinate Changes: Pure Rotations 1st column: iA in the basis of (iB, jB, kB) 3rd row: kB in the basis of (iA, jA, kA)

Coordinate Changes: Rotations about the z Axis

Rotation matrix Elementary rotation R=R x R y R z , described by three angles

A rotation matrix is characterized by the following properties: Its inverse is equal to its transpose, R-1=RT , and its determinant is equal to 1. Or equivalently: Its rows (or columns) form a right-handed orthonormal coordinate system.

Rotation group and SO(3) Rotation group: the set of rotation matrices, with matrix product Closure, associativity, identity, invertibility SO(3): the rotation group in Euclidean space R3 whose determinant is 1 Preserve length of vectors Preserve angles between two vectors Preserve orientation of space

Coordinate Changes: Pure Rotations

Coordinate Changes: Rigid Transformations

Block Matrix Multiplication What is AB ? Homogeneous Representation of Rigid Transformations

Rigid Transformations as Mappings

Rigid Transformations as Mappings: Rotation about the k Axis

Affine transformation Images are subject to geometric distortion introduced by perspective projection Alter the apparent dimensions of the scene geometry

Affine transformation In Euclidean space, preserve Collinearity relation between points 3 points lie on a line continue to be collinear Ratios of distance along a line |p2-p1|/|p3-p2| is preserved

Shear matrix Horizontal shear Vertical shear

2D planar transformations

2D planar transformations

2D planar transformations

3D transformation

Idealized coordinate system

Camera parameters Intrinsic: relate camera’s coordinate system to the idealized coordinated system Extrinsic: relate the camera’s coordinate system to a fix world coordinate system Ignore the lens and nonlinear aberrations for the moment

The Intrinsic Parameters of a Camera Units: k,l : pixel/m f : m a,b : pixel Physical Image Coordinates (f ≠1) Normalized Image Coordinates

The Intrinsic Parameters of a Camera Calibration Matrix The Perspective Projection Equation

In reality Physical size of pixel and skew are always fixed for a given camera, and in principal known during manufacturing Focal length may vary for zoom lenses Optical axis may not be perpendicular to image plane Change focus affects the magnification factor From now on, assume camera is focused at infinity

Extrinsic Parameters

Explicit Form of the Projection Matrix denotes the i-th row of R, tx, ty, tz, are the coordinates of t can be written in terms of the corresponding angles R can be written as a product of three elementary rotations, and described by three angles M is 3 x 4 matrix with 11 parameters 5 intrinsic parameters: α, β, u0, v0, θ 6 extrinsic parameters: 3 angles defining R and 3 for t

Explicit Form of the Projection Matrix Note: : i-th row of R M is only defined up to scale in this setting!!

Theorem (Faugeras, 1993)

Camera parameters A camera is described by several parameters Translation T of the optical center from the origin of world coords Rotation R of the image plane focal length f, principle point (x’c, y’c), pixel size (sx, sy) blue parameters are called “extrinsics,” red are “intrinsics” Projection equation The projection matrix models the cumulative effect of all parameters Useful to decompose into a series of operations projection intrinsics rotation translation identity matrix Definitions are not completely standardized especially intrinsics—varies from one book to another