1. Study the mathematical relations between corresponding image points.
Objective
3-D Scene u’ u
Study the mathematical relations between corresponding image points.
“Corresponding” means originated from the same 3D point.

2. Two-views geometry Outline
Background: Camera, Projection models
Necessary tools: A taste of projective geometry
Two view geometry:
Planar scene (homography ).
Non-planar scene (epipolar geometry).
3D reconstruction (stereo).

3. Background End of introduction. Objectives:
Students should understand: the objective of next 2 class (studing the mathematical relations between “corresponding” pixels.
Time line: 2 min (60 sec/slide)
Background
Objectives:
General background about cameras
Lens

4. A few words about Cameras
Camera obscura dates from 15th century
First photograph on record shown in the book – 1826
The human eye functions very much like a camera

5. History Camera Obscura
solar eclipse
"Reinerus Gemma-Frisius, observed an eclipse of the sun at Louvain on January 24, 1544, and later he used this illustration of the event in his book De Radio Astronomica et Geometrica, It is thought to be the first published illustration of a camera obscura..."
Hammond, John H., The Camera Obscura, A Chronicle

6. The first “photograph” www.hrc.utexas.edu/exhibitions/permanent/wfp/
Joseph Nicéphore Niépce. View from the Window at Le Gras.

7. A few words about Cameras
Current cameras contain a lens and a recording device (film, CCD, CMOS)
Basic abstraction is the pinhole camera

8. A few words about Lenses Ideal Lenses
Lens acts as a pinhole (for 3D points at the focal depth).

9. Regular Lenses E.g., the cameras in our lab.
To learn more on lens-distortion see Hartley & Zisserman Sec. 7.4 p.189.
Not part of this class.

10. Modeling a Pinhole Camera (or projection)

11. Single View Geometry ∏ f

12. Modeling a Pinhole Camera (or projection)

13. Basic projection equation
End of background.
Students should understand:
Image = projection
Time line: 5 min (30 sec/slide)
Basic projection equation
Objectives:
Other “imaging” model

14. Perspective Projection
Origin (0,0,0) is the Focal center
X,Y (x,y) axis are along the image axis (height / width).
Z is depth = distance along the Optical axis
f – Focal length

15. Notation O – Focal center π – Image plane Z – Optical axis
f – Focal length
P=(X,Y,Z)

16. Projection
P=(X,Y,Z) y f Y X f Z

17. Projection
P=(X,Y,Z) y f Y X f Z

18. Orthographic Projection
Projection rays are parallel
Image plane is fronto-parallel
(orthogonal to rays)
Focal center at infinity

19. Scaled Orthographic Projection
Also called “weak perspective”

20. Pros and Cons of Projection Models
Weak perspective has simpler math.
Accurate when object is small and distant.
Useful for object recognition.
When accuracy really matters (SFM), we must model the real camera (Pinhole / perspective ):
Perspective projection, calibration parameters (later), and all other issues (radial distortion).

21. Projective geometry basic
End of projection.
Students should understand:
Difference between projection models
Time line: 30 min (120 sec/slide)
Projective geometry basic
Objectives: Projective line & projective plane

22. Two-views geometry Outline
Background: Camera, Projection
Necessary tools: A taste of projective geometry
Two view geometry:
Planar scene (homography ).
Non-planar scene (epipolar geometry).
3D reconstruction from two views (Stereo algorithms)
Hartley & Zisserman:
Sec. 2 Proj. Geom. of 2D.
Sec. 3 Proj. Geom. of 3D.

23. Reading Hartley & Zisserman: Sec. 2 Proj. Geo. of 2D:
point lines in 2D
transformations
2.7 line at infinity
Sec. 3 Proj. Geo. of 3D.
3.1 – point planes & lines.
transformations

24. Same shapes are related by rotation and translation
Why not Euclidian Geometry(Motivation)
Euclidean Geometry is good for
questions like:
what objects have the same shape (= congruent)
Same shapes are related by rotation and translation

25. Why Projective Geometry (Motivation)
Parallel lines meet at the horizon (“vanishing line”)
Where do parallel lines meet?

26. Why Projective Geometry (Motivation)
Answers the question what appearances (projections) represent the same shape
Same shapes are related by a projective transformation

27. Coordinates in Euclidean Line R1
Not in space ∞

28. Coordinates in Projective Line P1
Take R2 –{0,0} and look at scale equivalence class (rays/lines trough the origin).
Realization: Points on a line P1
“Ideal point”
k(-1,1)
k(0,1)
k(1,1)
k(2,1) ∞
Rays vs. lines rigorous vs. clear We will use rays.
k(1,0)

29. Coordinates in Projective Plane P2
Take R3 –{0,0,0} and look at scale equivalence class
(rays/lines trough the origin).
k(0,1,1)
k(1,1,1)
“Ideal point”
k(0,0,1)
k(1,0,1)
k(x,y,0)

30. Projective Line vs. the Real Line
Symbol
R^2 – {0,0}
The real line
Space
Equivalence classes (2D “rays”)
points
Objects (points)
Intersection with line y=1
Realization
“Ideal point”
k(-1,1)
k(0,1)
k(1,1)
k(2,1) ∞
k(1,0)

31. Projective Plane vs Euclidian plane
Symbol
R3 – {0,0,0}
The real plane
Space
Equivalence classes (3D rays)
point
Objects (points)
Intersection with plane z=1
Realization
k(0,0,1)
k(x,y,0)
k(1,1,1)
k(1,0,1)
k(0,1,1)
“Ideal line”

32. Points & lines End of projective geometry basic
Students should understand:
Difference between projection models
Time line: 45 min (30 sec/slide)
Points & lines
Objectives: pxp = l lxl=p
inf.

33. 2D Projective Geometry: Basics
A point:
A line:
we denote a line with a 3-vector
Line coordinates are homogenous
Points and lines are dual: p is on l if
Intersection of two lines/points

34. Cross Product Every entry is a determinant of the two other entries
Area of parallelogram bounded by u and v
Hartley & Zisserman p. 581

35. Cross Product in matrix notation [ ]x
Hartley & Zisserman p. 581

36. Example: Intersection of parallel lines
Q: How many ideal points are there in P2?
A: 1 degree of freedom family – the line at infinity

37. Projective Transformationsu u’

38. 1D Projective transformations
End of points and lines .
Students should understand:
Difference between projection models
Time line: 60 min (120 sec/slide)
1D Projective transformations
Objectives:

39. Transformations of the projective line
A perspective mapping is a projective transformation T:P1  P1
Pencil of rays
Perspective mapping
One of two or more lines that have a point in common.
Perceptivity is a special projective mapping Hartley & Zisserman p. 632
Lines connecting corresponding points are “concurrent”

40. Perspectivities Projectivities Perspectivities are not a groupL
Slide Objective: Why perspective projection do not suffices l1 l2

41. Projective transformations of the projective line
Given a 2D linear transformation G:R2  R2
Study the induced transformation on the Equivalents classes.
On the realization y=1 we get:

42. Properties: Invertible (T-1 exists)
Composable (To G is a projective transformation)
Closed under composition
Has 4 parameters
3 degrees of freedom
Defined by 3 points
Every point defines 1 constraint

43. Ideal points and projective transformations
Projective transformation can map ∞ to a real point

44. 2D transformations End of 1d projective transformations .
Students should understand:
Difference between projection models
Time line: 75 min (120 sec/slide)
2D transformations
Objectives: Understand the structure of 2D transfomations

45. Plane Perspective

46. Plane Perspective

47. Euclidean Transformations (Isometries)
Rotation:
Translation:

48. Hierarchy of 2D Transformations
Projective
Affine
Similarity
Rigid (Isometry)
Translation:
Rotation:
Scale
Hartley & Zisserman p. Sec. 2.4

49. End of Part 1 Students should understand:
Difference between projection models
Time line: 100 min