October 19, 19981 STEREO IMAGING (continued). October 19, 19982 RIGHT IMAGE PLANE LEFT IMAGE PLANE RIGHT FOCAL POINT LEFT FOCAL POINT BASELINE d FOCAL.

Slides:

Advertisements

Similar presentations

1Ellen L. Walker Stereo Vision Why? Two images provide information to extract (some) 3D information We have good biological models (our own vision system)

Advertisements

CS 376b Introduction to Computer Vision 04 / 21 / 2008 Instructor: Michael Eckmann.

Public Library, Stereoscopic Looking Room, Chicago, by Phillips, 1923.

Stereo Many slides adapted from Steve Seitz. Binocular stereo Given a calibrated binocular stereo pair, fuse it to produce a depth image Where does the.

MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.

Geometry 1: Projection and Epipolar Lines Introduction to Computer Vision Ronen Basri Weizmann Institute of Science.

Lecture 8: Stereo.

Computer Vision : CISC 4/689

Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.

1 Introduction to 3D Imaging: Perceiving 3D from 2D Images How can we derive 3D information from one or more 2D images? There have been 2 approaches: 1.

Introduction to Computer Vision 3D Vision Topic 9 Stereo Vision (I) CMPSCI 591A/691A CMPSCI 570/670.

Stereopsis Mark Twain at Pool Table", no date, UCR Museum of Photography.

3D Computer Vision and Video Computing 3D Vision Lecture 14 Stereo Vision (I) CSC 59866CD Fall 2004 Zhigang Zhu, NAC 8/203A

May 2004Stereo1 Introduction to Computer Vision CS / ECE 181B Tuesday, May 11, 2004  Multiple view geometry and stereo  Handout #6 available (check with.

CSE473/573 – Stereo Correspondence

Announcements PS3 Due Thursday PS4 Available today, due 4/17. Quiz 2 4/24.

COMP322/S2000/L271 Stereo Imaging Ref.V.S.Nalwa, A Guided Tour of Computer Vision, Addison Wesley, (ISBN ) Slides are adapted from CS641.

Stereo matching “Stereo matching” is the correspondence problem –For a point in Image #1, where is the corresponding point in Image #2? C1C1 C2C2 ? ? C1C1.

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

Stereo vision A brief introduction Máté István MSc Informatics.

Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #15.

1 Perceiving 3D from 2D Images How can we derive 3D information from one or more 2D images? There have been 2 approaches: 1. intrinsic images: a 2D representation.

3-D Scene u u’u’ Study the mathematical relations between corresponding image points. “Corresponding” means originated from the same 3D point. Objective.

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

CSE 6367 Computer Vision Stereo Reconstruction Camera Coordinate Transformations “Everything should be made as simple as possible, but not simpler.” Albert.

Computer Vision Spring ,-685 Instructor: S. Narasimhan WH 5409 T-R 10:30am – 11:50am Lecture #15.

Introduction to 3D Vision How do we obtain 3D image data? What can we do with it?

Automatic Camera Calibration

Epipolar Geometry and Stereo Vision Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 03/05/15 Many slides adapted from Lana Lazebnik,

Lecture 11 Stereo Reconstruction I Lecture 11 Stereo Reconstruction I Mata kuliah: T Computer Vision Tahun: 2010.

Geometric and Radiometric Camera Calibration Shape From Stereo requires geometric knowledge of: –Cameras’ extrinsic parameters, i.e. the geometric relationship.

Lecture 12 Stereo Reconstruction II Lecture 12 Stereo Reconstruction II Mata kuliah: T Computer Vision Tahun: 2010.

Epipolar geometry Epipolar Plane Baseline Epipoles Epipolar Lines

Shape from Stereo  Disparity between two images  Photogrammetry  Finding Corresponding Points Correlation based methods Feature based methods.

Stereo Vision Reading: Chapter 11 Stereo matching computes depth from two or more images Subproblems: –Calibrating camera positions. –Finding all corresponding.

3D Sensing and Reconstruction Readings: Ch 12: , Ch 13: , Perspective Geometry Camera Model Stereo Triangulation 3D Reconstruction by.

CS654: Digital Image Analysis Lecture 8: Stereo Imaging.

Computer Vision cmput 428/615

Stereo Many slides adapted from Steve Seitz.

Cmput412 3D vision and sensing 3D modeling from images can be complex 90 horizon 3D measurements from images can be wrong.

Binocular Stereo #1. Topics 1. Principle 2. binocular stereo basic equation 3. epipolar line 4. features and strategies for matching.

Stereo Many slides adapted from Steve Seitz. Binocular stereo Given a calibrated binocular stereo pair, fuse it to produce a depth image image 1image.

Computer Vision Stereo Vision. Bahadir K. Gunturk2 Pinhole Camera.

Stereo Vision John Morris These slides were adapted from a set of lectures written by Mircea Nicolescu, University of Nevada at Reno Vision Research in.

Bahadir K. Gunturk1 Phase Correlation Bahadir K. Gunturk2 Phase Correlation Take cross correlation Take inverse Fourier transform  Location of the impulse.

Computer Vision cmput 499/615

stereo Outline : Remind class of 3d geometry Introduction

Feature Matching. Feature Space Outlier Rejection.

Stereo Vision John Morris Vision Research in CITR

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

776 Computer Vision Jan-Michael Frahm Spring 2012.

Solving for Stereo Correspondence Many slides drawn from Lana Lazebnik, UIUC.

Computer vision: models, learning and inference M Ahad Multiple Cameras

3D Reconstruction Using Image Sequence

Correspondence and Stereopsis Original notes by W. Correa. Figures from [Forsyth & Ponce] and [Trucco & Verri]

John Morris These slides were adapted from a set of lectures written by Mircea Nicolescu, University of Nevada at Reno Stereo Vision Iolanthe in the Bay.

Media Processor Lab. Media Processor Lab. Trellis-based Parallel Stereo Matching Media Processor Lab. Sejong univ.

Multiple View Geometry and Stereo. Overview Single camera geometry – Recap of Homogenous coordinates – Perspective projection model – Camera calibration.

Lec 26: Fundamental Matrix CS4670 / 5670: Computer Vision Kavita Bala.

Correspondence and Stereopsis. Introduction Disparity – Informally: difference between two pictures – Allows us to gain a strong sense of depth Stereopsis.

Noah Snavely, Zhengqi Li

제 5 장 스테레오.

Computational Vision CSCI 363, Fall 2016 Lecture 15 Stereopsis

3D Head Mesh Data Stereo Vision Active Stereo 3D Reconstruction

Thanks to Richard Szeliski and George Bebis for the use of some slides

Two-view geometry.

Computer Vision Stereo Vision.

Course 6 Stereo.

3D Sensing and Reconstruction Readings: Ch 12: , Ch 13: 13

Presentation transcript:

October 19, STEREO IMAGING (continued)

October 19, RIGHT IMAGE PLANE LEFT IMAGE PLANE RIGHT FOCAL POINT LEFT FOCAL POINT BASELINE d FOCAL LENGTH f BINOCULAR STEREO SYSTEM GOAL: Passive 2-camera system for triangulating 3D position of points in space to generate a depth map of a world scene. Example of a depth- map: z=f(x,y) where x,y coordinatizes one of the image planes and z is the height above the respective image plane. (2D topdown view)

October 19, RIGHT IMAGE PLANE LEFT IMAGE PLANE RIGHT FOCAL POINT LEFT FOCAL POINT BASELINE d FOCAL LENGTH f BINOCULAR STEREO SYSTEM Correspondence Problem is a key issue for binocular stereo -- namely identify image features in respective images that correspond to exactly the same world object point. Clearly localization of image features (e.g., edges) is of critical importance to 3D measurement accuracy. (2D topdown view)

October 19, SOME OTHER MAJOR PROBLEMS WITH CORRESPONDENCE (2D VIEW) OCCLUSION LIMITED FIELD OF VIEW

October 19, BINOCULAR STEREO SYSTEM (2D VIEW Nonverged Stereo System Verged Stereo System

October 19, BINOCULAR STEREO SYSTEM Z X (0,0) (d,0) Z=f XL XR DISPARITY (XL - XR) Z = (f/XL) X Z= (f/XR) (X-d) (f/XL) X = (f/XR) (X-d) X = (XR d) / (XL - XR) Z = df (XL - XR)

October 19, BINOCULAR STEREO SYSTEM (3D VIEW) Rays of projection in 3D may not intersect at all. RIGHT IMAGE LEFT IMAGE Points of closest approach

October 19, BINOCULAR STEREO SYSTEM X Y Z (XL,YL) (XR,YR) (0,0,0) (d,0,0) Points of closest approach

October 19, BINOCULAR STEREO SYSTEM (XL,YL) (XR,YR) (0,0,0) (d,0,0) Points of closest approach = (d,0,0) - (0,0,0)   u u = ^ u u u = (XL,YL,f) - (0,0,0) v = ^ v v = (XR+d,YL,f) - (d,0,0) v v FIND a and b that minimizes | au - (  + bv) | where norm | | is Euclidean Norm. ^ ^

October 19, BINOCULAR STEREO SYSTEM (XL,YL) (XR,YR) (0,0,0) (d,0,0) Points of closest approach  u v FIND a and b that minimizes | au - (  + bv) | where norm | | is Euclidean Norm. ^ ^ a = b = (v.u)(u.  ) - v.  u.  - (u.v)(v.  ) 1 - (u.v) 2 ^ 1 - (u.v) 2 ^ ^ ^ o o Best Geometric Computation is: a u + (  + b v) 2 oo ^

October 19, EPIPOLAR GEOMETRY Points of closest approach For an image point C in the left image plane consider the plane determined by the left image focal point A the right image focal point B and the point C. Call this the epipolar plane for image point C with respect to a particular binocular stereo configuration. C A B

October 19, EPIPOLAR GEOMETRY Points of closest approach In order to guarantee intersection of projective rays produced from the left and right image planes, the point in the right image plane corresponding to C must lie on the intersection of the epipolar plane with the right image plane. C A B EPIPOLAR PLANE EPIPOLAR LINE

October 19, EPIPOLAR GEOMETRY (‘SCANLINE COHERENT’ STEREO SYSTEM)

October 19, EPIPOLAR GEOMETRY (VERGED IN)