HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication.

Slides:

Advertisements

Similar presentations

3D reconstruction.

Advertisements

MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.

Self-calibration.

Two-view geometry.

Camera calibration and epipolar geometry

A Generic Concept for Camera Calibration Peter Sturm and Srikumar Ramaligam Sung Huh CPSC 643 Individual Presentation 4 April 15, 2009.

Structure from motion.

Self-calibration and multi-view geometry Class 10 Read Chapter 6 and 3.2.

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

Robot Vision SS 2008 Matthias Rüther 1 ROBOT VISION Lesson 6: Shape from Stereo Matthias Rüther Slides partial courtesy of Marc Pollefeys Department of.

3D reconstruction class 11

Epipolar geometry. (i)Correspondence geometry: Given an image point x in the first view, how does this constrain the position of the corresponding point.

Srikumar Ramalingam Department of Computer Science University of California, Santa Cruz 3D Reconstruction from a Pair of Images.

Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.

Uncalibrated Geometry & Stratification Sastry and Yang

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

Multiple View Geometry

3D reconstruction of cameras and structure x i = PX i x’ i = P’X i.

Many slides and illustrations from J. Ponce

Self-calibration Class 21 Multiple View Geometry Comp Marc Pollefeys.

Uncalibrated Epipolar - Calibration

Multiple View Geometry

Self-calibration Class 13 Read Chapter 6. Assignment 3 Collect potential matches from all algorithms for all pairs Matlab ASCII format, exchange data.

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

May 2004Stereo1 Introduction to Computer Vision CS / ECE 181B Tuesday, May 11, 2004  Multiple view geometry and stereo  Handout #6 available (check with.

Multiple View Geometry Marc Pollefeys University of North Carolina at Chapel Hill Modified by Philippos Mordohai.

Multiple View Geometry

Multiple View Geometry. THE GEOMETRY OF MULTIPLE VIEWS Reading: Chapter 10. Epipolar Geometry The Essential Matrix The Fundamental Matrix The Trifocal.

Stereo matching Class 10 Read Chapter 7 Tsukuba dataset.

Epipolar geometry Class 5. Geometric Computer Vision course schedule (tentative) LectureExercise Sept 16Introduction- Sept 23Geometry & Camera modelCamera.

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

Multi-view geometry. Multi-view geometry problems Structure: Given projections of the same 3D point in two or more images, compute the 3D coordinates.

Automatic Camera Calibration

Computer vision: models, learning and inference

875: Recent Advances in Geometric Computer Vision & Recognition Jan-Michael Frahm Fall 2011.

Multi-view geometry.

1 Preview At least two views are required to access the depth of a scene point and in turn to reconstruct scene structure Multiple views can be obtained.

Day 1 how do we represent the shape around us? course outline motivation for gathering geometry from multiple images –our eyes are two views –structure.

Projective cameras Motivation Elements of Projective Geometry Projective structure from motion Planches : –

Epipolar geometry Epipolar Plane Baseline Epipoles Epipolar Lines

Lecture 04 22/11/2011 Shai Avidan הבהרה : החומר המחייב הוא החומר הנלמד בכיתה ולא זה המופיע / לא מופיע במצגת.

Correspondence-Free Determination of the Affine Fundamental Matrix (Tue) Young Ki Baik, Computer Vision Lab.

3D Reconstruction Jeff Boody. Goals ● Reconstruct 3D models from a sequence of at least two images ● No prior knowledge of the camera or scene ● Use the.

Robot Vision SS 2007 Matthias Rüther 1 ROBOT VISION Lesson 6a: Shape from Stereo, short summary Matthias Rüther Slides partial courtesy of Marc Pollefeys.

Two-view geometry Epipolar geometry F-matrix comp. 3D reconstruction

© 2005 Martin Bujňák, Martin Bujňák Supervisor : RNDr.

Geometry of Multiple Views

Computer Vision Lecture #10 Hossam Abdelmunim 1 & Aly A. Farag 2 1 Computer & Systems Engineering Department, Ain Shams University, Cairo, Egypt 2 Electerical.

A minimal solution to the autocalibration of radial distortion Young Ki Baik (CV Lab.) (Wed)

Two-view geometry. Epipolar Plane – plane containing baseline (1D family) Epipoles = intersections of baseline with image planes = projections of the.

EECS 274 Computer Vision Affine Structure from Motion.

3D reconstruction from uncalibrated images

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.

776 Computer Vision Jan-Michael Frahm & Enrique Dunn Spring 2013.

Visual Odometry David Nister, CVPR 2004

Vision Sensors for Stereo and Motion Joshua Gluckman Polytechnic University.

3D Reconstruction Using Image Sequence

Auto-calibration we have just calibrated using a calibration object –another calibration object is the Tsai grid of Figure 7.1 on HZ182, which can be used.

MASKS © 2004 Invitation to 3D vision Uncalibrated Camera Chapter 6 Reconstruction from Two Uncalibrated Views Modified by L A Rønningen Oct 2008.

Geometry Reconstruction March 22, Fundamental Matrix An important problem: Determine the epipolar geometry. That is, the correspondence between.

Uncalibrated reconstruction Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration.

Structure from motion Multi-view geometry Affine structure from motion Projective structure from motion Planches : –

Projective cameras The end of projective SFM Euclidean upgrades Line geometry Purely projective cameras Présentations mercredi 26 mai de 9h30 à midi, salle.

EECS 274 Computer Vision Projective Structure from Motion.

Epipolar geometry.

3D Photography: Epipolar geometry

More on single-view geometry class 10

3D reconstruction class 11

Uncalibrated Geometry & Stratification

Two-view geometry.

Presentation transcript:

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction from uncalibrated images Young Ki Baik Visual Information Processing Lab. School of Radio Science & Communication Engineering. Hong-Ik University

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Contents Introduction Introduction  Overview Feature Extraction and Matching Feature Extraction and Matching Relating Image Relating Image  Camera model / Projection matrix  Fundamental matrix Initial reconstruction Initial reconstruction  Initial projection matrix

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Contents Auto-calibration Auto-calibration  Motivation  The Absolute Dual Quadric method  Result Future works Future works  Critical motion sequence  Dense matching  3D model building

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction from uncalibrated images Image Sequence Feature Extraction/ Matching Relating Image Projective Reconstruction Auto-Calibration Dense Matching 3D Model Building Overview Overview

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Feature Extraction / Matching Feature Extraction Feature Extraction  Harris corner detector OpenCVOpenCV C.Harris and M.Stephens, “ A combined corner and edge detector ”, Fourth Alvey Vision conference, 1988

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Feature Extraction / Matching Matching Matching  Optical flow Initial matchingInitial matching OpenCVOpenCV  Template matching ( SAD ) Near point matchingNear point matching

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Camera model Camera model

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Camera model Camera model

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Camera model Camera model

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Camera model Camera model  Non-square pixels and skew If m x and m y pixels per unit distance in x and y directions and skew, Pixel

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Fundamental matrix F Fundamental matrix F

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Relating images Fundamental matrix F Fundamental matrix F  RANSAC Normalized 8-Point algorithm (MVG p.265)Normalized 8-Point algorithm (MVG p.265)

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Initial reconstruction Initial reconstruction Initial reconstruction  Triangulation method Multiple View Geometry in computer visionMultiple View Geometry in computer vision –Hartly and Zisserman (p.297) World center

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Initial reconstruction Initial projection matrix Initial projection matrix  Projection matrix Get P matrix fromGet P matrix from initial world point X initial world point X  Bundle adjustment Sparse LMSparse LM F X x

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction Affine reconstruction(Calibration) Affine reconstruction(Calibration)

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction Affine reconstruction(Calibration) Affine reconstruction(Calibration)

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction Metric reconstruction Metric reconstruction Cholesky decomposition

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering 3D reconstruction Metric reconstruction Metric reconstruction

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Motivation Motivation  Avoid explicit calibration procedure Complex procedureComplex procedure Need for calibration objectNeed for calibration object Need to maintain calibrationNeed to maintain calibration  Allow flexible acquisition No prior calibration necessaryNo prior calibration necessary Possibility to vary intrinsic parametersPossibility to vary intrinsic parameters

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Projection matrix Projection matrix

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Projection matrix Projection matrix

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Constraints on intrinsic parameters Constraints on intrinsic parameters  Constant parameter Fixed cameraFixed camera K 1 = K 2 = …  Known parameter Rectangular pixel : s = 0Rectangular pixel : s = 0 Square pixel : s = 0, f x = f ySquare pixel : s = 0, f x = f y Principle point known : ( u x, u y ) = image centerPrinciple point known : ( u x, u y ) = image center

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Constraints on intrinsic parameters Constraints on intrinsic parameters  Constant parameter Faugeras et al. ECCV’92, Hartley’93, Triggs’97Faugeras et al. ECCV’92, Hartley’93, Triggs’97 –Kruppa equations, A stratified solution, Quadric Method Pollefeys et al. PAMI’98 …Pollefeys et al. PAMI’98 … –Absolute dual quadric method  Known parameter Heyden&Astrom CVPR’97Heyden&Astrom CVPR’97 Pollefeys et al. ICCV’98 …Pollefeys et al. ICCV’98 …

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration The Absolute Dual Quadric method The Absolute Dual Quadric method   **

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration The Absolute Dual Quadric method The Absolute Dual Quadric method  Constant parameter

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration The Absolute Dual Quadric method The Absolute Dual Quadric method  Constant parameter

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Result Result  Affine reconstruction

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Result Result  Metric reconstruction

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Auto-calibration Result ( Internal parameter K ) Result ( Internal parameter K )  Rig  Calibration (Vanishing point)  Quadric method

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Future works Critical Motion Sequence(CMS) Critical Motion Sequence(CMS)  Critical Motion Sequences have more than one potenti al absolute conic satisfying all constraints Pure translation / Pure rotationPure translation / Pure rotation Planar motion / Obital motionPlanar motion / Obital motion  Possible to derive classification of CMS  Sturm(CVPR´97), Kahl(ICCV´99)

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Future works Dense matching (Stereo vision) Dense matching (Stereo vision)  Dense matching through the epipolar line Conventional stereoConventional stereo Rectangulr subregioning / Sensus stereoRectangulr subregioning / Sensus stereo Cooperative stereo algorithmCooperative stereo algorithm Graph cut / PDE-based dense matchingGraph cut / PDE-based dense matching

HONGIK UNIVERSITY School of Radio Science & Communication Engineering Visual Information Processing Lab Hong-Ik University School of Radio Science & Communication Engineering Future works 3D model building 3D model building  Volumetric model  Super resolution  Plenoptic modeling and rendering