Department of Electrical and Electronic Engineering, The University of Hong Kong, Pokfulam Road, Hong Kong Three-dimensional curve reconstruction from multiple images

Outline Introduction Problem formulation Curve reconstruction Experimental results Conclusions

Introduction Unlike most existing methods, our approach does not require any other additional information of the image features or calibration of cameras. Since this is a point-based curve reconstruction approach, the problem of missing and/or partially occluded curves is readily handled using methods that are already established for occluded points.

Outline Introduction Problem formulation Curve reconstruction Experimental results Conclusions

Problem Formulation

The 2D reprojection error measured can be defined as

Outline Introduction Problem formulation Curve reconstruction Experimental results Conclusions

Curve Reconstruction

Introducing (5) into (3)

Curve Reconstruction

We may incorporate constraint 7(b) into the cost function (7) by means of a penalty term with a penalty factor γ.

Curve Reconstruction We use a three-step process to obtain a good initial guess for iterative algorithm. (1) 2D representative point selection. (2) initial point correspondences establishment 1. Affine-invariant points detection 2. Affine-invariant segments matching 3. Matching section extension 4. Similarity score computation (3) initial 3D reconstruction

Curve Reconstruction Point-based curve reconstruction algorithm

Curve Reconstruction

Outline Introduction Problem formulation Curve reconstruction Experimental results Conclusions

Experimental Result Synthetic Images

Experimental Result Tissue Box Jar

Experimental Result Mug Dell Box

Outline Introduction Problem formulation Curve reconstruction Experimental results Conclusions

In this paper, we propose a new approach for reconstructing 3D curves from a sequence of images taken by uncalibrated cameras. It is capable of constructing both planar curves and non-planar curves, and it readily handles cases where not all curves are visible or some curves are partially occluded.