Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline Shawn Recker 1, Mauricio Hess- Flores 1, Mark A. Duchaineau 2, and.

Slides:



Advertisements
Similar presentations
Zhengyou Zhang Vision Technology Group Microsoft Research
Advertisements

DEVELOPMENT OF A COMPUTER PLATFORM FOR OBJECT 3D RECONSTRUCTION USING COMPUTER VISION TECHNIQUES Teresa C. S. Azevedo João Manuel R. S. Tavares Mário A.
Assignment 4 Cloning Yourself
The fundamental matrix F
CSE473/573 – Stereo and Multiple View Geometry
For Internal Use Only. © CT T IN EM. All rights reserved. 3D Reconstruction Using Aerial Images A Dense Structure from Motion pipeline Ramakrishna Vedantam.
© Fraunhofer MEVIS Toward Automated Validation of Sketch-based 3D Segmentation Editing Tools Frank Heckel 1, Momchil I. Ivanov 2, Jan H. Moltz 1, Horst.
MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.
Multiple View Reconstruction Class 24 Multiple View Geometry Comp Marc Pollefeys.
3D M otion D etermination U sing µ IMU A nd V isual T racking 14 May 2010 Centre for Micro and Nano Systems The Chinese University of Hong Kong Supervised.
ProbExplorer: Uncertainty-guided Exploration and Editing of Probabilistic Medical Image Segmentation Ahmed Saad 1,2, Torsten Möller 1, and Ghassan Hamarneh.
Face Recognition in Hyperspectral Images Z. Pan, G. Healey, M. Prasad and B. Tromberg University of California Published at IEEE Trans. on PAMI Vol 25,
Intelligent Systems Lab. Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes Davide Scaramuzza, Ahad Harati, and Roland.
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Structure from motion.
Active Calibration of Cameras: Theory and Implementation Anup Basu Sung Huh CPSC 643 Individual Presentation II March 4 th,
Developing 3D models from photos Presented By: Mohamed El said Gamal Mohamed By: Jens Vedel Web Address:
Postcalibrating RBLFs Vaibhav Vaish. A “Really Big Light Field” 1300x1030 color images 62x56 viewpoints per slab Seven slabs of 3472 images each
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Face Recognition Based on 3D Shape Estimation
CSCE 641 Computer Graphics: Image-based Modeling Jinxiang Chai.
CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.
1 Three-view geometry 3-view constraint along F Minimal algebraic sol The content described in these slides is not required in the final exam!
CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.
Lecture 12: Structure from motion CS6670: Computer Vision Noah Snavely.
InerVis Mobile Robotics Laboratory Institute of Systems and Robotics ISR – Coimbra Contact Person: Jorge Lobo Human inertial sensor:
Image Based Rendering And Modeling Techniques And Their Applications Jiao-ying Shi State Key laboratory of Computer Aided Design and Graphics Zhejiang.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
Automatic Camera Calibration
Camera Calibration & Stereo Reconstruction Jinxiang Chai.
Path-Based Constraints for Accurate Scene Reconstruction from Aerial Video Mauricio Hess-Flores 1, Mark A. Duchaineau 2, Kenneth I. Joy 3 Abstract - This.
Sequential Reconstruction Segment-Wise Feature Track and Structure Updating Based on Parallax Paths Mauricio Hess-Flores 1, Mark A. Duchaineau 2, Kenneth.
SLAM (Simultaneously Localization and Mapping)
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
WASET Defence, Computer Vision Theory and Application, Venice 13 th August – 14 th August 2015 A Four-Step Ortho-Rectification Procedure for Geo- Referencing.
KinectFusion : Real-Time Dense Surface Mapping and Tracking IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings.
A Local Adaptive Approach for Dense Stereo Matching in Architectural Scene Reconstruction C. Stentoumis 1, L. Grammatikopoulos 2, I. Kalisperakis 2, E.
MESA LAB Multi-view image stitching Guimei Zhang MESA LAB MESA (Mechatronics, Embedded Systems and Automation) LAB School of Engineering, University of.
The Correspondence Problem and “Interest Point” Detection Václav Hlaváč Center for Machine Perception Czech Technical University Prague
An Information Fusion Approach for Multiview Feature Tracking Esra Ataer-Cansizoglu and Margrit Betke ) Image and.
Ray Divergence-Based Bundle Adjustment Conditioning for Multi-View Stereo Mauricio Hess-Flores 1, Daniel Knoblauch 2, Mark A. Duchaineau 3, Kenneth I.
Acquiring 3D models of objects via a robotic stereo head David Virasinghe Department of Computer Science University of Adelaide Supervisors: Mike Brooks.
© 2005 Martin Bujňák, Martin Bujňák Supervisor : RNDr.
Barcelonnette 10/2013 STAGE INSTRUMENTAIRE MASTER 2 3D SURFACE RECONSTRUCTION WITH MULTIVIEW-STEREO.
MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.
Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision ( )
3D reconstruction from uncalibrated images
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
COS429 Computer Vision =++ Assignment 4 Cloning Yourself.
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography.
The University of Ontario Yuri Boykov Research Interests n Computer Vision n Medical Image Analysis n Graphics Combinatorial optimization algorithms Geometric,
776 Computer Vision Jan-Michael Frahm & Enrique Dunn Spring 2013.
Visual Odometry David Nister, CVPR 2004
MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.
Lecture 22: Structure from motion CS6670: Computer Vision Noah Snavely.
GPU, How It Works? GRAPHICS PROCESSING UNITS Hidden Surfaces Determine which surfaces should be displayed Texturing Modify each pixel colour for added.
Seamless Video Stitching from Hand-held Camera Inputs Kaimo Lin, Shuaicheng Liu, Loong-Fah Cheong, Bing Zeng National University of Singapore University.
Advanced Computer Graphics
Processing visual information for Computer Vision
렌즈왜곡 관련 논문 - 기반 논문: R.Y. Tsai, An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision. Proceedings of IEEE Conference on Computer.
Multiple View Geometry
VideoTrace: Interactive 3d modelling for all
Mauricio Hess-Flores1, Mark A. Duchaineau2, Kenneth I. Joy3
Session: Video Analysis and Action Recognition, Friday 9 November 2012
Multiple View Geometry in Computer Vision
Noah Snavely.
Video Compass Jana Kosecka and Wei Zhang George Mason University
Lecture 15: Structure from motion
Announcements Project 3 out today (help session at end of class)
Presentation transcript:

Visualization of Scene Structure Uncertainty in a Multi-View Reconstruction Pipeline Shawn Recker 1, Mauricio Hess- Flores 1, Mark A. Duchaineau 2, and Kenneth I. Joy 1 1 University of California, Davis, USA, {strecker, mhessf, 2 Lawrence Livermore National Labs. Vision, Modeling, and Visualization (VMV) Workshop 2012 Magdeburg, Germany November

Multi-View Reconstruction 2 Bundle Adjustment ‘dinosaur’ dataset images from [1].

Structural Uncertainty Visualization 3

Volume Visualization Techniques Volume Rendering Contouring 4

Procedure … 5

Evaluated Test Cases Frame decimation simulation Feature matching inaccuracy Self calibration tests 6

Frame Decimation Graphs 7

Frame Decimation Results 30 cameras 15 cameras 10 cameras 8 cameras 4 cameras2 cameras 8

Feature Tracking Graphs 9

Feature Tracking Inaccuracy Results 10 0% Error 1% Error 2% Error 5% Error10% Error 20% Error

Self-Calibration Graphs 11

Self-Calibration Results 12 0%1% 2%5%10% 20% Principal Point Variation Focal Length Decrease

Conclusions and Future Work Presentation of a structural uncertainty visualization tool Continued visualization of computer vision Investigation of our cost function – Scene structure computation – Camera pose estimation 13

Acknowledgements This work was supported in part by Lawrence Livermore National Laboratory and the National Nuclear Security Agency through Contract No. DE-FG52-09NA

References [1] Oxford Visual Geometry Group, “Multi-view and Oxford Colleges building reconstruction,” August [2] V. Rodehorst, M. Heinrichs, and O. Hellwich, “Evaluation of relative pose estimation methods for multi-camera setups,” in International Archives of Photogrammetry and Remote Sensing (ISPRS ’08), (Beijing, China), pp. 135– 140, [3] D. Knoblauch, M. Hess-Flores, M. A. Duchaineau, and F. Kuester, “Factorization of correspondence and camera error for unconstrained dense correspondence applications,” in 5th International Symposium on Visual Computing, pp. 720–729, [4] T. Torsney-Weir, A. Saad, T. M´’oller, H.-C. Hege, B. Weber, and J.-M. Verbavatz, “Tuner: Principled parameter finding for image segmentation algorithms using visual response surface exploration,” IEEE Trans. On Visualization and Computer Graphics, vol. 17, no. 12, pp. 1892–1901, [5] A. Saad, T. M´’oller, and G. Hamarneh, “Probexplorer: Uncertainty guided exploration and editing of probabilistic medical image segmentation,” Computer Graphics Forum, vol. 29, no. 3, pp. 1113–1122,

Reprojection Error versus Angular Error 16 Reprojection Error Scalar Field Average Scalar Field