Fast Semi-Direct Monocular Visual Odometry

Slides:



Advertisements
Similar presentations
We consider situations in which the object is unknown the only way of doing pose estimation is then building a map between image measurements (features)
Advertisements

DEVELOPMENT OF A COMPUTER PLATFORM FOR OBJECT 3D RECONSTRUCTION USING COMPUTER VISION TECHNIQUES Teresa C. S. Azevedo João Manuel R. S. Tavares Mário A.
3D Model Matching with Viewpoint-Invariant Patches(VIP) Reporter :鄒嘉恆 Date : 10/06/2009.
For Internal Use Only. © CT T IN EM. All rights reserved. 3D Reconstruction Using Aerial Images A Dense Structure from Motion pipeline Ramakrishna Vedantam.
www-video.eecs.berkeley.edu/research
MASKS © 2004 Invitation to 3D vision Lecture 7 Step-by-Step Model Buidling.
Recent work in image-based rendering from unstructured image collections and remaining challenges Sudipta N. Sinha Microsoft Research, Redmond, USA.
Two-View Geometry CS Sastry and Yang
Reducing Drift in Parametric Motion Tracking
Parallel Tracking and Mapping for Small AR Workspaces Vision Seminar
Silvina Rybnikov Supervisors: Prof. Ilan Shimshoni and Prof. Ehud Rivlin HomePage:
IIIT Hyderabad Pose Invariant Palmprint Recognition Chhaya Methani and Anoop Namboodiri Centre for Visual Information Technology IIIT, Hyderabad, INDIA.
N-view factorization and bundle adjustment CMPUT 613.
1.Introduction 2.Article [1] Real Time Motion Capture Using a Single TOF Camera (2010) 3.Article [2] Real Time Human Pose Recognition In Parts Using a.
Cambridge, Massachusetts Pose Estimation in Heavy Clutter using a Multi-Flash Camera Ming-Yu Liu, Oncel Tuzel, Ashok Veeraraghavan, Rama Chellappa, Amit.
Real Time Motion Capture Using a Single Time-Of-Flight Camera
1 Long-term image-based motion estimation Dennis Strelow.
Intelligent Systems Lab. Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes Davide Scaramuzza, Ahad Harati, and Roland.
1 Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion (IEEE 2009) Junlan Yang University of Illinois,Chicago.
Stereoscopic Light Stripe Scanning: Interference Rejection, Error Minimization and Calibration By: Geoffrey Taylor Lindsay Kleeman Presented by: Ali Agha.
Introduction to Computer Vision 3D Vision Topic 9 Stereo Vision (I) CMPSCI 591A/691A CMPSCI 570/670.
FAST MULTI-BLOCK SELECTION FOR H.264 VIDEO CODING Chang, A.; Wong, P.H.W.; Yeung, Y.M.; Au, O.C.; Circuits and Systems, ISCAS '04. Proceedings of.
Triangulation and Multi-View Geometry Class 9 Read notes Section 3.3, , 5.1 (if interested, read Triggs’s paper on MVG using tensor notation, see.
Visual Odometry for Ground Vehicle Applications David Nister, Oleg Naroditsky, James Bergen Sarnoff Corporation, CN5300 Princeton, NJ CPSC 643, Presentation.
CS664 Lecture #19: Layers, RANSAC, panoramas, epipolar geometry Some material taken from:  David Lowe, UBC  Jiri Matas, CMP Prague
Viola and Jones Object Detector Ruxandra Paun EE/CS/CNS Presentation
Presented by Pat Chan Pik Wah 28/04/2005 Qualifying Examination
IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 20, NO. 11, NOVEMBER 2011 Qian Zhang, King Ngi Ngan Department of Electronic Engineering, the Chinese university.
Accurate, Dense and Robust Multi-View Stereopsis Yasutaka Furukawa and Jean Ponce Presented by Rahul Garg and Ryan Kaminsky.
A plane-plus-parallax algorithm Basic Model: When FOV is not very large and the camera motion has a small rotation, the 2D displacement (u,v) of an image.
Real-time Dense Visual Odometry for Quadrocopters Christian Kerl
Final Exam Review CS485/685 Computer Vision Prof. Bebis.
1 Interest Operators Harris Corner Detector: the first and most basic interest operator Kadir Entropy Detector and its use in object recognition SIFT interest.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
A General Framework for Tracking Multiple People from a Moving Camera
3D SLAM for Omni-directional Camera
Flow Separation for Fast and Robust Stereo Odometry [ICRA 2009]
MESA LAB Multi-view image stitching Guimei Zhang MESA LAB MESA (Mechatronics, Embedded Systems and Automation) LAB School of Engineering, University of.
Video Based Palmprint Recognition Chhaya Methani and Anoop M. Namboodiri Center for Visual Information Technology International Institute of Information.
CSCE 643 Computer Vision: Structure from Motion
Computer Vision Lab Seoul National University Keyframe-Based Real-Time Camera Tracking Young Ki BAIK Vision seminar : Mar Computer Vision Lab.
Visual SLAM Visual SLAM SPL Seminar (Fri) Young Ki Baik Computer Vision Lab.
Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.
1 Motion estimation from image and inertial measurements Dennis Strelow and Sanjiv Singh.
University of Electronic Science and Technology of China
FREE-VIEW WATERMARKING FOR FREE VIEW TELEVISION Alper Koz, Cevahir Çığla and A.Aydın Alatan.
AAM based Face Tracking with Temporal Matching and Face Segmentation Mingcai Zhou 1 、 Lin Liang 2 、 Jian Sun 2 、 Yangsheng Wang 1 1 Institute of Automation.
Jeong Kanghun CRV (Computer & Robot Vision) Lab..
Visual Odometry David Nister, CVPR 2004
Vision-based SLAM Enhanced by Particle Swarm Optimization on the Euclidean Group Vision seminar : Dec Young Ki BAIK Computer Vision Lab.
Lecture 9 Feature Extraction and Motion Estimation Slides by: Michael Black Clark F. Olson Jean Ponce.
Visual Odometry for Ground Vehicle Applications David Nistér, Oleg Naroditsky, and James Bergen Sarnoff Corporation CN5300 Princeton, New Jersey
Reconstruction from Two Calibrated Views Two-View Geometry
Learning video saliency from human gaze using candidate selection CVPR2013 Poster.
G. Casalino, E. Zereik, E. Simetti, A. Turetta, S. Torelli and A. Sperindè EUCASS 2011 – 4-8 July, St. Petersburg, Russia.
1 Long-term image-based motion estimation Dennis Strelow and Sanjiv Singh.
Camera calibration from multiple view of a 2D object, using a global non linear minimization method Computer Engineering YOO GWI HYEON.
Mobile Robot Localization and Mapping Using Range Sensor Data Dr. Joel Burdick, Dr. Stergios Roumeliotis, Samuel Pfister, Kristo Kriechbaum.
Jianchao Yang, John Wright, Thomas Huang, Yi Ma CVPR 2008 Image Super-Resolution as Sparse Representation of Raw Image Patches.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching Link: singhashwini.mesinghashwini.me.
UAV for Indoors Inspection and Measurement
Real-Time Soft Shadows with Adaptive Light Source Sampling
Paper – Stephen Se, David Lowe, Jim Little
Florian Shkurti, Ioannis Rekleitis, Milena Scaccia and Gregory Dudek
Vehicle Segmentation and Tracking in the Presence of Occlusions
Iterative Optimization
The Brightness Constraint
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
Air-Ground Localization and Map Augmentation
Video Compass Jana Kosecka and Wei Zhang George Mason University
Presentation transcript:

Fast Semi-Direct Monocular Visual Odometry SVO Fast Semi-Direct Monocular Visual Odometry Christian Forster, Matia Pizzoli, Davide Scaramuzza Shervin Ghasemlou – November 2015

Introduction SVO: Is a method that combines Feature based methods and direct methods for visual Odometry According to authors, All Visual Odometry works for MAVs are featurebased. SVO is more robust and allows faster flight maneuvers Higher accuracy and speed Shervin Ghasemlou – December 2015

Introduction Feature based Methods: Extract a sparse set of features Match them in successive frames Recover camera pose and also structure using epipolar geometry Finally refine pose and structure Shervin Ghasemlou – December 2015

Introduction Direct Methods: Uses intensity of the image Exploit information from all parts of the image These methods outperform feature based mthods in term of robustness In scenes with little textures Camera defocus Motion blur They save time of feature detection Shervin Ghasemlou – December 2015

Contributions 1-A novel semi direct VO method for MAVs, which in comparison with the state of the art methods, is faster More accurate 2-Integration of a probabilistic mapping method Robust to outliers Shervin Ghasemlou – December 2015

Algorithm Two Thread Motion Estimation Mapping Sparse model-based image alignment Feature alignment Pose and structure refinement Mapping Shervin Ghasemlou – December 2015

Flowchart Shervin Ghasemlou – December 2015

Motion Estimation (1)Sparse mode based image alignment The maximum likelihood estimate of the rigid body transformation Tk,k−1 between two consecutive camera poses minimizes the negative log-likelihood of the intensity residuals: The intensity residual dδ is defined by the photometric difference between pixels observing the same 3D point. Shervin Ghasemlou – December 2015

Motion Estimation It can be computed by back-projecting a 2D point u from the previous image Ik−1 and subsequently projecting it into the current camera view: Where Shervin Ghasemlou – December 2015

Motion Estimation Shervin Ghasemlou – December 2015

Motion Estimation (2)Relaxation through feature alignment The last step aligned the camera with respect to the previous frame To reduce the drift, the camera pose should be aligned with respect to the map,rather than to the previous frame Shervin Ghasemlou – December 2015

Motion Estimation Shervin Ghasemlou – December 2015

Motion Estimation (3)Pose and Structure Refinement In this final step, we again optimize the camera pose Tk,w to minimize the re-projection residuals: Shervin Ghasemlou – December 2015

Motion Estimation Shervin Ghasemlou – December 2015

Experimental results Experiments were performed on a data set recorded from two sources On the quad-rotor A handheld camera Process done on : Quad-copter embedded platform A laptop Two settings One for accuracy One for speed Shervin Ghasemlou – December 2015

Experimental results Comparison with PTAM The proposed method has fewer outliers due to the depth-filter Shervin Ghasemlou – December 2015

Questions?