Lecture 23: Structure from motion 2

Slides:



Advertisements
Similar presentations
Structure from motion.
Advertisements

The fundamental matrix F
Lecture 11: Two-view geometry
CS 221 Chapter 2 Excel. In Excel: A1 = 95 A2 = 95 A3 = 80 A4 = 0 =IF(A1
Building Rome in a Day Sameer Agarwal1 Noah Snavely2 Ian Simon1 Steven M. Seitz1 Richard Szeliski3 1University of Washington 2Cornell University 3Microsoft.
Recent work in image-based rendering from unstructured image collections and remaining challenges Sudipta N. Sinha Microsoft Research, Redmond, USA.
Discrete-Continuous Optimization for Large-scale Structure from Motion David Crandall, Andrew Owens, Noah Snavely, Dan Huttenlocher Presented by: Rahul.
Structure from motion.
Lecture 23: Structure from motion and multi-view stereo
CS6670: Computer Vision Noah Snavely Lecture 17: Stereo
Lecture 11: Structure from motion, part 2 CS6670: Computer Vision Noah Snavely.
Lecture 1: Images and image filtering
Lecture 11: Structure from motion CS6670: Computer Vision Noah Snavely.
Lecture 22: Structure from motion CS6670: Computer Vision Noah Snavely.
Announcements Kevin Matzen office hours – Tuesday 4-5pm, Thursday 2-3pm, Upson 317 TA: Yin Lou Course lab: Upson 317 – Card access will be setup soon Course.
Lecture 32: Photometric stereo, Part 2 CS4670: Computer Vision Noah Snavely.
Lecture 3a: Feature detection and matching CS6670: Computer Vision Noah Snavely.
Lecture 20: Two-view geometry CS6670: Computer Vision Noah Snavely.
Lecture 11: Stereo and optical flow CS6670: Computer Vision Noah Snavely.
Lecture 19: Optical flow CS6670: Computer Vision Noah Snavely
Stereo Guest Lecture by Li Zhang
Advanced Computer Vision Structure from Motion. Geometric structure-from-motion problem: using image matches to estimate: The 3D positions of the corresponding.
Project 1 artifact winners Project 2 questions Project 2 extra signup slots –Can take a second slot if you’d like Announcements.
Global Alignment and Structure from Motion Computer Vision CSE455, Winter 2008 Noah Snavely.
Lecture 6: Feature matching and alignment CS4670: Computer Vision Noah Snavely.
Lecture 12: Structure from motion CS6670: Computer Vision Noah Snavely.
VZvZ r t b image cross ratio Measuring height B (bottom of object) T (top of object) R (reference point) ground plane H C scene cross ratio  scene points.
Mosaics CSE 455, Winter 2010 February 8, 2010 Neel Joshi, CSE 455, Winter Announcements  The Midterm went out Friday  See to the class.
SBU Digital Media CSE 690 Internet Vision Organizational Meeting Tamara Berg Assistant Professor SUNY Stony Brook.
Multiple View Geometry in Computer Vision Slides modified from Marc Pollefeys’ online course materials Lecturer: Prof. Dezhen Song.
Lecture 4: Feature matching CS4670 / 5670: Computer Vision Noah Snavely.
CSP Examples Tamara Berg CS 560 Artificial Intelligence Many slides throughout the course adapted from Svetlana Lazebnik, Dan Klein, Stuart Russell, Andrew.
Why is computer vision difficult?
Announcements Project 3 due Thursday by 11:59pm Demos on Friday; signup on CMS Prelim to be distributed in class Friday, due Wednesday by the beginning.
Lecture 7: Features Part 2 CS4670/5670: Computer Vision Noah Snavely.
IIIT HYDERABAD Image-based walkthroughs from partial and incremental scene reconstructions Kumar Srijan Syed Ahsan Ishtiaque C. V. Jawahar Center for Visual.
Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision ( )
Lecture 16: Stereo CS4670 / 5670: Computer Vision Noah Snavely Single image stereogram, by Niklas EenNiklas Een.
Autonomous Navigation for Flying Robots Lecture 6.3: EKF Example
Lecture 8: Feature matching CS6670: Computer Vision Noah Snavely.
Announcements No midterm Project 3 will be done in pairs same partners as for project 2.
MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.
Lecture 22: Structure from motion CS6670: Computer Vision Noah Snavely.
Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Noah Snavely Hybrid Images, Oliva et al.,
Lecture 14: Feature matching and Transforms CS4670/5670: Computer Vision Kavita Bala.
Lecture 10: Image alignment CS4670/5760: Computer Vision Noah Snavely
Lecture 5: Feature detection and matching CS4670 / 5670: Computer Vision Noah Snavely.
IIIT HYDERABAD Techniques for Organization and Visualization of Community Photo Collections Kumar Srijan Faculty Advisor : Dr. C.V. Jawahar.
CS 6501: 3D Reconstruction and Understanding Stereo Cameras
Think-Pair-Share What visual or physiological cues help us to perceive 3D shape and depth?
Multiple View Geometry
Miniature faking In close-up photo, the depth of field is limited.
Modeling the world with photos
CS4670 / 5670: Computer Vision Lecture 12: Cameras Noah Snavely
Advanced Computer Vision
Multiple View Geometry in Computer Vision
Physics-based simulation for visual computing applications
Unit 3: Lesson 9-Looping and Random Numbers
Lecture 5: Feature detection and matching
Noah Snavely.
Lecture 8: Image alignment
Name of Chapter Area of Chapter
Structure from motion.
Lecture 8: Image alignment
Lecture 15: Structure from motion
CS5760: Computer Vision Lecture 9: RANSAC Noah Snavely
Lecture 6: Feature matching
CS5760: Computer Vision Lecture 9: RANSAC Noah Snavely
Project Presentation – Week 6
Lecture 11: Image alignment, Part 2
Presentation transcript:

Lecture 23: Structure from motion 2 CS6670: Computer Vision Noah Snavely Lecture 23: Structure from motion 2

Readings Szeliski, Chapter 7.1 – 7.4

SfM – Failure cases Necker reversal

Structure from Motion – Failure cases Repetitive structures

Incremental structure from motion To help get good initializations for all of the parameters of the system, we reconstruct the scene incrementally, starting from two photographs and the points they observe.

Incremental structure from motion To help get good initializations for all of the parameters of the system, we reconstruct the scene incrementally, starting from two photographs and the points they observe.

Incremental structure from motion We then add several photos at a time to the reconstruction, refine the model, and repeat until no more photos match any points in the scene.

Incremental structure from motion

Photo Explorer

Demo

Questions?

SfM applications 3D modeling Surveying Robot navigation and mapmaking Visual effects… (see video)