Motion Field and Optical Flow. Outline Motion Field and Optical Flow Definition, Example, Relation Optical Flow Constraint Equation Assumptions & Derivation,

Slides:



Advertisements
Similar presentations
Andrew Cosand ECE CVRR CSE
Advertisements

Motion.
Computer Vision Optical Flow
A New Block Based Motion Estimation with True Region Motion Field Jozef Huska & Peter Kulla EUROCON 2007 The International Conference on “Computer as a.
Course Review CS/ECE 181b Spring Topics since Midterm Stereo vision Shape from shading Optical flow Face recognition project.
PSY 5018H: Math Models Hum Behavior, Prof. Paul Schrater, Spring 2004 Vision as Optimal Inference The problem of visual processing can be thought of as.
Feature tracking. Identify features and track them over video –Small difference between frames –potential large difference overall Standard approach:
Optical Flow Methods 2007/8/9.
May 2004Motion/Optic Flow1 Motion Field and Optical Flow Ack, for the slides: Professor Yuan-Fang Wang Professor Octavia Camps.
Computing motion between images
Optical Flow Brightness Constancy The Aperture problem Regularization Lucas-Kanade Coarse-to-fine Parametric motion models Direct depth SSD tracking.
CSc83029 – 3-D Computer Vision/ Ioannis Stamos 3-D Computational Vision CSc Optical Flow & Motion The Factorization Method.
Computer Vision Optical Flow Marc Pollefeys COMP 256 Some slides and illustrations from L. Van Gool, T. Darell, B. Horn, Y. Weiss, P. Anandan, M. Black,
Optical Flow
Optical Flow Brightness Constancy The Aperture problem Regularization Lucas-Kanade Coarse-to-fine Parametric motion models Direct depth SSD tracking.
CS 6825: Motion Part 2 – Optical Flow Recall: Optical Flow is an approximation of the 2D motion field. is an approximation of the 2D motion field. Motion.
Motion Computing in Image Analysis
Lecture 19: Optical flow CS6670: Computer Vision Noah Snavely
Optical Flow Estimation using Variational Techniques Darya Frolova.
Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
Image Motion.
COMP 290 Computer Vision - Spring Motion II - Estimation of Motion field / 3-D construction from motion Yongjik Kim.
Image Primitives and Correspondence
3D Rigid/Nonrigid RegistrationRegistration 1)Known features, correspondences, transformation model – feature basedfeature based 2)Specific motion type,
Photometric Stereo & Shape from Shading
Optic flow from dynamic anchor point attributes a feasibility study Bart Janssen.
CSCE 641 Computer Graphics: Image Registration Jinxiang Chai.
Motion from normal flow. Optical flow difficulties The aperture problemDepth discontinuities.
Computer Vision Optical Flow Marc Pollefeys COMP 256 Some slides and illustrations from L. Van Gool, T. Darell, B. Horn, Y. Weiss, P. Anandan, M. Black,
Optical flow (motion vector) computation Course: Computer Graphics and Image Processing Semester:Fall 2002 Presenter:Nilesh Ghubade
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
Optical Flow Donald Tanguay June 12, Outline Description of optical flow General techniques Specific methods –Horn and Schunck (regularization)
1-1 Measuring image motion velocity field “local” motion detectors only measure component of motion perpendicular to moving edge “aperture problem” 2D.
Computer Vision, Robert Pless Lecture 11 our goal is to understand the process of multi-camera vision. Last time, we studies the “Essential” and “Fundamental”
Verifying the “Consistency” of Shading Patterns and 3-D Structures Pawan Sinha & Edward Adelson.
Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
December 9, 2014Computer Vision Lecture 23: Motion Analysis 1 Now we will talk about… Motion Analysis.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #16.
Course 11 Optical Flow. 1. Concept Observe the scene by moving viewer Optical flow provides a clue to recover the motion. 2. Constraint equation.
CS332 Visual Processing Department of Computer Science Wellesley College Analysis of Motion Measuring image motion.
3D Imaging Motion.
Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.
1 Motion Analysis using Optical flow CIS601 Longin Jan Latecki Fall 2003 CIS Dept of Temple University.
CS332 Visual Processing Department of Computer Science Wellesley College Analysis of Motion Recovering 3-D structure from motion.
Multiple Light Source Optical Flow Multiple Light Source Optical Flow Robert J. Woodham ICCV’90.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Motion / Optical Flow II Estimation of Motion Field Avneesh Sud.
Optical flow and keypoint tracking Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
MASKS © 2004 Invitation to 3D vision Lecture 3 Image Primitives andCorrespondence.
Image Motion. The Information from Image Motion 3D motion between observer and scene + structure of the scene –Wallach O’Connell (1953): Kinetic depth.
MOTION Model. Road Map Motion Model Non Parametric Motion Field : Algorithms 1.Optical flow field estimation. 2.Block based motion estimation. 3.Pel –recursive.
Announcements Project 3a due today Project 3b due next Friday.
Instructor: S. Narasimhan
Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
Robust Visual Motion Analysis: Piecewise-Smooth Optical Flow
CSE 577 Image and Video Analysis
Image Primitives and Correspondence
Derivatives of Trig Functions
Computing the velocity field
Filtering Things to take away from this lecture An image as a function
Announcements Questions on the project? New turn-in info online
Coupled Horn-Schunck and Lukas-Kanade for image processing
Measuring image motion
Open Topics.
Filtering An image as a function Digital vs. continuous images
Optical flow and keypoint tracking
Image Motion.
Detecting Motion Pattern in Optical Flow Fields
Presentation transcript:

Motion Field and Optical Flow

Outline Motion Field and Optical Flow Definition, Example, Relation Optical Flow Constraint Equation Assumptions & Derivation, Related Problems Space-Time Diagram Definition, Example

Motion Field Projection of the 3-D velocity field on the 2-D image plane.

Optical Flow Apparent motion of the brightness pattern in the image.

Optical Flow Motion Field

Optical Flow Constraint Equation 1.Assumptions uniform illumination Lambertian surface reflectance translation // image plane

Optical Flow Constraint Equation 2.Equation Derivation

OFCE: Correspondence Problem

OFCE: Aperture Problem

OFCE: Smoothness Restraints Small gradient of the optical flow ( Es ) Small error in OFCE ( Ec ) Objective : minimize ( Es + k Ec )

Space-Time Diagram