3D with EUVI images using optical flow First attempt on 30.4nm images Samuel Gissot Jean-François Hochedez SIDC/Royal Observatory of Belgium 5th SECCHI.

Slides:



Advertisements
Similar presentations
Andrew Cosand ECE CVRR CSE
Advertisements

Motion.
The fundamental matrix F
Investigation Into Optical Flow Problem in the Presence of Spatially-varying Motion Blur Mohammad Hossein Daraei June 2014 University.
Motion Estimation I What affects the induced image motion? Camera motion Object motion Scene structure.
Digital Camera and Computer Vision Laboratory Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan, R.O.C.
Computer vision: models, learning and inference
Computer Vision Optical Flow
Medical Imaging Mohammad Dawood Department of Computer Science University of Münster Germany.
Structure from motion.
Active Calibration of Cameras: Theory and Implementation Anup Basu Sung Huh CPSC 643 Individual Presentation II March 4 th,
Motion Estimation I What affects the induced image motion? Camera motion Object motion Scene structure.
Announcements Quiz Thursday Quiz Review Tomorrow: AV Williams 4424, 4pm. Practice Quiz handout.
1 Determination of 3D CME Trajectories using Stereoscopy Paulett Liewer, Jeff Hall, Eric DeJong, JPL Vahab Pournaghsband, UCB Arnaud Thernisien and Russ.
2008/10/21 J. Fontenla, M Haberreiter LASP – Univ. of Colorado NADIR MURI Focus Area.
Structure from motion. Multiple-view geometry questions Scene geometry (structure): Given 2D point matches in two or more images, where are the corresponding.
Feature matching and tracking Class 5 Read Section 4.1 of course notes Read Shi and Tomasi’s paper on.
3D Stereoscopic Reconstruction of CMEs by Forward Modeling 5th Consortium STEREO-SECCHI Meeting Orsay, March 2007 Y.BOURSIER – P.LAMY – F.GOUDAIL - A.LLEBARIA.
Lecture 11: Structure from motion CS6670: Computer Vision Noah Snavely.
Optical flow and Tracking CISC 649/849 Spring 2009 University of Delaware.
Optical Flow Estimation
Optical Flow Estimation using Variational Techniques Darya Frolova.
Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
Linearizing (assuming small (u,v)): Brightness Constancy Equation: The Brightness Constraint Where:),(),(yxJyxII t  Each pixel provides 1 equation in.
Motion Field and Optical Flow. Outline Motion Field and Optical Flow Definition, Example, Relation Optical Flow Constraint Equation Assumptions & Derivation,
COMP 290 Computer Vision - Spring Motion II - Estimation of Motion field / 3-D construction from motion Yongjik Kim.
Matching Compare region of image to region of image. –We talked about this for stereo. –Important for motion. Epipolar constraint unknown. But motion small.
Optical flow (motion vector) computation Course: Computer Graphics and Image Processing Semester:Fall 2002 Presenter:Nilesh Ghubade
CSC 589 Lecture 22 Image Alignment and least square methods Bei Xiao American University April 13.
Generating panorama using translational movement model.
Co-spatial White Light and Hard X-ray Flare Footpoints seen above the Solar Limb: RHESSI and HMI observations Säm Krucker Space Sciences Laboratory, UC.
1 Interpreting SECCHI White Light Images: FOV Sensitivity & Stereo Viewing Paulett Liewer, JPL; Russ Howard & Dennis Socker, NRL SECCHI Consortium Meeting.
1 Preview At least two views are required to access the depth of a scene point and in turn to reconstruct scene structure Multiple views can be obtained.
Polarized V-band Stars for In-flight Calibration of Space-borne Solar Coronagraphs Capobianco, Gerardo; Fineschi, Silvano INAF- Osservatorio Astrofisico.
Sky Coordinate Image Specs Fully processed: –Merged –10-min cadence –“sky to sky” interpolation –Gaussian temporal filter –Renormalized such that time.
Optical Flow Donald Tanguay June 12, Outline Description of optical flow General techniques Specific methods –Horn and Schunck (regularization)
The Brightness Constraint
Course 12 Calibration. 1.Introduction In theoretic discussions, we have assumed: Camera is located at the origin of coordinate system of scene.
Digital Image Processing Lecture 7: Geometric Transformation March 16, 2005 Prof. Charlene Tsai.
1 Determination of CME 3D Trajectories using COR Stereoscopy + Analysis of HI1 CME Tracks P. C. Liewer, E. M. DeJong, J. R. Hall, JPL/Caltech; N. Sheeley,
The Measurement of Visual Motion P. Anandan Microsoft Research.
CS654: Digital Image Analysis Lecture 8: Stereo Imaging.
CSCE 643 Computer Vision: Structure from Motion
Visual motion Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
1 3D Sun Loop Trace: A Tool for Stereoscopy of Coronal Loops for STEREO Jean Lorre Jeff Hall Paulett Liewer Parth Sheth Eric DeJong Jet Propulsion Laboratory.
Uses of Motion 3D shape reconstruction Segment objects based on motion cues Recognize events and activities Improve video quality Track objects Correct.
2007 March 261 SECCHI-EUVI Status and First Observations Jean-Pierre Wuelser Lockheed Martin Solar and Astrophysics Lab And The SECCHI Team.
Michael L. Kaiser STEREO Project Scientist NASA/Goddard Space Flight Center STEREO June 11, 2008 STEREO at 1.4 years.
Two-view geometry. Epipolar Plane – plane containing baseline (1D family) Epipoles = intersections of baseline with image planes = projections of the.
Joint Tracking of Features and Edges STAN BIRCHFIELD AND SHRINIVAS PUNDLIK CLEMSON UNIVERSITY ABSTRACT LUCAS-KANADE AND HORN-SCHUNCK JOINT TRACKING OF.
1 Motion Analysis using Optical flow CIS601 Longin Jan Latecki Fall 2003 CIS Dept of Temple University.
Ning Sun, Hassan Mansour, Rabab Ward Proceedings of 2010 IEEE 17th International Conference on Image Processing September 26-29, 2010, Hong Kong HDR Image.
Motion Estimation I What affects the induced image motion?
ST236 Site Calibrations with Trimble GNSS
Static and dynamic measurements of the altitude of solar structures with the Secchi telescopes of STEREO-A and STEREO-B SOHO 20 Gent august 27, 31: 2007.
Motion / Optical Flow II Estimation of Motion Field Avneesh Sud.
Optical flow and keypoint tracking Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys.
XRT SOT Alignment DeLuca With comments from Tarbell & Metcalf 21-Jan-2006.
Measurements of the altitudes of solar filaments Guy Artzner Institut d’Astrophysique Spatiale Orsay ftp://ftp.ias.u-psud.fr/gartzner/ftp_projet/Secchi/
Lecture Notes on Astrometry Space Newtonian Viewpoint Spatial Coord. System = Reference Frame Inertial Reference Frame Spatial Coord. Transformation.
Motion estimation Digital Visual Effects, Spring 2005 Yung-Yu Chuang 2005/3/23 with slides by Michael Black and P. Anandan.
UVIS calibration update Greg Holsclaw Bill McClintock Jan 8,
Motion and Optical Flow
Exploring Large-scale Coronal Magnetic Field Over Extended Longitudes With EUVI EUVI B EIT EUVI A 23-Mar UT Nariaki Nitta, Marc DeRosa, Jean-Pierre.
First Assessments of EUVI Performance on STEREO SECCHI
The Brightness Constraint
Combining Geometric- and View-Based Approaches for Articulated Pose Estimation David Demirdjian MIT Computer Science and Artificial Intelligence Laboratory.
Coupled Horn-Schunck and Lukas-Kanade for image processing
Chapter 11: Stereopsis Stereopsis: Fusing the pictures taken by two cameras and exploiting the difference (or disparity) between them to obtain the depth.
Optical flow and keypoint tracking
Presentation transcript:

3D with EUVI images using optical flow First attempt on 30.4nm images Samuel Gissot Jean-François Hochedez SIDC/Royal Observatory of Belgium 5th SECCHI Consortium Meeting Orsay, France. March

3D reconstruction method outline of the talk  Aim Prominence altitude Altitude gradients in supergranules?  Mutual registration of EUVI-A and B images Limb fitting (center and radius estimations) Roll angle, rotation transform and header parameters  Optical flow Apparent displacement estimation Error prediction  Stereoscopic reconstruction Formula Confidence level and limitations  Outlooks

3D reconstruction method Global registration to (S/C-A, S/C-B, Sun) plane EUVI-AEUVI-B rotated EUVI-A rotated and scaled EUVI-B Input parameters: roll from ecliptic north (stereo science center website) HEE positions of S/C-A and S/C-B Optical flow computation Depth map construction as produced by secchi_prep.pro, no rotation, B-limb fitted on A-limb 0.5 deg adjustment of roll angle correction

Mutual registration of EUVI-A and B (δx,δy) Solar disc center in EUVI-A Solar disc center in EUVI-B Limb

Mutual registration of EUVI-A and B Ecliptic plane S/C-B S/C-A Sun Earth Normal direction to (S/C-A, S/C-B, Sun) plane Ecliptic north θ Expected shifts parallel to this line HEE latitude S/C-A HEE longitude S/C-B

Mutual registration of EUVI-A and B Ecliptic north Normal direction to (S/C-A, S/C-B, Sun) plane Center of Sun/EUVI-A scaling rotation to the (s/cA,s/cB,S) plane correction to roll angle applied to EUVI-B δθδθ θ

EUVI-A and DATE: _ Mutual registration needed: EUVI-AEUVI-B Note limb fitted

Mutual registration of EUVI-A and B  Summary of parameters found: IDL> print,crx_im1,cry_im1,crx_im2,cry_im IDL> print,rad_im1,rad_im ;;;; DATE: _ STEREO-B Earth STEREO-A Heliocentric distance (AU) Semidiameter (arcsec) HCI longitude HCI latitude Carrington longitude Carrington rotation number Heliographic (HEEQ) longitude Heliographic (HEEQ) latitude Earth Ecliptic (HEE) longitude Earth Ecliptic (HEE) latitude Roll from ecliptic north Roll from solar north Separation angle with Earth Separation angle A with B IDL> print,header_304_a_norot.heex_obs e+11 IDL> print,header_304_a_norot.heey_obs e+09 IDL> print,header_304_a_norot.heez_obs e+08 IDL> print,header_304_a_norot.dsun_obs e+11 IDL> print,header_304_b_norot.heex_obs e+11 IDL> print,header_304_b_norot.heey_obs e+08 IDL> print,header_304_b_norot.heez_obs e+08 IDL> print,header_304_b_norot.dsun_obs e+11

Optical flow method  Gissot S., Hochedez (2007) A&A volume 464, issue 3: Multiscale optical flow probing of dynamics in solar EUV images. Algorithm, calibration and first results

1 st Assumption : Brightness Constancy (BCA) Its linear approximation: At each pixel: 1 equation for 1 unknown in 1-D But, Still 1 equation for 2 unknowns in 2-D (images) Aperture issue Signal spatial dimension Image registration: I1I1 I2I2 I 2 -I 1 x δxδx

Following LUCAS KANADE (1981), we assume: Uniformity of the motion over a neighborhood Ω  Extra-equations (more than needed!) e.g. 9 equations if Ω = 3x3 pixels Over-determination  Least-square minimization 2 nd Assumption : Local Uniformity (LUA)

Brightness Variation (δI = BV)  Over-determined system  possible to add unknown(s)  We estimate δx, δy AND δI  Mathematically better Cope with time aliasing (lack of cadence) Model accounts for a larger fraction of I 2 - I 1 Neighborhood (scale) δx = θ = (δx, δy, δI) δIδI

Mutual registration of EUVI-A and B: difference image, δθ=0 degree (no additional correction)

Optical flow estimation, full image, low resolution (2) beta=0.5, δθ=0 deg

Mutual registration of EUVI-A and B: difference image, δθ=0.5 degree

Optical flow estimation, full image, low resolution (1) beta=0.5, δθ=0.5 deg

Mutual registration of EUVI-A and B: difference image, δθ=0.9 degree

Optical flow estimation, full image, low resolution (4) beta=0.5, δθ=0.9 deg

Depth reconstruction formula Sun center z EUVI-B EUVI-A δx B δx A δx=δxB-δxA z=1/tan(α)* δx α

Depth reconstruction

Discussion (1/2)  Brightness change remains to be interpreted Transparency of SiXI emission  DEM “purification” will help Slight flatfields mis-match?  Error map on the optical flow remains to be exploited (method provides it)  Hope for best roll angles from headers

Discussion (2/2)  The flow could help to estimate δθ  Origin of δθ (roll angle correction) ? Misalignment between instruments and S/C pointing?  Static or not?  Correction method Bug in our method??

Conclusions  Calibration study: Refinement of roll angle between stereo A and B  First attempt of optical-flow application to 3D reconstruction: Initial global matching, optical-flow estimation and 3D interpretation  Under construction: