Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Image Reconstruction in Optical/IR Aperture Synthesis Eric.

Slides:



Advertisements
Similar presentations
Pattern Recognition and Machine Learning
Advertisements

Bayesian Belief Propagation
A Crash Course in Radio Astronomy and Interferometry: 4
1 Low-Dose Dual-Energy CT for PET Attenuation Correction with Statistical Sinogram Restoration Joonki Noh, Jeffrey A. Fessler EECS Department, The University.
Kriging.
Machine Learning Week 2 Lecture 1.
Nonlinear Regression Ecole Nationale Vétérinaire de Toulouse Didier Concordet ECVPT Workshop April 2011 Can be downloaded at
Data mining and statistical learning - lecture 6
Aspects of Conditional Simulation and estimation of hydraulic conductivity in coastal aquifers" Luit Jan Slooten.
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
ECE 472/572 - Digital Image Processing Lecture 8 - Image Restoration – Linear, Position-Invariant Degradations 10/10/11.
Forecasting JY Le Boudec 1. Contents 1.What is forecasting ? 2.Linear Regression 3.Avoiding Overfitting 4.Differencing 5.ARMA models 6.Sparse ARMA models.
x – independent variable (input)
Constraining Astronomical Populations with Truncated Data Sets Brandon C. Kelly (CfA, Hubble Fellow, 6/11/2015Brandon C. Kelly,
Motion Analysis (contd.) Slides are from RPI Registration Class.
Estimating parameters in inversions for regional carbon fluxes Nir Y Krakauer 1*, Tapio Schneider 1, James T Randerson 2 1. California Institute of Technology.
Curve-Fitting Regression
I DENTIFICATION OF main flow structures for highly CHANNELED FLOW IN FRACTURED MEDIA by solving the inverse problem R. Le Goc (1)(2), J.-R. de Dreuzy (1)
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
1 Synthesis Imaging Workshop Error recognition R. D. Ekers Narrabri, 20 Sep 2006.
Independent Component Analysis (ICA) and Factor Analysis (FA)
Algorithm Evaluation and Error Analysis class 7 Multiple View Geometry Comp Marc Pollefeys.
1 Synthesis Imaging Workshop Error recognition R. D. Ekers Narrabri, 14 May 2003.
Array Design David Woody Owens Valley Radio Observatory presented at NRAO summer school 2002.
Regression Eric Feigelson. Classical regression model ``The expectation (mean) of the dependent (response) variable Y for a given value of the independent.
Principles of Least Squares
Collaborative Filtering Matrix Factorization Approach
ELE 488 F06 ELE 488 Fall 2006 Image Processing and Transmission ( ) Wiener Filtering Derivation Comments Re-sampling and Re-sizing 1D  2D 10/5/06.
Model fitting: tutorial and introduction to the practice session EuroSummer School Observation and data reduction with the Very Large Telescope Interferometer.
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Non-imaging Analysis and Self- calibration Steven Tingay ATNF Astronomical Synthesis Imaging Workshop Narrabri, 24 – 28 September, 2001.
Hydrologic Modeling: Verification, Validation, Calibration, and Sensitivity Analysis Fritz R. Fiedler, P.E., Ph.D.
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
DTU Medical Visionday May 27, 2009 Generative models for automated brain MRI segmentation Koen Van Leemput Athinoula A. Martinos Center for Biomedical.
A physical basis of GOES SST retrieval Prabhat Koner Andy Harris Jon Mittaz Eileen Maturi.
Learning Lateral Connections between Hidden Units Geoffrey Hinton University of Toronto in collaboration with Kejie Bao University of Toronto.
WB1440 Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Efficient computation of Robust Low-Rank Matrix Approximations in the Presence of Missing Data using the L 1 Norm Anders Eriksson and Anton van den Hengel.
Research Vignette: The TransCom3 Time-Dependent Global CO 2 Flux Inversion … and More David F. Baker NCAR 12 July 2007 David F. Baker NCAR 12 July 2007.
Image deconvolution, denoising and compression T.E. Gureyev and Ya.I.Nesterets
Data assimilation and forecasting the weather (!) Eugenia Kalnay and many friends University of Maryland.
Raquel A. Romano 1 Scientific Computing Seminar May 12, 2004 Projective Geometry for Computer Vision Projective Geometry for Computer Vision Raquel A.
July 11, 2006Bayesian Inference and Maximum Entropy Probing the covariance matrix Kenneth M. Hanson T-16, Nuclear Physics; Theoretical Division Los.
Quality of model and Error Analysis in Variational Data Assimilation François-Xavier LE DIMET Victor SHUTYAEV Université Joseph Fourier+INRIA Projet IDOPT,
Tony Jebara, Columbia University Advanced Machine Learning & Perception Instructor: Tony Jebara.
Milli-arcsecond Imaging of the Inner Regions of Protoplanetary Disks Stéphanie Renard In collaboration with F. Malbet, E. Thiébaut, J.-P. Berger & M. Benisty.
Over-fitting and Regularization Chapter 4 textbook Lectures 11 and 12 on amlbook.com.
Machine Learning 5. Parametric Methods.
Geology 5670/6670 Inverse Theory 20 Feb 2015 © A.R. Lowry 2015 Read for Mon 23 Feb: Menke Ch 9 ( ) Last time: Nonlinear Inversion Solution appraisal.
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
Numerical Analysis – Data Fitting Hanyang University Jong-Il Park.
Data Mining Lectures Lecture 7: Regression Padhraic Smyth, UC Irvine ICS 278: Data Mining Lecture 7: Regression Algorithms Padhraic Smyth Department of.
Linear Models Tony Dodd. 21 January 2008Mathematics for Data Modelling: Linear Models Overview Linear models. Parameter estimation. Linear in the parameters.
Biointelligence Laboratory, Seoul National University
Bounded Nonlinear Optimization to Fit a Model of Acoustic Foams
Probability Theory and Parameter Estimation I
Ch3: Model Building through Regression
Workshop on Methods for Genomic Selection (El Batán, July 15, 2013) Paulino Pérez & Gustavo de los Campos.
10701 / Machine Learning.
Probabilistic Models for Linear Regression
Roberto Battiti, Mauro Brunato
Collaborative Filtering Matrix Factorization Approach
Image Restoration and Denoising
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Cross-validation for the selection of statistical models
Biointelligence Laboratory, Seoul National University
Non-imaging Analysis and Self-calibration
Whitening-Rotation Based MIMO Channel Estimation
Presentation transcript:

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Image Reconstruction in Optical/IR Aperture Synthesis Eric Thiébaut JMMC & AIRI/CRAL (France) Jean-Marie Mariotti Center Centre de Recherche Astronomique de Lyon Astrophysique et Imagerie aux Résolutions de l'Interférométrie

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Preamble 1/The problem of optical/IR aperture synthesis imaging is quite different from radio-astronomy: one cannot rebuild the Fourier phase and produce synthetic complex visibilities (unless perhaps for redundant configuration in snapshot mode, i.e. no hyper-synthesis) ► fit phase closures and power spectrum data 2/One has to regularize in order to: ■cope with missing data (i.e. interpolate between sampled spatial frequencies) ■avoid artifacts due to the sparse/non-even sampling ► result is biased toward a priori enforced by regularization it; is important to realize that in order to correctly understand the restored images ► formation of users

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Approximations ● versatile brightness distribution model (no need for FFT's nor rebinning of the sampled spatial frequencies) ● simple model of the data: – point-like telescopes (OK as far as D << B) – calibrated powerspectrum and phase closure ● gaussian noise (not true for interferometric data at least because of the calibration) ● probably others...

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Brightness Distribution Model general linear model of the brightness distribution: advantages: exact Fourier transform choice of proper basis of functions (e.g. wavelets, delta functions for stars and splines for background,...) or, using a grid: model of j-th complex visibility: with:or

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Inverse Problem the image restoration problem is stated as a constrained optimization problem: regularization likelihood: penalty: subject to hyperparameter

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Likelihood Terms likelihood for heterogeneous data: powerspectrum data: with residuals: phase closure data: is the Fourier phase is the difference wrapped in [- ,+  ] to avoid the phase wrapping problem (Haniff, 1994)

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Regularization Term Several possible expressions for the regularization: ✗ maximum entropy method : ✗ Tikhonov : where g is the prior, R is a symetric positive matrix ✗ others:...

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Choosing the Hyperparameter(s) ✗ deterministics methods (e.g. Lannes, Wiener) ✗ statistics methods, e.g. Gull: ✗ cross validation (CV) ✗ generalized cross validation (GCV, Wahba) ✗ L-curves (Hansen)

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Potential Difficulties ● heterogeneous data ► more hyperparameters? ● possibly large number of parameters ● penalty to minimize is: – non-quadratic ► non-linear optimization – multi-mode (sum of terms with different behaviour) – constrained (at least positivity) – non-convex ► multiple local minima ➔ very difficult to optimize ● phase wrapping problem (solved)

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Optimization Part optimization of a non-convex, non-quadratic penalty function of a large number of constrained parameters by: ● descent methods: – variable metric methods (BFGS) are faster than conjugate gradient ● there exists limited memory version (VMLM, Nodedal 1980) ● can be modified to account for bound constraints (VMLM-B, Thiébaut 2002) ● easy to use (only gradients required) – local subspace method should be more efficient (Skilling & Brian 1984; Thiébaut 2002) but needs second derivatives ● global methods?

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Test Image: PMS's Microjet microjet emitted by a PMS (model by P. Garcia et al.) 7 observing nights 7 configurations with 3 AT's ➔ 190 powerspectrum data ➔ 63 phase closures ➔ 1024 unknowns (u,v) coverage

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Future Work for the Image Restoration Software ● account for correlated data (+) ● use data exchange format (+) ● automatically adjust hyperparameters (++) ● improve optimization part (+++++) ● link with ASPRO (G. Duvert) for more realistic simulated data ● provide error bars (++) ● process real data (Amber with 3 telescopes in 2004)

Imaging Algorithm – Eric Thiébaut – IAU Optical/IR Interferometry Working Group, 2002 J M M C Future Work for the Image Restoration Group of the JMMC ● elaborate on proper regularization(s) ● model of the data may be more complex ● metric to compare restored images with different – configurations → optimization of (u,v) coverage to reduce observing time – regularizations ● estimation of the best hyperparameters ● educate astronomers (summer school, workshops,...) : regularized image reconstruction is not so difficult to understand and must be understood to realize the unavoidable biases in the result