21/22 February 2003Granada iAstro Worshop1 Analysis of Astrophysical Data Cubes using Cross-correlations and Wavelet Denoisings A.Bijaoui 1, D.Mékarnia.

Slides:



Advertisements
Similar presentations
An Introduction to Fourier and Wavelet Analysis: Part I Norman C. Corbett Sunday, June 1, 2014.
Advertisements

Noise & Data Reduction. Paired Sample t Test Data Transformation - Overview From Covariance Matrix to PCA and Dimension Reduction Fourier Analysis - Spectrum.
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Color Imaging Analysis of Spatio-chromatic Decorrelation for Colour Image Reconstruction Mark S. Drew and Steven Bergner
PCA Tomography and its application to nearby galactic nuclei João Steiner IAG - Universidade de São Paulo +R. B. Menezes, T. V. Ricci +F. Ferrari (UNIPAMPA)
Machine Learning Lecture 8 Data Processing and Representation
2004 COMP.DSP CONFERENCE Survey of Noise Reduction Techniques Maurice Givens.
Interferometric Spectral Line Imaging Martin Zwaan (Chapters of synthesis imaging book)
Signal Processing Institute Swiss Federal Institute of Technology, Lausanne 1 Feature selection for audio-visual speech recognition Mihai Gurban.
Kernel Methods for De-noising with Neuroimaging Application
Principal Component Analysis
Reconstruction with Adaptive Feature-Specific Imaging Jun Ke 1 and Mark A. Neifeld 1,2 1 Department of Electrical and Computer Engineering, 2 College of.
AEOS Telescope + Image-Slicer/ Spectrograph Data Reduction and Results for June 8, 2006.
The Hidden Message Some useful techniques for data analysis Chihway Chang, Feb 18’ 2009.
Dimensional reduction, PCA
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
A Quick Practical Guide to PCA and ICA Ted Brookings, UCSB Physics 11/13/06.
1 When Does Randomization Fail to Protect Privacy? Wenliang (Kevin) Du Department of EECS, Syracuse University.
Principal Component Analysis Principles and Application.
Mercury’s Sodium Exosphere from Maui AEOS & Tohoku Observatory June 2006.
Multiscale transforms : wavelets, ridgelets, curvelets, etc.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Multidimensional Data Analysis : the Blind Source Separation problem. Outline : Blind Source Separation Linear mixture model Principal Component Analysis.
Survey on ICA Technical Report, Aapo Hyvärinen, 1999.
Image Representation Gaussian pyramids Laplacian Pyramids
Wavelets, ridgelets, curvelets on the sphere and applications Y. Moudden, J.-L. Starck & P. Abrial Service d’Astrophysique CEA Saclay, France.
Summarized by Soo-Jin Kim
Hyperspectral Imaging Alex Chen 1, Meiching Fong 1, Zhong Hu 1, Andrea Bertozzi 1, Jean-Michel Morel 2 1 Department of Mathematics, UCLA 2 ENS Cachan,
1 Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal 國立交通大學電子研究所 張瑞男
Feature extraction 1.Introduction 2.T-test 3.Signal Noise Ratio (SNR) 4.Linear Correlation Coefficient (LCC) 5.Principle component analysis (PCA) 6.Linear.
Type and redshift distributions 65 candidates have been observed between June 2003 and May Redshift is measured by using emission and/or absorption.
Hongyan Li, Huakui Wang, Baojin Xiao College of Information Engineering of Taiyuan University of Technology 8th International Conference on Signal Processing.
Independent Component Analysis Zhen Wei, Li Jin, Yuxue Jin Department of Statistics Stanford University An Introduction.
Robust Motion Watermarking based on Multiresolution Analysis Tae-hoon Kim Jehee Lee Sung Yong Shin Korea Advanced Institute of Science and Technology.
Digital Imaging and Remote Sensing Laboratory NAPC 1 Noise Adjusted Principal Component Transform (NAPC) Data are first preprocessed to remove system bias.
Using Support Vector Machines to Enhance the Performance of Bayesian Face Recognition IEEE Transaction on Information Forensics and Security Zhifeng Li,
Analysis Techniques for Weak Brain Activity Alain de Cheveigné CNRS / Université Paris Descartes / École normale supérieure / UCL Ear Institute AIM Isolate.
Experiments on Noise CharacterizationRoma, March 10,1999Andrea Viceré Experiments on Noise Analysis l Need of noise characterization for  Monitoring the.
COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS Dr. Robert Barsanti SSST March 2011, Auburn University.
Feature Selection and Extraction Michael J. Watts
Principal Component Analysis (PCA).
Suppression of Musical Noise Artifacts in Audio Noise Reduction by Adaptive 2D filtering Alexey Lukin AES Member Moscow State University, Moscow, Russia.
Jun Li 1, Zhongdong Yang 1, W. Paul Menzel 2, and H.-L. Huang 1 1 Cooperative Institute for Meteorological Satellite Studies (CIMSS), UW-Madison 2 NOAA/NESDIS/ORA.
Principal component analysis of the color spectra from natural scenes Long Nguyen ECE-499 Advisor: Prof. Shane Cotter.
1 C.A.L. Bailer-Jones. Machine Learning. Data exploration and dimensionality reduction Machine learning, pattern recognition and statistical data modelling.
Speech Enhancement Summer 2009
Extracting the atrial signal from an electrocardiogram (ECG)
A new technique of detection and inversion
Hot subdwarfs from the SDSS/BOSS
The Chinese University of Hong Kong
Image Denoising in the Wavelet Domain Using Wiener Filtering
Lecture 1: Images and image filtering
Blind Signal Separation using Principal Components Analysis
Outline Linear Shift-invariant system Linear filters
4. DIGITAL IMAGE TRANSFORMS 4.1. Introduction
[CII] observations of the Ring nebula (NGC 6720)
Principal Component Analysis (PCA)
Data Preprocessing Copyright, 1996 © Dale Carnegie & Associates, Inc.
SVD, PCA, AND THE NFL By: Andrew Zachary.
[CII] observations of the Ring nebula (NGC 6720)
Analysis of Audio Using PCA
Principal Components Analysis
Non-negative Matrix Factorization (NMF)
Principal Component Analysis
Lecture 1: Images and image filtering
Principal Component Analysis
Feature Extraction (I)
Data Preprocessing Copyright, 1996 © Dale Carnegie & Associates, Inc.
Marios Mattheakis and Pavlos Protopapas
Image restoration, noise models, detection, deconvolution
Presentation transcript:

21/22 February 2003Granada iAstro Worshop1 Analysis of Astrophysical Data Cubes using Cross-correlations and Wavelet Denoisings A.Bijaoui 1, D.Mékarnia 1, J.P.Maillard 2, C.Delle Luche 1 1 Observatoire de la Côte d'Azur (Nice) 2 Institut d’Astrophysique de Paris

21/22 February 2003Granada iAstro Worshop2 Outlines The Astrophysical Data Cubes –BEAR and IFTS The Karhunen-Loève expansion (KL/PCA) –The KL basis –The noise of the basis /components Wavelet denoising of the basis/components The residues and their denoising An application on NGC 7027 cube Conclusion

21/22 February 2003Granada iAstro Worshop3 The Integral-Field Spectrographs Different optical devices –Scanning Fabry-Perot –Optical fibers (VIMOS, GIRAFFE) –Cylindrical lenses + Grating (TIGRE, OASIS) –Multislit (SAURON, MUSE) –Imaging Fourier Transform Spectrograph Resulting Data Cubes –Size depending on the device –From Megapixel to Gigapixel Need of specific analysis methods

21/22 February 2003Granada iAstro Worshop4 BEAR : an IFTS device

21/22 February 2003Granada iAstro Worshop5 BEAR at the CFHT focus

21/22 February 2003Granada iAstro Worshop6 The example of NGC 7027 A post AGB planetary nebula –Observations  Cox et al –The resampled data cube: 128x128x1024 What information? –Different spectral lines  Abundance –Velocity field  3D view –Continuum Necessity to denoise the data cube –To increase the SNR –To observe fainter objects

21/22 February 2003Granada iAstro Worshop7 The data cube

21/22 February 2003Granada iAstro Worshop8 Spectra sample

21/22 February 2003Granada iAstro Worshop9 Elements of the data reduction We can take into account –The cross correlation between the images  PCA / KL expansion –The significant details image / image –The significant details spectrum / spectrum Different possible ways –Wavelet Transform + KL exp. + Denoising + Reconstruction (Starck et al. 2001) –KL exp. + Denoising + Reconstruction + Residue + Denoising (Mékarnia et al. 2003)

21/22 February 2003Granada iAstro Worshop10 KL and PCA Search of uncorrelated images The Principal Component Analysis –Iterative extraction of the linear combinations having the greatest variance PCA application to images  KL The eigenvalue = the energy / order

21/22 February 2003Granada iAstro Worshop11 The noisy KL basis

21/22 February 2003Granada iAstro Worshop12 Denoising the KL expansion Each KL component is noisy –Depends on the order / eigenvalue Each KL spectrum is noisy The reconstruction from noisy components leads to a noisy restoration Each KL component / spectrum is denoised –Wavelet denoising –Redundant transform –Soft wavelet shrinkage

21/22 February 2003Granada iAstro Worshop13 The denoised KL basis

21/22 February 2003Granada iAstro Worshop14 The residues and their analysis Do not forget to denoise the mean ! The reconstruction with the denoised KL is limited: –Not enough components –Adding components = increase the noise –The denoising can remove local significant feature Use of the residues between the original data and the restored one

21/22 February 2003Granada iAstro Worshop15 After the residue denoising

21/22 February 2003Granada iAstro Worshop16 Spectra Sample

21/22 February 2003Granada iAstro Worshop17 The velocity field

21/22 February 2003Granada iAstro Worshop18 3D visualisation

21/22 February 2003Granada iAstro Worshop19 A spectrum in a cavity

21/22 February 2003Granada iAstro Worshop20 A continuum image

21/22 February 2003Granada iAstro Worshop21 The integrated continuum

21/22 February 2003Granada iAstro Worshop22 CONCLUSION Data cube can be denoised from KL Limitation of the number of components –We could use more components with denoising –Too local information (spectral/spatial) Residue denoising –Could be improved (best basis, softening rule, regularisation,..) Artifact removal –Use of ICA/SOBI blind source separation Help for astrophysical interpretation