Wed. 17th Sept. 20081Hamburg LOFAR Workshop.  Extract a cosmological signal from a datacube, the three axes of which are x and y positions, and frequency.

Slides:



Advertisements
Similar presentations
A Crash Course in Radio Astronomy and Interferometry: 4
Advertisements

Suman Majumdar Department of Astronomy and Oskar Klein Centre Stockholm University Redshift Space Anisotropies in the EoR 21-cm Signal: what do they tell.
NASSP Masters 5003F - Computational Astronomy Lecture 5: source detection. Test the null hypothesis (NH). –The NH says: let’s suppose there is no.
Foreground cleaning in CMB experiments Carlo Baccigalupi, SISSA, Trieste.
Cleaned Three-Year WMAP CMB Map: Magnitude of the Quadrupole and Alignment of Large Scale Modes Chan-Gyung Park, Changbom Park (KIAS), J. Richard Gott.
EOR Detection Strategies Somnath Bharadwaj IIT Kharagpur.
FastICA as a LOFAR-EoR Foreground Cleaning Technique Filipe Abdalla and Emma Woodfield University College London with Saleem Zaroubi, Vibor Jelic, Panos.
Subtleties in Foreground Subtraction Adrian Liu, MIT mK 1 K 100 mK.
Indo – SA Joint Astronomy Workshop, August 2012 / 22 Study of Foregrounds and Limitations to EoR Detection Nithyanandan Thyagarajan N. Udaya Shankar Ravi.
Galaxy and Mass Power Spectra Shaun Cole ICC, University of Durham Main Contributors: Ariel Sanchez (Cordoba) Steve Wilkins (Cambridge) Imperial College.
Epoch of Reionization Tomography with the CSO Wide-field C+ spectral mapping and correlation with HI Matt Bradford CSO NSF visit: October 12, 2011 CSO.
Scientific Detector Workshop, Taormina Sicily, June Raw H2RG Image  Two Hawaii2RG images provided by Gert Finger is the starting point of this.
Cosmology with the 21 cm Transition Steve Furlanetto Yale University September 25, 2006 Steve Furlanetto Yale University September 25, 2006.
Laurent Itti: CS599 – Computational Architectures in Biological Vision, USC Lecture 7: Coding and Representation 1 Computational Architectures in.
Large Scale Simulations of Reionization Garrelt Mellema Stockholm Observatory Collaborators: Ilian Iliev, Paul Shapiro, Marcelo Alvarez, Ue-Li Pen, Hugh.
Matched Filter Search for Ionized Bubbles in 21-cm Maps Kanan K. Datta Dept. of Astronomy Stockholm University Oskar Klein Centre.
Binary Variables (1) Coin flipping: heads=1, tails=0 Bernoulli Distribution.
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
1 Patch Complexity, Finite Pixel Correlations and Optimal Denoising Anat Levin, Boaz Nadler, Fredo Durand and Bill Freeman Weizmann Institute, MIT CSAIL.
The “probability event horizon” and probing the astrophysical GW background School of Physics University of Western Australia Research is funded by the.
Raman Research Institute, Bangalore, India Ravi Subrahmanyan (RRI, Bangalore) Ron Ekers & Aaron Chippendale (CAS) A Raghunathan & Nipanjana Patra (RRI,
130 cMpc ~ 1 o z~ = 7.3 Lidz et al ‘Inverse’ views of evolution of large scale structure during reionization Neutral intergalactic medium via HI.
Sanjay K. Pandey L.B.S.P.G.College, Gonda (India). Statistical Analysis of Redshifted Neutral Hydrogen.
Ch4 Describing Relationships Between Variables. Section 4.1: Fitting a Line by Least Squares Often we want to fit a straight line to data. For example.
CMB Polarization from Patchy Reionization Gil Holder.
Learning to perceive how hand-written digits were drawn Geoffrey Hinton Canadian Institute for Advanced Research and University of Toronto.
PHY306 1 Modern cosmology 4: The cosmic microwave background Expectations Experiments: from COBE to Planck  COBE  ground-based experiments  WMAP  Planck.
Efficient computation of Robust Low-Rank Matrix Approximations in the Presence of Missing Data using the L 1 Norm Anders Eriksson and Anton van den Hengel.
Diffuse Galactic components in the Gould Belt System Richard Davis 8/7/20131EWASS Torku Finland.
Reserve Variability – Session II: Who Is Doing What? Mark R. Shapland, FCAS, ASA, MAAA Casualty Actuarial Society Spring Meeting San Juan, Puerto Rico.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
Mário Santos1 EoR / 21cm simulations 4 th SKADS Workshop, Lisbon, 2-3 October 2008 Epoch of Reionization / 21cm simulations Mário Santos CENTRA - IST.
G. Cowan RHUL Physics LR test to determine number of parameters page 1 Likelihood ratio test to determine best number of parameters ATLAS Statistics Forum.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Foreground Contamination and the EoR Window Nithyanandan Thyagarajan N. Udaya Shankar Ravi Subrahmanyan (Raman Research Institute, Bangalore)
Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy
Observed and Simulated Foregrounds for Reionization Studies with the Murchison Widefield Array Nithyanandan Thyagarajan, Daniel Jacobs, Judd Bowman + MWA.
Machine Learning 5. Parametric Methods.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
Big Bang f(HI) ~ 0 f(HI) ~ 1 f(HI) ~ History of Baryons (mostly hydrogen) Redshift Recombination Reionization z = 1000 (0.4Myr) z = 0 (13.6Gyr) z.
March 26, Large Scale Simulations: properties of the 21cm signal Garrelt Mellema Stockholm Observatory Collaborators: Martina.
Constraint on Cosmic Reionization from High-z QSO Spectra Hiroi Kumiko Umemura Masayuki Nakamoto Taishi (University of Tsukuba) Mini Workshop.
Carlos Hernández-Monteagudo CE F CA 1 CENTRO DE ESTUDIOS DE FÍSICA DEL COSMOS DE ARAGÓN (CE F CA) J-PAS 10th Collaboration Meeting March 11th 2015 Cosmology.
Measuring shear using… Kaiser, Squires & Broadhurst (1995) Luppino & Kaiser (1997)
Jianchao Yang, John Wright, Thomas Huang, Yi Ma CVPR 2008 Image Super-Resolution as Sparse Representation of Raw Image Patches.
On the Doorstep of Reionization Judd D. Bowman (Caltech) March 11, 2009 DIY 21 cm cosmology.
The cross-correlation between CMB and 21-cm fluctuations during the epoch of reionization Hiroyuki Tashiro N. Aghanim (IAS, Paris-sud Univ.) M. Langer.
The Dark Ages and Reionization with 21cm Aaron Parsons.
All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.
Some bonus cosmological applications of BigBOSS ZHANG, Pengjie Shanghai Astronomical Observatory BigBOSS collaboration meeting, Paris, 2012 Refer to related.
Planck working group 2.1 diffuse component separation review Paris november 2005.
3D Matter and Halo density fields with Standard Perturbation Theory and local bias Nina Roth BCTP Workshop Bad Honnef October 4 th 2010.
EoR power spectrum systematics
Nithyanandan Thyagarajan1, Aaron R. Parsons2,
Data Assimilation.
Probability Theory and Parameter Estimation I
LECTURE 11: Advanced Discriminant Analysis
Constraining the redshift of reionization using a “modest” array
Degradation/Restoration Model
Data Reduction and Analysis Techniques
Image Analysis Image Restoration.
Nithyanandan Thyagarajan (Arizona State University) HERA+, MWA+
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Announcements more panorama slots available now
Recovery of The Signal from the Epoch of Reionization
Recovering Hardware Injection Waveforms with Maximum Entropy
Announcements more panorama slots available now
21 cm Foreground Subtraction in the Image Plane and in the uv-Plane
Presentation transcript:

Wed. 17th Sept Hamburg LOFAR Workshop

 Extract a cosmological signal from a datacube, the three axes of which are x and y positions, and frequency.  Consider three components:  The cosmological signal itself;  Iliev et al. (2008)  Thomas et al. (2008)  Astrophysical foregrounds;  Jelić et al. (2008)  Noise.  The foregrounds are expected to be smooth in frequency, which allows them to be fitted out.  Does the signal also have any special properties which should enable us to tease it out?  Seek statistics which are robust with respect to making incorrect assumptions about the foregrounds and noise. Wed. 17th Sept. 2008Hamburg LOFAR Workshop2

Wed. 17th Sept. 2008Hamburg LOFAR Workshop3 100 h -1 Mpc 5° Tile Instrumental response Noise Subtract foregrounds Compare Signal ForegroundsDirty map Residuals

 Foregrounds are assumed smooth as a function of frequency.  Fit with e.g. a polynomial, or use some sort of non- parametric fit. Wed. 17th Sept. 2008Hamburg LOFAR Workshop4  If the fitting is biased, how does this relate to the statistics used for signal extraction?  Are fitting errors correlated in the same way as noise?  Better to fit uv points rather than image pixels?

 δ T b = (stuff)∙x HI ∙(1+ δ )∙(1+ z ) 1/2  Skewness= μ 3 / σ 3  At early times, the brightness temperature follows the cosmological density field which is positively skewed.  Reionization generates ionized bubbles (‘Swiss cheese’), which show up as a peak at zero emission in the one-point distribution, reducing the skewness.  At the late stages of reionization, the few remaining areas with emission form a high- δ T b tail. Wed. 17th Sept. 2008Hamburg LOFAR Workshop5 f250C simulation

Wed. 17th Sept. 2008Hamburg LOFAR Workshop6 f250C - Iliev et al. (2008) T-QSO T-star Three simulations: Thomas et al. (2008)

 Convolve images of the cosmological signal with the instrumental response, and add realistic noise.  This is equivalent to achieving perfect foreground subtraction (and very similar to the case when fitting errors have exactly the same characteristics as the noise).  Look at the skewness of the one- point distribution in these residual images as a function of redshift. Wed. 17th Sept. 2008Hamburg LOFAR Workshop7  Some features of the signal recovered, but at low redshift, where the signal is very small, the noise dominates.

 Fit the foregrounds with a third-order polynomial in log ν.  Skewness in the residual maps dominated by fitting errors and noise.  Can no longer recover the redshift evolution of skewness. Wed. 17th Sept. 2008Hamburg LOFAR Workshop8  If the noise on each image pixel was independent, then smoothing the images would help (because of correlations in the signal).  The real noise is more structured, so we require something more sophisticated.

 For the residual map at each frequency, attempt to reconstruct the cosmological signal with a Wiener deconvolution.  Optimal in a least- squares sense, BUT...  Requires knowledge of the correlation properties of the signal and noise, though in fact we ignore the contribution from the fitting errors.  Recovers the main features of the evolution of the skewness in the cosmological signal simulations.  The dip followed by the rise may be hard for noise and bias to mimic. Wed. 17th Sept. 2008Hamburg LOFAR Workshop9 (Original simulations)

 Might the real foregrounds be more skewed and will this require a more sophisticated foreground subtraction algorithm?  Test the level of accuracy to which the correlation properties of the cosmological signal must be estimated to make the Wiener deconvolution feasible (relation here to power spectrum estimation).  Can the whole process be carried out in the uv-plane?  Generate larger simulations of the signal which don’t require tiling.  Effect of exotic reionization scenarios – does this wipe out the ‘generic’ features?  Other statistics. Wed. 17th Sept. 2008Hamburg LOFAR Workshop10

 We test the LOFAR EoR signal extraction algorithms using datacubes including the cosmological signal, foregrounds, noise and instrumental effects.  Subtracting foregrounds which are smooth in frequency leaves a cube with three components: cosmological signal, noise and fitting errors, which have different correlation properties.  We exploit these properties to differentiate the cosmological signal from the fitting errors and noise.  The skewness of residual maps ‘denoised’ in this way shows similar (generic) features as a function of redshift to the cosmological signal simulations.  The difficulty comes from a combination of having to accurately subtract foregrounds and deal with structured noise. Wed. 17th Sept. 2008Hamburg LOFAR Workshop11

Wed. 17th Sept. 2008Hamburg LOFAR Workshop12

Wed. 17th Sept. 2008Hamburg LOFAR Workshop13

Wed. 17th Sept. 2008Hamburg LOFAR Workshop14 Density field Neutral fraction Differential brightness temperature Skewness Third moment (Variance) 3/2