Lecture 15 Deconvolution CLEAN MEM Why does CLEAN work? Parallel CLEAN

Slides:



Advertisements
Similar presentations
A Crash Course in Radio Astronomy and Interferometry: 4
Advertisements

Lecture 11 (Was going to be –Time series –Fourier –Bayes but I haven’t finished these. So instead:) Radio astronomy fundamentals NASSP Masters 5003F -
NASSP Masters 5003F - Computational Astronomy Lecture 5: source detection. Test the null hypothesis (NH). –The NH says: let’s suppose there is no.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Whoever North American.
NASSP Masters 5003F - Computational Astronomy Lecture 13 Further with interferometry – Resolution and the field of view; Binning in frequency and.
Foreground cleaning in CMB experiments Carlo Baccigalupi, SISSA, Trieste.
Computational Methods in Physics PHYS 3437
Computer Vision Optical Flow
Source detection at Saclay Look for a fast method to find sources over the whole sky Provide list of positions, allowing to run maximum likelihood locally.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Cross Correlators Walter Brisken.
CSIRO; Swinburne Error Recognition Emil Lenc University of Sydney / CAASTRO CASS Radio Astronomy School 2012 Based on lectures given previously.
Interferometry Basics
Dr Martin Hendry, Dept of Physics and Astronomy University of Glasgow, UK Astronomical Data Analysis I 11 lectures, beginning autumn 2008.
CS Spring 2012 CS 414 – Multimedia Systems Design Lecture 8 – JPEG Compression (Part 3) Klara Nahrstedt Spring 2012.
NASSP Masters 5003F - Computational Astronomy Lecture 23 Two areas of my current research interest: –Parallel CLEAN. –Looking for bursts in XMM.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Mosaicing Tim Cornwell.
Calibration Ron Maddalena NRAO – Green Bank July 2009.
Wideband Imaging and Measurements ASTRONOMY AND SPACE SCIENCE Jamie Stevens | ATCA Senior Systems Scientist / ATCA Lead Scientist 2 October 2014.
Survey Quality Jim Condon NRAO, Charlottesville. Survey Qualities Leiden 2011 Feb 25 Point-source detection limit S lim Resolution Ω s Brightness sensitivity.
J. Hibbard Spectral Line II: Calibration & Analysis 1 Spectral Line II: Calibration and Analysis Bandpass Calibration Flagging Continuum Subtraction Imaging.
S.T. MyersEVLA Advisory Committee Meeting September 6-7, 2007 EVLA Algorithm Research & Development Steven T. Myers (NRAO) CASA Project Scientist with.
NASSP Masters 5003F - Computational Astronomy Lecture 9 – Radio Astronomy Fundamentals Source (randomly accelerating electrons) Noisy electro- magnetic.
Ninth Synthesis Imaging Summer School Socorro, June 15-22, 2004 Spectral Line II John Hibbard.
Fundamental limits of radio interferometers: Source parameter estimation Cathryn Trott Randall Wayth Steven Tingay Curtin University International Centre.
Non-coplanar arrays Wide field imaging Non-copalanar arrays Kumar Golap Tim Cornwell.
Sanjay BhatnagarEVLA Advisory Committee Meeting May 8-9, EVLA Algorithm Research & Development Progress & Plans Sanjay Bhatnagar CASA/EVLA.
Astronomical Data Analysis I
NASSP Masters 5003F - Computational Astronomy Lecture 14 Reprise: dirty beam, dirty image. Sensitivity Wide-band imaging Weighting –Uniform vs Natural.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.
ASKAP: Setting the scene Max Voronkov ASKAP Computing 23 rd August 2010.
The Australia Telescope National Facility Ray Norris CSIRO ATNF.
Pulsar luminosity distribution in 47-Tuc Tim Connors, Vacation student University of Sydney.
Practical applications: CCD spectroscopy Tracing path of 2-d spectrum across detector –Measuring position of spectrum on detector –Fitting a polynomial.
Recent progress in EVLA-specific algorithms EVLA Advisory Committee Meeting, March 19-20, 2009 S. Bhatnagar and U. Rau.
Sampling Pixel is an area!! – Square, Rectangular, or Circular? How do we approximate the area? – Why bother? Color of one pixel Image Plane Areas represented.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
NASSP Masters 5003F - Computational Astronomy Lecture 16 Further with interferometry – Digital correlation Earth-rotation synthesis and non-planar.
Lecture 8 Source detection NASSP Masters 5003S - Computational Astronomy
NASSP Masters 5003F - Computational Astronomy Lecture 7 Confusion Dynamic range Resolved sources Selection biases Luminosity (and mass) functions.
Some EOVSA Science Issues Gregory Fleishman 26 April 2011.
NASSP Masters 5003F - Computational Astronomy Lecture 11 Single-dish spectra: baselines. Complex numbers refresher Fourier refresher Correlation.
Motion Estimation Today’s Readings Trucco & Verri, 8.3 – 8.4 (skip 8.3.3, read only top half of p. 199) Newton's method Wikpedia page
1 Combining Single Dish and Interferometer Data Naomi McClure-Griffiths ATNF ATNF Astronomical Synthesis Imaging Workshop September 24-28, 2001 or Seeing.
+ Lister Staveley-Smith – Narrabri Synthesis Workshop 15 May Merging Single-Dish Data  Bibliography  The short-spacing ‘problem’  Examples –Images.
ATNF Synthesis Workshop - September Single-dish spectral-line observing Lister Staveley-Smith, ATNF  Why use a single-dish?  Analogy with interferometer.
1 M 277 (60 h) Mathematics for Computer Sciences Bibliography  Discrete Mathematics and its applications, Kenneth H. Rosen  Numerical Analysis, Richard.
1/20 Radio interferometric imaging of spatial structure that varies with time and frequency Urvashi Rau ( NRAO ) Wednesday Lunch Talk 29 Aug 2012 Outline.
Imaging issues Full beam, full bandwidth, full Stokes noise limited imaging Algorithmic Requirements: –PB corrections: Rotation, Freq. & Poln. dependence,
Dr. Clincy Professor of CS
Table of Contents Chapter 5 (What-If Analysis for Linear Programming)
AAVS1 Calibration Aperture Array Design & Construction Consortium
Single Object & Time Series Spectroscopy with JWST NIRCam
CLEAN: Iterative Deconvolution
Perturbation method, lexicographic method
Imaging and Calibration Challenges
ESAC 2017 JWST Workshop JWST User Documentation Hands on experience
Clustering, Proximity, and Balrog
Sampling Theorem told us …
Image Sampling Moire patterns
Wide field imaging Non-copalanar arrays
Deconvolution and Multi frequency synthesis
Filtering Part 2: Image Sampling
Basic theory Some choices Example Closing remarks
Numerical Integration:
Announcements more panorama slots available now
The spectral properties of Galactic X-ray sources at faint fluxes
EVLA Algorithm Research & Development
Announcements more panorama slots available now
21 cm Foreground Subtraction in the Image Plane and in the uv-Plane
Presentation transcript:

Lecture 15 Deconvolution CLEAN MEM Why does CLEAN work? Parallel CLEAN NASSP Masters 5003F - Computational Astronomy - 2009

Deconvolution. How can we go from this to this? Deconvolution in the sky plane implies interpolation or reconstruction of missing values in the UV plane. But we, the human observer, can look at the top image and just ‘know’ that it is 2 point sources on a blank field. NASSP Masters 5003F - Computational Astronomy - 2009

The following ‘naive’ algorithm gives surprisingly good results: CLEAN The following ‘naive’ algorithm gives surprisingly good results: Find the brightest pixel xb,yb in the dirty image. Measure its brightness I(xb,yb). Subtract λI(xb,yb)B(x-xb,y-yb) from the image, where λ is a number in the approximate range 0.01 to 0.2. Repeat until satisfied. This is known as the CLEAN algorithm. The successive numbers λI are called clean components. NASSP Masters 5003F - Computational Astronomy - 2009

Problems with CLEAN: Mathematicians don’t like CLEAN. They say it ought not to work. There are lots of papers out there proving it doesn’t. But it does work, good enough for rough-and-ready astronomers, anyway. This is because the real sky obeys strong constraints: Nearly always there are just a few smallish bright patches on a blank background; Negative flux values don’t occur in the real sky. CLEAN doesn’t work really well on extended sources – can get ‘clean stripes’ or ‘bowl’ artifacts. It is difficult to know when to stop CLEANing. Too soon, and you are missing flux. Too late, and you are just cleaning the noise in your image. NASSP Masters 5003F - Computational Astronomy - 2009

More problems with CLEAN: Sources which vary in flux over the duration of the observation. Solution: cut the observation into shorter chunks, clean separately, then recombine. Clunky, loses sensitivity. ‘Parallel’ cleaning works well though. (Only relevant for wide-band case:) different sources have different shapes of spectrum. Parallel cleaning is also good for this – even when sources vary both in frequency and time! Sources which aren’t located at the centre of a pixel. Fixes: Re-centre on each source, then CLEAN them away. You guessed it – parallel cleaning can also help. NASSP Masters 5003F - Computational Astronomy - 2009

Sault R J & Wieringa M H: A&A Suppl. Ser. 108, 585 (1994) Parallel CLEAN: First developed to cope with wide-band imaging. The fundamental paper is: The basic idea is to construct a number of dirty beams, the jth beam (starting at j=0) by setting Vj(ν) to (ν/ν0)j/j! then FTing. Eg V0=1, V1=ν/ν0, V2=(ν/ν0)2/2, etc. Since the Vjs form a Taylor series, any spectrum can be approximated by a sum of Vjs; thus any source by a sum of Bjs. Sault R J & Wieringa M H: A&A Suppl. Ser. 108, 585 (1994) NASSP Masters 5003F - Computational Astronomy - 2009

Description of the problem: an example. If both point sources have identical spectra, there is no problem. S ν ν S NASSP Masters 5003F - Computational Astronomy - 2009

Description of the problem: an example. More realistic: different spectra: S ν S ν This will not clean away. NASSP Masters 5003F - Computational Astronomy - 2009

The Sault-Wieringa algorithm: 0th order S + ν νref Taylor expansion ν νref 1st order ν νref + A source spectrum: ν νref 2nd order etc… NASSP Masters 5003F - Computational Astronomy - 2009

Taylor-term beams 0th order 1st order 2nd order 3rd order max = 1.0 NASSP Masters 5003F - Computational Astronomy - 2009

A simulation to test this: 19 point sources from 0.001 to 1 Jy Spectra: cubics, with random coefficients. eg ν (GHz) NASSP Masters 5003F - Computational Astronomy - 2009

Alternate cleaning: (i) 1000 cycles of standard clean …not good. NASSP Masters 5003F - Computational Astronomy - 2009

Alternate cleaning: (ii) each spectral channel cleaned, then co-added. plus different beam sizes. …pretty good, but do we lose faint sources? NASSP Masters 5003F - Computational Astronomy - 2009

S-W clean to various orders (All 1000 cycles with gain (λ) = 0.1) 0th order (equivalent to standard clean) NASSP Masters 5003F - Computational Astronomy - 2009

S-W clean to various orders 1st order NASSP Masters 5003F - Computational Astronomy - 2009

S-W clean to various orders 2nd order NASSP Masters 5003F - Computational Astronomy - 2009

S-W clean to various orders 3rd order Not much left but numerical noise. NASSP Masters 5003F - Computational Astronomy - 2009

Time-varying sources: Source constant in time Source flux varying with time NASSP Masters 5003F - Computational Astronomy - 2009

Time-varying sources: I M Stewart et al – paper in preparation! NASSP Masters 5003F - Computational Astronomy - 2009

MEM – the Maximum Entropy Method. (Content for this slide pretty much copied from T. Cornwell, chapter 7, NRAO 1985 Synthesis Imaging Summer School. I haven’t studied ME myself.) What does entropy mean in this context? “Something which, when maximized, produces a positive image with a compressed range of pixel values.” An example: maximize I guess we would need to read Narayan and Nityananda 1984 to figure out what e is. I is the image we end up with M is our ‘best guess’ starting image. NASSP Masters 5003F - Computational Astronomy - 2009