Bruno Altieri September # 1 PACS photometer pipeline overview Bruno Altieri (ESA/HSC) Maynooth, September 2010

Bruno Altieri September # 2 pipelines current status Two pipelines: –photProject: High-pass filter + projection –MADmap Common pipeline from L0 to L1 with branching to L2. HCSS 2.0: MADmap removed from HSC pipeline –Too low quality maps (as cross scan not handled) –Memory problems Plan: re-introduce in HCSS 5.0 once HCSS-9361 is implemented to handle cross-scans.

Bruno Altieri September # 3 Sequence to apply to PACS photo data cube (frames) 1.Flag bad pixels 2.Flag saturated pixels 3.Convert ADUs to Volts 4.Cross-talk correction 5.Pixel timeline deglitching (multi-median resolution) 6.Flat-field and responsitivity correction: Jy/pixel 7.Compute ra/dec for virtual aperture (centre) –Scan leg re-centering 8.Run high-pass filter, to filter 1/f noise In two or more passes to mask out (bright) sources for high-pass 9.Project cube onto a grid to get WCS map Computes the ra/dec for each pixel corners on the fly photProject scan map pipeline Level 0 to 1 Level 1 to 2

Bruno Altieri September # 4 photProject ? High-pass + phoProject is more sensitive for point-sources. Running MadMap over very large and deep PACS scan maps (e.g. cosmological surveys) prevented by serious memory problems MadMap has still problems of residuals for bright point sources PhotProject takes ~ 10 minutes for 1.5 h AOR with reasonable memory use However iteration is needed to optimize results

Bruno Altieri September # 5 a xy geometrical weights w xy error based weigths drop size also customizable (75%, 50%, 25%, 12.5% of the input pixel size) still error propagation not trustable

Bruno Altieri September # 6 DEEP PACS imaging

Bruno Altieri September # 7 Artefact of high-pass filter on bright sources

Bruno Altieri September # 8 New photometer pipeline in HCSS 4.1 A two-stage masked high-pass filtering pipeline proposed for HCSS 4.0: –A compromise to get reasonable maps on all fields. –PACS-2801, implemented by Ekki Wieprecht. –Simple principle : Sources above a certain threshold are masked for the highpass filter MMT deglitching disabled on sources Larger filter width in the second pass to preserve extended emission up to a few arcmin. To be used for the HSC bulk reprocessing (HCSS 4.1) –good photometry within 5-10% on all cal stars –no holes in the coverage map (deglitching) –no negative artifact around bright sources. –relative good point-source sensitivity. –preserve a significant fraction of extended emission.

Bruno Altieri September # 9 HCSS 4.1 versus 2.0

Bruno Altieri September # 10 HCSS 4.1 versus 2.0

Bruno Altieri September # 11 HCSS 4.1 on M16

Bruno Altieri September # 12 What is MADmap? Map-making technique which will produce maximum likelihood sky maps from time ordered instrument data. MADmap uses the data model: d = A(p,t) * S(p) + n(t), Where, d = detector readout, A=pointing matrix, p=sky pixel, S=signal, n=noise and t is time (or index). For all readouts, all detectors, the set of linear equations is too large to invert; thus, conjugate gradient method is used to find the best least-squares fit to the data, given a noise model n(t).

Bruno Altieri September # 13 Implementation for PACS DP * But see caveat about deglitching. Pixel-to-pixel, module to module and global drift corrections. Level 1 Processing* Frames Generate TOD 2nd level deglitching Naive Map MADmap Optimal Map Pre-processing Cal. Files makeTodArray() runMadMap()

Bruno Altieri September # 14 Scan+cross-scan mandatory for MADmap On-going work with HCSS-9361 to handle multiple scans MADmap with Single scan MADmap with Scan+x-scan

Bruno Altieri September # 15 Aquilla

Bruno Altieri September # 16 HOPS

Bruno Altieri September # 17 A new pipeline for the longer term Scanamorphos is an IDL software to build maps from scan observations made with bolometer arrays, in particular with the PACS and SPIRE photometers Scanamorphos is designed to remove the low-frequency noise, both thermal and non-thermal, causing additive brightness drifts. To this end, it makes use of the redundancy built in the observations (each portion of the sky with nominal coverage is sampled by multiple bolometers at multiple times) to derive the brightness drifts directly from the data themselves. This means that Scanamorphos does not depend on any noise model, and is thus immune to mismatches between models and reality, that may occur because the noise is not perfectly calibrated, or does not satisfy the model assumptions, or varies in time, or is altered by the pre-processing (from level 0 to level). Scanamorphos is flux-conserving and restores sources on all spatial scales, ranging from point sources to extended structures with scales just below the map size.

Bruno Altieri September # 18 Scanamophos (H.Roussel) on a galactic field (HiGal) Courtesy N.Billot 70μm 160μm