PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao.

Slides:



Advertisements
Similar presentations
6dF Data Release 2 The good, the bad and the ugly Will Saunders AAO 27/04/05.
Advertisements

Naoyuki Tamura (University of Durham) Expected Performance of FMOS ~ Estimation with Spectrum Simulator ~ Introduction of simulators  Examples of calculations.
1 TIPS 2011 May Persistence in the WFC3 IR detector Knox S. Long.
→ Herschel data for absolute beginners Herschel Science Centre (ESAC)
Molecular Gas and Dust in SMGs in COSMOS Left panel is the COSMOS field with overlays of single-dish mm surveys. Right panel is a 0.3 sq degree map at.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Photometer Data Reprocessing Bernhard Schulz (NHSC/IPAC) on.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Photometer Extended Source Photometry Bernhard Schulz NHSC/IPAC on behalf of the SPIRE.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
 Last Version: DR3.5  Released June 2012  Pipeline:  Optimised De- glitcher  BriGAdE  Allow Dark Pixel drift removal.
NHSC Workshop August 2013 NASA Herschel Science Center - page 1 PACS David R. Ardila User Support coordinator / NHSC Archive Scientist The Herschel Science.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The SPIRE Photometer and its Observing Modes Bernhard Schulz (NHSC/IPAC)
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 SPIRE AOTs, Products and Quick Look Tools Bernhard Schulz NHSC/IPAC on behalf of the.
PACS Spectrometer Spatial Calibration plan in PV phase A.Contursi D. Lutz and U. Klaas.
JWST Calibration Error Budget Jerry Kriss. 15 March 20072/14 JWST Flux & Wavelength Calibration Requirements SR-20: JWST shall be capable of achieving.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 Roberta Paladini NHSC/IPAC Photometry Guidelines for PACS data.
PACS Hitchhiker’s Guider to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 SPIRE Photometer Data Products Kevin Xu NHSC/IPAC on behalf of the.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Photometer: Overview and Products Roberta Paladini NHSC/IPAC.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Pat Morris, NHSC HIFI Mapping Processing in HIPE.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 12.0) Level 1 to Level 2 processing: The JScanam pipeline Prepared.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
NHSC PACS NHSC Herschel Data Processing Workshop Steve Lord August Intro to HIPE PACS Spectroscopy: Getting Fluxes and Maps.
Imaging Molecular Gas in a Nearby Starburst Galaxy NGC 3256, a nearby luminous infrared galaxy, as imaged by the SMA. (Left) Integrated CO(2-1) intensity.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Spectroscopy with PACS M82 PACS line imaging from the SHINING team (Contursi et al First Results workshop talk) Phil Appleton and Dario Fadda for.
Analysing SPIRE FTS spectra 1 Day 4: SPIRE Rosalind Hopwood.
PACS page 1 NHSC Open Time Cycle 1 Observation Planning Workshop 3 rd - 4 th Jun 2010 – Bernhard Schulz SPIRE Overview Bernhard Schulz, Nanyao Lu, Kevin.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.
PACS Page 1 NHSC Workshop on HSA Data Oct 6-10, 2014 SPIRE Spectrometer Data Reduction: Special Cases Nanyao Lu NHSC/IPAC (On behalf of the SPIRE ICC,
TIPS COS Status: SMOV update III STScI/CU COS Team 17 September 2009.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Broad-Band Photometry Extraction Bernhard Schulz (NHSC/IPAC)
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
Page 1 PACS NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena Update on SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS Deglitching PACS Photometer Data Presentation based on tutorial PACS-402.
NHSC SPIRE Data School – Pasadena 28 th - 30 th June 2010 PACS page 1 SPIRE Imaging Fourier Transform Spectrometer (FTS) Pipeline Data Processing Nanyao.
MOS Data Reduction Michael Balogh University of Durham.
Page 1 PACS NHSC Webinar: What’s New in HIPE 13 for SPIRE 19 th May 2015, Pasadena What’s New in HIPE 13 General Topics Bernhard Schulz (NHSC/IPAC) on.
NICMOS Calibration Challenges in the Ultra Deep Field Rodger Thompson Steward Observatory University of Arizona.
14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.
NHSC PACS PACS Photometry and Errors Estimate Roberta Paladini (NSHC/Caltech) R. Paladini NHSC Archive Data Processing Workshop – August 26 th – 30 th.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Issues with Photometer Data & How to Resolve them with HIPE Tools Kevin Xu.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Aug 26-30, 2013 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
Observations of Near Infrared Extragalactic Background (NIREBL) ISAS/JAXAT. Matsumoto Dec.2-5, 2003 Japan/Italy seminar at Niigata Univ.
NHSC Data Processing Workshop Aug 26-30, 2013 PACS Page 1 SPIRE Spectrometer Data Processing (The Pipeline) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE.
HIFI Tutorial 1: Running the HIFI Pipelines and Adaptations A.P.Marston ESAC 27 June 2013.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 13.0) Level 1 to Level 2.5 processing: The JScanam pipeline Prepared.
PACS page 1 NHSC SPIRE Data Processing Webinars 8 th Feb 2012 PACS page 1 Overview of SPIRE Photometer Pipeline C. Kevin Xu (NHSC/IPAC)
NHSC HIFI DP workshop Caltech, 7-9 February page 1 Spurs in HIFI data.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Preparing HIPE for SPIRE work David Shupe, NHSC/IPAC on behalf of the SPIRE ICC.
PACS page 1 NHSC SPIRE Data Processing Webinars 7 th March 2012 PACS page 1 SPIRE Photometer Map Making C. Kevin Xu (NHSC/IPAC)
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
PACS Page 1 NHSC Workshop on HSA Data Oct 6-10, 2014 SPIRE Spectrometer: Pipeline Calibration Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC, HSC & NHSC)
NHSC HIFI DP workshop Caltech, 8-9 March page 1 Pat Morris, NHSC DP Webinar, 9 March 2012 HIFI Spectral Maps in HIPE.
- page 1 PACS Phil Appleton on behalf of the NHSC/HSC and the PACS ICC ; especially Bart Vandenbussche and Pierre Royer (KUL Belgium) Instrument Performance.
A. Ealet Berkeley, december Spectrograph calibration Determination of specifications Calibration strategy Note in
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Reprocessing Scan Maps Kevin Xu NHSC/IPAC on behalf of the SPIRE ICC.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 Overview of SPIRE Photometer Data Reduction Pipeline Kevin Xu NHSC/IPAC.
Markus Nielbock (MPIA) – PACS Photometer Flux Calibration Herschel Calibration Workshop PACS Photometer Flux Calibration: Update Markus Nielbock (MPIA.
Single Object & Time Series Spectroscopy with JWST NIRCam
COS FUV Flat Fields and Signal-to-Noise Characteristics
Phil Appleton based on material from a study by Roland Vavrek (ESAC)
Data Reduction and Analysis Techniques
SPIRE Spectrometer Data Reduction: Spectral Line Fitting
Data Reduction and Analysis Techniques
What’s New in HIPE 10.0 (SPIRE FTS)
Spectroscopy Workshop
Presentation transcript:

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao Lu NHSC/IPAC (On behalf of the SPIRE ICC)

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 2 Outline Calibration updates. User data reprocessing. Issues that may impact your data and how to deal with them: –Continuum offset –Fringe problem? –Partially resolved lines –Semi-extended sources, pointing offset –Cooler cycles –LR mode

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 3 Why Might You Want to Reprocess Your FTS Observations? Two Main Reasons: Both calibration and pipeline are still being improved at this point. You might want to process your data with the latest calibration files (i.e., spire_cal_11_0). Depending on your particular observation, you may want to explore possible improvements to the standard data reduction pipeline, especially if your targets are faint (i.e., of a few Jy). We discuss a few “issues” that may affect your observations, and how you can deal with them.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 4 HIPE 11: Reduced Noise & Finges HIPE 11 HIPE 10 Mrk 231 A dark sky observation

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 5 HIPE 11: Better RSRFs  Better Sensitivity HIPE 11 HIPE 10 HSPOT

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 6 HIPE 11 gives much better results on dark observations than HIPE 10. HIPE 11 HIPE 10 NOTE: Ideally we want a flat spectrum at 0 Jy for these (telescope background-subtracted) spectra of dark sky. HIPE 11: Much Better Results for the Bright Source Mode

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 7 How to Do a User Data Reprocessing? You can load the spectrometer data reprocessing script within your HIPE session:  HIPE -> Pipelines -> SPIRE -> Spectrometer single pointing user pipeline. As an example, at the end of this session, I will show how to run this script to reprocess an observation from HIPE 10 to 11:  Obsid =  Target = ESO099-G004  HR, 40 FTS repeats, sparse sampling, with nominal detector setting. (Note: This is one of the sample observations for the workshop. Then during the last SPIRE session this afternoon, you can do an exercise to compare the spectral noise between HIPE 10 and 11 results on this particular observation.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 8 Potential Issues Issues that may impact your data and how to deal with them: –I. Continuum offset. –II. Fringes, and how to remove them. –III. Partially resolved lines. –IV. Semi-extended sources (or pointing offset). –V. Impact from the cooler cycles. –VI. Long expoures in the LR mode.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 9 Telescope Emission Dominates Most Observations! Telescope + Source Source only I. Continuum Flux Systematics

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 10 Uncertainty from Telescope Emission Removal Standard deviation of > 5000 dark sky scans reduced using the standard pipeline: 10  Continuum flux calibration accuracy in HIPE 11 is on the order of ~ Jy for SLW and ~ Jy for SSW.  Further improvement may be done using the background subtraction script.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 11 How to Remove Residual Telescope Emission? Two practical ways: –Subtract an observed Dark Sky from the same observational day, as close in time to your observation as possible, which is processed in the same way as your own observation.  A list of dark observations can be found at: –Subtract a median spectrum from surrounding detectors in case of a point source observation:  We will demo how to do this using a simple script in the end of the session. 11 A script for doing both these corrections is available inside HIPE:

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 12 Residual Telescope Emission Removal: Using Surrounding Channels 18 Jan Calibration Workshop2: SPIRE Calibration  Using a median spectrum from the co-aligned detectors as the residual telescope spectrum.  This (or a polynominal fit to it) is then subtracted from the spectrum of the central detectors. D4 C3

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 13 Residual Telescope Emission Removal: More Examples 13 See a demo on this in this afternoon

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page Systematic Noise Over the Mission (NOTE: HIPE 10 Results) OD1032

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 15 II. Any Significant Systematic Noise? 15 Script does a quick calculation of r.m.s. noise in your spectrum.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 16 Spectral Noise: An Example 16 Random noise HSPOT noise prediction R.M.S. noise (HIPE 10 result) Significant systematic error!

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 17 Spectral Noise: An Example 17 Random noise HSPOT noise prediction R.M.S. noise (HIPE 11 result) systematic error reduced!

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 18 How to Beat Down Systematic Noise First anf foremost, use or reprocess your data to HIPE 11 results. If there is still significant sytematic noise (or fringes), there are ways to reduce it:  Direct dark subtraction: Subtract from your observation a long dark observation taken in the same OD. (This may not work for early ODs, i.e., prior to OD1079, as dark observations were take in a different mode, i.e., CR instead of HR.)  Noise Template Method: Create a correlated-noise template by median filtering observations of galaxies at different redshifts. Then this template spectrum could be subtracted from your own spectrum to remove much of the systematic noise. (This method always works. But you need to have and access to other observations on the same OD.)  See Lu.pdf)  A user script for this is available unpon requesting. 18

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 19 III. Spectral Resolving Power Depends on Wavelength IC342: a large galaxy FWHM ~ 296 km/s for [NII] 205um (at 1461 GHz or 205 μm); σ/Δσ = λ/Δλ ~ FWHM ~ 750 km/s for CO J=5-4 line (at GHz or 520 μm); σ/Δσ = λ/Δλ ~

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 20 [NII] 205 um Lines May be Partially Resolved 20 [NII] 205 GHz Fit with SINC only Fit with SINC convolved with Gaussian (SincGauss model) Frquency (GHz)

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 21 Line Fitting with SincGauss Profile in HIPE 21 Works best when S/N is high. For fainter lines, it might be better to use a SINC profile for fitting, and then correct the resulting flux for an estimated velocity width. See SDRG, sect on how to use SincGauss line profile in script.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 22 IV. Semi-extended Source Correction Tool Task name: semiExtendedCorrector (For more information. see: Wu et al :

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 23 Semi-extended Source Correction Tool Correction factor Original After correction

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 24 Semi-extended Source Correction Tool Works best on bright objects. For faint objects, the continuum suffers an (additive) uncertainty on the order of 0.4 Jy. It might be a good idea to try to reduce/remove this continuum offset using surrounding channels before applying the semi extended correction tool to your data. For galaxies, it is likely that the warm CO lines come from a more compact region than the (cold) dust continuum. Thus, if your interest is in CO lines, it might be better not to apply this correction to your spectrum. Some remarks on using this tool:

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 25 V. Impact from Cooler Cycles Subk Temperature Unstable initial part (“cooler burp”) Fridge hold time ~ 45 hrs. n 3 He cooler

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 26 Impact from Cooler Cycles Red data points are taken when SubK temp. still increases rapidly during the initial phase of a cooler cycle. If not corrected for, it leads to a flux over- (under-) estimate at the high (low) end of a spectrum. This can be empirically corrected. Investigation is still underway.

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 27 VI. Caution on Low-resolution (LR) Data (with Long Integration) 27 HRLR Still under investigation! Pipeline results Results with further surrounding channel subtraction 72 repeats

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 28 Summary on Potential Issues I. Continuum offset. Subtraction of a dark obs from the same observational day. Surrounding channel background subtraction. II. Fringes and how to remove them. Check HIPE 11 results first, for the least possible fringes. Subtraction of an HR dark from same day (available after OD1079) Noise template method (for ODs prior to OD1079 or any OD). III. Partially resolved lines. Gaussain-SINC profile fitting (but generally requiring a higher S/N). IV. Semi-extended sources (or pointing offset). Correction tool available. But be aware of the continuum uncertainty in faint sources and of the fact that lines may originate from a more compact region than the continuum. V. Impact from cooler cycles (under investigation). VI. Long exposures in the LR mode (under further investigation).

PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 29 Demo on Data Reprocessing I will use the script:  HIPE -> Pipelines -> SPIRE -> Spectrometer single pointing user pipeline. I will featch the HIEP 10 results of the following observation from Herschel archive and reprocess it to HIPE 11:  Obsid =  Target = ESO099-G004  HR, 40 FTS repeats, sparse sampling, with nominal detector setting. (Note: This is one of the sample observations for the workshop. We will let the script run during the coffee break. And we will come back in the last SPIRE session today compare the spectral noise between HIPE 10 and 11 results on this particular observation.