Page 1 PACS NHSC Webinar: New SPIRE Features in HIPE 9.1 28 th Nov 2012, Pasadena Update on SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the.

Slides:



Advertisements
Similar presentations
Bruno Altieri September # 1 PACS photometer pipeline overview Bruno Altieri (ESA/HSC)
Advertisements

Data Processing Workshop ESAC, Madrid, Spain 20 – 24 February 2012 Stephan Ott VG #1 PACS Overview and the latest developments.
ASI Review Padova ICC Contribution 1 WP3000 : Padova ICC Contribution Mattia Vaccari & Giulia Rodighiero & Gabriele Mainetti Department of Astronomy -
- page 1 July NHSC Mini-workshop PACS NASA Herschel Science Center PACS Photometer AORs How to Prepare an Observation with HSpot: 2 Science Use.
- page 1 NHSC PACS Web Tutorial PACS-401 NHSC/PACS Web Tutorials Running PACS Photometer pipelines PACS-401.
PACS Instrument Day: Welcome ! PACS Instrument Day: Welcome ! NHSC PACS R. Paladini NHSC Archive Data Processing Workshop – August 26 th – 30 th 2013 PACS.
HIFI Tutorial 3: Getting some basic science out A.P.Marston ESAC 27 June 2013.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Photometer Data Reprocessing Bernhard Schulz (NHSC/IPAC) on.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 SPIRE Day team, goals, schedule, logistics Bernhard Schulz NHSC/IPAC.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
SPIRE Consortium Meeting La Palma, Oct. 1 – SPIRE FTS Pipeline Trevor Fulton Blue Sky Spectroscopy, Lethbridge, Canada.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 Introduction to HIPE 12.1 (Part 2) Bernhard Schulz (NHSC/IPAC) on.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Photometer Extended Source Photometry Bernhard Schulz NHSC/IPAC on behalf of the SPIRE.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-202 (for Hipe 9.0) Level 0 to Level 2 processing: From raw data to calibrated.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
 Last Version: DR3.5  Released June 2012  Pipeline:  Optimised De- glitcher  BriGAdE  Allow Dark Pixel drift removal.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The SPIRE Photometer and its Observing Modes Bernhard Schulz (NHSC/IPAC)
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-202 (for Hipe 8.0) Level 0 to Level 2 processing: From raw data to calibrated.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS PACS Photometer Standard Pipeline Level 0 to Level 1 processing: From raw to calibrated data cubes.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 SPIRE AOTs, Products and Quick Look Tools Bernhard Schulz NHSC/IPAC on behalf of the.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS PACS Photometer Standard Pipeline Level 1 to Level 2 processing: How to make a map for point source.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 Roberta Paladini NHSC/IPAC Photometry Guidelines for PACS data.
PACS Hitchhiker’s Guider to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 SPIRE Photometer Data Products Kevin Xu NHSC/IPAC on behalf of the.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 Roberta Paladini NHSC/IPAC PACS photometer maps: several flavors.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Photometer: Overview and Products Roberta Paladini NHSC/IPAC.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Pat Morris, NHSC HIFI Mapping Processing in HIPE.
PACS Hitchhiker’s Guide to the Herschel Science Archive Pasadena, 6 th -10 th October 2014 Tuesday Introduction Agenda & Goals David Shupe User Support.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 12.0) Level 1 to Level 2 processing: The JScanam pipeline Prepared.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-201 (for Hipe 12.0) Level 1* to Level 2 processing: The High-Pass Filter pipeline.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Page 1 PACS NHSC Webinar: New SPIRE Features in HIPE 10 6 th March 2013, Pasadena What’s New in SPIRE Photometer Pipeline in HIPE 10 Kevin Xu NHSC/IPAC.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.
PACS Page 1 NHSC Workshop on HSA Data Oct 6-10, 2014 SPIRE Spectrometer Data Reduction: Special Cases Nanyao Lu NHSC/IPAC (On behalf of the SPIRE ICC,
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Broad-Band Photometry Extraction Bernhard Schulz (NHSC/IPAC)
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Spectrometer: Overview and Products Roberta Paladini NHSC/IPAC.
PVPhotFlux PACS Photometer photometric calibration MPIA PACS Commissioning and PV Phase Plan Review 21 st – 22 nd January 2009, MPE Garching Markus Nielbock.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 HIPE Introduction and Setup for SPIRE David Shupe, NHSC/IPAC on behalf of the SPIRE.
- page 1 NHSC – DP workshop – Feb – N. Billot PACS Deglitching PACS Photometer Data Presentation based on tutorial PACS-402.
NHSC SPIRE Data School – Pasadena 28 th - 30 th June 2010 PACS page 1 SPIRE Imaging Fourier Transform Spectrometer (FTS) Pipeline Data Processing Nanyao.
Page 1 PACS NHSC Webinar: What’s New in HIPE 13 for SPIRE 19 th May 2015, Pasadena What’s New in HIPE 13 General Topics Bernhard Schulz (NHSC/IPAC) on.
Page 1 PACS HSC SPIRE Webinar 10 th Jul 2013 Introduction and General HIPE changes that impact SPIRE Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC.
Data Processing Workshop NHSC, Pasadena, CA 02 – 04 February 2011 Stephan Ott VG #1 PACS Overview and new developments in.
NHSC Data Processing Workshop – Pasadena 25 8h 30 th June 2010 PACS page 1 Workshop Slides NHSC-SPIRE Team NHSC Data Processing Workshop Pasadena
Page 1 NHSC PACS Web Tutorial Babar Ali PACS 401 PACS photometer map-making with MADmap PACS-401 for HIPE 11 user release Version Babar Ali (NHSC)
NHSC PACS PACS Photometry and Errors Estimate Roberta Paladini (NSHC/Caltech) R. Paladini NHSC Archive Data Processing Workshop – August 26 th – 30 th.
PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Issues with Photometer Data & How to Resolve them with HIPE Tools Kevin Xu.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Aug 26-30, 2013 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
NHSC Data Processing Workshop Aug 26-30, 2013 PACS Page 1 SPIRE Spectrometer Data Processing (The Pipeline) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 13.0) Level 1 to Level 2.5 processing: The JScanam pipeline Prepared.
PACS page 1 NHSC SPIRE Data Processing Webinars 8 th Feb 2012 PACS page 1 Overview of SPIRE Photometer Pipeline C. Kevin Xu (NHSC/IPAC)
NHSC HIFI DP workshop Caltech, 7-9 February page 1 Spurs in HIFI data.
PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Preparing HIPE for SPIRE work David Shupe, NHSC/IPAC on behalf of the SPIRE ICC.
PACS ICC Readiness Review MPE, July 3/ Extended-DP 1/13 E. Sturm: Extended-DP Eckhard Sturm.
PACS page 1 NHSC SPIRE Data Processing Webinars 7 th March 2012 PACS page 1 SPIRE Photometer Map Making C. Kevin Xu (NHSC/IPAC)
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
PACS Page 1 NHSC Workshop on HSA Data Oct 6-10, 2014 SPIRE Spectrometer: Pipeline Calibration Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC, HSC & NHSC)
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Reprocessing Scan Maps Kevin Xu NHSC/IPAC on behalf of the SPIRE ICC.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th – 10 th Oct 2014 Overview of SPIRE Photometer Data Reduction Pipeline Kevin Xu NHSC/IPAC.
Markus Nielbock (MPIA) – PACS Photometer Flux Calibration Herschel Calibration Workshop PACS Photometer Flux Calibration: Update Markus Nielbock (MPIA.
SPIRE Flux Calibration: Implementation
Herschel Calibration Workshop
photometry and spectroscopy with PACS
PACS ICC Meeting #41 PACS Photometer
Overview and new developments in Herschel Data Processing
What’s New in HIPE 10.0 (SPIRE FTS)
Presentation transcript:

page 1 PACS NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena Update on SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE ICC

PACS page 2 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Timeline Fitter Sussextractor Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔

PACS page 3 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena Destriper Destriper (replacing the median baseline remover as pipeline default): Minimize map stripes by adjusting the baseline subtraction (median or polynomial) iteratively using the naïve mapper. 3 Median Baseline Remover: Destriper: For more information, see the Destriper’s webpage:

PACS page 4 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Timeline Fitter Sussextractor Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔ ✔ ✔

PACS page 5 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Timeline Fitter Sussextractor Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔ ✔ ✔ ✔

PACS page 6 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena SPIRE Naïve Mapper signal samplings Sky pixel Two options: (1) No weighting: Flux of a sky pixel is the simple average of all signal samplings (by all detectors) in the pixel: f3f3 f1f1 f2f2 f4f4 f5f5 (2) Inverse variance (of instrument noise) weighted: Flux of a sky pixel is the inverse variance weighted mean of all signal samplings in the pixel, the variance is calculated using the white noise of the detector with which a given sampling is taken:,

PACS page 7 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena 7 Simple Average: mapPsw=naiveScanMapper(scans, array="PSW", method=BinaryWeightStrategy) Inverse variance (of instrument white noise) weighted: mapPsw=naiveScanMapper(scans, array="PSW", method=WhiteNoiseWeight) SPIRE Naïve Mapper HIPE Command Line:

PACS page 8 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Timeline Fitter Sussextractor Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔ ✔ ✔ ✔ ✔

PACS page 9 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena “Cooler Burp” Every time when SPIRE is switched on after a cooler recycle, the first ~6 h sees rapid drifts of the temperature and of the bias voltage. It causes abnormal drifts in detector timelines, which in turn cause stripes in maps observed during the “cooler burp” period. After cooler recycle 1 (~40 h) After cooler recycle 2 (~40 h) “burp” ~ 6h bias drift ~10σ  Resistor voltage Bias voltage An example of stripes caused by cooler burp: In user pipeline, there is an optional module for the correction of this effect.

PACS page 10 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Sussextractor Timeline Fitter Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔ ✔ ✔ ✔ ✔ ✔

PACS page 11 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena Sussextractor (new algorithm): srcList = sourceExtractorSussextractor(image=map,\ detThreshold=detectionThreshold, fwhm=fwhm[array], \ beamArea=area[array]) Timeline Fitter (old name: timelineSourceFitterTask): result = sourceExtractorTimeline(input=scanContext, array=array, \ sourcePositionEstimate=Double1d([raCentres[i], decCentres[i]]),\ rPeak=rPeak[array]) HIPE Command Line: To learn more about these modules, see SPIRE Data Reduction Guide, Section 5.7 “Recipe for SPIRE Photometry”

PACS page 12 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena What’s New in HIPE 9.1 Improved map-making, with destriper in standard processing Electrical crosstalk correction (significant for very bright sources) NaiveMapper has two options for estimating flux in a sky pixel: simple average (the only option before HIPE 9) inverse variance weighted mean “Cooler Burps” correction in user pipeline scripts New versions of two point source photometry tasks: Sussextractor Timeline Fitter Two new “SPIRE Useful scripts”: Photometer Bolometer Finder Photometer Calculate Ephemeris SSO Position ✔ ✔ ✔ ✔ ✔ ✔ ✔

PACS page 13 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena new “SPIRE Useful scripts”:

PACS page 14 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena  Bolometer Finder: A new (and better) version: See the following web page for details:

PACS page 15 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena 5’5’ Other News Improvement in pointing for data taken between – Because of an error in the pointing model, Herschel data taken between – suffered larger than normal pointing errors (up to 8”). Now new, improved pointing products are available for these observations in: ftp://ftp.sciops.esa.int/pub/msanchez/corrected_pointing_od320_761/. See the following twiki page on how to use them: New values for SPIRE beam profile solid angles (i.e. beam areas): New analyses of the SPIRE beam profile data, with background tilt subtraction and background source removal, lead to revised values for beam profile solid angles, which differ from the current official values by up to 6.7%. See the following twiki page for details:

PACS page 16 NHSC Webinar: New SPIRE Features in HIPE th Nov 2012, Pasadena 5’5’ Anticipated Major Changes in HIPE 10 Level 1 timelines will be destriped (i.e. baseline removed). Zero-level correction (i.e. realistic large-scale background level taken from the Planck Survey) will be available. Level 2 products will include: maps in units of Jy/beam (for point sources); maps in units of MJy/sr (for extended sources); maps corrected for proper motion (for solar system objects only).