MIPS Data Processing for SINGS George J. Bendo & Chad Engelbracht (A ''George's Adventures in Learning OpenOffice'' Presentation)

Slides:



Advertisements
Similar presentations
GMOS Data Reduction Richard McDermid Gemini Data Reduction Workshop Tucson, July 2010.
Advertisements

ADASS XVII Sep 2007The NOAO Pipeline Applications Francisco Valdes (NOAO) Robert Swaters (UMd) Derec Scott (NOAO) Mark Dickinson (NOAO)
Patrick Ogle, Lee Armus, Bob Narron, Carl Grillmair, Justin Howell, IRS IST.
Submillimeter Data for SINGS George J. Bendo & Robert D. Joseph (A ''George's Adventures in Learning OpenOffice'' Presentation)
VISTA/WFCAM pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,
FMOS Observations and Data 14 January 2004 FMOS Science Workshop.
ELT Stellar Populations Science Near IR photometry and spectroscopy of resolved stars in nearby galaxies provides a way to extract their entire star formation.
SIRTF-IRS software Fred Lahuis Leiden 18 Nov 2002 (presented by Ewine van Dishoeck and Adwin Boogert, c2d meeting Dec. 11, 2002)
HAWCPol / SuperHAWC Software & Operations J. Dotson July 28, 2007.
VISTA pipelines summit pipeline: real time DQC verified raw product to Garching standard pipeline: instrumental signature removal, catalogue production,
PSF Reconstruction: Part I The PSF “Core” Primary Goal: Derive PSFs for point source detection and PSF fitting photometry. Secondary Goal: Derive PSFs.
October, 2004ADASS XIV O1.31 Hires: Super-resolution for the Spitzer Space Telescope Charles Backus Velu Velusamy Tim Thompson John Arballo Description.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
A Preliminary Cycle 1 Calibration Plan for the JWST Science Instruments James Muzerolle.
PACS CoP & PV Review 21/22 Jan 2009 PVSpecWave1 Spectrometer Wavelength Calibration XHSPOT Proposal: PVSpecWave H. Feuchtgruber.
0. To first order, the instrument is working very well ! 1.Evolution of the IR detector with time 2.Stability of the L channel 3.Saturation 4.Linearity.
Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.
AAO Fibre Instrument Data Simulator 10 October 2011 ROE Workshop 2011 Michael Goodwin Tony Farrell Gayandhi De Silva Scott Smedley Australian Astronomical.
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
STEP2 simulated images Richard Massey with Molly Peeples, Will High, Catherine Heymans, etc. etc.
Science Impact of Sensor Effects or How well do we need to understand our CCDs? Tony Tyson.
Distortion in the WFC Jay Anderson Rice University
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
IRS Data Products: An Update SINGS Team Meeting November 2002 Baltimore, MD L. Armus SIRTF Science Center.
Spectroscopic Observations (Massey & Hanson 2011, arXiv v2.pdf) Examples of Spectrographs Spectroscopy with CCDs Data Reduction and Calibration.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Sept 10-14, 2012 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
Telescope Guiding with a HyViSI H2RG Used in Guide Mode Lance Simms Detectors for Astronomy /2/09.
SPIRE Consortium Meeting La Palma, Oct. 1 – SPIRE FTS Pipeline Trevor Fulton Blue Sky Spectroscopy, Lethbridge, Canada.
Page 1 PACS NHSC Data Processing Workshop – Pasadena 26 th - 30 th Aug 2013 Overview of SPIRE Photometer Pipeline Kevin Xu NHSC/IPAC on behalf of the SPIRE.
The SINGS SED Tool Daniela Calzetti (STScI) June 10 th, 2002 SSC Deliverable  SSC Deliverable – IDL Image Analysis Software to provide: o PSF-matched,
End to End Simulations. p.2 What’s this ? This is the MUSE datacube of NGC 1068 we just received from ESO Can you remind me how many students we have.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The SPIRE Photometer and its Observing Modes Bernhard Schulz (NHSC/IPAC)
ST–ECF UC, Dec 01 1 NGST support at the ST-ECF Bob Fosbury
ACS Drizzling Overview J. Mack; DA Training 10/5/07 Distortion Dither Strategies MultiDrizzle ‘Fine-tuning’ Data Quality Photometry.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 SPIRE AOTs, Products and Quick Look Tools Bernhard Schulz NHSC/IPAC on behalf of the.
WFPC2 UPDATE TIPS : August 15, 2002 L.M. Lubin New WFPC2 Documentation 1.Cycle 12 Instrument Handbook (V7.0, Biretta et al.)  Updated information on the.
Counting individual galaxies from deep mid-IR Spitzer surveys Giulia Rodighiero University of Padova Carlo Lari IRA Bologna Francesca Pozzi University.
Observational Astrophysics I
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Spectroscopy with PACS M82 PACS line imaging from the SHINING team (Contursi et al First Results workshop talk) Phil Appleton and Dario Fadda for.
HARPS Data Flow System Christophe Lovis Geneva Observatory HARPS-N PDR, 6-7 December 2007, Cambridge MA.
MIPS Enhancer MIPS_Enhancer Overview MIPS Data Processing and Calibration Workshop April 12, 2004.
PVPhotFlux PACS Photometer photometric calibration MPIA PACS Commissioning and PV Phase Plan Review 21 st – 22 nd January 2009, MPE Garching Markus Nielbock.
IRS Data Flow & Questions SINGS Team Meeting November 2002 Baltimore, MD L. Armus SIRTF Science Center.
MOS Data Reduction Michael Balogh University of Durham.
PACS ICC Readiness Review MPE, July 3/ PACS Photometer PV Phase Plan 1 Status Report M. Nielbock: PACS PHOT PV Phase Plan Markus Nielbock (MPIA)
C2d Data flow diagram BCD from SSC Texas SAO Quality Analysis and Improved Calibrated Data Mapping team.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
Improving the Rectification of Spectral Images Linda Dressel, Paul Barrett, Paul Goudfrooij, and Phil Hodge.
Overview, Spectrometer Products and Processing Philosophy Phil Appleton on Behalf of PACS Team PACS IFU Spectrometer.
11-Jun-04 1 Joseph Hora & the IRAC instrument team Harvard-Smithsonian Center for Astrophysics The Infrared Array Camera (IRAC) on the Spitzer Space Telescope.
Corot:Ubatuba Nov The Ground Segment: Data Processing. Software development in laboratories. Brazilian contribution. Michel Auvergne Réza Samadi.
PACS Page 1 NHSC Data Processing Workshop – Pasadena Aug 26-30, 2013 SPIRE Spectrometer Data Reduction: Mapping Observations Nanyao Lu NHSC/IPAC (On behalf.
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
RAW DATA BIAS & DARK SUBTRACTION PIXEL-TO-PIXEL DQE CORR. LOCATE EXTR. WINDOW THROUGHPUT CORRECTION (incl. L-flat, blaze function, transmission of optics,
July 21, 2004 Natalia Kuznetsova NICMOS Analysis of ACS ● Data Inventory ● Calibration ● Bad pixel mask ● Extracting photometry ● Next steps 1.
CUPID (Bob Narron)GRITS - May 14, CUPID “Customizable User Pipeline for IRS Data” Abstract: The CUPID package will allow users to run the Spitzer.
Progress Report on GEANT Study of Containerized Detectors R. Ray 7/11/03 What’s New Since Last Time?  More detailed container description in GEANT o Slightly.
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Application of a Charge Transfer Model to Space Telescope Data Paul Bristow Dec’03
A. Ealet Berkeley, december Spectrograph calibration Determination of specifications Calibration strategy Note in
SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
JWST Pipeline Overview
NIRSpec pipeline concept Guido De Marchi, Tracy Beck, Torsten Böker
Spectrophotometric calibration of the IFU spectrograph
NIRSpec simulation data-package
What’s New in HIPE 10.0 (SPIRE FTS)
Presentation transcript:

MIPS Data Processing for SINGS George J. Bendo & Chad Engelbracht (A ''George's Adventures in Learning OpenOffice'' Presentation)

Overview ● Brief review of MIPS ● Description of observational data ● Data checks ● Mosaicing data ● Parallel pipeline processing

MIPS Overview Three detector arrays – 128x  m array – 32x32 70  m array – 2x  m array Will provide – Photometric maps – Low-resolution spectra in  m range

MIPS Observing Modes for SINGS Scan Mapping (or Photometry Mode for smaller targets) – Telescope drifts by targets as mirror in MIPS keeps image steady for multiple adjacent BCDs – Each AOR may contain tens to thousands of individual BCDs – Each observation consists of 2 AORs (for spatial sampling and asteroid rejection) SED Mode – Telescope slit is pointed at a series of adjacent locations to form data cube

Example Data: NGC 3184 Generated simulated data for demonstration – Started with U-band image from NED – Convolved image with MIPS PSFs – Flux calibrated data with IRAS data – Added images to backgrounds provided by H. Dole et al.

Scanned region of NGC 3184 (70  m)

Example of MIPS Scan Map Data

Data Checks Fits header checks – Basic header keywords – Proposal & observer name – Target name – AOT & AOR information – Observing mode – Integration time – Coordinates – Map or SED observing parameters Pipeline data checks – Number of BCDs – BCD image size – Movement of target from BCD to BCD – Noise levels per BCD

List of Fits Header Keywords in Check General Keywords ● KEYWORD ● NAXIS ● NAXIS1 ● NAXIS2 ● TELESCOP ● INSTRUME ● CHNLNUM ● AOT_TYPE ● AORLABEL ● FILETYPE ● FOVID ● FOVNAME ● ISPRIME ● RDOUTMOD Scan Map Keywords ● SCANRATE ● REQ160 ● FASTRES ● NMAPCYCL ● NSCANLEG ● SCANLEN ● STEPFOR ● STEPREV ● OBSRVR ● PROGID ● SAMPTIME ● OBJECT ● RA_HMS ● DEC_DMS ● RA_CMD ● DEC_CMD Photometry Super- Resolution Keywords ● LARGE24 ● NCYCL24 ● LARGE70 ● NCYCL70 ● LARGE160 ● NCYCL160 SED Keywords ● CHOPDIST ● NCYCLES ● COLSTEP ● ROWSTEP

Mosaicing The individual frames will be combined with the mips_enhancer software, which will produce a mosaic of the images as well as enhancing the data. Further checks of the observations will include checking the signal-to-noise ratio of the final data product, checking the quality of the PSF, and comparing the fluxes to IRAS fluxes. The final data products will include the straight mips_enhancer output and trimmed, background-subtracted, resampled versions.

Comparison of Input and Output 24  m Data

Comparison of Input and Output 70  m Data

Comparison of Input and Output 160  m Data

Parallel Pipeline Processing To check the data products from the SSC pipeline, the raw MIPS data will also be processed with developmental software written by the MIPS group ● mips_sloper – Processes charge ramps into slopes for all pixels – Removes cosmic rays – Performs transient correction ● mips_caler – Data calibrated – Dark current subtracted

Example of Output from mips_sloper

Summary ● Prepared series of checks on data output to check observations ● Have software for producing simulated data ● Have software for mosaicing pipeline data from SSC ● Have developmental software for additional parallel pipeline processing

Mosaicer Schedule 5 Sep 2002 (Version 1) – No interpolation (directly from BCD to final mosaicked image) – Distortion correction and outlier rejection Late 2003 (Version 1.n) – MIPS/SINGS review of progress and possible decision to use an intermediate version for SINGS MIPS deliveries – May decide to continue to use version – Add instrumental signatures removal based on redundancy – Iterative approach driven by actual MIPS data – Stim flash latents, long-term drift,... Late 2004 (Version 2) – Will be used to create the final MIPS SINGS data products

Simulator Schedule Jun 2002 – Given AOR and image, will produce input for mips_enchancer Aug 2002 – Produce input for full MIPS pipeline (charge ramps) including distortions Sep 2002 – Add the capability to do SED AORs Dec 2002 – Add instrumental signatures ● Cosmic rays ● Stim flash latents ● Long term drift