STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 1 Removing SAA-Persistent Cosmic Ray Flux from NICMOS.

Slides:



Advertisements
Similar presentations
EPIC Calibration Meeting, Mallorca Update of EPIC pn noise suppression K. Dennerl, 2009 March 31 Mallorca, Spain, 2009 March 31 – April 1 EPIC Calibration.
Advertisements

Computational Biology, Part 23 Biological Imaging II Robert F. Murphy Copyright  1996, 1999, All rights reserved.
Probing Magnetic Reconnection with Active Region Transient Brightenings Martin Donachie Advisors: Adam Kobelski & Roger Scott.
Image reconstruction and analysis for X-ray computed microtomography Lucia Mancini 1, Francesco Montanari 2, Diego Dreossi 3 1 Elettra - Trieste 2 A.R.P.A.
Atacama Large Millimeter/submillimeter Array Expanded Very Large Array Robert C. Byrd Green Bank Telescope Very Long Baseline Array Whoever North American.
Albinoni (NICMOS) Analysis SCP Collaboration Meeting June Greg Aldering Vitaliy Fadeyev with help from Shane Burns Albinoni (1998eq) a SNIa at.
Commentary on Validating Resource Usage in Least Commitment Planning Authors: Nazma Ferdous and Mark Giuliano Commentary by Rob Sherwood October 2006.
Developing JWST Pipelines at STScI Robert Jedrzejewski.
Echelle spectra reduction with IRAF*
Status report on Light Simulator Claudia Cecchi Francesca Marcucci Monica Pepe Software meeting Udine January
EPIC Calibration Meeting, Mallorca K. Dennerl, 2006 October 26 Suppression of the low-energy noise Suppression of the low-energy noise: an improved approach.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
…….CT Physics - Continued V.G.WimalasenaPrincipal School of radiography.
Spectral contrast enhancement
Study of NICMOS Non-linearity B. Mobasher, A. Riess, R.de Jong, S.Arribas, E.Bergeron, R.Bohlin, H. Ferguson, A. Koekemoer, K. Noll, S. Malhotra, T. Wiklind.
S. Baggett, J. Anderson, K. S. Long, J. W. MacKenty, K. Noeske, J. Biretta, and the WFC3 team (STScI) WFC3 : Understanding and mitigating UVIS charge.
Memorandam of the discussion on FMOS observations and data kicked off by Ian Lewis Masayuki Akiyama 14 January 2004 FMOS Science Workshop.
1 TIPS 2011 May Persistence in the WFC3 IR detector Knox S. Long.
Understanding Persistence: A 3D Trap Map of an H2RG Imaging Sensor
Dif-c-mri-5-epoxi-hartley2- photom-v1.0 Matthew Knight (lead reviewer) 10:15 AM.
Cosmic Ray + Bright Stars Masking S. Desai E. Bertin J. Mohr H. Lin DES Algorithms meeting.
PACS NHSC SPIRE Point Source Spectroscopy Webinar 21 March 2012 David Shupe, Bernhard Schulz, Kevin Xu on behalf of the SPIRE ICC Extracting Photometry.
Science with the new HST after SM4 WFC3 slitless spectroscopy Harald Kuntschner Martin Kümmel, Jeremy R. Walsh (ST-ECF) WFC3-team at STScI and NASA.
NIRSpec Operations Concept Michael Regan(STScI), Jeff Valenti (STScI) Wolfram Freduling(ECF), Harald Kuntschner(ECF), Robert Fosbury (ECF)
What’s in a sum? Simon Dawes CMHAS. Should you stack frames using Mean, Median or Sum?
ACS Drizzling Overview J. Mack; DA Training 10/5/07 Distortion Dither Strategies MultiDrizzle ‘Fine-tuning’ Data Quality Photometry.
Flux Dependent Non-Linearity: The Evil Twin of Persistence Mike Regan, Kevin Lindsay, Eddie Bergeron, Rachel Anderson.
WFPC2 UPDATE TIPS : August 15, 2002 L.M. Lubin New WFPC2 Documentation 1.Cycle 12 Instrument Handbook (V7.0, Biretta et al.)  Updated information on the.
AMS Tracker Data Reduction Status Claude Zurbach Laboratoire de Physique Théorique et Astroparticules – Montpellier Houston, AMS-TIM, January 08, 2007.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 12.0) Level 1 to Level 2 processing: The JScanam pipeline Prepared.
NICMOS Status Roelof de Jong (STScI) and the NICMOS team: Santiago Arribas, Elizabeth Barker, Eddie Bergeron, Ilana Dashevsky, Anton Koekemoer, Sangeeta.
1-D Flat Fields for COS G130M and G160M Tom Ake TIPS 17 June 2010.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
Mixture of Gaussians This is a probability distribution for random variables or N-D vectors such as… –intensity of an object in a gray scale image –color.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 The SPIRE Destriper Bernhard Schulz NHSC/IPAC on behalf of the SPIRE ICC 1.
Herschel Open Time Cycle 1 DP workshop ESAC, March page 1 Spurs in HIFI data Colin Borys.
1 NaI calibrationneutron observation NaI calibration and neutron observation during the charge exchange experiment 1.Improving the NaI energy resolution.
C2d Data flow diagram BCD from SSC Texas SAO Quality Analysis and Improved Calibrated Data Mapping team.
NICMOS Calibration Challenges in the Ultra Deep Field Rodger Thompson Steward Observatory University of Arizona.
ESO Reflex A Graphical Workflow Engine for Data Reduction Richard Hook Euro VO Data Centres Alliance Theory & Grid Workshop, Garching, April 2008.
Physics 114: Lecture 8 Measuring Noise in Real Data Dale E. Gary NJIT Physics Department.
14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.
Statistical analysis of variability in SWAP image sequences K. Bonte & Y. S. Mehmet (KULeuven) D. Berghmans (ROB) A. De Groof (ESA/ROB)
Basic Detector Measurements: Photon Transfer Curve, Read Noise, Dark Current, Intrapixel Capacitance, Nonlinearity, Reference Pixels MR – May 19, 2014.
STScI 2010 Calibration Workshop The NICMOS Legacy Archival Recalibration Project Anton M. Koekemoer and the STScI NICMOS Team (E. Barker, E. Bergeron,
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 13.0) Level 1 to Level 2.5 processing: The JScanam pipeline Prepared.
Non-standard Gains for NICMOS Daniela Calzetti (In lieu of Torsten Boeker) TIPS May 15 th 2003.
: Chapter 5: Image Filtering 1 Montri Karnjanadecha ac.th/~montri Image Processing.
PyRAF/Pipeline Removal of SAA Persistence from NICMOS Data Elizabeth A. Barker Vicki Laidler Eddie Bergeron Anton Koekemoer Elizabeth A. Barker Vicki Laidler.
New NICMOS Readout Sequences Chun Xu Space Telescope Science Institute Abstract On 12 June 2005, four new NICMOS multi-accum sequences (SPARS4, SPARS16,
NHSC HIFI DP workshop Caltech, 7-9 February page 1 Spurs in HIFI data.
1 Notes about eis_prep Alessandro Gardini University of Oslo Oslo, July 9th, 2009.
Energy Calibration of BESIII EMC  ‘Digi’-calibration Bhabha calibration  0 calibration Radiative Bhabha calibration  ‘Cluster’-calibration.
STScI TIPS, 15 January 2004MultiDrizzle Overview - Anton Koekemoer1 MultiDrizzle Status and Development Overview Anton Koekemoer, ACS+WFPC2 Branch Project.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Application of a Charge Transfer Model to Space Telescope Data Paul Bristow Dec’03
DT calibration software: tentative release schedule S.Bolognesi & S.Maselli & G.Mila Alignement&Calibration Meeting, 25 January 2008, CERN.
Torsten Böker TIPS May 16, 2002 status Instrument status 1) Final temperature adjustment 2) Fine Optical Alignment 3) Remaining SMOV timeline.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
CAA 6 th Cross Cal Meeting RAL, th Oct 2007 RAPID/IES Calibration Status J.A. Davies.
26th Oct 2006CAA cross cal meeting, MSSL RAPID Calibration Status RAPID team.
The CORNISH data reduction pipeline. Architecture - Overview AIPS Tasks Obit Tasks ObitTalk / Python Control Scripts MySQL Database Book-keeping Raw Data.
RAPID/IES Calibration Status Rutherford Appleton Lab
JWST Pipeline Overview
CCD Image Processing …okay, I’ve got a bunch of .fits files, now what?
New static DQ masks for NICMOS
COS FUV Flat Fields and Signal-to-Noise Characteristics
BESIII EMC electronics
Sabra Djomehri SULI 2007 Stanford Linear Accelerator 8/15/2007
Presentation transcript:

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 1 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) with Elizabeth Barker, Vicki Laidler, Eddie Bergeron Overview of SAA persistence Algorithm for removing SAA persistent flux Implementation & testing of “saaclean” task Future plans

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 2 SAA Persistence Overview of Persistence: NICMOS HgCdTe/CdTe bulk material contains small flaws that trap electrons produced by detected photons The trapped electrons are not read out together with all the other electrons detected in a given pixel Thermal excitation causes traps to release the electrons on longer timescales with a logarithmic decay Resulting flux appears in subsequent exposures, with a distribution that depends on the original intensity and the population of traps (Bergeron & Dickinson, NICMOS-ISR )

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 3 South Atlantic Anomaly (SAA): Region in Earth’s magnetosphere where Van Allen belts dip closest to the surface, resulting from misalignment in Earth’s magnetic axis HST passes through it ~50% of the time, 8-9 orbits/day Although NICMOS is powered off, cosmic ray electrons are still trapped Cosmic ray rate is so high that persistence can increase total noise by 4-5x in subsequent exposures obtained long after the SAA passage (Bergeron & Dickinson, NICMOS-ISR )(O. Lupie, WFC3-ISR )

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 4 Removing SAA Persistent Flux Post-SAA darks: After each SAA passage when NICMOS transitions from SAAOPER to OPERATE, a pair of dark exposures is obtained: –ACCUM mode, NREAD=25, EXPTIME=256s –Darks start 174s and 444s after exiting the SAA Calibrate the darks to remove other instrumental signatures (pedestal etc) Create average post-SAA dark image: –scale the 2nd dark to the level of the 1st dark, using the decay time constant –average the 2 darks to remove CRs accumulated during the dark exposures (Bergeron & Dickinson, NICMOS-ISR )

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 5 Subtracting the SAA model: The average of the 2 post-SAA darks is the SAA model, representing all the CRs accumulated during SAA passage Scale and subtract from the calibrated (pedestal-corrected) science image Scale factor is determined iteratively: –multiply SAA model image by small scale factors –subtract from science image –measure the resulting noise (FWHM of Gaussian fit to pixel histogram) –Plot noise as a function of scale factor, fit parabola to determine optimal scale

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 6 Fitting for High and Low pixels: Some CRs during SAA have higher energy and/or occur later than others Need to fit different scale factors, depending on the level of the residual signal In practice, divide the pixel histogram into 2 regimes: low and high Determine separate scale factors, and only apply a correction if the reduction in noise is > 1%

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 7 Example Results (Barker & Koekemoer, 2005 HST Cal Workshop Before SAAcleanAfter SAAclean SAA CR Persistence model Post-SAA Dark

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 8 Implementation of SAAclean task Original script: IDL, provided by E.Bergeron New version: Python code, written by Vicki Laidler, following original IDL prototype Installed as Pyraf/STSDAS hst_calib.nicmos.saaclean Some slight differences in algorithms (mostly related to IDL fitting functions that are unavailable or different in Pyraf) Inputs: –calibrated exposure (optionally corrected for pedestal effect) –Post-SAA darks (read from the image header) Output: –calibrated exposure with the SAA model subtracted –SAA model (in off-line version) –Lots of output text containing information about the fitting process –Fitting parameters also stored in header keywords

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 9 Testing Procedures Compare IDL and Pyraf versions: run on the full variety of datasets, ranging from extreme SAA events to datasets that are not impacted resulting model files and output images compared, examining: –noise in the images –individual pixels –dependence on quality of bad pixel files Results: –some differences between IDL and Pyraf; generally only in treatment of bad pixels, while SAA-impacted pixels showed the same behaviour Full test of the Pyraf version: Ran on all SAA-impacted NIC1,2,3 exposures ever obtained (>6,000) Examined images, as well as the output values of: –chi-sq –nhigh/nlow pixels and the threshold value –scale correction factor –noise reduction values

STScI TIPS 19 January 2006 Removing SAA-Persistent Cosmic Ray Flux from NICMOS Anton Koekemoer (INS) 10 Future Plans Off-line version: Prototype version was released publicly in STSDAS 3.4 (Nov 1, 2005) Available for use within STScI and in the outside community; feedback solicited Finalize addressing minor issues turned up in very extreme datasets (very low or very high chi-sq, or low/high pixel regimes not well modelled): –appears that all of these can be fixed by using the correct bad pixel files Add some additional parameters to improve flexibility of iterations Next release likely in Feb/Mar 2006 Pipeline version: Aim to incorporate all improvements in off-line version by Feb/Mar 2006 Likely release to OPUS in Apr/May 2006 Initially only run on data that is within 1 orbit of SAA passage Correction only applied if noise reduction is >1% Continue to solicit feedback from community