Spectral Combination Software Jerry Kriss 5/8/2013.

Slides:



Advertisements
Similar presentations
Response Spectrum Analysis as per Indian IS: 1893 (Part 1)-2002
Advertisements

Post-SM4 Sensitivity Calibration of the STIS Echelle Modes Azalee Bostroem With help from: Ralph Bohlin, Alessandra Aloisi, Charles Proffitt, Kenneth Hart,
Cross-correlation Cross-correlation function (CCF) is defined byscaling a basis function P(X i ), shifted by an offset X, to fit a set of data D i with.
Segmentation. Methods Region Growing Split and Merge Clustering.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
Review1 What is multilingual computing? Bilingual, trilingual, vs. Multilingual What are the fundamental issues in multi-lingual computing? –Representation.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
1 Formation et Analyse d’Images Daniela Hall 30 Septembre 2004.
Model-fitting E. BertinDES Munich meeting 05/ Automated model fitting in DESDM E.Bertin (IAP)
Distortion in the WFC Jay Anderson Rice University
NASSP Masters 5003F - Computational Astronomy Lecture 19 EPIC background Event lists and selection The RGA Calibration quantities Exposure calculations.
STIS Closeout Plan Paul Goudfrooij 2005 HST Calibration Workshop, 10/26/2005.
ATMOSPHERIC CORRECTION – HYPERSPECTRAL DATA Course: Special Topics in Remote Sensing & GIS Mirza Muhammad Waqar Contact:
14 October Observational Astronomy SPECTROSCOPY and spectrometers Kitchin, pp
First results of the tests campaign in VISIBLE in VISIBLE for the demonstrator 12 October 2007 SNAP Collaboration Meeting Paris Marie-Hélène Aumeunier.
SPIRE Consortium Meeting La Palma, Oct. 1 – SPIRE FTS Pipeline Trevor Fulton Blue Sky Spectroscopy, Lethbridge, Canada.
18 October Observational Astronomy SPECTROSCOPY and spectrometers Kitchin, pp
Data Reduction. 1.Overview 2.The Curse of Dimensionality 3.Data Sampling 4.Binning and Reduction of Cardinality.
COS PIPELINE PDR Daryl Swade December 7, 2000OPUS / OTFR Space Telescope Science Institute 1 of 24 Science Data Processing
Tutorial T-10 Amber Data Reduction (practical point of view) EuroSummer School Observation and data reduction with the Very Large Telescope Interferometer.
Padova-Asiago Supernova Group (
ACS Drizzling Overview J. Mack; DA Training 10/5/07 Distortion Dither Strategies MultiDrizzle ‘Fine-tuning’ Data Quality Photometry.
Wide-Field Slitless Spectr scopy with NIRISS Van Dixon STScI TIPS/JIM 2012 September 20.
The CoRoT ground-based complementary archive The CoRoT ground-based complementary archive Monica Rainer, Ennio Poretti M. Rosa Panzera, Angelo Mistò INAF.
JWST Calibration Error Budget Jerry Kriss. 15 March 20072/14 JWST Flux & Wavelength Calibration Requirements SR-20: JWST shall be capable of achieving.
The Status of COS Flat Fields Tom Ake TIPS 21 August 2008.
Data products of GuoShouJing telescope(LAMOST) pipeline and current problems LUO LAMOST Workshop.
CSE554Fairing and simplificationSlide 1 CSE 554 Lecture 6: Fairing and Simplification Fall 2012.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Outline of CALCOS Processing Steps and Keywords Reference Files Associations.
1-D Flat Fields for COS G130M and G160M Tom Ake TIPS 17 June 2010.
COS signal to noise capabilities Limitation of COS S/N No good 2-D flat available. Fixed pattern noise dominates COS spectra. An uncalibrated COS spectrum.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.
European Space Astronomy Centre (ESAC) Villafranca del Castillo, MADRID (SPAIN) Andrea Laruelo IVOA Interoperability Cambridge September 2007 Mathematical.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline PDR File Structure Overview Charles D. (Tony) Keyes 7 December 2000.
COS Training Series II. Optimizing Observations --- David Sahnow February mm.
1 Overview Importing data from generic raster files Creating surfaces from point samples Mapping contours Calculating summary attributes for polygon features.
STORM WP7 Software library for nonlinear analysis of fluctuations in space plasma time series P. Kovács, A. Koppán C. Munteanu, M. Echim, STORM Annual.
MOS Data Reduction Michael Balogh University of Durham.
Practical applications: CCD spectroscopy Tracing path of 2-d spectrum across detector –Measuring position of spectrum on detector –Fitting a polynomial.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
Improving the Rectification of Spectral Images Linda Dressel, Paul Barrett, Paul Goudfrooij, and Phil Hodge.
1 JULIA ROMAN-DUVAL & COS/STIS TEAM AUGUST 12, 2014 MOVING COS/FUV TO LIFETIME POSITION 3 See also Poster by Proffitt et al.
JWST Time-Series Pipeline Nikole K. Lewis STScI. Data Pipeline for Transiting Exoplanets The foundation for the Spitzer and Hubble data pipelines were.
RAW DATA BIAS & DARK SUBTRACTION PIXEL-TO-PIXEL DQE CORR. LOCATE EXTR. WINDOW THROUGHPUT CORRECTION (incl. L-flat, blaze function, transmission of optics,
Diagnostics and Optimization Procedures for Beamline Control at BESSY A. Balzer, P. Bischoff, R. Follath, D. Herrendörfer, G. Reichardt, P. Stange.
STScI Slitless Spectroscopy Workshop November 2010 aXe Advanced Topics – becoming more dextrous, using aXe with other instruments, making calibration.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS TAGFLASH System Requirements Review CALCOS Requirements Philip E Hodge 14 December 2005.
Selection and Characterization of Interesting Grism Spectra Gerhardt R. Meurer The Johns Hopkins University Gerhardt R. Meurer The Johns Hopkins University.
Observational procedures and data reduction Lecture 4: Data reduction process XVII Canary Islands Winter School of Astrophysics: ‘3D Spectroscopy’ Tenerife,
Essential components of the implementation are:  Formation of the network and weight initialization routine  Pixel analysis of images for symbol detection.
1 Berger Jean-Baptiste
# x pixels Geometry # Detector elements Detector Element Sizes Array Size Detector Element Sizes # Detector elements Pictorial diagram showing detector.
A. Ealet Berkeley, december Spectrograph calibration Determination of specifications Calibration strategy Note in
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-403 (for Hipe 13.0) Level 1 to Level 2.5 processing: The Unimap pipeline Prepared.
Description of the giro ON THE DETAILS OF THE IMPLEMENTATION
A.Zanichelli, B.Garilli, M.Scodeggio, D.Rizzo
NAC flat fielding and intensity calibration
NIRSpec pipeline concept Guido De Marchi, Tracy Beck, Torsten Böker
Sizing With Function Points
Cross-line shot interpolation
COS FUV Flat Fields and Signal-to-Noise Characteristics
NHSC/PACS Web Tutorials Running PACS spectrometer pipelines PACS-302
Telecommunications Engineering Topic 2: Modulation and FDMA
Enhancing the Enlargement of Images
UVIS Calibration Update
Chapter 7: Transformations
MapReduce: Simplified Data Processing on Large Clusters
Calibration Method.
Enhancing the Enlargement of Images
Presentation transcript:

Spectral Combination Software Jerry Kriss 5/8/2013

Combining FUSE Spectra Procedure is called cf_merge (1805 lines of code + calfuse utilities) Determine zero-point offsets in wavelength scales relative to Segment LiF1A by cross correlation. Renormalize fluxes in all segments to LiF1A&B using overlapping wavelengths. (Pointing control used the FGS on mirror LiF1 for most of the mission.) Weighting is done using relative effective areas in order to preserve Poisson statistics. Correct for the “worm” in Segment LiF1B spectra using LiF2A as a template. Combine all 8 spectra into a single spectrum.  Weighting is done using relative effective areas in order to preserve Poisson statistics.  A minimum S/N is required for inclusion (in case there were gross segment drifts, which were not uncommon).  Spectra are rebinned using linear interpolation.  This introduces correlated errors between adjacent pixels, but FUSE is highly oversampled (~7 pix per resel). Binning up by 3 or 4 pixels minimizes the correlated errors. 5/08/2013 2

Correcting the FUSE “Worm” Re-bin LiF1B and LiF2A on commensurate wavelength scales at 1Å spacings from 1100 to 1180 Å. Form the ratio of the rebinned spectra. Find the average in the regions and , rejecting outliers. Fit the ratio using a 3rd-order cubic spline with 13 nodes.  Force the fitted data to have the average found in (3) over the wavelength regions and  Reject 2-sigma outliers. Form a ratio function using the resulting fit and the average computed in (3) so that  F(w) = the average from and  F(w) = the fitted ratio from 1115 to 1175  Replace points in F(w) from 1115 longwards that differ from the average by more than 0.01 with the average.  Replace points in F(w) from 1175 shortwards that differ from the average by more than 0.01with the average. Divide the original LiF1B data by this ratio, and use this corrected spectrum in forming the final binned result. 5/08/2013 3

Combining STIS Echelle Spectra (1) The whole process is controlled with a cl script, “ech2asc_tot.cl” (81 lines). I start with the x1d file from the pipeline and dump the FITS binary tables into 3-column ascii files containing wavelength, flux, error using “tprint”, with one temporary file per order. Read this list of files into arrays of w, f, e for each order. Loop through the orders and determine the wavelength ranges that overlap.  Split this range in half, and take half from one order and half from the next.  Overlapping data are simply discarded and are not used.  There are some gaps since not all orders overlap. The merged spectrum is written out as a single ascii file containing wavelength, flux, error. 5/08/2013 4

Combining STIS Echelle Spectra (2) I only combine spectra obtained with the same grating. Start with the 3-column ascii files containing wavelength, flux, and error produced by “ech2asc_tot.cl”. Program “weighted_merge.c” (189 lines) combines the spectra into a single file of the same format with a linear wavelength scale.  Read a list of filenames and weights to be applied.  To preserve Poisson statistics, I generally weight by exposure time.  User specifies starting & ending wavelengths and dispersion.  Input spectra are linearly interpolated onto the output array.  Errors are propagated using weights provided. 5/08/2013 5

Combining COS Spectra Very similar to how I combine STIS echelle spectra. I only combine spectra obtained with the same grating. I start with the x1dsum files from the pipeline, which have combined all the FPPOS spectra for a single central wavelength. Dump the x1d FITS binary tables into 3-column ascii files containing wavelength, flux, error, and DQ using a cl script, “listcos.cl” (76 lines; uses tprint, tabpar, thselect, imgets). Program “weighted_merge.c” combines the spectra into a single file of the same format with a linear wavelength scale.  Read a list of filenames and weights to be applied.  To preserve Poisson statistics, I generally weight by exposure time.  User specifies starting & ending wavelengths and dispersion.  Input spectra are linearly interpolated onto the output array.  Errors are propagated using weights provided.  DQ flags are propagated using “OR”. 5/08/2013 6