COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 1 of 14 Keywords and Associations.

Slides:



Advertisements
Similar presentations
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Science Calibration & Instrument Status TIPS 20 Nov 2003 Last COS TIPS Aug 2003.
Advertisements

NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA TIPS / COS Update The NUV Gratings 18 October 2007 Last COS TIPS presentation: 21 December.
Initial Alignment Check / Calibration in Vacuum Dennis Ebbets With substantial contributions from Tom Delker, Erik Wilkinson, Steve Osterman, Ken Brownsberger,
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 21 August 2001.
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
Chapter Oracle Server An Oracle Server consists of an Oracle database (stored data, control and log files.) The Server will support SQL to define.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA Cosmic Origins Spectrograph Hubble Mission Status Review Charles D. (Tony) Keyes Last Review:
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
File FormatsFile Formats File Name ConventionsFile Name Conventions File ContentsFile Contents Association Contents & RulesAssociation Contents & Rules.
5-1 DMS Data Products Nov. 6, 2013 S&OC Data Management System Design Review 3.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA TIPS / COS TV Update 21 December 2006 Agenda Agenda Testing Setup and Status Testing Setup.
Cosmic Origins Spectrograph Hubble Space Telescope James C. Green University of Colorado Cosmic Origins Spectrograph Instrument Design and Capabilities.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Status FUV Detector “1-bounce design” NUV Detector HST aberration fully-corrected Calibration.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS TAGFLASH System Requirements Review COS Lamp Lifetime Estimates for TAGFLASH Scenarios.
Keyes - 5 Mar 2001 Slide 1 of 16 COS Science Team Meeting – STScI Status  STScI Integrated Scheduling System Development – TIME-TAG (primary science mode)
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 20 October 1999.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA An Update on the COS Development Status TIPS 21 August 2003 (Last COS TIPS: Dec 2002) COS Integrated.
COS PIPELINE PDR Daryl Swade December 7, 2000OPUS / OTFR Space Telescope Science Institute 1 of 24 Science Data Processing
HST Quarterly Review Page 1 Space Telescope Science Institute 12 February 2004 SI Status: COS STScI Support of COS Thermal-Vacuum Testing COS Thermal-Vacuum.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
18 May 2006 Slide 1 of 10 STScI TAGFLASH Ground System Development Current ground system could support immediate COS launch Current ground system could.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA Hubble Mission Status Review Charles D. (Tony) Keyes Last Review: 10 June August 2003.
TIPS COS Overview - Keyes : 18 May 2000 COS Overview v CDR: April 2000 v FUV delivery: January 2001 v Environmental (Thermal-Vac): spring 2002 v Launch:
The Status of COS Flat Fields Tom Ake TIPS 21 August 2008.
SOFTWARE TOOLS FOR DATA QUALITY ANALYSIS The Science Data Analysis Tool (SDAT) is the primary tool used by the DQA team. SDAT can access all raw and processed.
Selection of the New COS/FUV Lifetime Position Cristina Oliveira Jan TIPS Meeting - COS/FUV Lifetime1.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Outline of CALCOS Processing Steps and Keywords Reference Files Associations.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA WFC3 and StarView
1-D Flat Fields for COS G130M and G160M Tom Ake TIPS 17 June 2010.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 15 January 2002.
Cosmic Origins Spectrograph
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Calibration Goals of CALCOS Association Table Input and Output Files High Level.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA An Update on the COS Development Status TIPS 21 August 2003 (Last COS TIPS: Dec 2002) COS Integrated.
28 February 2008 COS Training Series IV 1 COS Training Series IV: COS Post-observation M.E. Kaiser P. E. Hodge 28 February 2008 COS.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline PDR File Structure Overview Charles D. (Tony) Keyes 7 December 2000.
TIPS COS Status: SMOV update III STScI/CU COS Team 17 September 2009.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA Cosmic Origins Spectrograph Status STIC 13 February 2001.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA SMOV4 Requirements Review Cosmic Origins Spectrograph Scott D. Friedman STScI 30 July 2003.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 17 September 2002.
Click to Change Title Here is a text box to present information in paragraph format, instead of bulleted lists. We’ve left space to the right for an image.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Critical Design Review July 2001.
WFC3 COS 5 th COS/WFC3 FSW/GS Splinter Meeting Baggett - 03 April 2002 Slide 1 of 8 SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA 5 th COS/WFC3.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA Cosmic Origins Spectrograph Hubble Mission Status Review Charles D. (Tony) Keyes Last Review:
The Status of HST/COS and HST/STIS Cristina Oliveira 8/12/14COS and STIS Cal Workshop1 SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA.
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
Tracing the JWST Proposal from User Interface to Commanding of an Instrument Margaret Meixner & WIT Balzano, Robinson & CMD.
HST Quarterly Review Page 1 Space Telescope Science Institute 15 October 2003 SI Status: COS STScI COS Program Activity SubprojectSTScI Activity Instrument.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 24 October 2007.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS TAGFLASH System Requirements Review CALCOS Requirements Philip E Hodge 14 December 2005.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA TIPS / COS 17 January 2002.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 15 September 1999.
Cosmic Origins Spectrograph November 13, 2003 Page 1 “Data contained herein is exempt from ITAR regulations under CFR 125.4(13) -- data approved for public.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 22 April 2002.
Keyes – 1 February 2000 : Slide 1 of 6 COS Monthly Status Review v OP-01 updates and revisions – STScI and IDT schedule and agenda for continuing COWG.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Monthly Status Review 22 January 2003.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA TIPS Cosmic Origins Spectrograph 20 September 2001.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA Cosmic Origins Spectrograph HST Quarterly Review – Instrument Status Charles D. (Tony) Keyes.
Cosmic Origins Spectrograph Monthly Status Review 17 April 2001 Charles D.(Tony) Keyes Page 1 of 10 Synopsis Role: STScI supports COS science operations.
COS Training Series COS Update: pre-SMOV / Cycle Tony Keyes March 2009.
Cosmic Origins Spectrograph Monthly Status Review 19 June 2001 Charles D.(Tony) Keyes Page 1 of 10 Synopsis Role: STScI supports COS science operations.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline and Archives Preliminary Design Review 7 December 2000.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA TIPS / COS 27 June 2002.
COS FUV Flat Fields and Signal-to-Noise Characteristics
Instrument Introduction
File Formats File Name Conventions File Contents File Sizes
Presentation transcript:

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 1 of 14 Keywords and Associations

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 2 of 14 Keyword specification – keyword name – default value – possible values – units – datatype – short comment for header – long description – header position – DADS table – keyword source The following information is being generated by STScI Science Instrument team and DST for all COS specific keywords. COS ICD-19 header and keyword development is underway and can be tracked through the development version of the keyword database at header_form?db=Development

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 3 of 14 Science Instrument Configuration Keywords  Keyword: some possible values – OBSTYPE: Spectroscopy, Imaging – OBSMODE: ACCUM, TIME-TAG – EXPTYPE: ACQ, PEAKUP/XDISP, PEAKUP/DISP, SCI, WAVE, FLAT, DARK, PHA – DETECTOR: FUV, NUV – SEGMENT: FUVA, FUVB – OPT_ELEM: G130M, G160M, G185M, G225M, G285M, G140L, G230L, MIRROR, MIRRORB – CENWAVE: 1298, 1309, 1320, etc. – APERTURE : PSA, BOA, WCA, FCA (Indicates a COS unique keyword or value)

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 4 of 14 COS Associations  Only associations required for data processing will be constructed by TRANS  There will be 1 product, and only 1 product, for each association.  COS associations will consist of – FP-split (always 4) or repeat obs. exposures – Wavecals > Wavecals executed after each grating, central wavelength, mirror, or aperture change; and at least once each orbit.  Wavecals can be shared between associations  An association table will contain all information about associated dataset  Observations will complete Generic Conversion as individual exposures, be held by a Data Collector until all member exposures are present, and the product will be created by CALCOS.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 5 of 14 Trailer concatenation  CALCOS will append trailer messages for individual exposure calibrations to the OPUS generated trailers.  CALCOS will concatenate the individual exposure trailers at the start of product generation, and append further product calibration comments to the resulting file.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 6 of 14 Association related keywords  Science headers: – ASN_ID – unique identifier assigned to association – ASN_TAB – name of the association table – ASN_MTYP – Role of the Exposure in the Association  Association table header: – ASN_STAT – status of association (Complete/Incomplete) – ASN_PROD – association product formed (T/F)

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 7 of 14 Association Table Example – FP split  Example of Association Table listing at time of creation with all exposures present – ASN_ID = lpppss01 MEMNAME MEMTYPE MEMPRSNT MEMNAME MEMTYPE MEMPRSNT lpppss01q EXP-WAVE YES lpppss01q EXP-WAVE YES lpppss02q EXP-FP YES lpppss02q EXP-FP YES lpppss03q EXP-FP YES lpppss03q EXP-FP YES lpppss04q EXP-FP YES lpppss04q EXP-FP YES lpppss05q EXP-FP YES lpppss05q EXP-FP YES lpppss06q EXP-WAVE YES lpppss06q EXP-WAVE YES lpppss010 PROD-FP NO lpppss010 PROD-FP NO  CALCOS must update ASN table as products are generated.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 8 of 14 Association Table Example –Repeat Obs  Example of Association Table listing at time of creation with all exposures present – ASN_ID = lpppss02 MEMNAME MEMTYPE MEMPRSNT MEMNAME MEMTYPE MEMPRSNT lpppss07q EXP-WAVE YES lpppss07q EXP-WAVE YES lpppss08q EXP-RPT YES lpppss08q EXP-RPT YES lpppss09q EXP-RPT YES lpppss09q EXP-RPT YES lpppss0aq EXP-RPT YES lpppss0aq EXP-RPT YES lpppss0bq EXP-WAVE YES lpppss0bq EXP-WAVE YES lpppss0cq EXP-RPT YES lpppss0cq EXP-RPT YES lpppss0dq EXP-RPT YES lpppss0dq EXP-RPT YES lpppss0eq EXP-WAVE YES lpppss0eq EXP-WAVE YES lpppss020 PROD-RPT NO lpppss020 PROD-RPT NO

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 9 of 14 Archive Catalog  All datasets for a given association presented to DADS in a single OPUS archive request.  Product and unassociated exposure level information cataloged in “science” tables (science, cos_science, cos_ref_data, etc.).  All exposure level information cataloged in “instrument” tables (shp_data, cos_a_data, etc.)

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 10 of 14 Shared Wavecals  For example, the first wavecal of an association can be shared with the previous association, or the last wavecal of an association can be shared with the following association.  Data Processing – OPUS pipeline cleanup routine will not delete a shared wavecal until the last association using it has completed processing. – Same wavecal exposure from different associations will be sent to DADS in separate archive requests.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 11 of 14 Shared Wavecals (cont.)  Archive Catalog – Each instance of a shared wavecal will be cataloged in the COS instrument tables. > Dataset name and association_id will be used as unique keys to distinguish table rows.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 12 of 14 Association rules for processing with missing data  The data collector will time-out at a tunable time (~ 2 days) and continue processing without the missing data  Rules for processing anomalous scenarios: – If at least one science exposure exists (FP-split or RptObs), generate a product. > If no wavecal exists generate a product from the science exposures using default wavelength shifts in CALCOS. – If one or more wavecals exist with no science, process wavecals as individual exposures including calibration.

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 13 of 14 Association rules for processing with missing data (cont.)

COS OPUS/HDA CDR Daryl Swade July 23, 2001Keywords and Associations Space Telescope Science Institute 14 of 14 Associating COS jitter files  Jitter files for individual exposures will be packaged into products that correspond to the science data products.