GLAST Science Support Center July 16, 2003 2003 July Ground Software Workshop The HEASARC CALDB David S. Davis, SSC.

Slides:



Advertisements
Similar presentations
Introduction to C Programming
Advertisements

Software development process. Explanation of the iterative nature of the software development process.
Data Dictionary What does “Backordered item” mean? What does “New Customer info.” contain? How does the “account receivable report” look like?
Outline May 10-15, 2014 Warrenton Progress of HXMT Science Ground Segment: Calibration and Background analysis Zhang Juan , on behalf of HXMT.
Chandra Calibration Status ACIS 1.Gain correction files for epochs 30, 31 and 32 were released in CALDB (Sept 2007), (Dec. 2007) and
GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.
SOFIA Archiving Requirements for the SOFIA Data Cycle System Mark Morris, UCLA Joe Mazzarella & Steve Lord, IPAC John Milburn & Jochen Horn, UCLA.
LAT Data Server Workshop - 1 Jan 13-14, 2005 Tom Stephens GSSC Database Lead GSSC LAT Data Server Overview.
GLAST Science Support CenterJuly, 2003 LAT Ground Software Workshop Science Analysis Tools Design Robert Schaefer – Software Lead, GSSC.
Mission Operations and Data Flow Overview Koji Mukai Astro-E2 Guest Observer Facility.
T. Burnett: IRF status 30-Jan-061 DC2 IRF Status Meeting agenda, references at:
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test A. T. Kavelaars 1 GLAST Large Area Telescope: I&T Integration Readiness.
GLAST LAT ProjectISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.1 Requirements 1 Gamma-ray Large Area Space Telescope GLAST Large.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test J. Panetta 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope:
© The McGraw-Hill Companies, 2006 Chapter 5 Arrays.
Section 15-1GLAST Ground System Design Review August 18&19, 2004 ISOC Organization ISOC Manager R Cameron Commanding, H&S Timeline Planning Command Generation.
1 Tom Stephens GSSC/GSFC Database Access and the dataSubselector Tool December 8, 2003 DC1 Kickoff Workshop.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL June 23, 2003 GAE workshop Caltech.
GLAST LAT ProjectCCB Review – April 1 st, 2005 GLAST LAT I&T Online A.T.Kavelaars 1 GLAST Large Area Telescope: I&T CCB Review April 1 st, 2005 E-Logbook.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
GLAST Science Support CenterAugust 9, 2004 Implementation of the Standard Analysis Environment (SAE) James Peachey (HEASARC/GLAST SSC—GSFC/L3)
X-ray Astronomy School 2007 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.
LIGHT WEIGHT DIRECTORY ACCESS PROTOCOL Presented by Chaithra H.T.
Faculty of Engineering and Applied Science University of Ontario Institute of Technology Canada Faculty of Engineering and Applied Science University of.
Root, GLAST, and IDL Heather Kelly NASA/GSFC Emergent Corporation.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
IXYZ Frank Marshall NASA/GSFC 25 April 2012 April 25, 20121Implementing Portals of the Universe.
Data Management Subsystem Jeff Valenti (STScI). DMS Context PRDS - Project Reference Database PPS - Proposal and Planning OSS - Operations Scripts FOS.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
ENGR 3950U / CSCI 3020U: Operating Systems Description and C Code of Major Functions in Simulated Unix File System. Instructor: Dr. Kamran Sartipi Faculty.
ICS 145B -- L. Bic1 Project: Main Memory Management Textbook: pages ICS 145B L. Bic.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
GLAST Science Support Center May 8, 2006 GUC Meeting Demonstration of GRB Spectral Analysis with the SAE David Band (GSSC/JCA-UMBC)
Serving Data to the GLAST Users Community Thomas E. Stephens (GSFC/RSIS) for the GLAST Science Support Center Abstract.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
EDExpress Training Presented by Doug Baldwin – CPS/SAIG Technical Support Bob Berry – U.S Department of Education/FSA.
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
AstroGrid Solar/STP planning meeting Agenda: Helioscope Preparing for Solar-B Time-series viewing application IVOA and time series A PPARC funded project.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
Domain-Expert Repository Management for Adaptive Hypermedia Learning System By Norazah Yusof & Paridah Samsuri Members of SPAtH Group Faculty of Comp.
April , 2006 HEASARC Users Group Roger Brissenden 1 HEASARC Supported Activities at SAO Roger Brissenden.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
The HEASARC Coordinate data, software, and media standards with other astrophysics sites. Established December 1990 The HEASARC Charter: Maintain and disseminate.
VIIRS Product Evaluation at the Ocean PEATE Frederick S. Patt Gene C. Feldman IGARSS 2010 July 27, 2010.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
GLAST Science Support CenterJuly, 2003 LAT Ground Software Workshop Science Analysis Tools Design Robert Schaefer – Software Lead, GSSC.
GLAST Science Support Center May 8, 2006 GUC Meeting Status of GLAST User Support David Band (GSSC/JCA-UMBC)
GLAST Large Area Telescope LAT Flight Software System Checkout TRR Test Suites (Backup) Stanford Linear Accelerator Center Gamma-ray Large Area Space Telescope.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
Postgraduate Computing Lectures PAW 1 PAW: Physicist Analysis Workstation What is PAW? –A tool to display and manipulate data. Learning PAW –See ref. in.
06-1L Suzaku Suzaku UG - 3 May, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
Higher Computing Science 2016 Prelim Revision. Topics to revise Computational Constructs parameter passing (value and reference, formal and actual) sub-programs/routines,
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
1 Getting Involved with GLAST Workshop, CFA, 06/21/ C. Shrader, NASA/GSFC GLAST Data & Software Release plans + Science Support Center Services C.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
GLAST LAT ProjectCDR/CD-3 Review May 12-16, 2003 Document: LAT-PR Section 5 IOC Subsystem 1 GLAST Large Area Telescope: IOC Subsystems WBS: 4.1.B.
X-ray Astronomy School 2005 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.
AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.
Review of PARK Reflectometry Group 10/31/2007. Outline Goal Hardware target Software infrastructure PARK organization Use cases Park Components. GUI /
GLAST Science Support Center November 8, 2005 GUC Action Item #15 AI#15: Pre-Launch GI Proposal Tools David Band (GSSC/JCA-UMBC)
WEB API.
David Band – Science Lead, GSSC
Technical aspects of the GIRO work: inputs from GRWG
Presentation transcript:

GLAST Science Support Center July 16, July Ground Software Workshop The HEASARC CALDB David S. Davis, SSC

The HEASARC ● Provides multi-mission archive – Gamma-ray, X-ray, EUV data ● Contains data for 20+ missions ● Stores and distributes mission data in FITS format ● Developed and distributes the FITSIO library for data access

The HEASARC CALDB ● Provides a framework to organize calibration data ● Provides a location for the documentation of calibration data ● Location for software ● Stores calibration data ● FTOOLS provides utilities to populate, index, and browse the CALDB

Calibration Data flow ● Stage 1 – Ground data – Flight data – Instrument models ● Basic Calibration Files (BCFs) – Instrument PSF – Gain Maps – Efficiency maps – Vignetting

Calibration Data flow cont. ● Stage 2 – Stage 1 data is convolved/joined to generate Calibration Product Files (CPFs) ● Along with files external to the CALDB – Event data – Housekeeping data ● Calibration Product Files (CPFs) – Instrument RMF – Effective area maps – Composite PSF

Calibration Data Flow cont. ● Stage 1 BCFs ● Stage 2 CPFs

BCF CPF ● PSF as a function of energy ● dE/E ● Effective area vs energy ● Composite PSF ● RMF ● Effective area for an observation

CALDB Directory Structure /CALDB Data Docs Software Environment variable CALDB points to the top level

CALDB Directory Structure cont. /data /caldb/data/mission/instrument /GLAST caldb.indx /LAT /GBM BCFs CPFs BCFs CPFs

Finding files in the CALDB ● Files are found using the caldb.indx file – Locates the file – Contains date stamp for usage – Contains flags for constrains ● Detector off-axis angles ● Energy range ● Temperature range

Required CALDB Keywords CALDB documentation can be found at

Calibration Index File By using parameters found in the CIF, HEADAS and FTOOLS can locate a specific calibration data file. OGIP CALDB Access Subroutines are described in OGIP Memo (95-002). The main FORTRAN subroutine is "gtcalf". Recently, Ziqin Pan coded it with C, and is being implemented in the HEADAS core library.

CALDB Tools Copy the LAT calibration files into $CALDB/data crcif (Create an empty Calibration Index File) udcif (Creates a new entry in a Calibration Index File) Name of file containing dataset[psf_lat.fits] aeff_lat.fits Name of Calibration Index File[caldb.indx] Dataset: DETEFF Quality value for the dataset being entered[0] Dataset: DETEFF Quality value for the dataset being entered[0] Dataset: DETEFF Quality value for the dataset being entered[0]

CALDB Tools ● General Maintenance Utilities – Quzcif Returns the location of calibration files ● Quzcif GLAST LAT BACK - - DETEFF :00:00 - /local/data/ryu4/ikebe/PC_BACKUP/home/ikebe/GLAST/CALDB/mini_caldb/data/ aeff_lat.fits – mudcif allows many datasets to be input into the CIF – brcaldb Browse the Caldb data holdings

int gtcalf(char* tele, char* instr, char* detnam, char* filt, char* codenam, char* strtdate, char* strtime, char* stpdate, char* stptime, char* expr, int* maxret, char** filenam, long* extno, char** online, int* nret, int* nfound, int* status) GTCALF allows access files specified by URLs remotely, if $CALDB == ftp://legacy.gsfc.nasa.gov/caldb ARGUMENTS tele (in) The name of the mission or telescope. instr (in) The name of the instrument. detnam (in) The name of the detector. filt (in) The name of the filter. codenam (in) The OGIP codename for the requested dataset. strtdate (in) The start-date when the datasets should be valid. strtime (in) The time of the day (strtdate) when the dataset should be valid. stpdate (in) The end-date when the datasets should be valid. stptime (in) The time of the day (in hh:mm:ss.s format) when the dataset should be valid. T expr (in) A boolean expression used to select on calibration boundary parameters. example: Theta.eq.10.and.energy.eq.5 filenam (out) A character array containing the complete system dependent path(s) to the file(s). i nfound (out) The nfound argument reports the total number of datasets found during the search. w status (out) The (integer) return status of the subroutine.

Remote access to the CALDB The HEASARC CALDB can be accessed remotely eliminating the need for distributing large files This also means that the user does not have to worry about updating their local caldb caldb_remote_access.html GTCALF allows remote access to files, if $CALDB == ftp://legacy.gsfc.nasa.gov/caldb

Conclusions ● CALDB allows mission data to be stored in a uniform structure ● Provides tools for accessing and updating CALDB ● Many representations are allowed as long as it can be cast into a FITS file ● Allows remote access to calibration data