Swift HUG 12-13 April 2006 1 Swift data archive Lorella Angelini HEASARC.

Slides:



Advertisements
Similar presentations
Title: ICON L0 from MOC to SOC automation Author: MOC/SOC Resides: SOC Description: This is a script that copies the ICON L0 files from the MOC to the.
Advertisements

Solar-B FPP 1 Ted Tarbell, TRACE Operations 3 February 2003 MODA Mtg, ISAS The TRACE Model for Operations Ted Tarbell
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center Phase E Kickoff Meeting February 23, 2007.
Experiences From The Fermi Data Archive Dr. Thomas Stephens Wyle IS/Fermi Science Support Center.
NOAO/Gemini Data workshop – Tucson,  Hosted by CADC in Victoria, Canada.  Released September 2004  Gemini North data from May 2000  Gemini.
A high z (z~6.3) GRB-- GRB Reported by Bubu 2006 Mar.17.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
Swift 1 Swift Spacecraft and Instruments. Swift 2 Spacecraft Design 1 of 6 Reaction wheels Gyros Star Trackers.
Mission Operations and Data Flow Overview Koji Mukai Astro-E2 Guest Observer Facility.
Swift Identification of the host galaxy of Swift short GRBs by the Chandra sub-arcsecond position T. Sakamoto, N. Gehrels, E. Troja, J. Norris, S. Barthelmy,
GLAST LAT ProjectDC1 Closeout Workshop, Feb , Post-DC1 Work Seth Digel (HEPL/Stanford Univ.) Post-DC1 Work.
Lessons from HETE-2 Ops D. Q. Lamb (U. Chicago) with invaluable input from E. Fenimore, C. Graziani, and R. Vanderspek.
Data Processing A simple model and current UKDA practice Alasdair Crockett, Data Standards Manager, UKDA.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
Leicester Database & Archive Service J. D. Law-Green, J. P. Osborne, R. S. Warwick X-Ray & Observational Astronomy Group, University of Leicester What.
Leicester Database & Archive Service J. D. Law-Green, S. W. Poulton, J. Osborne, R. S. Warwick Dept. of Physics & Astronomy, University of Leicester LEDAS.
STEREO Science Center SWG – Dec 2004 William Thompson NASA Goddard SFC Code Greenbelt, MD
Data Processing and User Software Ken Ebisawa (Astro-E2 GOF) presentation and demonstration.
CXC Implementing 2007 NRC Portals of the Universe Report Chandra X-ray Center Recommended Best Practices Roger Brissenden and Belinda Wilkes 25 April 2012.
OSN Archive: Current status and future implementations José Miguel Ibáñez Instituto de Astrofísica de Andalucía - CSIC Sierra Nevada Observatory First.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.
MASSACHUSETTS INSTITUTE OF TECHNOLOGY NASA GODDARD SPACE FLIGHT CENTER ORBITAL SCIENCES CORPORATION NASA AMES RESEARCH CENTER SPACE TELESCOPE SCIENCE INSTITUTE.
IXYZ Frank Marshall NASA/GSFC 25 April 2012 April 25, 20121Implementing Portals of the Universe.
Transiting Exoplanet Survey Satellite Daryl Swade Archive Peer Review June 18, 2014.
Aquarius Project Status 7 th Aquarius/SAC-D Science Team Meeting 11 April 2012.
Swift HUG 14 Feb Swift archive Lorella Angelini/HEASARC.
An Overview of the Swift Observatory Liz Puchnarewicz Mullard Space Science Laboratory University College London.
1 SpaceOps 2002 Autonomous Operations For The Swift Mission T3-47 John Ong/Swift Software Systems Manager NASA/GSFC Code 582/ Mike Rackley/Swift.
Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.
April , 2006 HEASARC Users Group Steve Drake RXTE Archive at HEASARC Status and Plans Steve Drake.
06-1L Suzaku Suzaku UG - 13 Dec, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
The GLAST Science Support Center’s Role in Supporting the User Community [24.10] Thomas E. Stephens (GSFC/L-3GSI) for the GLAST Science Support Center.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Serving Data to the GLAST Users Community Thomas E. Stephens (GSFC/RSIS) for the GLAST Science Support Center Abstract.
GLAST Science Support CenterAugust 9, 2004 Users’ Committee Meeting GSSC USER SUPPORT David Band – GSSC.
Common Archive Observation Model (CAOM) What is it and why does JWST care?
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
GLAST Science Support CenterNovember, 2005 GSSC User Committee Meeting Tools for Mission and Observation Planning Robin Corbet, GSSC
3/30/04 16:14 1 Lessons Learned CERES Data Management Presented to GIST 21 “If the 3 laws of climate are calibrate, calibrate, calibrate, then the 3 laws.
HEASARC and Related Data Center Activities Nicholas White HEASARC Director.
April , 2006 HEASARC Users Group Mike Corcoran HETE-2.
1 John Nousek (Penn State University) Gamma-Ray Burst Explorer: Afterglow Follow-up & Swift Constraints Swift & GRBs: Unveiling the Relativistic Universe,
April , 2006 HEASARC Users Group Roger Brissenden 1 HEASARC Supported Activities at SAO Roger Brissenden.
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG March 27-28, 2007.
The HEASARC Coordinate data, software, and media standards with other astrophysics sites. Established December 1990 The HEASARC Charter: Maintain and disseminate.
Swift as a Rapid Wide Field Follow-up Instrument John Nousek & Jamie Kennea Penn State University Phil Evans University of Leicester International Workshop.
1 HETE-II Catalogue Filip Münz and Graziella Pizzichini for HETE team Burst statistics in.
Fermi Users Group Meeting Goddard Space Flight Center, February 6, 2009C. Shrader, NASA/GSFC 1 Fermi Users Group FSSC News Chris Shrader, Fermi Science.
1 Transiting Exoplanet Survey Satellite Daryl Swade Archive Team Meeting June 16, 2014.
EO Dataset Preservation Workflow Data Stewardship Interest Group WGISS-37 Meeting Cocoa Beach (Florida-US) - April 14-18, 2014.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
Archiving, Distribution and Analysis of Solar-B Data Masumi Shimojo SOLAR-B Project ・ NSRO/NAOJ and The SOLAR-B MODA Working Group Masumi Shimojo SOLAR-B.
1 John Nousek & David Burrows (Penn State University) Alberto Moretti (Osservatorio Astronomico di Brera) X-Ray Telescope (XRT): Performance after Five.
25s detection of the Sy1 galaxy NGC3516 The Palermo BAT survey project Application to a sample of SDSS LINERs V. La Parola, A.Segreto, G. Cusumano, V.
The GRB Luminosity Function in the light of Swift 2-year data by Ruben Salvaterra Università di Milano-Bicocca.
06-1L Suzaku Suzaku UG - 3 May, 2007 Suzaku processing and archive Lorella Angelini/HEASARC.
1 Getting Involved with GLAST Workshop, CFA, 06/21/ C. Shrader, NASA/GSFC GLAST Data & Software Release plans + Science Support Center Services C.
1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.
GLAST Science Support CenterAugust 10, 2004 Users’ Committee Meeting The Project Data Management Plan David Band – GSSC.
Distributed Archives Interoperability Cynthia Y. Cheung NASA Goddard Space Flight Center IAU 2000 Commission 5 Manchester, UK August 12, 2000.
The HETE-2 Archive Mike Corcoran HEASARC User Group Feb 14, 2003 HETE-2: A small satellite designed to detect and localize gamma- ray bursts Instruments:
Swift-BAT as a Triggering Facility Amy Lien Scott Barthelmy, Hans Krimm NASA Goddard Space Flight Center The 4 th AMON workshop, Penn State University,
The Swift GRB Observatory
AGILE Data Center Activities C. Pittori (coord), F. Lucarelli, F. Verrecchia (INAF), G. Fanari (TPZ/Serco) 14 th AGILE WS, June 20-21, 2016.
GLAST Large Area Telescope:
Proposal for LAT Year 1 Data Release Plan
GLAST Large Area Telescope
Presentation transcript:

Swift HUG April Swift data archive Lorella Angelini HEASARC

Swift HUG April Swift Multi-wavelength observatory Burst Alert Telescope (BAT): keV –onboard computation of positions –arc-minute positional accuracy X-rays, UV, and optical afterglow follow up: – keV X-ray Telescope (XRT) – nm UV/Optical Telescope (UVOT) Launch 20 Nov Rapid response satellite - Rapid data dissemination made public immediately - 2 AO cycles (analysis of Swift data, follow-up observation, theoretical investigation) Collaboration USA/Italy/UK Science highlights : Discovered and/or follow-up 151 GRBs (23 from different satellite) Arcsec localization for short bursts ; Detected high redshift bursts Detection of GRB concident with a SN2006aj Discovered new phenomenology in the early afterglow lightcurves Build up the first hard X-ray survey Swift in senior review in 2006

Swift HUG April HEASARC responsibilities Populate and maintain the Swift science and calibration data archive Provide the following services –Public access to the Swift archive –Science data analysis software environment –Web server for the Swift Science Support Center –Database system for the Swift tables –Long-term archive Generate GRB summary products These responsibilities are documented in the Swift-HEASARC MOU –Technical agreement via ICD in place with the SDC, ISAC, BAT Team for the catalog delivery

Swift HUG April Archive general Swift archive contains –Science and HK data –High level Calibration file pre-post launch –Software for data analysis –Documentation (archive, software, calibration) Data are in FITS format OGIP standards – GIF and HTML used for products preview or to record processing No proprietary period for data –But check-out (~45 days) & verification mission phase (3 months) data were available only to the Swift team Archive co-located at HEASARC –Copy of the Science and HK data are sent to the Italian and UK data center

Swift HUG April Archive Standards HEASARC infrastructure used to ingest and distribute –Science & HK data & databases —Data access via the multi-mission Web Browse and FTP —Special Swift Web interface to facilitate searches by GRB name and sources within the BAT FOV —Data are in OGIP FITS standard –Software part of the HEAsoft package (knows as FTOOLS) — 7 releases since launch (1 every ~2 months) — Same software is used by the SDC pipeline processing –Calibration data in the HEASARC multi-mission Calibration database (CALDB) —Updates since launch : 7 BAT, 10 XRT, 8 UVOT

Swift HUG April Swift rapid data dissemination plan Data are downloaded via : – TDRSS. Series of messages after a trigger is detected on board. — broadcast via the GCN (minutes) —later archived as part of the final Swift archive (< a week) –Malindi. All the telemetry. About 6 -7 download per day Two processing types of the Malindi data (same pipeline software) –Quick look (output data is not part of the final archive): — Data processed every Malindi dump, e.g. the same observation is re- processed when new data arrive. — Data public in 3-6 hours after each dump (from FTP SDC). –Permanent archive: — Final processing after an observation (~ 1 day of data ) — Archived after all telemetry for observation is available ( < a week)

Swift HUG April Data delivery & Archive population  Archive uses automated transfer and ingest protocols  Transfer data & DBs from the processing site  Ingest data into the physical archive and database system = > ensure small dead time  Transfer & ingest protocols used by the European Data centers  Backup done at the ingest time  Archive populated from the start of the mission  Since 1st April data are public (end of the verification phase)  Physical archive and database system updated daily

Swift HUG April Content of the Physical Archive Total volume 1146 GB Average ingest 2.5 GB x day Observing Time percentage (April Dec ) GRB 63% ToO 9% Fill-in Targets 20 % Calibration 8% SectionGB#Seq Obervation Messages Trend 35NA Archive size * 1 Jan Mar 2006 Production data : –TDRSS messages (SDC) - by trigger number –Level 1,2,3 production data (SDC) - by observation –Monitoring & Calibration data (SDC/SSC) - by type & CALDB

Swift HUG April Recent reprocessing Current status : – First 3 months in 2005 used to test the reprocessing —SDC processing delivery at HEASARC for checking – Final version for these 3 months are ready –Instrument tables not quite ready – Other data centers currently copying the data – Plan is to reprocess 1 month at the time Data reprocessing : –All data taken so far will be reprocessed by the SDC –Latest Pipeline includes improvement implemented in the last year –New databases logging the 3 instrument configurations at the exposure or snapshot level are generated with the reprocessing

Swift HUG April Data downloads SDC higher download during first trimester compared to normal operation since first trimester was holding more than a week of data Overall HEASARC download increase with time Last trimester : 20% of the total HEASARC holdings (24 missions / 7 active) Swift is among the top 3 popular missions

Swift HUG April Downloads Demography US OTHER JAPAN Europe Russia China HEASARC only

Swift HUG April Future HEASARC will maintain the current level of activities and the current data ingest –Additional creation of the high level data products for GRB New high level data & databases are expected from Swift –Swift GRB catalog –Serendipitous survey from the BAT, XRT and UVOT The Swift catalog used for the HEASARC GRB name resolver