IRS Data Flow & Questions SINGS Team Meeting 21-22 November 2002 Baltimore, MD L. Armus SIRTF Science Center.

Slides:



Advertisements
Similar presentations
MTA ETA. Product Description A real-time simulation system that estimates the expected time that it will take a certain bus to arrive at an end- users.
Advertisements

Level 2 Status February 25, 2003 syl 1 Level 2 Status Sung-Yung Lee and Edward Olsen Chris Barnet and John Blaisdell February 25, 2003.
Translation and Translation Verification National Research Coordinators Meeting Amsterdam, October 2006.
PDS MC April 2-3, Wash. D. C.1 PDS4 Data Model Working Group Status Report to the PDS Management Council April 2-3, 2008.
GIST 19: GGSPS Planning GGSPS Development & Review Planning Andy Smith GGSPS software project manager.
MIPS Data Processing for SINGS George J. Bendo & Chad Engelbracht (A ''George's Adventures in Learning OpenOffice'' Presentation)
JWST IFUs and Data Tool Development Plans Tracy Beck JWST NIRSpec Instrument Scientist.
Patrick Ogle, Lee Armus, Bob Narron, Carl Grillmair, Justin Howell, IRS IST.
LADEE PDS4 Experience G. Delory LADEE Instrument and PDS Teams LADEE SOC PDS Management Council Nov /19/2014 LADEE PDS4 Experience 1.
10 July Yohkoh Galileo: To Infinity! … and Beyond! Lockheed Martin’s Role in the Yohkoh Galileo Project 10 July 2002.
Early results from the IRS Jim Houck and the IRS team - AAS Denver 6/1/04.
Cross-Calibration Between All Three Instruments Lin Yan, Jason Surace (Spitzer Science Center)
MTA ETA. Product Description A real-time simulation system that estimates the expected time that it will take a certain bus to arrive at an end- user’s.
IRAC-Data Processing Pipeline Review / January 26, 2001 Jason Surace (1) IRAC Pipeline Data Analysis and Pipeline Validation Plan Jason Surace January.
GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)
Chapter 12 Spatial Sharpening of Spectral Image Data.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
Data Flow for the SINGS SIRTF Data Daniela Calzetti (STSci) SINGS Team Meeting Baltimore, November 22 nd, 2002.
Characterisation Data Model applied to simulated data Mireille Louys, CDS and LSIIT Strasbourg.
242/102/49 0/51/59 181/172/166 Primary colors 248/152/29 PMS 172 PMS 137 PMS 546 PMS /206/ /227/ /129/123 Secondary colors 114/181/204.
IRS Data Products: An Update SINGS Team Meeting November 2002 Baltimore, MD L. Armus SIRTF Science Center.
1 Workshop First look, calibrations, reference sources IAP – 24 November CU6 structure 2.Aims of the workshop / open questions.
CCSM DATA MANGEMENT POLICY The Community Climate System Model (CCSM) Data Management Policy documents the procedures for the management of model data produced.
The DARTS database Yoshihiro Ueda (ISAS) on behalf of the PLAIN members
SINGS Team Meeting — Baltimore, October 16, 2015JDS 1 CUBISM or How I Learned to Stop Worrying and Love the Cube J.D. Smith.
National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.
All rights reserved © Altec ExoMars 2018 Rover Operations Control Centre Planned Organization of ROCC Operations I. Musso.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.
Discussion - Survey Design Survey product equation: #fields = fld/nt x useable x (%xnights/yr) x years = 4 x 0.5 x (0.75 x 13 x 18) x 3 = 4 x 0.5 x 175.
SSC SI Data Processing Pipeline Plans Tom Stephens USRA Information Systems Development Manager SSSC Meeting – Sept 29, 2009.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 12.0) Level 1 to Level 2 processing: The JScanam pipeline Prepared.
Swift HUG April Swift data archive Lorella Angelini HEASARC.
Software Phase V Testing and Improvements to Test Procedures S. Corder and L.-A. Nyman April 18, 20131ICT Planning Meeting, Santiago.
Service Delivery Quality Management SDQM. © British Telecommunications plc Agenda Intro / Why do we need to further define Quality check standards? What.
DEX Publication Project OASIS PLCS TC Face-to-face meeting 1 October 2007 Trine Hansen.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
GLAST Science Support Center June 21, 2007 Getting Involved with GLAST GLAST Guest Investigator Program David Band, GSSC CRESST/GSFC/UMBC.
GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.
Long-Term Congestion Rights (LTCR) Weekly Testing Call January 5, Project Pinnacle.
A.Gsella, J.Targa | 5 th of October 2015 | 20 th EIONET Workshop, Ljubljana, Slovenia Air Quality e-Reporting: state of play.
Sprint 113 Review / Sprint 114 Planning August 12th, 2013.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
1 NHSC PACS NHSC/PACS Web Tutorials Running PACS photometer pipelines PACS-402 (for Hipe 13.0) Level 1 to Level 2.5 processing: The JScanam pipeline Prepared.
Lead from the front Texas Nodal 1 Reduction of MMS Vendor Effort for TPTF January 8, 2008 Murray Nixon Sai Moorty.
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
New SPIRE features in HIPE 9.1 NHSC; Nov 28, 2012 PACS Page 1 What’s New in HIPE 9.1 ( SPIRE FTS) Nanyao Lu NHSC/IPAC (on behalf of the SPIRE ICC)
Extreme Software Engineering A Hands-On Approach From Extreme Software Engineering: A Hands-On Approach Daniel H. Steinberg Daniel W. Palmer.
GLAST Science Support Center May 8, 2006 GUC Meeting AI#28. SAE Release Schedule David Band (GSSC/JCA-UMBC) Julie McEnery (GSFC)
EDS 3 Release 5 SCED Testing Update - TPTF Daryl Cote August 28, 2007.
GLAST Science Support Center November 8, 2005 GUC Action Item #15 AI#15: Pre-Launch GI Proposal Tools David Band (GSSC/JCA-UMBC)
SINFONI data reduction using the ESO pipeline. Instrument design and its impact on the data (I) integral field spectrometer using mirrors brickwall pattern.
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
The road to the first E2E tests
The English RCT of ‘Families and Schools Together’
ROCC Operations and The PSA RSP Archive Concept Review 28 September 2017 Tanya Lim Archive Scientist.
From delivery to acceptance
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
Product Pipelines Swapnil Gupta – QA Manager
Proposal for LAT Year 1 Data Release Plan
Adopting a patient pre-registration process
Chapter 11 – Project Dashboard
What’s New in HIPE 10.0 (SPIRE FTS)
Adopting a patient pre-registration process
Helping Active Missions Convert to PDS4
Eurostat regional yearbook 2012 – new routines and time planning
NSS Instrument Project Tollgate Coordinator
Chapter 11 – Project Dashboard
X-ray high resolution spectra in the VO: the case of XMM-Newton RGS
Presentation transcript:

IRS Data Flow & Questions SINGS Team Meeting November 2002 Baltimore, MD L. Armus SIRTF Science Center

2 SINGS team mtg. – 21 Nov 2002 General IRS data flow / timeline  Our validation dataset should be taken in the 1 st three weeks of nominal operations (after SV). We will then have about four weeks to get back to the SSC with our “report” before the rest of the observations get released. (This should be about two months into normal operations).  We will get “privileged” access to the SINGS data in the archive at some point between L+4 and when the archive officially opens. We may also have access to some SV data (TBD).  All BCD’s will be taken from the archive, as processed by the automated IRS pipeline. These BCD’s will be inputs to the cube builder and feed our first delivery of “best post-BCD’s”. They will also double as important feed-back to the IRS pipeline development effort at the SSC.

3 SINGS team mtg. – 21 Nov 2002 General IRS data flow  Post-BCD processing (for the L+9 delivery) will be done by IRS sub- team, lead by Helene and PD. This will involve de-fringing of all 1D spectra, and co-addition of source and “background” spectra before subtraction.  All cubes and maps for the 1 st cube release at L+21, will be created, validated (level 0 QA) and tuned by the IRS sub-team.  J.D., Danny, Helene and PD will all be trained in cube-making.  Tom and Helene will lead the product validation effort.  SINGS team members should become familiar with CUBISM and CubeView, and suggest enhancements for ongoing development.  Science products not created for SSC delivery will be created by a wider team of trained Cubists. All SINGS team members should have scientific input into cube production and be familiar with CubeView, since this is the whole point of making the glorious interface.

LA - 4 SINGS Team Meeting – 21 Nov 02 General IRS data flow (model)  Our 1 st maps get delivered at L+15 [18]. These will be derived from the nuclear, HII and radial strip cubes for 1/3 of the sample or what’s in archive at L+12 [15].  1 st week = select data for processing. Process all new data ?  weeks 1-4 = create cubes, use CubeView to create product maps and make first pass at QA for all products.  week 8 = deadline for SINGS team comments on the maps and decision on which products to incorporate into the SSC delivery.  weeks 9-12 = final run for maps (cubes ?) and final data quality check before delivery to SSC.

5 SINGS team mtg. – 21 Nov 2002 Some remaining data issues  How are we going to cross-calibrate the IRS maps (generated with cubism) and the IRAC or MIPS maps ? Things we might have to deal with include:  Flux offsets, morphological differences, gradients, etc. The fact that we can make 8  m and 24  m maps from the IRS data should help. Should have a quick way in CubeView to generate IRAC and MIPS-like maps from included transmission curves.  Also, what does “validation” mean for each sub-team ? Need a checklist from each sub-team that is known to all SINGS team members.  How do we alert the SSC to real problems with the data….not simply in our cube building ?  How will we co-ordinate deliveries, processing and analysis of targets across team (instrument) boundaries for our own use ? ….Synchronization.  Might need a “meta-team” to allow effective science extraction.  Do we completely de-couple this internal science work from the official data deliveries ?

Release date Data product L+9L+15L+21L+27L+33 Circum- nuclear & HII regions 1D spectra “Best BQD’s” 10% of sample or what’s in archive at L+7 - High-res line maps (NeII 12.8 & SiII 34.8) - PAH feature maps ([ ] & 11.3) - 1D map spectra 1/3 of sample or what’s in archive at L+12 Second 1/3 or what’s in archive at L+18 Final 1/3 or what’s in archive at L+24 All data Spectral cubes 1/3 of sample or what’s in archive at L+18 Final 2/3 or what’s in archive at L+24 All data Radial strips Continuum maps 1/3 of sample or what’s in archive at L+12 Second 1/3 or what’s in archive at L+18 Final 1/3 or what’s in archive at L+24 All data Spectral cubes 1/3 of sample or what’s in archive at L+18 Final 2/3 or what’s in archive at L+24 All data Our Schedule (does not include 3 month “slip”)