GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.

Slides:



Advertisements
Similar presentations
GLAST LAT Project ISOC 5/17/2004 – Seth Digel1 ISOC Lessons Learned RFA09 Issue –No writeup on lessons learned from visits to other instrument/mission.
Advertisements

LAT IOC GLAST Science Support Center September 25, 2002 LAT Science Tools Review Supplemental Slides Seth Digel (Stanford University/HEPL) David Band (GLAST.
GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.
GLAST LAT SLAC DoE Review June 13, 2007 R.Dubois1 GLAST Large Area Telescope: Science Analysis Systems and Collaboration Computing Needs Robert Cameron,
1 GLAST Large Area Telescope Monthly Mission Review LAT Flight Software Status October 29, 2007 Jana Thayer Stanford Linear Accelerator Center Gamma-ray.
GLAST LAT ProjectLAT Operations Planning, 23 March GLAST Large Area Telescope LAT Operations Planning 23 March 2005 Rob Cameron
GLAST LAT Project 1S. Ritz GLAST Large Area Telescope: Data Challenge Overview December 2003 Steven Ritz Gamma-ray Large Area.
GLAST LAT ProjectGround Software Workshop, July 15-18, Wrap-up: Science Tools Seth Digel HEPL/Stanford Univ. 18 July 2003 EGRET >300 MeV What we.
GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC2 Closeout Meeting 2 June, 2006 S. Ritz Gamma-ray Large Area Space Telescope.
GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC1 Closeout Meeting February 13, 2004 S. Ritz Gamma-ray Large Area Space Telescope.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 7.3 Science Analysis Software 1 Gamma-ray Large Area Space Telescope.
GLAST LAT ProjectDC1 Closeout Workshop, Feb , Post-DC1 Work Seth Digel (HEPL/Stanford Univ.) Post-DC1 Work.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
GLAST LAT Project Analysis Meeting March 22, 2004 E. do Couto e Silva 1/8 LAT Instrument Test Analysis Eduardo do Couto e Silva March 23, 2004.
Section 15-1GLAST Ground System Design Review August 18&19, 2004 ISOC Organization ISOC Manager R Cameron Commanding, H&S Timeline Planning Command Generation.
GLAST LAT ProjectGround Software Workshop, July 15-18, Science Tools - Status Seth Digel HEPL/Stanford Univ. 16 July 2003.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
GLAST LAT Project 1S. Ritz DC1 Closeout Introduction February 2004 Steven Ritz Gamma-ray Large Area Space Telescope.
GLAST Large Area Telescope - OperationsDOE Review, 15 June GLAST Large Area Telescope Operations Review Rob Cameron Instrument Science Operations.
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test One and Two Tower Integration Readiness Review.
GLAST LAT Project LAT Monthly Apr SAS 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope WBS 4.1.D SAS LAT Monthly Managerfest.
GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)
GLAST LAT Project Analysis Meeting April 22, 2004 E. do Couto e Silva 1/5 SVAC Status SVAC Status Eduardo do Couto e Silva April 22, 2004.
GLAST LAT Offline SoftwareWorkshop - SLAC, Jan , 2001 R.Dubois Lehman Review Feb Joint NASA/DoE review My understanding: –“The purpose of the.
GLAST LAT Project ISOC Subsystem1 Response to Peer Review RFA 6  Request: –Need to provide more information on the planned and actual staffing profiles.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
R.Dubois Sim/Recon Overview 1/10 GLAST LAT ProjectSoftware Workshop July, SLAC Sim/Recon Overview Elements of Simulation/Reconstruction Development,
GRB Simulations in DC2 Valerie Connaughton with input from Nicola Omodei and David Band.
October 24, 2000Milestones, Funding of USCMS S&C Matthias Kasemann1 US CMS Software and Computing Milestones and Funding Profiles Matthias Kasemann Fermilab.
GLAST Science Support CenterAugust 9, 2004 Implementation of the Standard Analysis Environment (SAE) James Peachey (HEASARC/GLAST SSC—GSFC/L3)
Status of Onboard Filter & Ground Software Integration Work done by Navid Golpayegani Steve Ritz J.J. Russell David Wren SLAC Ground Software Workshop:
Fermi Large Area Telescope (LAT) Integration and Test (I&T) Data Experience and Lessons Learned LSST Camera Workshop Brookhaven, March 2012 Tony Johnson.
Market Coordination Team Update to RMS.  MCT Kick-off Meeting Update… –1 st MCT Meeting was held on 3/2 (Austin) Twenty five people were in attendance.
Project Overview How to get here…. Half Way to the Test Run October 18, 2012HPS Project Overview2 …starting from here? John Jaros HPS Collaboration Meeting.
# - 1 E. Andrews LAT Software Schedule  Key FSW Milestone Dates –PAST: Jan ‘02 / Jul ‘02 – Preliminary Design Review / Delta PDR May ’03 – Critical Design.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
GLAST LAT ProjectI&T&C Pre PDR, October 2, 2001 E. do Couto e Silva1 I&T&C Organization Chart I&T&C Manager Elliott Bloom WBS I&T Engineer B. Grist.
Julie McEnery1 Data Challenge II Logo by Stefano Ciprini.
GLAST LAT ProjectFace to Face Managers Meeting 04/14/ Integration and Test 1 GLAST Large Area Telescope: I & T Input to Face to Face Managers.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
1 Stepping in everyone’s toes ( but for a good cause….) Eduardo do Couto e Silva Software Meeting – January 2001.
DEX Publication Project OASIS PLCS Telecon 27 November 2007 Trine Hansen.
Data Standards Development August 29, Topics 1.Current Status 2.What was delivered for Build 2c 3.How was IPDA supported 4.What mission support.
Aquarius Mission Simulation A realistic simulation is essential for mission readiness preparations This requires the ability to produce realistic data,
ESAC_3_24_05.ppt 1 GLAST Large Area Telescope Overview and Science Update Peter F. Michelson Stanford University GLAST User’s Committee.
GLAST LAT Project DC2 Closeout Workshop, GSFC, 31 May-2 June Comparisons of Searches for Sources in the DC2 Data S. W. Digel Stanford Linear Accelerator.
GLAST LAT Project IA Workshop 4 July 14, 2005 E. do Couto e Silva 1/7 Introduction to the Instrument Analysis Workshop 4 Eduardo do Couto e Silva July.
1 Getting Involved with GLAST Workshop, CFA, 06/21/ C. Shrader, NASA/GSFC GLAST Data & Software Release plans + Science Support Center Services C.
GLAST Large Area Telescope – ISOC Overview and StatusDOE Annual Review, 13 June GLAST Large Area Telescope Instrument Science Operations Center.
GLAST LAT Project DC2 Software Workshop, GSFC, June 27-29, Analytical Objectives for Science Tools for DC2 for DC2 S. W. Digel Stanford Linear Accelerator.
Development Project Management Jim Kowalkowski. Outline Planning and managing software development – Definitions – Organizing schedule and work (overall.
GLAST Science Support Center May 8, 2006 GUC Meeting AI#28. SAE Release Schedule David Band (GSSC/JCA-UMBC) Julie McEnery (GSFC)
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review SVAC Elliott.
GLAST LAT ISOCNotes for Italian meeting, 15 december Notes about ISOC and the italian contributions Gamma-ray Large Area Space Telescope.
GLAST Large Area Telescope Instrument Science Operations Center
Background Rejection Prep Work
LAT Instrument Test Data Analysis in Context
Data Challenge II Logo by Stefano Ciprini.
Proposal for LAT Year 1 Data Release Plan
GLAST Large Area Telescope Instrument Science Operations Center
Science Analysis Software Development Status
Data Challenge 2: Aims and Status
GLAST Large Area Telescope
GLAST Large Area Telescope
GLAST Large Area Telescope Instrument Science Operations Center
Overview of Beam Test Benoit, Ronaldo and Eduardo Nov 8 , 2005 thanks to Steve and Bill for helping to consolidate all the information.
Presentation transcript:

GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary –implementation This plan was generated in meetings with Richard Dubois, Seth Digel, Bill Atwood, and Steve Ritz. It has been discussed by the Analysis Group and the SSAC.

GLAST LAT Project 2S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?) Familiarize team with data content, formats, tools and realistic details of analysis issues (both instrumental and astrophysical). Develop additional methods for analyzing GLAST data, encouraging alternatives that fit within the existing framework. Provide feedback to the SAS group on what works and what is missing from the data formats and tools. Uncover systematic effects in reconstruction and analysis. Support readiness by launch time to do all first-year science.

GLAST LAT Project 3S. Ritz Realities, Boundary Conditions Still much to do on GLEAM to be ready: –geometry review –underlying physics review –embed onboard filter –other infrastructure (compilers, package versions, etc. –Check, check, check everything!! –finish implementing remaining gamma source fluxes Still much to do on instrument analysis to be ready: –background rejection –performance evaluation and parameterization –See Bill Atwood’s talk Still much to do on science tools to be ready –See Seth Digel’s talk tomorrow Lots of other work demanding attention: –Reviews… –EM support –Other calibration planning and development –Construction, Integration, and Test planning and execution This meeting!

GLAST LAT Project 4S. Ritz Approach Use the September collaboration meeting as the start of the Data Challenges. Walk before running: design a progression of studies. – DC1. Modest goals to work out problems. Mainly use existing recon tools to explore where improvements could be made. Contains most essential features of a data challenge (see following slides). –DC2. More ambitious science goals. Encourage further development within the existing structure, based on lessons from DC1. –DC3. Support for flight science production.

GLAST LAT Project 5S. Ritz Preparatory Work Preparation complete by September collaboration meeting: complete geometry review preparatory work meeting: THIS MEETING complete embedding, verification of filter, evaluate: July Simulation hard freeze date – TBA (needed soon!). first new background rejection/performance analysis July & August sky model fluxes implementation complete September 1 –At Collaboration meeting: first, PRELIMINARY instrument response functions presented DC1 kickoff (see following slide) small workshop on using tools for team

GLAST LAT Project 6S. Ritz Data Challenge Progression DC1 –modest goals: 1 simulated day all-sky survey simulation (3M bkgd+gamma events to ground, => 400M generated events) find flaring AGN, a GRB single-day point source sensitivity. daily quicklook analysis development. recognize simple hardware problem(s) a few physics surprises exercise: –exposure, orbit/attitude handling, data processing pipeline components, analysis tools use existing recon, bkgd rejection and instrument response to show the problem areas that need improvement. secondary goal (not required) is to prototype improvements –baseline schedule: Sept-Oct startup problems resolution. Nov-Dec high-level tools beta testing. Finalize instrument response functions. Dec 15 high-level tools release, workshop. mid-January: interim reports (vrvs or face-to-face) Feb 2004 closeout, and plan for DC2 (see following slide). Then, break for I&T prep. Use the time for fixing problems learned in DC1, software advances, etc.

GLAST LAT Project 7S. Ritz DC Progression DC2 –more sophisticated goals: 1 simulated month all-sky survey simulation (100M bkgd+gamma events post-filter. Method TBD) PLUS 1 simulated year of gammas find AGN, bursts, pulsars produce a toy 1-month catalog detailed point source sensitivity and localization analyses recognize more subtle hardware problems a few more physics surprises exercise: –exposure, data processing pipeline, analysis tools, quicklook. benchmark processing times, data volume, etc. connect to SSC. use updated recon, bkgd rejection and instrument response to show the problem areas that need work. encourage improvements –tentative schedule: freeze software version July 04. start generation in September start DC2 October 2004 (beam test analysis ~complete) Dec midterm reports milestone Feb 2005 closeout, and plan for DC3 (see following slide).

GLAST LAT Project 8S. Ritz DC Progression “DC3” – Flight Data Challenge! –physics groups will have been working on detailed analyses, based on experience with DC2, during the previous year. –main goal is realism to support running experiment analysis: 1 full simulated year of data (methods TBD) –exercise everything: format data as it comes into the IOC. also confirm data storage, backup, processing speed. will be the reference sample for 1 st year data analysis. connect to SSC demonstrate point source sensitivity and localization recognize a few very subtle hardware problems. recognize a few realistic daily hardware problems -> feed to IOC and FSW. physics surprises use updated recon, bkgd rejection and instrument response. this will be our initial science performance. by this time, physics analysis groups should be up and running. –schedule: freeze software version Feb 06. This is the first year flight version! start generation in May. physics groups working launch.

GLAST LAT Project 9S. Ritz Schedule Summary CY 2003 CY 2004CY 2005CY 2006 DC1DC2 “DC3” Start reference sample for flight Start integration practice Start flight buildLAT delivery LAUNCH freeze simulation for flight production. Start final checkout. Beam test Separate science group activities notes: (1)the LAT schedule is being rebaselined. (2)the date of the beam test is not yet fixed. It should be complete, and the data analyzed, before the simulation freeze to incorporate the tuning into DC3.

GLAST LAT Project 10S. Ritz Implementation Suggestions A small organizing committee (~3-5 people) should be put into place by the PI for DC1. Each person on the committee should have a clearly defined set of responsibilities for coordinating and overseeing the components of the work. The organizing committee should have a well- defined, prioritized list of plots and other results to be produced by data challenge participants. Review lessons from DC1, and re-evaluate scope and schedule for DC2 (and DC3) as appropriate.

GLAST LAT Project 11S. Ritz Needed results from this meeting Checklist on remaining work. –dates, people responsible Sanity check on schedule. Fill in the holes! Especially need help checking, debugging infrastructure; thinking things through. Many other interesting SAS issues to discuss; however, for the data challenge to be possible, we must stay on topic at this meeting. Eye on the ball.