GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)

Slides:



Advertisements
Similar presentations
Operations Testing in the ISOC Service Challenges are a successor and extension to the successful Data Challenge model Broader set of objectives Continue.
Advertisements

LAT IOC GLAST Science Support Center September 25, 2002 LAT Science Tools Review Supplemental Slides Seth Digel (Stanford University/HEPL) David Band (GLAST.
GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.
GLAST LAT SLAC DoE Review June 13, 2007 R.Dubois1 GLAST Large Area Telescope: Science Analysis Systems and Collaboration Computing Needs Robert Cameron,
GLAST Large Area Telescope - OperationsDOE Review, 15 June GLAST Large Area Telescope Operations Review Rob Cameron Instrument Science Operations.
1 GLAST Large Area Telescope Monthly Mission Review LAT Flight Software Status October 29, 2007 Jana Thayer Stanford Linear Accelerator Center Gamma-ray.
GLAST LAT Project 1S. Ritz GLAST Large Area Telescope: Data Challenge Overview December 2003 Steven Ritz Gamma-ray Large Area.
GLAST LAT ProjectGround Software Workshop, July 15-18, Wrap-up: Science Tools Seth Digel HEPL/Stanford Univ. 18 July 2003 EGRET >300 MeV What we.
GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC2 Closeout Meeting 2 June, 2006 S. Ritz Gamma-ray Large Area Space Telescope.
GLAST LAT Project Engineering Meeting – ISOC Peer Review 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review ISOC Detail.
GLAST LAT Project 1S. Ritz Discussion: To Where From Here? DC1 Closeout Meeting February 13, 2004 S. Ritz Gamma-ray Large Area Space Telescope.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 7.3 Science Analysis Software 1 Gamma-ray Large Area Space Telescope.
GLAST LAT ProjectDC1 Closeout Workshop, Feb , Post-DC1 Work Seth Digel (HEPL/Stanford Univ.) Post-DC1 Work.
GLAST LAT ProjectDOE/NASA CD3-Critical Design Review, May 12, 2003 S. Ritz Document: LAT-PR Section 03 Science Requirements and Instrument Design.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.
GLAST LAT Project Analysis Meeting March 22, 2004 E. do Couto e Silva 1/8 LAT Instrument Test Analysis Eduardo do Couto e Silva March 23, 2004.
Section 15-1GLAST Ground System Design Review August 18&19, 2004 ISOC Organization ISOC Manager R Cameron Commanding, H&S Timeline Planning Command Generation.
GLAST LAT ProjectGround Software Workshop, July 15-18, Science Tools - Status Seth Digel HEPL/Stanford Univ. 16 July 2003.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
GLAST LAT ProjectJune Cost/Schedule Status Meeting 07/23/ Integration and Test 1 GLAST Large Area Telescope: I & T Input to June Cost/Schedule.
GLAST LAT Project 1S. Ritz DC1 Closeout Introduction February 2004 Steven Ritz Gamma-ray Large Area Space Telescope.
GLAST Large Area Telescope - OperationsDOE Review, 15 June GLAST Large Area Telescope Operations Review Rob Cameron Instrument Science Operations.
GLAST LAT Project LAT Monthly Apr SAS 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope WBS 4.1.D SAS LAT Monthly Managerfest.
GLAST LAT Project Analysis Meeting April 22, 2004 E. do Couto e Silva 1/5 SVAC Status SVAC Status Eduardo do Couto e Silva April 22, 2004.
GLAST LAT Offline SoftwareWorkshop - SLAC, Jan , 2001 R.Dubois Lehman Review Feb Joint NASA/DoE review My understanding: –“The purpose of the.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
GRB Simulations in DC2 Valerie Connaughton with input from Nicola Omodei and David Band.
October 24, 2000Milestones, Funding of USCMS S&C Matthias Kasemann1 US CMS Software and Computing Milestones and Funding Profiles Matthias Kasemann Fermilab.
Annie Griffith Infrastructure Programme Manager July 2007 UK Link Technology Refresh.
GLAST Science Support CenterAugust 9, 2004 Implementation of the Standard Analysis Environment (SAE) James Peachey (HEASARC/GLAST SSC—GSFC/L3)
Fermi Large Area Telescope (LAT) Integration and Test (I&T) Data Experience and Lessons Learned LSST Camera Workshop Brookhaven, March 2012 Tony Johnson.
Market Coordination Team Update to RMS.  MCT Kick-off Meeting Update… –1 st MCT Meeting was held on 3/2 (Austin) Twenty five people were in attendance.
# - 1 E. Andrews LAT Software Schedule  Key FSW Milestone Dates –PAST: Jan ‘02 / Jul ‘02 – Preliminary Design Review / Delta PDR May ’03 – Critical Design.
Consortium Meeting La Palma October PV-Phase & Calibration Plans Sarah Leeks 1 SPIRE Consortium Meeting La Palma, Oct. 1 – PV Phase and.
Julie McEnery1 Data Challenge II Logo by Stefano Ciprini.
GLAST LAT ProjectFace to Face Managers Meeting 04/14/ Integration and Test 1 GLAST Large Area Telescope: I & T Input to Face to Face Managers.
1 Japan-US collaboration to develop the “End-to-End simulator” Tsunefumi Mizuno Mar 12, 2003.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
1 Stepping in everyone’s toes ( but for a good cause….) Eduardo do Couto e Silva Software Meeting – January 2001.
DEX Publication Project OASIS PLCS Telecon 27 November 2007 Trine Hansen.
Information Technology Services Priority Planning Exercise And Decision Lens Pilot IT Leadership Council Executive Committee Meeting June 3, 2011 Pam Fuller.
Aquarius Mission Simulation A realistic simulation is essential for mission readiness preparations This requires the ability to produce realistic data,
ESAC_3_24_05.ppt 1 GLAST Large Area Telescope Overview and Science Update Peter F. Michelson Stanford University GLAST User’s Committee.
GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.
1 Fermi Gamma-ray Space Telescope Users Group Meeting 6 February 2009 Mission Status Update (since the phonecall) and Issues S. Ritz, J. McEnery.
GLAST LAT ProjectSAS PDR, Aug. 17, 2001 R.Dubois1 Schedule Balloon Science Tools, Analysis Platforms Calibrations Performance Tuning, Tracking Data Production.
1 Getting Involved with GLAST Workshop, CFA, 06/21/ C. Shrader, NASA/GSFC GLAST Data & Software Release plans + Science Support Center Services C.
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ACOS Report ATLAS Software Workshop December 1998 Jürgen Knobloch Slides also on:
Feb. 3, 2007IFC meeting1 Beam test report Ph. Bruel on behalf of the beam test working group Gamma-ray Large Area Space Telescope.
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
GLAST Science Support Center May 8, 2006 GUC Meeting AI#28. SAE Release Schedule David Band (GSSC/JCA-UMBC) Julie McEnery (GSFC)
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review SVAC Elliott.
GLAST LAT ISOCNotes for Italian meeting, 15 december Notes about ISOC and the italian contributions Gamma-ray Large Area Space Telescope.
BENCH-CAN Internal evaluation 2nd semester
GLAST Large Area Telescope Instrument Science Operations Center
Background Rejection Prep Work
LAT Instrument Test Data Analysis in Context
Proposal for LAT Year 1 Data Release Plan
GLAST Large Area Telescope Instrument Science Operations Center
Science Analysis Software Development Status
Data Challenge 2: Aims and Status
Integration and Test Organization Chart
GLAST Large Area Telescope
GLAST Large Area Telescope
GLAST Large Area Telescope Instrument Science Operations Center
Presentation transcript:

GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?) Familiarize team with data content, formats, tools and realistic details of analysis issues (both instrumental and astrophysical). Develop additional methods for analyzing GLAST data, encouraging alternatives that fit within the existing framework. Provide feedback to the SAS group on what works and what is missing from the data formats and tools. Re-evaluate sensitivities –Uncover systematic effects in reconstruction and analysis. Grow the team. Learn how we work together. Support readiness by launch time to do all first-year science.

GLAST LAT Project 2S. Ritz Data Challenge Planning Discussions thus far with Richard, Seth, and Bill. What is shown is a DRAFT. Develop proposal, take to Peter and SSAC within the next two weeks. => Need Analysis Group input.

GLAST LAT Project 3S. Ritz Realities Still much to do on GLEAM to be ready: –geometry review –underlying physics review –embed onboard filters don’t dismiss this –other infrastructure (move to.NET, etc. don’t dismiss this!) –finish implementing gamma source fluxes Still much work to do on analysis to be ready: –background rejection –performance evaluation and parameterization –analysis platform recommendation and validation Lots of other work demanding attention: –CDR and fallout. Other reviews. –EM support –Other calibration planning and development –Integration!

GLAST LAT Project 4S. Ritz Draft Top-level Schedule [UNOFFICIAL!] Use the September collaboration meeting as a major milestone. We need deadline pressure. Walk before running: design a progression of studies. – Preparation complete by September collaboration meeting: complete geometry review: June 15 recon meeting: late June/early July? complete embedding, verification of filter, evaluate: July 1.NET cutover date? Simulation hard freeze date? first new background rejection/performance analysis July & August sky model fluxes implementation complete September 1 –At Collaboration meeting: first instrument response functions presented DC1 kickoff (see following slide) workshop on using tools

GLAST LAT Project 5S. Ritz Data Challenge Progression DC1 –modest goals: 1 simulated day all-sky survey simulation (3M bkgd+gamma events to ground, => 400M generated events) find flaring AGN, a GRB demonstrate single-day point source sensitivity recognize simple hardware problem(s) a few physics surprises exercise: –exposure, data processing pipeline, analysis tools, daily quicklook analysis use existing recon, bkgd rejection and instrument response to show the problem areas that need improvement. secondary goal (not required) is to prototype improvements –schedule: Sept-Oct startup problems resolution. Nov-Dec high-level tools beta testing. Finalize irfs. Dec 15 high-level tools release, workshop. mid-January: interim reports Feb 2004 closeout, and plan for DC2 (see following slide). Then, break for I&T prep. Use the time for fixing problems learned in DC1, software advances, etc.

GLAST LAT Project 6S. Ritz DC Progression DC2 –more sophisticated goals: 1 simulated month all-sky survey simulation (100M bkgd+gamma events post-filter. Method TBD) PLUS 1 simulated year of gammas find flaring AGN, pulsars (geminga’s) produce a 1-month catalog demonstrate point source sensitivity and localization recognize more subtle hardware problem(s) a few more physics surprises exercise: –exposure, data processing pipeline, analysis tools. benchmark processing times, data volume, etc. connect to SSC? use updated recon, bkgd rejection and instrument response to show the problem areas that need improvement. encourage improvements –schedule: freeze software version July 04. start generation in September start DC2 October 2004 (beam test analysis ~complete) Dec midterm reports milestone Feb 2005 closeout, and plan for DC3 (see following slide).

GLAST LAT Project 7S. Ritz DC Progression “DC3” – Flight Data Challenge! –main goal is realism to support running experiment analysis: 1 full simulated year of data (methods TBD) –exercise everything: format data as it comes into the IOC. also confirm data storage, backup, processing speed. will be the reference sample for 1 st year data analysis. connect to SSC demonstrate point source sensitivity and localization recognize a few very subtle hardware problems. recognize a few realistic daily hardware problems -> feed to IOC and FSW. physics surprises use updated recon, bkgd rejection and instrument response. this will be our initial science performance. by this time, physics analysis groups should be up and running. –schedule (start after completion of beam test and MC tuning): freeze software version Feb 06. This is the first year flight version! start generation in May. physics groups working launch.