LAT Software Quality Assurance

Slides:

Advertisements

Similar presentations

1 Software Architecture CSSE 477: Week 5, Day 1 Statistical Modeling to Achieve Maintainability Steve Chenoweth Office Phone: (812) Cell: (937)

Advertisements

Status report on Light Simulator Claudia Cecchi Francesca Marcucci Monica Pepe Software meeting Udine January

GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.

Bill Atwood, SCIPP/UCSC, May 8, 2006 GLAST 1 Partial validation of v9r3 - Bkg. Rej. Comparison 2000 sec. of backgrounds were run using v9r3 (heros: Tom.

Science Tools 27 Sep 06 1 Generating post-DC2 IRFs: a proposal Toby Burnett.

S. Ritz1 Checking Out What is Checked In  Need to optimize balance of checking between users and developers. –infuse more of a culture of detailed checking.

GLAST LAT ProjectISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.1 Requirements 1 Gamma-ray Large Area Space Telescope GLAST Large.

Hardware Failure Impacts Exercises S. Ritz. Issues Recent results from design reliability analysis (system engineering, Thurston et al.) Probabilities.

GLAST LAT ProjectDC1 Closeout Workshop, Feb , Post-DC1 Work Seth Digel (HEPL/Stanford Univ.) Post-DC1 Work.

GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 2.3 Verification and Validation 1 Gamma-ray Large Area Space Telescope.

C&A 8 May 06 1 Point Source Localization: Optimizing the CTBCORE cut Toby Burnett University of Washington.

GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 4.11 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.

GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.

GLAST LAT Project 1S. Ritz DC1 Closeout Introduction February 2004 Steven Ritz Gamma-ray Large Area Space Telescope.

Science Requirements Verification GLAST LAT Project September 15, 2006: Pre-Shipment Review Presentation 2 of 12 GLAST Large Area Telescope Gamma-ray Large.

GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)

GLAST Simulations Theodore E. Hierath Louisiana State University August 20, 2001.

30 Ge & Si Crystals Arranged in verticals stacks of 6 called “towers” Shielding composed of lead, poly, and a muon veto not described. 7.6 cm diameter.

Simulating JWST-MIRI data with the Multi-Object Simulator (MOSim) Owen Littlejohns, Paul O’Brien & John Pye Department of Physics & Astronomy University.

CLAS12 CalCom Activity CLAS Collaboration Meeting, March 6 th 2014.

GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.

NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.

Geant4 Acceptance Suite for Key Observables CHEP06, T.I.F.R. Mumbai, February 2006 J. Apostolakis, I. MacLaren, J. Apostolakis, I. MacLaren, P. Mendez.

Piera Sapienza – VLVNT Workshop, 5-8 october 2003, Amsterdam Introduction and framework Simulation of atmospheric  (HEMAS and MUSIC) Response of a km.

GLAST Large Area Telescope Instrument Flight Software Flight Unit Design Review 16 September 2004 Diagnostics Framework James Swain Stanford Linear Accelerator.

Optimising Cuts for HLT George Talbot Supervisor: Stewart Martin-Haugh.

1 Japan-US collaboration to develop the “End-to-End simulator” Tsunefumi Mizuno Mar 12, 2003.

Release Validation J. Apostolakis, M. Asai, G. Cosmo, S. Incerti, V. Ivantchenko, D. Wright for Geant4 12 January 2009.

Array for Microwave Background Anisotropy AMiBA SZ Science AMiBA Team NTU Physics Figure 4. Simulated AMiBA deep surveys of a 1deg 2 field (no primary.

Feb. 7, 2007First GLAST symposium1 Measuring the PSF and the energy resolution with the GLAST-LAT Calibration Unit Ph. Bruel on behalf of the beam test.

Week 14 Introduction to Computer Science and Object-Oriented Programming COMP 111 George Basham.

GLAST Science Support Center June 21, 2007 Getting Involved with GLAST GLAST Guest Investigator Program David Band, GSSC CRESST/GSFC/UMBC.

GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.

Mark Dorman UCL/RAL MINOS Collaboration Meeting Fermilab, Oct. 05 Data/MC Comparisons and Estimating the ND Flux with QE Events ● Update on QE event selection.

JPS 2003 in Sendai Measurement of spectral function in the decay 1. Motivation ~ Muon Anomalous Magnetic Moment ~ 2. Event selection 3. mass.

GLAST LAT ProjectSAS PDR, Aug. 17, 2001 R.Dubois1 Schedule Balloon Science Tools, Analysis Platforms Calibrations Performance Tuning, Tracking Data Production.

The “Comparator” Atlfast vs. Full Reco Automated Comparison Chris Collins-Tooth 19 th February 2006.

06/2006I.Larin PrimEx Collaboration meeting  0 analysis.

Development of a Data-Based Fission Fragment Generator using the Geant4 Framework FISSION FRAGMENT GENERATOR Idaho State UniversityBrycen Wendt.

Feb. 3, 2007IFC meeting1 Beam test report Ph. Bruel on behalf of the beam test working group Gamma-ray Large Area Space Telescope.

RP Software Collaboration Meeting 7 Mars 2007 Hubert Niewiadomski TOTEM, CERN Brunel University.

T. Burnett: Anagroup 5/24/04 1 Latest PSF and Point-source sensitivity prediction status Anagroup meeting Toby Burnett 24 May 04.

M. Ellis - MICE Collaboration Meeting - Wednesday 27th October Sci-Fi Tracker Performance Software Status –RF background simulation –Beam simulation.

Reconstruction code and comparison between Genie and Genhen A. Trovato, C. Distefano, R. Coniglione and P. Sapienza Kick-off ORCA meeting: 6 September.

S. Ritz 1 Onboard Science Processing S. Ritz F-FIDT March 2002.

GLAST Science Support Center November 8, 2005 GUC Action Item #15 AI#15: Pre-Launch GI Proposal Tools David Band (GSSC/JCA-UMBC)

Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclaySLAC, 23 May 2005 Four main functions: Find unknown.

Low Energy Gamma Rejection

P0D reconstruction/analysis update

GLAST Large Area Telescope:

Gamma-ray Large Area Space Telescope

Fermi LAT Limits on High-Energy Gamma Lines from WIMP Annihilation

Introduction Goal: Can we reconstruct the energy depositions of the proton in the brain if we are able to reconstruct the photons produced during this.

OO Muon Reconstruction in ATLAS

First day: Planets, Sun and Moon

Prospects for Observations of Microquasars with GLAST LAT

Proposal for LAT Year 1 Data Release Plan

Tagging in T(b) (I) Generated 1M events of e + Pb208 collisions at 10  40 GeV/n with 1 < Q2 < 20, 0.3 < y < 0.95, parameter settings tuned by Mark, genShd.

Source catalogue generation

UW “Source Detection” Status

HADRONIC INTERACTION MODELS AND DPMJET-CHARM MODEL

Update on Data Analysis

LAT performance for DC2 and the “4-panel plot”

Mini Tower Preliminary Results

Data Challenge 2: Aims and Status

Simulate Multiple Dice

Problems in π0 Reconstruction

° status report analysis details: overview; “where we are”; plans: before finalizing result.. I.Larin 02/13/2009.

Overview of Beam Test Benoit, Ronaldo and Eduardo Nov 8 , 2005 thanks to Steve and Bill for helping to consolidate all the information.

Presentation transcript:

LAT Software Quality Assurance Span of LAT ground software tests Unit tests System Tests Instrument Performance Tests End-to end tests – “Mock Data Challenges”

LAT Software Quality Assurance Unit tests Test individual software packages via test designed by package maintainer Tests have expected outcomes Tests are run by release management software when maintainer “tags” package Tests reside in conventional location (../test subdirectory) and have conventional names (test_PackageName) Failures reported automatically to package maintainer (e.g. via email) Examples: Regression tests, histogram comparison tests

LAT Software Quality Assurance System tests Test application (checkout) packages Tests are run by release management software when a release is declared Tests generate diagnostics Diagnostics tracked between releases and compared against standards Failures reported automatically to designated list of management team members Examples: Regression tests, histogram comparison tests, performance tests

LAT Software Quality Assurance Instrument Performance tests Test basic instrument performance parameters Show that parameters meet LAT Performance Specification Regular testing and tracking of results will allow for study of code evolution and possible large deviations from understood performance In particular, examine (after background rejection and resolution cuts) TKR front and back section PSF, as a function of energy and angle Energy resolution on-axis and at > 60 deg. incidence, as a function of energy Effective area as a function of energy and angle (and hence FOV) Residual background as fraction of accepted high-lattitude diffuse flux as a function of energy

LAT Software Quality Assurance Sample TKR reconstruction plots showing reconstructed track multiplicity, origin point of tracks, and PSF (68 % and 95 % containment) for gammas

LAT Software Quality Assurance End to end tests – “Mock Data Challenges” Large scale test of entire LAT ground software system Bulk processing of simulated source raw data through Level 1 processing followed by Level 2 analysis “Single blind” – those doing analysis don’t know the underlying physics – their job is to discover it Large scale effort involving large fraction of collaboration and certainly Science Working Groups Anticipate 2-3 Mock Data Challenges prior to launch In mid 2002 (as input to CDR) Towards the end of 2005 Perhaps in the middle of 2005 as well