GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois1 SAS Overview Overall Data Flow Sim/Recon –Gleam –Recon rewrites –Calibrations Level.

Slides:



Advertisements
Similar presentations
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Advertisements

GLAST LAT ProjectDOE/NASA Review of the GLAST/LAT Project, Feb , 2001 IOC – S.Williams SAS - R.Dubois 1 Instrument Operations Center (IOC) and Science.
GLAST LAT Project I&T Meeting – Jan 20,2004 E. do Couto e Silva 1 GLAST Large Area Telescope: EM1 Data Analysis and Calibration Summary Report Eduardo.
GLAST LAT ProjectISOC CDR, 4 August 2004 Document: LAT-PR-04500Section 3.31 GLAST Large Area Telescope: Instrument Science Operations Center CDR Section.
GLAST LAT Offline SoftwareWorkshop - SLAC, Jan , 2001 R.Dubois The Plan The Year in Review The Big Picture Short Term Plan & Balloon Manpower issues.
GLAST LAT ProjectIA Workshop 6 – Feb28,2006 Preliminary Studies on the dependence of Arrival Time distributions in the LAT using CAL Low Energy Trigger.
GLAST LAT Project Apr 1, 2005 E. do Couto e Silva 1/31 Overview of End to End Runs Eduardo do Couto e Silva April 1, 2005 ( not it is not a joke, we finally.
SVAC/ISOCInstrument Analysis Workshop, February 27, 2006 Anders W. Borgland 1 Overview Of LAT Data Taking Anders W. Borgland Science Verification, Analysis.
GLAST LAT Project Instrument Analysis Meeting– May 27, 2005 Hiro Tajima, TKR Bad Strips 1 GLAST Large Area Telescope: TKR Bad strips analysis update Hiro.
Science Analysis SoftwareInstrument Design Team, Mar. 5, 2002 Tracking Reconstruction GLAST Science Analysis Software Instrument Design Team Meeting Tuesday,
Status of ReconGround Software Workshop, July 15, 2003 The GLAST Event Reconstruction: What’s in it for DC-1? GLAST Ground Software Workshop Tuesday, July.
GLAST LAT Project 1 Tracker “mini-tower” Full Size Calorimeter module Face to Face IDT meeting March 20, 2002 Convener: E. do Couto e Silva Engineering.
TkrRecon Status Perugia Software Workshop May, 2003.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 4.3 Pipeline, Data Storage and Networking Issues1 Gamma-ray Large.
Simulation / Reconstruction Working group Toby Burnett University of Washington Jan 2000 T.
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test J. Panetta 1 Gamma-ray Large Area Space Telescope GLAST Large Area Telescope:
R.Dubois 12 Jan 2005 Generating MC – User Experience 1/6 GLAST SAS Data Handling Workshop – Pipeline Session Running MC & User Experience Template for.
GLAST LAT Project Analysis Meeting March 22, 2004 E. do Couto e Silva 1/8 LAT Instrument Test Analysis Eduardo do Couto e Silva March 23, 2004.
The CU Beam Test at CERN Status Report and highlights from workshop II Luca Latronico LAT C&A Meeting May
GLAST LAT Project ISOC Peer Review - March 2, 2004 Section Gamma-ray Large Area Space Telescope GLAST Large Area Telescope ISOC Peer Review 7.2.
GLAST LAT Project ISOC Peer Review - March 2, 2004 Document: LAT-PR Section 7.1 Pre-launch Operation and Calibration 1 Gamma-ray Large Area Space.
Simulation / Reconstruction Working group Toby Burnett University of Washington 11 Jan 2000 T.
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test One and Two Tower Integration Readiness Review.
GLAST LAT Project 1S. Ritz Purposes of the Data Challenges “End-to-end” testing of analysis software. –define the ends –define the tests (what is success?)
GLAST LAT Project Analysis Meeting April 22, 2004 E. do Couto e Silva 1/5 SVAC Status SVAC Status Eduardo do Couto e Silva April 22, 2004.
Tracker Reconstruction SoftwarePerformance Review, Oct 16, 2002 Summary of Core “Performance Review” for TkrRecon How do we know the Tracking is working?
GLAST LAT ProjectOnline Peer Review – July 21, Integration and Test L. Miller 1 GLAST Large Area Telescope: I&T Integration Readiness Review.
GLAST LAT Project Instrument Analysis Workshop #4, 14 July 2005 David Smith CAL calib at SLAC SVAC1 Stability of the CAL Calibrations Online script “suites”
August 98 1 Jürgen Knobloch ATLAS Software Workshop Ann Arbor ATLAS Computing Planning ATLAS Software Workshop August 1998 Jürgen Knobloch Slides also.
R.Dubois Sim/Recon Overview 1/10 GLAST LAT ProjectSoftware Workshop July, SLAC Sim/Recon Overview Elements of Simulation/Reconstruction Development,
Fermi Large Area Telescope (LAT) Integration and Test (I&T) Data Experience and Lessons Learned LSST Camera Workshop Brookhaven, March 2012 Tony Johnson.
GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.
Root, GLAST, and IDL Heather Kelly NASA/GSFC Emergent Corporation.
LAT Reconstruction (and simulation) Toby Burnett University of Washington.
GLAST CHEP 03 March R.Dubois1/17 GLAST Large Area Telescope: Overview of GLAST Offline Software Richard Dubois Stanford Linear Accelerator Center.
GLAST CHEP 03 March K.Young1/22 GLAST Large Area Telescope: Release System for GLAST Offline Software Karl Young, Richard Dubois, Alex Schlessinger.
GLAST LAT ProjectFace to Face Managers Meeting 04/14/ Integration and Test 1 GLAST Large Area Telescope: I & T Input to Face to Face Managers.
T. Burnett1 GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 9, 2002 SAS Software: Sources Detector geometry model Simulation Event.
Heather Kelly PPA Scientific Computing Apps LAT was launched as part of the Fermi Gamma-ray Space Telescope on June 11 th 2008.
GLAST LAT Project LAT Instrument Analysis Workshop – Feb 27, 2006 Hiro Tajima, TKR Data Processing Overview 1 GLAST Large Area Telescope: TKR Data Processing.
Feb. 7, 2007First GLAST symposium1 Measuring the PSF and the energy resolution with the GLAST-LAT Calibration Unit Ph. Bruel on behalf of the beam test.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
Status of the LAr OO Reconstruction Srini Rajagopalan ATLAS Larg Week December 7, 1999.
GLAST Calorimeter Crystal Position Measurement Zach Fewtrell, NRL/Praxis GLAST Integration & Test Workshop SLAC July 14, 2005.
Science Analysis Software DC-2 Kickoff Workshop March 1-3, 2005 Tracy Usher 1/25 Data Challenge II Kickoff Workshop Simulation and Reconstruction Overview.
GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.
GLAST LAT Project CU Beam Test Workshop 3/20/2006 C. Sgro’, L. Baldini, J. Bregeon1 Glast LAT Calibration Unit Beam Test Status Report on Online Monitor.
GLAST LAT ProjectSAS PDR, Aug. 17, 2001 R.Dubois1 Schedule Balloon Science Tools, Analysis Platforms Calibrations Performance Tuning, Tracking Data Production.
GLAST LAT Offline SoftwareWorkshop - SLAC, Jan , 2001 TKR Software Review -- Jan. 17, Topics for the TKR Software Review Tracy Usher, Leon.
1 Study of Data from the GLAST Balloon Prototype Based on a Geant4 Simulator Tsunefumi Mizuno February 22, Geant4 Work Shop The GLAST Satellite.
Feb. 3, 2007IFC meeting1 Beam test report Ph. Bruel on behalf of the beam test working group Gamma-ray Large Area Space Telescope.
GLAST Beamtest 2006 Pisa R.Dubois1/3 Offline Possibilities for Ancillary Data Handling.
4 Dec., 2001 Software Week Data flow in the LArG Reconstruction software chain Updated status for various reconstruction algorithm LAr Converters and miscellaneous.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review SVAC Elliott.
Simulation Tools for Test Beam
Existing Perl/Oracle Pipeline
Science Analysis Software
Linear Collider Simulation Tools
SAS Overview The Big Picture
Simulation and Physics
Cal Calibration Software
LAT Instrument Operations Center
Data Challenge 1 Closeout Lessons Learned Already
Status Report and highlights from workshop II
Linear Collider Simulation Tools
Level 1 Processing Pipeline
Calibration Infrastructure Design
Presentation transcript:

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois1 SAS Overview Overall Data Flow Sim/Recon –Gleam –Recon rewrites –Calibrations Level 1 Pipeline + Mirrors Science Tools Advertisement

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois2 Data Flow MOC IOC DPF Recon L1 DB SSC L2 DB Italian mirror French mirror MC Calibs Fully automated server, with RDB for data catalogue + processing state. Uses SLAC batch CPU and disk farms. Data recon + MC on disk. Abstract full- recon output into L1 DB for analysis Parts of L2 processing also automated

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois3 Instrument Simulations and Reconstruction CAL Detail Instrument data 3 GeV gamma interaction 3 GeV gamma recon

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois4 Processing Pipeline ~50 CPUs; ~50 TB disk by 2010 IOC Batch system Level 0 Level 1, diagnostics HSM Automated Tape Archive Level 0

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois5 Sim/Recon Toolset cvs – file version management CMT – package version management simulation package gismo – on its way out GEANT4 – on its way in Root – object I/O Gaudi – code framework Gleam TkrRecon, CalRecon, AcdRecon – test beam era versions; Rewrites being planned & executed vcmt – Windows gui glastpack+soap - Linux ssh – secure cvs access VC++ – Windows IDE gnu tools - Linux Root, IDL – analysis xml – geometry, parameters utilities applications Event Display

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois6 Goals for Gleam New flexible geometry –flight.xml + detModel –Handle EM1 (1x1), Calib unit (1x4), Flight (4x4) Calib may well include some simulation of beamline Expect to handle BFEM; maybe BTEM –Used in Sim, Recon & Event Display. Analysis? –Looking successful so far I&T group trying it out for EM1 Separate Sim, Digi & Recon –Separately selectable and configurable via jobOptions –Persistent I/O from each phase Root is the current choice Fully detailed output –Object I/O matches OO coding in sim/recon –MC allows for configurable output – user can specify which volumes are sensitive and PositionHit or IntegratingHit types –Separate trees for MC, Digi, Recon Logically connected as one dataset Separate branches for systems: MC, subsystems Can exercise conditional reads by branch –Expect to have a summary ntuple as well Derivable from the full tree

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois7 Output Structure MC TreeDigi TreeRecon Tree Summary ntuple McParticle McPositionHit McIntegratingHit TkrDigi CalDigi AcdDigi TkrRecon CalRecon AcdRecon need mechanism to link Recon Digi MC nice if it were external to either pair could also be used for cross-subsystem relationships talking to Riccardo/Toby about such a mechanism

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois8 Gleam Goals (cont’d) New Recon chains per subsystem –TKR well underway (subject of this meeting) –CAL just getting going again TKR+CAL for low energy measurements – TKR is sampling calorimeter Real clustering at low energies? Revisit leakage corrections, especially off-axis –ACD to get a facelift Use revised propagator to associate tracks to tiles (use extrapolated error matrix?) –Expect such work to be made much easier with the new output structures – access to all the detail we’ll need to understand algorithm performance –Gaudi allows for plug ‘n’ play operation of algorithms, so we can try out new ones easily. Have to make sure the recons are set up to exploit this! –Started planning on extensive test suites to follow performance as code evolves Tie to Release Manager – track performance vs Release via database

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois9 Cal ID Layer Tower Column x=y=50 mm Horiz pitch = mm => Tower 10, Col 1

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois10 Xtal Threshold 2 MeV = 100 ADC: looks close. Might need more stats to understand cutoff.

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois11 Details of Subsystems Data Root output is imminent –MC & CAL already available for Digis –TKR should be appear within a day or two –ACD by end of week (we hope, if Heather has recovered!) We have proto Root macros for accessing new output files and doing some simple checking Have sample userAlg files for generating them (userAlg.cxx, requirements and jobOptions) Can demonstrate them this week

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois12 Calibrations Infrastructure –Starting to happen now (Joanne Bogart) –MySql db for metadata; xml, Root for storing parameters –Prototyping now on TKR hot/dead channels –CAL interested in getting on board early. First redesign of calibration classes happening. TKR –Hot/dead channels (Leon) –Alignment (Hiro Tajima) – should have substantial progress by end 2002 CAL (NRL, Bordeaux?) –Thresholds, pedestals, gains, light tapers –Charge injection –Using heavy ions in flight ACD –thresholds, pedestals, gains

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois13 Data Pipeline and Mirrors We are in the process of writing a spec for the pipeline now –Alex Schlessinger will write the server etc –Database is specified already – started from SLD experience Set up for flexibility – configure data per task so RealData and MC can both be handled See LAT-TD-0533 for database description Will augment db for handling server state We expect to have mirrors in 3 locations: –SSC – level 1 DB (summary ntuple needed for astronomy) –Italy – so far we have only had contact with ASI. ? –France –Don’t have input from LAT mirrors on what data to mirror Choices are Level 1 DB only; plus Recon; plus Raw Data Initial druther would be not to distribute raw data to ensure version control over Recon.

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois14 Science Tools Science Support Center is at Goddard –Well funded – will probably have ~12 people! –Their charter is to provide access to the public for analysis of GLAST data Our goal is to work with them on a single suite of tools –Joint LAT-SSC working group in operation for a couple of months now Have been fleshing out initial descriptions and requirements on the tool box Public call for comments on the documents leading into the Science Tools SLAC June Organized by Seth Digel (a Real Astronomer).

GLAST LAT ProjectTracking Software Week – Pisa – 20 May 2002 R.Dubois15 Communications Meetings –vrvs –Core – Wed 17:30; General Thurs 17:30; CAL – Wed 16:30; TKR/DSTF – Fri 17:30(alternating); DocTF – Tues 17:30 –All have minutes and slides posted from meetings – Mailing Lists –General – Softlist; Core – InfraSoftlist; TKR – TkrSoftlist; CAL – CalSoftlist; –“bug tracking” – HelpSoftList –Majordomo via Stanford. ICQ –Very useful for distributed group –Trillian for Windows; GAIM for linux seem best clients currently Monthly Code reviews