Migration of reconstruction and analysis software to C++

Slides:



Advertisements
Similar presentations
25/03/2003Simulation Application for the LHCb Experiment CHEP March 2003 Presented by: W. Pokorski / CERN Authors: I. Belyaev, Ph. Charpentier,
Advertisements

LHCb Simulation Tutorial CERN, 21 st -22 nd February B 00 l e How to pass a detector geometry to.
Marco Cattaneo, 23rd February Status of the software migration  Migration strategy: Where we should be  Status: Where we are  Plans.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
1 GAUDI - The Software Architecture and Framework for building LHCb data processing applications Marco Cattaneo, CERN February 2000.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
ALICE Simulation Framework Ivana Hrivnacova 1 and Andreas Morsch 2 1 NPI ASCR, Rez, Czech Republic 2 CERN, Geneva, Switzerland For the ALICE Collaboration.
1 Planning for Reuse (based on some ideas currently being discussed in LHCb ) m Obstacles to reuse m Process for reuse m Project organisation for reuse.
LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)
ATLAS Data Challenges US ATLAS Physics & Computing ANL October 30th 2001 Gilbert Poulard CERN EP-ATC.
Reconstruction Configuration with Python Chris Jones University of Cambridge.
LHCb Lausanne Workshop, 21st March /12 Tracking Software for DC’06 E. Rodrigues, NIKHEF LHCb Tracking and Alignment Workshop  To do list, and done.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Marco Cattaneo, 15-Sep OO software plans  Major milestone (presented last June) Fully functional SICB replacement by mid-2000  How to get there?
GAUDI Muon Software  Algorithms : Muon Digitization MuonL0Trigger MuonIdentification  Detector Description Database  Transient Detector Store  Detector.
1 SICBDST and Brunel Migration status and plans. 2 Migration Step 1: SICBMC/SICBDST split  Last LHCb week: Split done but not tested  Software week.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
BES III Software: Overview, Status and Plan Weidong Li Representing BES III Software Group BES Annual Meeting, Beijing 1 st June 2005.
Claudio Grandi INFN-Bologna CHEP 2000Abstract B 029 Object Oriented simulation of the Level 1 Trigger system of a CMS muon chamber Claudio Grandi INFN-Bologna.
April 6, 2000 LHCb Event Data Model Pavel Binko, Gloria Corti LHCb / CERN 1 LHCb Software week LHCb Event Data Model Pavel Binko Gloria Corti LHCb / CERN.
Prospects for Integrating Veloroot into GAUDI D. Steele - 24/11/1999.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Overview Methodology Design Architecture Outline of future work Ideas for discussion.
Software Week - 8/12/98G. Poulard - CERN EP/ATC1 Status of Software for Physics TDR Atlas Software Week 8 December 1998 G. Poulard.
Marco Cattaneo, 6-Apr Issues identified in sub-detector OO software reviews Calorimeters:18th February Tracking:24th March Rich:31st March.
Detector SimOOlation activities in ATLAS A.Dell’Acqua CERN-EP/ATC May 19th, 1999.
Proposal for the MEG Offline System Assisi 9/21/2004Corrado Gatto General Architecture Computing Model Organization & Responsibilities Milestones.
Calo Software: Urgent tasks and resources Ivan Belyaev LHCb, CERN & ITEP/Moscow.
Peter ClarkeATLAS software week / Berkley 9-13 May 2000ATLFAST status report Status of ATLFAST integration into Gaudi P.Clarke H.Phillips E. Richter-Was.
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Current Status of the Tracking Trigger Software Andrew W. Rose.
Mar 05 - hvdsOffline / HLT1  Athena SW Infrastructure  programming + applying tools wrt. dependencies between packages  developing + testing extra ideas.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Marco Cattaneo, Milano, 27th September Brunel status and plans Status of commissioning Forthcoming improvements Conventions.
9 Feb, MEG Software Status -for the coming review committee- Question from A.Blondel Our answer Schedule and Man power MEG Software Group.
David Adams ATLAS Hybrid Event Store Integration with Athena/StoreGate David Adams BNL March 5, 2002 ATLAS Software Week Event Data Model and Detector.
Marco Cattaneo, 20-May Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
LHCb Software Week 25/11/99 Gonzalo Gracia Abril 1 r Status of Geant4 in LHCb. r Ideas on how to populate the LHCb Detector Description Data Base (LHCb.
LHCb Computing 2015 Q3 Report Stefan Roiser LHCC Referees Meeting 1 December 2015.
LHCb Simulation LHCC Computing Manpower Review 3 September 2003 F.Ranjard / CERN.
Physics Software Towards first Physics data Reconstruction Alignment
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Status of Brunel team and next steps
Physical Units Event Data Model Access to MonteCarlo truth
Marco Cattaneo, CERN February 2000
US ATLAS Physics & Computing
(CMS GEANT4 simulation)
SW Architecture SG meeting 22 July 1999 P. Mato, CERN
What’s new in version 5 of GAUDI
Simulation and Physics
Search for coincidences and study of cosmic rays spectrum
Muon Group Software Report
2 Getting Started.
OORich Implementation Status
2 Getting Started.
Discussion on managing the coexistence of CDF and XML geometry files
And plan for SICBDST retirement
2 Getting Started.
Summary Computing Model SICb Event Model Detector Description
Use of GEANT4 in CMS The OSCAR Project
LHCb Data Quality Check web. cern
Agenda SICb Session Status of SICb software migration F.Ranjard
Andrea Valassi Pere Mato
Use Of GAUDI framework in Online Environment
Joel Closier Eric van Herwijnen Agnieszka Jacholkowska
Planning next release of GAUDI
Calibration Infrastructure Design
Presentation transcript:

Migration of reconstruction and analysis software to C++ A proposal based on feedback from the software week Marco Cattaneo, 1st December 1999

Immediate Goals Physics Goal: Software Goal To be able to run new tracking pattern recognition algorithms written in C++ in production with standard FORTRAN algorithms in time to produce useful results for the RICH TDR. Software Goal To allow software developers to become familiar with GAUDI and to encourage the development of new software algorithms in C++. Marco Cattaneo, 1st December 1999

Proposed Strategy - Step 1 Finish splitting of SICB into: simulation (SICBMC) Event generation, GEANT tracking outputs kinematics AND raw GEANT hits i.e. Current RAW format, but with xxRW banks from all detectors reconstruction (SICBREC) doesn’t need GEANT3 nor its common blocks digitisation, trigger, reconstruction in distinct steps outputs same DST format as now. Benefits: Clear separation between simulation and reconstruction Modularity of reconstruction Organiser : Florence Marco Cattaneo, 1st December 1999

SICB “digitisings” (not on SICB DST) Step 1 overview SICBREC SICBSIM Generator SICB local tracking and “digitisation” Half way between raw data and coordinates. E.g. wire number, signed drift distance MC Kinematics Pileup SICB “digitisings” (not on SICB DST) GEANT transport Pattern Recognition Trigger SICB “raw” data Entrance and exit points and energy loss in detectors SICB DST Marco Cattaneo, 1st December 1999

Tasks for step 1 SICBMC SICBREC Remove anything that belongs to digitisation and reconstruction Done Create raw hits for calorimeter To be done by calorimeter experts (~1 week?) SICBREC Add initialization routines for each step of the processing (digitize, apply trigger, reconstruction) Verify validity of results Both the above are essentially work for the sub-detector experts Time estimate is about two weeks If started now, step 1 could be finished by Xmas Marco Cattaneo, 1st December 1999

Step 1 SICBREC structure X This dataflow is forbidden (no COMMON...) SICB raw Digitisation A Digitisation B Trigger Reconstruct A Reconstruct B Input ZEBRA common (SICB banks) Output SICB “framework” SICB DST Marco Cattaneo, 1st December 1999

Proposed Strategy - Step 2 For every SICBREC FORTRAN module: wrap it such that it can be called from C++ Integrate with the GAUDI framework Time estimate about 1 month - sub-detectors and Gaudi team Result is a new reconstruction program - BRUNEL Produce a DST (Zebra banks) with this program check the output is as expected i.e. identical to SICBREC output Must be done by sub-detector experts Drop SICBREC Could be ready for decision by next LHCb week Benefit: Single environment for C++ and FORTRAN work Integrated environment for verification of C++ developments Organiser: Marco

Step 2 BRUNEL structure SICB raw ZEBRA common (SICB banks) Digitisation A Digitisation B Trigger Reconstruct A Reconstruct B Input ZEBRA common (SICB banks) Output Gaudi framework SICB DST Marco Cattaneo, 1st December 1999

Proposed Strategy - Step 3 Start replacing FORTRAN modules with C++ equivalent. Each new piece consists of: event model detector description algorithm. Provide converters to: regenerate same SICB output bank that was there before Preserves format of SICB DST DST banks may contain improved data (e.g. Result of tracking pattern recognition Some “added value” of C++ algorithms would NOT be on SICB DST write data out to the supported persistent object manager Contains as complete a reconstructed event as is available in GAUDI event store Including “added value” of C++ algorithms, available only to GAUDI based analyses Marco Cattaneo, 1st December 1999

Step 3 - organisation This step implies (for each sub-detector): Development of event model : help coordinated by Marco Development of detector description : help coordinated by Florence Reviews of evt mod, det desc, algorithms : organised by John. Review panel will include Pere, Marco, Florence, plus SDs Known candidates: Tracking, Analysis tools, Muon digitisation, Calorimeters, RICH, ... Timescale: Depends (almost) entirely on sub-detectors Marco Cattaneo, 1st December 1999

Step 3 BRUNEL structure CDF files SICB raw SICB DST Digitisation A Digitisation B Trigger Reconstruct B Zebra Input Zebra Output ZEBRA common (SICB banks) Sicb Converters Sicb Converter Gaudi transient event store Sicb Converters Reconstruct A BRUNEL OO Output XML geom. OO DST

Step 3: Analysis structure SICB DST Analysis A Has access ONLY to SICB DST Steered by GAUDI job options GAUDI Zebra Input ZEBRA common (SICB banks) HBOOK GAUDI job options Sicb Converters Gaudi transient event store Sicb Converters OO Input Analysis B Visualisation Have access to OO DST and SICB banks for which converters exist. Steered by GAUDI job options OO DST

Step 3 - benefits A unified development and production environment As soon as C++ algorithms are proven to do the right thing, they can be brought into production in the official reconstruction program Early exposure of all developers to Gaudi infrastructure FORTRAN gurus and C++ beginners Increasing functionality of OO ‘DST’ As more and more of the event data becomes available in Gaudi, it will become more and more attractive to perform analysis with Gaudi N.B. Contains ALL (and only!) parts of reconstructed event for which data model is defined A smooth transition to a C++ only reconstruction Marco Cattaneo, 1st December 1999

Summary Step 1: separate SICBMC and SICBREC Could be ready by Xmas Step 2: wrap SICBREC algorithms into Gaudi framework Could be ready by end February Step 3: gradually replace FORTRAN with C++ algorithms Timescale dictated by sub-detector priorities Development/integration in Gaudi can start now Analysis in Gaudi is possible now Functionality will increase as subdetectors define their data model Analysis toolkit under development, send requirements to Gloria Marco Cattaneo, 1st December 1999