Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.

Slides:



Advertisements
Similar presentations
Simulation Project Overview Based on the project plan submitted to and approved by the SC2 March 14, 2003 Torre Wenaus, BNL/CERN for the Simulation Project.
Advertisements

SFT Group Review Introduction  Mandate  History and Organization  List of Projects  Today Resources September 30th,
Simulation Project Major achievements (past 6 months 2007)
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
4 November Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Development, validation and.
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
Maria Grazia Pia, INFN Genova Test & Analysis Project aka “statistical testing” Maria Grazia Pia, INFN Genova on behalf of the T&A team
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
LCG Generator, October 16 th 2003 Introduction to the October LCG Generator meeting Paolo Bartalini CERN.
Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Dmitri Konstantinov 26 March
19 November 98 1 Jürgen Knobloch ATLAS Computing ATLAS Computing - issues for 1999 Jürgen Knobloch Slides also on:
Fabiola Gianotti, 31/8/’99 PHYSICS and SOFTWARE ATLAS Software Week 31/8/’99 Fabiola Gianotti Software requirements of physics groups What should Detector.
Fabiola Gianotti, 30/07/2003 ATLAS HO HB ECal Beam Line CMS LHCb ALICE Goals and plans Examples of work done so far and first results Examples of on-going.
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
Release Validation J. Apostolakis, M. Asai, G. Cosmo, S. Incerti, V. Ivantchenko, D. Wright for Geant4 12 January 2009.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LHCbComputing Manpower requirements. Disclaimer m In the absence of a manpower planning officer, all FTE figures in the following slides are approximate.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Introduction What is detector simulation? A detector simulation program must provide the possibility of describing accurately an experimental setup (both.
Lucie Linssen, PH senior staff meeting 23 Nov ’05 slide 1 EUDET Links: Public EUDET pages: Internal EUDET pages:
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
W. Pokorski - EP/SFT Simulation Project1 Generator Services Subproject Witek Pokorski
Computing Performance Recommendations #10, #11, #12, #15, #16, #17.
Simulation Project Status LHCC Comprehensive Review 2006 Gabriele Cosmo, PH/SFT.
Fabiola Gianotti, 13/05/2003 Simulation Project Leader T. Wenaus Framework A. Dell’Acqua WP Geant4 J.Apostolakis WP FLUKA Integration A.Ferrari WP Physics.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
Calorimeter Simulation Infrastructure Norman Graf Arlington ‘03.
Generator Services planning meeting Witek Pokorski
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Simulation Project Status Witek Pokorski, PH/SFT
Physics Performance. EM Physics: Observations Two apparently independent EM physics models have led to user confusion: –Different results for identical.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
Luciano Pandola, INFN Gran Sasso Luciano Pandola INFN Gran Sasso Genova, July 18 th, 2005 Geant4 and the underground physics community.
Simulation Project Overview (Very condensed) Torre Wenaus, BNL/CERN Simulation Project Leader LHCC Comprehensive Review.
MC4LHC w/s July Activities promoted by LCG-Generator Supporting Monte Carlo Generators in the LHC era P. Bartalini (University of Florida)
Simulation Project Setup Status Torre Wenaus, BNL/CERN LCG Applications Area Manager PEB Meeting January 28, 2003.
Atlas Software May, 2000 K.Amako Status of Geant4 Physics Validation Atlas Software Week 10 May, Katsuya Amako (KEK)
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
Project Work Plan SEAL: Core Libraries and Services 7 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Projects, Tools and Engineering Patricia McBride Computing Division Fermilab March 17, 2004.
LCG Generator Monthly Meeting, September 25 th 2003 Status Of The Generator Project And Feedbacks From The MC4LHC Steering Group Paolo Bartalini CERN EP.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
STATUS OF GDML SUPPORT IN ROOT A.Gheata SFT group meeting, June 2, 2014.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
CERN, 7 November 2011 Anton Pytel Slovak Technical University TRIP FROM GENERATORS TO GEOMETRIES.
Generator Services planning meeting Witek Pokorski
Ian Bird GDB Meeting CERN 9 September 2003
European Organization for Nuclear Research
LCG Generator Services project
CPU Benchmarks Parallel Session Summary
Simulation Project Structure and tasks
Generator Services planning meeting
Physics Validation of LHC Simulations
Summary of the 7th Geant4 Collaboration Workshop
Simulation Framework Subproject cern
Simulation Project Structure and tasks
Simulation Project Structure and tasks
SEAL Project Core Libraries and Services
Presentation transcript:

Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal Review September 19 th, 2006

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 2 Simulation Project  Simulation framework  Interface to multiple simulation engines (Geant4, Fluka) and geometry models exchange (GDML), MC truth handling, Python interfaces  Geant4 team participating  Aligned with and responding to needs from LHC experiments, physics validation, simulation framework  Fluka team participating  Framework integration, physics validation  Garfield team participating  Garfield package integration and support in LCG - SPI  Simulation physics validation  Assess adequacy of simulation and physics environment for LHC and provide the feedback to drive needed improvements  Generator services  Generator libraries; validation/test suite; development when needed (HepMC, etc.); common event files Witold Pokorski John Apostolakis Alfredo Ferrari Alberto Ribon Witold Pokorski as of 15-Sep-06 Rob Veenhof

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 3 Project Organization Simulation Project Leader Framework WP Geant4 WP Fluka WP Physics Validation WP Generator Services WP Subprojects Work packages Geant4 Project Fluka Project Experiment Validation MC4LHC Garfield WP

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 4 Recommendations 2005 review – generator services  “ The size of the complete GENSER package is becoming too big to be handled efficiently. Therefore the review recommends introducing more granular packaging options for distribution”  A modular way for downloading also individual MC packages has been introduced since release of GENSER. A Python script allows for the selection and automatic download from the Web  “The situation with HepMC is still unclear and needs to be re- evaluated once the new release is used in production by all experiments”  HepMC has been agreed as the file format for the production of common generator particle-level event files. It is also adopted for later stages in simulation and reconstruction  Since January 2006 the HepMC package is released and maintained among the external packages in the LCG AFS area, now released and distributed independently. Lynn Garren (FNAL) has joined the effort undertaking the support for HepMC. HepMC is now organised in the context of LCG and a dedicated Savannah portal is set  From the future version of HepMC (2.X), the package will become a standalone product with no external dependencies  Agreement among experiments to consider the standalone HepMC as the reference version

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 5 Recommendations 2005 review – physics validation - 1  “A continuing common effort together with the experiments to validate the packages against test beam data and simple benchmark processes ”  Results from test-beam setups of 2004 have been obtained and presented (ATLAS, CMS) others are expected soon (ATLAS)  New releases of Geant4 are promptly validated against test-beam data (ATLAS-HEC); such process has been established since 2005  “Continuation of the Fluka validation, especially of the hadronic physics”  Milestones for simple benchmarks and test-beam setups are defined and in advanced state. Fluka and Geant4 are the MC engines being verified  “To install a central repository for the validation results”  The code repository for the simple benchmarks is in place and populated. For the test-beam setups, work is in progress for correcting the data from instrumental effects and allow their use for standalone validation

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 6 Recommendations 2005 review – physics validation - 2  “To revisit together with the experiments the effect on systematic uncertainties for future measurements, due to the present simulation uncertainties, as observed by the ongoing validation studies”  These evaluations are undergoing in the experiments. Considerable effort has been put and is still ongoing for understanding, improving and verifying the hadronic shower shapes  Concern: “The reduction in manpower of 2.3 to 0.8 FTE in the physics validation of Geant4 is very worrying. If Geant4 can argue that this is essentially a CERN responsibility we recommend that the LCG tries to improve the manpower situation”  The average manpower in the last 12 months has been of 2.3 FTE, which corresponds to the current figure  Manpower projection for the next 6 months: 1.9 FTE

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 7 Concerns 2005 review – simulation framework  “ Concern that the subproject is carried by less than one FTE. In the long run this may be insufficient ”  The project has been reinvigorated with new manpower during 2006 reaching an average of 1.3 FTE in the past 12 months and currently at 1.8 FTE  Helped to successfully achieve most of the milestones assigned to the Project  Manpower projection for the next 9 months: 1.4 FTE

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 8 Recommendations 2005 review – Fluka  “FLUKA installation together with source code should be made available very soon”  “Distribution of FLUKA should make use of the SPI tools, like other AA related software products”  The source code of Fluka is available to CERN and INFN researchers since July The source of the most recent release (fluka2006.3) will be open to all scientific Institutions  AFS space has been setup for the installation of the Fluka package in the LCG area  The most recent version of Fluka (2006.3) will be soon installed

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 9 Recommendations 2005 review – Geant4  “Any concerns on the validity of the physics results should be brought forward in the validation subproject ”  Feedback for validation studies done in the experiments is reported in the Physics Validation meetings monthly organised by the Physics Validation subproject in coordination with the physics validation responsibles in the experiments

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 10 Simulation Project major Milestones :  2005/02: VD502 - Review/prioritization os simple benchmarks for physics validation  2005/05: VD508 - First results of background radiation studies in Geant4  2005/06: VD512 - New validation results on longitudinal shower shapes in Geant4  2005/06: SF515 - GDML schema extension to support divisions and reflections  2005/06: SF516 - Feasibility study of Pool/Root-based geometry persistency in Geant4  2005/06: SF517 - Python implementation of GDML writers for Geant4 and Root  2005/06: G Geant4 7.1 public release  2005/07: G Tutorial on Geant4 at CERN and move of Geant4 code repository to IT service  2005/09: VD rd simple benchmark completed  2005/09: VD524 - Validation of Fluka against ATLAS TileCal test-beam  2005/09: GS527 - Procedure for light GENSER releases  2005/09: SF530 - Flugg application to ATLAS TileCal test-beam simulation  2005/10: G Improved Geant4 regression suite for release validation and testing infrastructure  2005/10: VD532 - First results of ATLAS combined and 2004 test-beams data comparisons  2005/12: GS535 - Generator level production framework: production quality release  2005/12: GS536 - Evaluation of possible migration of HepMC to LCG  2005/12: SF537 - Introduction of modularization of GDML files  2005/12: SF538 - Proposal for universal handling of Monte Carlo truth  2005/12: GF540 - Interface in Garfield with new version of Magboltz  2005/12: GF541 - Interface in Garfield with new version of Heed  2005/12: G Geant4 8.0 public release  2006/03: GS602 - Introduction of MCDB GRID certificates and management of large files  2006/05: G Developments for Geant4 8.1 public release  2006/06: SF608 - Refinements to GDML schema to support user extensions of elements  2006/06: VD617 - Investigation of corrections to test-beam data for validation of stand-alone simulation engines  2006/12: G Report on the main physics effects responsible for hadronic shower development in Geant4  2007/06: VD703 - Application of corrections to test-beam data to the LHC calorimeter test-beam simulations  2007/06: GS701 - Generator level validation framework production version  2007/09: GS702 - Pythia 8 production release

Gabriele Cosmo, CERN/PH-SFT AA Internal Review, Sep 2006 Slide 11 Current LCG simulation manpower Simulation framework1.80 (1.40) Geant47.20 (7.70) Infrastructure, performance, management (approx)2.05 EM / Hadronic physics effort (approx)3.90 Tracking, biasing, geometry (approx)1.25 CERN staff (3.80), CERN fell./assoc. (3.40) Physics validation2.30 (1.90) Validation specific to experiments 1.50 Generator services3.30 (3.50) management, documentation/release (LCG CERN, Florida U.) 1.20 GENSER dev., Validation, MCDB (LCG Russia, Italy) 1.85 Production Framework (LCG Spain) 0.25 Fluka0.00 Garfield1.00 (0.80) Management0.25 Total As of Sep 15