LCG Generator Monthly Meeting, September 25 th 2003 Status Of The Generator Project And Feedbacks From The MC4LHC Steering Group Paolo Bartalini CERN EP.

Slides:



Advertisements
Similar presentations
Simulation Project Major achievements (past 6 months 2007)
Advertisements

Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
Gauss: Generator Status Patrick Robbe, LAL Orsay, 6 Oct 2009.
Introduction to the workshop LHCb Generators Tuning Mini Workshop Bucharest 22 nd & 23 rd November 2012 LHCb Generators Tuning Mini Workshop Bucharest.
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
Tev4LHC Workshop, QCD, Emily Nurse, UCL for the CEDAR collaboration (Andy Buckley, Jon Butterworth, James Monk, Ben Waugh, Mike Whalley,
Abstract The automated multi-platform software nightly build system is a major component in the ATLAS collaborative software organization, validation and.
JetWeb on the Grid Ben Waugh (UCL), GridPP6, What is JetWeb? How can JetWeb use the Grid? Progress report The Future Conclusions.
Monte Carlo event generators for LHC physics
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
HERA/LHC Workshop, MC Tools working group, HzTool, JetWeb and CEDAR Tools for validating and tuning MC models Ben Waugh, UCL Workshop on.
4 November Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Development, validation and.
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
LCG Generator, October 16 th 2003 Introduction to the October LCG Generator meeting Paolo Bartalini CERN.
Alexander Toropin Generator Services monthly meeting 6 June 2007 GENSER status.
Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Dmitri Konstantinov 26 March
GridPP, Durham 5 th July1 PhenoGrid Status Peter Richardson Durham University.
PRS Session, May 12, 2006Filip Moortgat, ETHZ Generator Interface Generator Interface in CMSSW existing/planned interfaces with generators content of the.
LCG Application Area Meeting, March 10 th 2004 Status of LCG Generator Paolo Bartalini, CERN/PH.
June The LCG Generator Project Supporting Monte Carlo Generators in the LHC era P. Bartalini (University of Florida)
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
Feedback from the POOL Project User Feedback from the POOL Project Dirk Düllmann, LCG-POOL LCG Application Area Internal Review October 2003.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
SEAL Project Core Libraries and Services 18 December 2002 P. Mato / CERN Shared Environment for Applications at LHC.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.
Feedback from LHC Experiments on using CLHEP Lorenzo Moneta CLHEP workshop 28 January 2003.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
W. Pokorski - EP/SFT Simulation Project1 Generator Services Subproject Witek Pokorski
Computing Performance Recommendations #10, #11, #12, #15, #16, #17.
Fabiola Gianotti, 13/05/2003 Simulation Project Leader T. Wenaus Framework A. Dell’Acqua WP Geant4 J.Apostolakis WP FLUKA Integration A.Ferrari WP Physics.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
Generator Services planning meeting Witek Pokorski
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects Status and work plan for H July 2003 A.Aimar.
HERA – LHC Workshop, June Validation of simulation packages in LCG Validation of simulation packages in LCG M. Kirsanov (INR Moscow)
Simulation Project Overview (Very condensed) Torre Wenaus, BNL/CERN Simulation Project Leader LHCC Comprehensive Review.
MC4LHC w/s July Activities promoted by LCG-Generator Supporting Monte Carlo Generators in the LHC era P. Bartalini (University of Florida)
News from EP SFT John Harvey FOCUS Meeting – October 3 rd 2003.
Simulation Project Setup Status Torre Wenaus, BNL/CERN LCG Applications Area Manager PEB Meeting January 28, 2003.
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
The interface to EvtGen in CMS Roberto Covarelli University of Rochester EvtGen workshop, 06/12/2010.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Why do F77 always spoil the landscape ?. Several ideas … slide 2.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
LCG Introduction John Gordon, STFC-RAL GDB June 11 th, 2008.
Current status A.Kryukov Skobeltsyn Institute of Nuclear Physics, Moscow State University On behalf of CompHEP Collaboration.
September CHEP 2004 LCG Generator P. Bartalini (University of Florida) F. Ambroglini, S. Belov, J. Cuevas Maestro, L. Dudko, M. Kirsanov, S. Makarychev,
Generator Services planning meeting Witek Pokorski
LCG Generator Services project
Simulation Project Structure and tasks
Generator Services planning meeting
P. Bartalini (University of Florida)
US ATLAS Physics & Computing
Simulation Framework Subproject cern
Simulation Project Structure and tasks
Simulation Project Structure and tasks
SEAL Project Core Libraries and Services
Presentation transcript:

LCG Generator Monthly Meeting, September 25 th 2003 Status Of The Generator Project And Feedbacks From The MC4LHC Steering Group Paolo Bartalini CERN EP division

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division LCG-Generator: Work Packages and Milestones  ALPHA version of the generator repository (GENSER) ready by 06/30/2003. (OK!)  Top priority packages available in LCG by 09/15/2003  GENSER BETA.  LHC experiments: How to switch from the CERNLIB to GENSER ?  Agreement on common event files format by 11/30/2003.  Impact on existing projects (MCDB).  Migration of the first C++ generator in GENSER by end  Ressources for the overall coordination (0.3 FTE) allocated by CMS  Ressources for WP1 and WP3 (1 FTE) allocated by MSU, ITEP and other Russian institutions. A.Sherstnev spent 3 months at CERN, S.Makarichev is at CERN since middle July, I.Seluzhenkov will join in October.  Existing UK-GRID activities in the WP4 domain might be exported in LCG Generator.  ATLAS traditionally does contribute to WP2.  Italian participation: LCG inclusion of some 2 nd priority packages (WP1) is anticipated.  WP1: GENERATOR LIBRARY  WP2: STORAGE, EVENT INTERFACES AND PARTICLE SERVICES (INTERPLAYS)  WP3: COMMON EVENT FILES, EVENT DATA BASE  WP4: TUNING AND VALIDATION OF EVENT GENERATORS Subproject of LCG Simulation, activities steered by MC4LHC

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Generator Library Requirements  Quick releases decoupled from large library releases  Most of the versions released by the authors have to be installed, old versions have to be maintained as long as they are required by the end users  Maintenance for all LCG supported platforms  Top priority: HERWIG, HIJING, ISAJET and PYTHIA.  New C++ generators: Herwig++, Pythia 7, Sherpa, ThePeg etc.  2 nd priority: ALPGEN, COMPHEP, DPMJET, EVTGEN, GRACE, LHAPDF, MADGRAPH, MCDB, NEXUS, PHOJET, PHOTOS, SFM & TAUOLA  CVS repository, AFS distribution.  SCRAM release and building tool for librarian and end users.  Binary distribution also provided.  Automatically generated directory structure (from original MC code).  Some complex package maintained externally  Test/Validation software (provided by the authors and by the users).  Installed in the «Example» and «Test» modules.  Code development for WP1, WP2, WP3, WP4  New Modules The Generator Repository (GENSER)

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Subpackage versions and test code currently installed in the LCG environment 1) HERWIG (contact person P.Richardson): 6.500, 6.503, Examples from 2) PYTHIA (contact person T.Sjöstrand): 6.217, Examples from 3) HIJING (contact person X.Nian): 1.36, 1.37, No examples available for the time being 4) Isajet (contact person still to be suggested by the authors): Examples available in the Isajet distribution 5) Sherpa (contact person F.Krauss) - Examples from 6) MCDB (contact person A.Sherstnev) - Examples available in the MCDB distribution Package versions pursued for inclusion have been indicated by the contact persons in MC projects and/or by the volunteered beta testers. Further versions and test code can be installed easily

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division GENSER: Progress Report  GENSER was the first repository in the Simulation project  Complete migration of MCDB  Inclusion of the Top priority packages has been achieved  Convenient «compact» distribution.  Guaranteed installation on all the LCG supported platforms.  MC structure just automatically reorganised using macros, end users can patch the code.  GENSER BETA pre-release available mid august 2003 GENSER BETA  Documentation:  GENSER is distributed in /afs/cern.ch/sw/lcg/app/releases/GENSER  Currently tested by ATLAS and CMS  Package versions agreed by contact persons in MC projects and/or by the volunteered beta testers.  Simple procedure to include additional versions.  Today: Plans for GENSER BETA release and further technical details (S.Makarychev) and first user reports (from G. Stavropolous and F. Moortgat).

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division MC4LHC Recommendations  The goals of LCG generator (in WP1, WP2, WP3, WP4), the defined milestones, the current GENSER structure and the plans for its future evolution have been approved.  The LCG participation in the MC4LHC workshop has been appreciated. LCG Generator is contributing to advertise the new MC projects and is providing a constant forum for discussions on the generator related software.  It is recommended to improve the collaboration with the MC authors, identifying the contact persons to monitor the inclusion of the existing packages in the LCG environment.  The turn over and the possible loss of well trained people (for instance the librarian) can represent a big problem as all the experiments will soon rely on GENSER. Long term support to LCG Generator members has to be guaranteed by LCG.  LCG Generator: a new multidisciplinary field ?  Working on the border between TH/EP/IT

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division  Persistency for the common event files  11/30/2003.  Get the requirements from the LHC experiments!  Evaluate impact on existing projects (MCDB).  Inclusion of the first C++ generator (Sherpa) in the LCG environment (thanks to Frank Krauss).  Evaluation of the GENSER CVS repository as possible development environment  12/31/2003.  Inclusion of 2 nd priority packages in LCG  To be defined.  Creation of MC user data base. Next Milestones

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division  Definition of environment and output stream for the generation of the common event files.  Get the requirements from the LHC experiments.  Evaluate the impact of POOL.  Review the XMLHEP proposal.  Review the conclusions of the MC4LHC working groups.  Conveners are kindly requested to summarize the requests to LCG (and the software needs in general).  Inputs to the MC user data base. Next LCG Generator Meeting (Thursday October 16 th 32-1-A24 and VRVS Island)

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division WEB pageWEB page: -- links to relevant documents and to CVS repository CDS Agenda HomeCDS Agenda Home > Projects > LHC Computing Grid > Physics GeneratorsProjectsLHC Computing GridPhysics Generators -- minutes of meetings, slides of presentations Applications area mailing list: Meetings: -- Kick off meeting in June (mini-workshop) -- During MC4LHC workshop (in July) -- Last Thursday of the month at 5 PM in 32-1-A24 (VRVS connection in Desert or in Island room) -- September meeting (tomorrow)  The GENSER beta release -- October meeting anticipated to Thursday 16 th. Organisational Issues

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Backup

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Simulation project in LCG-APP Simulation Project T.Weanus Framework A. Dell’Acqua Geant4 J.Apostolakis FLUKA Integration A.Ferrari Physics Validation F.Gianotti Shower Param ? Generator Services P.Bartalini Subprojects Work packages Geant4 Project FLUKA Project Experiment Validation MC4LHC -- GENERATOR LIBRARY -- STORAGE, EVENT INTERFACES AND PARTICLE SERVICES -- COMMON EVENT FILES, EVENT DATA BASE -- TUNING AND VALIDATION OF EVENT GENERATORS MC generator RTAG reportMC generator RTAG report:

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Kick-off Meeting of LCG-Generator Mini w/s (20 June 2003) Kick-off Meeting of LCG-Generator Mini w/s (20 June 2003) 17:00Introduction (Paolo Bartalini) 17:10GENSER, the generator repository in LCG (Alexander Sherstnev) 17:25Parton Shower MC's (Stefan Gieseke) 17:50Event Simulation Tools in ALICE (Andreas Morsch) 18:15LHCb event generators status (Witek Pokorski) 18:40CMS event generators status (Albert De Roeck) 19:05---long coffe- / short dinner- break--- 20:10Generator support in ATLAS (Ian Hinchliffe) 20:35HepMC Event Record - Status (Matt Dobbs) 21:00The requirements from TH (discussion) (tba) 21:25The MCDB project (Alexander Cherstnev) 21:40JetWeb (Ben Waugh) 22:05The LCG Generator subproject - organizational issues (Paolo Bartalini)

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division 2 nd LCG Generator Meeting (31 July 2003) 2 nd LCG Generator Meeting (31 July 2003) 17:00Introduction (Paolo Bartalini) 17:05Tutorial on LCG tools (Alberto Aimar) 17:45Status of GENSER (Sergey Makarychev) 18:00XMLHEP (Alexander Sherstnev) 18:15Status of the C++ Event Generator Packages (Alberto Ribon) 18:30Decay Tables (Peter Z Skands) 18:45Status of CLHEP split (Mark Fischler)

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Are the MC packages inside or outside the LCG generator repository ?  There are two possibilities for the MC generator packages. 1) To fully store the MC generator code in GENSER defining the corresponding sub-package. 2) To install the MC generator as external software packages in the LCG environment and to store in GENSER just tests suites and other related code (examples etc.). Just a technical issue! For each MC package an ad-hoc solution should be found taking into account the user requirements

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division GENSER as a development environment If agreed, MC authors could use the GENSER CVS repository for the development of the MC generators code.  Solution rejected for most of the well assessed Fortran packages.  It should apply in particular to new projects.  MCDB already migrated in GENSER  Feasability study for the inclusion of Sherpa will start soon. Advantages:  MC generators authors would have a convenient environment for development (SPI Tools).  Coding compliance to LCG policies would be guaranteed.  Release, Feedbacks and bug fixes would speed up.

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Storage, Event Interfaces And Particle Services  The MC truth  HepMC  Problems with duplication of versions/missing translators.  CLHEP maintenance was not satisfactory  Split (anything else ?)  Structure of partonic event files: XMLHEP ?  The modularisation  Basic idea in THEPEG, Pythia 7, Herwig++, Sherpa. What are the dependencies ?  EvtGen: how to reuse the Fermilab experience ? How to avoid duplication of versions ?  Persistency  How to define the common event files ?  Particle properties in the physics generators and in the simulation/analysis frameworks.  Is everybody relying on HepPDT ?

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Common Event Files, Event Data Base  Motivations  Some physics processes (the most difficult for generation) should be prepared by experts or MC generators authors.  Sharing the same generator events does simplify the comparisons and save CPU time  There’s a product fulfilling such requirements: MCDB, developed for CMS by Lev Dudko et al.   MCDB has interfaces of 2 different types  interface based on the Web: a web site with simple access to the available event samples with relative bookkeeping.  handy programming interface: automatic generation from local machine once some basic parameters have been set.  It would be desirable to study how to extend this model to the new ME+PS packages

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division New Fitting/Tuning Tool: JetWeb also submitted to Comput. Phys. Commun.Based on HERA HZTOOL package – updated to include Minimum Bias data, Tevatron Jets… [J.M.Butterworth and S.Butterworth hep-ph/ ] also submitted to Comput. Phys. Commun. Web page - Database of data, MC and comparisonsDatabase of data, MC and comparisons Web interface allows access to DB and submission of jobs to generate MC plotsWeb interface allows access to DB and submission of jobs to generate MC plots Good starting point for the LCG-Generator Validation working packageGood starting point for the LCG-Generator Validation working package Tuning And Validation Of Event Generators

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Workshop on MC’s for the LHC (MC4LHC), CERN, 7 july - 2 august 2003 Workshop on MC’s for the LHC (MC4LHC), CERN, 7 july - 2 august 2003  Web page  Seminars from program authors; working groups etc. 1. Matrix element generators (the 4 weeks) Matrix element generators 2. N(N)LO tools (7-12 july) N(N)LO tools 3. Tools for electroweak physics (the 4 weeks) Tools for electroweak physics 4. Parton Distribution Functions (weeks 3 and 4) Parton Distribution Functions 5. MC's for new physics (9-16 july) MC's for new physics 6. Heavy quark and tau decay packages (22-29 july) Heavy quark and tau decay packages 7. Minimum bias, Underlying event, and MC tunings (27 july - 2 august) Minimum bias, Underlying event, and MC tunings 8. Tools for Heavy Ion Physics (8-11 july) Tools for Heavy Ion Physics 9. CLHEP and related tools (14-16 july) CLHEP and related tools 10. Herwig++, Pythia++ (21-25 july) Herwig++, Pythia++

LCG Generator, September 25 th 2003Paolo Bartalini – CERN EP division Between Two Worlds  Small TH groups  Old/Huge Fortran packages still in development  Cannot spend all the time to give user support  Large Experiments  C++ Frameworks  Challenging requirements