LCG Generator Services project

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Simulation Project Major achievements (past 6 months 2007)
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL), Benedikt Hegner (CERN) 14 January
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL) 18 March 2015 Code Contributors: Michele De Gruttola, Benedikt Hegner, Clément.
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
Overview of Mini-Edit and other Tools Access DB Oracle DB You Need to Send Entries From Your Std To the Registry You Need to Get Back Updated Entries From.
Linux Operations and Administration
Tev4LHC Workshop, QCD, Emily Nurse, UCL for the CEDAR collaboration (Andy Buckley, Jon Butterworth, James Monk, Ben Waugh, Mike Whalley,
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Marc Sangel Supervisor: Sebastian Johnert DESY Summer Student Programm Hamburg, DESY, 02. September 2011.
1 Apache. 2 Module - Apache ♦ Overview This module focuses on configuring and customizing Apache web server. Apache is a commonly used Hypertext Transfer.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
HERA/LHC Workshop, MC Tools working group, HzTool, JetWeb and CEDAR Tools for validating and tuning MC models Ben Waugh, UCL Workshop on.
4 November Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Development, validation and.
LCG Generator, October 16 th 2003 Introduction to the October LCG Generator meeting Paolo Bartalini CERN.
Alexander Toropin Generator Services monthly meeting 6 June 2007 GENSER status.
Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Dmitri Konstantinov 26 March
Enlarging the scope of Generator Services project Witek Pokorski SFT Program of Work Meeting 03/03/2010.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Module 6 Securing Content. Module Overview Administering SharePoint Groups Implementing SharePoint Roles and Role Assignments Securing and Auditing SharePoint.
PRS Session, May 12, 2006Filip Moortgat, ETHZ Generator Interface Generator Interface in CMSSW existing/planned interfaces with generators content of the.
LCG Application Area Meeting, March 10 th 2004 Status of LCG Generator Paolo Bartalini, CERN/PH.
The new European Toolkit EC-CHM Miruna Bădescu EEA contractor: Eau de Web.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Mar. 13 th, 2014 Geant4 Physicslist and Validation Working Group Meeting 1 Hans Wenzel Mar 13 th 2014 Physics validation display Webapplication.
Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.
Design of an Integrated Robot Simulator for Learning Applications Brendon Wilson April 15th, 1999.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
Experience with CalcHEP H. S. Goh Univ. of Arizona very little West Coast LHC Theory Network -- UC Irvine May
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
W. Pokorski - EP/SFT Simulation Project1 Generator Services Subproject Witek Pokorski
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
Generator Services planning meeting Witek Pokorski
Oct. 16 th, 2013 Geant4 hadronic Meeting 1 Hans Wenzel Oct 16 th 2013 Status of physics validation tool.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Infrastructure for LCG Software Projects GRIDPP 7 th Collaboration Meeting 30 June – 2 July.
MC4LHC w/s July Activities promoted by LCG-Generator Supporting Monte Carlo Generators in the LHC era P. Bartalini (University of Florida)
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
LCG Generator Monthly Meeting, September 25 th 2003 Status Of The Generator Project And Feedbacks From The MC4LHC Steering Group Paolo Bartalini CERN EP.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
Why do F77 always spoil the landscape ?. Several ideas … slide 2.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
Generator Services planning meeting Witek Pokorski
ImageJ2. Why ImageJ2? ● Support the next generation of image data ● Interoperate and collaborate with other projects ● Broaden the ImageJ community ●
Installation of the ALICE Software
SPI Infrastructure for LCG Software Projects
CEDAR Combined E-science Data Analysis Resource cedar. ac
How P3P Works Lorrie Faith Cranor P3P Specification Working Group Chair AT&T Labs-Research 4 February
SPI external software build tool and distribution mechanism
EvtGen Miniworkshop, Patrick Robbe LAL Orsay, 21 Jan 2005
SPI Software Process & Infrastructure
Simulation Project Structure and tasks
Generator Services planning meeting
LHCb Software Tutorial
LCG Monte-Carlo Events Data Base: current status and plans
eCulture Science Gateway – reloaded
Simulation Framework Subproject cern
Simulation Project Structure and tasks
Simulation Project Structure and tasks
Presentation transcript:

LCG Generator Services project Witek Pokorski 31.03.2010 MC4LHC readiness

Outline Overview of LCG Generator Services project Workpackages discussion Conclusion 31/03/2010 Witek Pokorski

LCG project 31/03/2010 Witek Pokorski

LCG Application Area Simulation Project 31/03/2010 Witek Pokorski

LCG Generator Services http://lcgapp.cern.ch/project/simu/generator/ mandate of the project: "...to prepare validated LCG compliant (generators) code for both the theoretical and experimental communities at the LHC..." to avoid duplication of work to build libraries for required platform to share experience between experiments to use common generators (tunings?) to offload authors from the 'basic support' duties Generator Services MC authors LHC Exp. 31/03/2010 Witek Pokorski

Project work packages generator libraries repository [GENSER] testing and validation of generators [VALIDATION] event record [HEPMC] maintained by Lynn Garren (FERMILAB) event database [MCDB] 31/03/2010 Witek Pokorski

GENSER centralized installation of all the MC generators used by LHC experiments on all the LCG supported platforms common structure for all the generators ready to use libraries tarfiles with binaries tarfiles with sources 31/03/2010 Witek Pokorski

Repository structure (1/3) /afs/cern.ch/sw/lcg/external/MCGenerators /pythia6 /pythia8 /herwig /herwig++ /jimmy ..... /distribution/.. For each generator: pythia8/130 /135 .... LCG tar files with sources and binaries 31/03/2010 Witek Pokorski

Repository structure (2/3) For each version: 135/share /x86_64-slc5-gcc43-opt /slc4_amd64_gcc34 ... For each platform: slc4_amd64_gcc34/compile.log /config.mk /include/ /lib/libpythia8.so /lib/archive/libpythia8.a 31/03/2010 Witek Pokorski

Repository structure (3/3) tarfiles: /afs/cern.ch/sw/lcg/external/MCGenerators/distribution/ pythia8-135-src.tgz pythia8-135-x86_64-slc5-gcc43-opt.tgz pythia8-135-slc4_amd64_gcc34.tgz pythia8-135-slc4_ia32_gcc34.tgz 31/03/2010 Witek Pokorski

Using GENSER to use libraries from AFS to use binary tarfiles link to /afs/cern.ch/sw/lcg/external/MCGenerators/... to use binary tarfiles download, unpack and link to use source tarfiles tar zxvf pythia6-413-src.tgz cd pythia6/413 ./configure --help ./configure --your-options make libraries go to pythia6/413/lib/ 31/03/2010 Witek Pokorski

Using GENSER - Bootstrap a set of tools to install GENSER generators following the same directory structure as on /afs/cern.ch can be used to create 'mirrors' of GENSER can be used to install individual generators in 'GENSER-like' way allows to have a common structure that other tools (HepMC Analysis, Rivet, MCTester) can rely on 31/03/2010 Witek Pokorski

Available generators (1/2) generator homepage some (minimal) info about the build (dependencies, etc) 31/03/2010 Witek Pokorski

Available generators (2/2) over 25 different generators available FORTRAN and the new C++ generators new versions installed with minimal delay binaries provided for several platforms Linux (all) MacOSX (most) Windows (some) new generators added on experiments' request 31/03/2010 Witek Pokorski

Testing and validation experiments used to independently test and validate each new version of the generator clear duplication of work GENSER testing and validation testing of generators on different platforms comparing different (new) versions of each generator physics validation (comparing to data) 31/03/2010 Witek Pokorski

GENSER testing simple tests 'single number' output, observable (charged multiplicity, etc) histogramming tests (to be replaced by HepMC Analysis Tool) distribution output (pT, etc) needs to be linked with ROOT physics validation Rivet validation 31/03/2010 Witek Pokorski

GENSER simple tests (1/2) at least one simple test per generator automatic checking between different versions of generators and platforms 31/03/2010 Witek Pokorski

GENSER simple tests (2/2) 31/03/2010 Witek Pokorski

GENSER distribution tests NEEDS PORTING TO NEW GENERATORS SHOULD PROBABLY BE PORTED TO HEPMC ANALYSIS TOOL 31/03/2010 Witek Pokorski

GENSER validation using Rivet CDF_2001_S4751469 just starting to use Rivet in GENSER plan to have a collection of physics validation tests to be run on different generators especially LHC data 31/03/2010 Witek Pokorski

HepMC Analysis Tool validation (1/2) we certainly want to profit from the DESY group work and integrate it into GENSER tests infrastracture for automatic running/comparison so far: web page on the GENSER site created and Albert is filling it out 31/03/2010 Witek Pokorski

HepMC Analysis Tool validation (2/2) 31/03/2010 Witek Pokorski

HepMC (1/2) 31/03/2010 Witek Pokorski

HepMC (2/2) de facto standard for HEP events Lynn Garren maintaining the code changes and new features discussed within the community two HepMC planning meetings per year one major release per year (unless the second one is strictly necessary) bugfixes released as soon as possible currently preparing HepMC 2.06 31/03/2010 Witek Pokorski

MCDB (1/2) 31/03/2010 Witek Pokorski

MCDB in Production, lessons of last year (2/2) Current content and contributors: 8966 event samples with parton level MC (1.65 TB) 586 articles (384 publicly available) 60 authors Stable interfaces: WEB interface (authors and users) Automatic uploading and documenting of new LHEF files (MadGraph and HepML headers are supported) Automatic access to the content of MCDB (C++) Automatic interfaces are implemented in CMSSW and used for CMS production (MCDB is accessible from LHEInterface in CMSSW) 31/03/2010 Witek Pokorski

New stable release of HepML arXiv:1001.2576 HepML is the unified XML based description of parton level MC model (is used in the header of LHEF file or as a standalone XML block) XML schemes C++ library to write/read/modify HepML blocks New stable version of libhepml is released HepML documents creating, parsing and mixing; support for standard Xerces and Expat XML libraries; autotools support Can be easily added to ME or SH MC generator to describe the events (TH model parameters, generator parameters, cuts, etc.) Already used in CompHEP, MCDB, CMSSW Available at http://mcdb.cern.ch/distribution and http://svnweb.cern.ch/guest/lcghepml/tags/0.2.6/ 31/03/2010 Witek Pokorski

Generator Services plans involvement in the join tuning exercise repository of tuning tools repository/web resources with different tunes documented, validated, compared, etc tuning/validation of generators using publicly available data repository of NLO tools contribution to LHC data 'publication' common format (?) feeding into HEPDATA (?) 31/03/2010 Witek Pokorski

Conclusions Generator Services proves to play a useful role for the LHC experiments generators repository testing event record MC event database Generator Services future plan is to contribute more to the physics validation and tuning of the generators 31/03/2010 Witek Pokorski