20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.

Slides:



Advertisements
Similar presentations
Introduction to Eclipse. Start Eclipse Click and then click Eclipse from the menu: Or open a shell and type eclipse after the prompt.
Advertisements

Configuration management
Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
MP IP Strategy public Stateye Training (Getting Started) Please enable author’s notes for a textual description of the slides. A audio file.
July 2010 D2.1 Upgrading strategy Javier Soto Catalog Release 3. Communities.
Programming Types of Testing.
Software Quality Assurance Inspection by Ross Simmerman Software developers follow a method of software quality assurance and try to eliminate bugs prior.
Concepts of Version Control A Technology-Independent View.
Principles of Procedural Programming
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
What is so good about Archie and RevMan 5
Git for Version Control These slides are heavily based on slides created by Ruth Anderson for CSE 390a. Thanks, Ruth! images taken from
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
by Chris Brown under Prof. Susan Rodger Duke University June 2012
Software Engineering Modern Approaches
Software Engineering 2003 Jyrki Nummenmaa 1 CASE Tools CASE = Computer-Aided Software Engineering A set of tools to (optimally) assist in each.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 Software Process panel SPI GRIDPP 7 th Collaboration Meeting 30 June – 2 July 2003 A.Aimar -
…using Git/Tortoise Git
SWEN 302: AGILE METHODS Roma Klapaukh & Alex Potanin.
4 November Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Development, validation and.
© Blackboard, Inc. All rights reserved. Deploying a complex building block Andre Koehorst Learning Lab Universiteit Maastricht, the Netherlands July 18.
Progress with migration to SVN Part3: How to work with g4svn and geant4tags tools. Geant4.
LCG Generator, October 16 th 2003 Introduction to the October LCG Generator meeting Paolo Bartalini CERN.
1 / 22 AliRoot and AliEn Build Integration and Testing System.
Alexander Toropin Generator Services monthly meeting 6 June 2007 GENSER status.
Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Dmitri Konstantinov 26 March
May 7, We manage documents and their changes with versioning and check out/check in procedures.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
PRS Session, May 12, 2006Filip Moortgat, ETHZ Generator Interface Generator Interface in CMSSW existing/planned interfaces with generators content of the.
LCG Application Area Meeting, March 10 th 2004 Status of LCG Generator Paolo Bartalini, CERN/PH.
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
G4MICE Status and Plans 1M.Ellis - CM24 - RAL - 31st May 2009  Firstly, a correction to the agenda:  I failed to spot a mistake in the agenda that I.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Semi-Automatic patch upgrade kit
Analysis trains – Status & experience from operation Mihaela Gheata.
14th Oct 2005CERN AB Controls Development Process of Accelerator Controls Software G.Kruk L.Mestre, V.Paris, S.Oglaza, V. Baggiolini, E.Roux and Application.
12/8/2015PLC Software Configuration WG - CCB1 PLC Software Configuration WG Members Philippe Gayet Fréderic Havart Renaud Barillère [Mathias Dutour]
WinCvs. WinCVS WinCvs is a window based version control system. Use WinCvs when  You want to save every version of your file you have ever created. CVS.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
C++ LANGUAGE TUTORIAL LESSON 1 –WRITING YOUR FIRST PROGRAM.
PESAsim – the e/  analysis framework Validation of the framework First look at a trigger menu combining several signatures Short-term plans Mark Sutton.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
1 Chapter 12 Configuration management This chapter is extracted from Sommerville’s slides. Text book chapter 29 1.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
1 Update on tt-bar signal and background simulation Stan Bentvelsen.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
Generator Services planning meeting Witek Pokorski
Krzysztof Genser/Fermilab For the Fermilab Geant4 Performance Team.
Geant4 is a toolkit to simulate the passage of particles through matter, and is widely used in HEP, in medical physics and for space applications. Ongoing.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
MC4LHC w/s July Activities promoted by LCG-Generator Supporting Monte Carlo Generators in the LHC era P. Bartalini (University of Florida)
27/02/04 ATLAS weekTileCal Athena tutorial, part 21 TileCal Athena tutorial Part 2: Reading GEANT hits from ZEBRA and POOL Reading HLT and testbeam ByteStream.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
Introduction to FCC Software FCC Istanbul 11 March, 2016 Alice Robson (CERN/UNIGE) on behalf of / with thanks to the FCC software group.
Why do F77 always spoil the landscape ?. Several ideas … slide 2.
Text2PTO: Modernizing Patent Application Filing A Proposal for Submitting Text Applications to the USPTO.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
1 April 2, Software Packaging and Releasing Best Practices William Cohen NCSU CSC 591W April 2, 2008.
LCG Generator Services project
Gaudi software release procedures
Generator Services planning meeting
Releases and developments
CVS revisions UML diagram
Carthage ios 8 onwards Dependency manager that streamlines the process of integrating the libraries into the project.
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Presentation transcript:

20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting 20 October 2005

20 October 2005 LCG Generator Services monthly meeting, CERN 2 Outline Preparation of new GENSER release Monte Carlo validation in GENSER - Basic sanity checks - Physics tests New versions of generators Small changes concerning some generator packages New tools Order of libraries in examples ROOT libraries Conclusions

20 October 2005 LCG Generator Services monthly meeting, CERN 3 Preparation of new GENSER release Procedure of preparation of new GENSER release starts from looking for new versions of generators already installed. Another problem is the installation of new generators. In this case should be confirmation from author to have his generator incorporated in GENSER. GENSER has own files structure. As usual it is different from layout of authors version. So at the first step the new version is adapted to the structure of existed GENSER release. When everything works without any problem the new version of generator is committed to GENSER CVS with a tag corresponding the version number. A couple of weeks before the date proposed for new GENSER release we start to make prereleases of new release. They have the same functionality as release but with possible bugs. As soon as prerelease is accessible we start to test it.

20 October 2005 LCG Generator Services monthly meeting, CERN 4 Preparation of new GENSER release During tests of prerelease additional problems could be found and sometimes can arrive additional bug fixes and modifications of versions from authors. For GENSER_1_2_0 were prepared 4 prereleases. After the first prerelease was done a decision was made to add Sherpa after discussion with authors. It had some instability in examples. After the second prerelease arrived bug fix for Herwig and it was modified to Herwig due to authors instructions. When the third prerelease was done authors of Photos asked to install Photos-2.15 instead of installed for prerelease 1 Photos The new version has special possibility to switch debugging printout from any suspicious event which could be very useful in the case of wrong behavior of Photos for some events. A number of installation bugs was fixed as well during this procedure of testing prereleases.

20 October 2005 LCG Generator Services monthly meeting, CERN 5 Preparation of new GENSER release Then all bugs and modifications are fixed the information about new versions are stored in generators_list.dat. Typical string in this file looks like this generator name tag version pythia pythia _324 The preparation of this information is responsibility of current Integrator. Then this information is ready the Librarian prepares new prerelease or release with special script.

20 October 2005 LCG Generator Services monthly meeting, CERN 6 Basic sanity checks The generators packages could have some bugs. The sources of these bugs could be in code itself and another bugs could be produced during implementation procedure. All generators packages have examples areas. As usual in this areas mainly the tests proposed by authors are present. The routine testing procedure is the following: Check if all examples were able to finish without crash. No error messages at the end of events processing. Estimating by an eye quality of produced results. It means - check if calculated cross sections are in reasonable limits, - momenta of produced particles have reasonable values, - IDs of produced particles are reasonable, - distributions of some physical quantities if they are presented have reasonable shapes. Comparison with any reference data if they exist.

20 October 2005 LCG Generator Services monthly meeting, CERN 7 Physics tests Only physics tests can ensure that there is no wrong behavior in new versions of generators. To make physics tests of some generators the tests package was developed by M.Kirsanov. The purpose of this package is to make fast and efficient way to test the most usable generators. These tests could be also useful for education of new users. Now in the test list are Pythia, Herwig, Alpgen, Evtgenlhc. To make these tests the process was chosen. During testing procedure the events are simulated and processed by simple program to reconstruct leptons and jets. For each generator in a special file four values are saved: total cross section of process and error in this value, fraction of events with number of leptons not less than 2 and number of jets not less than 1 and an error in this value. It is supposed this values have the Gaussian distributions. The reference file with the same values also exists in working directory.

20 October 2005 LCG Generator Services monthly meeting, CERN 8 Physics tests For these tests direct outputs from Pythia and Herwig were used, Evtgenlhc was used with Photos and Alpgen was used with Pythia to make fragmentation. Another program called by testing script checks the validity of obtained values by comparison of given value with the error in this value. If this validity is not enough good from the point of view of testing procedure program asks to increase statistics. If this test was passed program compares the given value with the reference one. If criteria of program were satisfied it writes its conclusion into small output file results.dat. From contents of this file one can easily conclude if the tested versions of generators are different from the previous versions.

20 October 2005 LCG Generator Services monthly meeting, CERN 9 Fragmentation tests in Alpgen package To make tests of fragmentation with Pythia and Herwig two scripts fragmPythia and fragmHerwig were added to examples directory of Alpgen package. For these tests the examples of M.Kirsanov from GENSER tests package to produce Z+jet events were adapted. After simulation of 1000 events the programs at the end print the following Pythia Herwig (508) Two isolated leptons (381) Two or more jets (504) Two isolated leptons and jet (321) Two isolated leptons and two or more jets (103) These numbers are just to show how the programs work and should be properly normalized to use as reference numbers. Here tests with Pythia_6.324 and Herwig_6.507 were done with GENSER_1_1_0, test with Herwig_6.508 was done with GENSER_1_2_0

20 October 2005 LCG Generator Services monthly meeting, CERN 10 New versions of generators in GENSER Generator Version Date of Release alpgen feynhiggs herwig lhapdf photos pythia sherpa All of them were tested. Only Sherpa sometimes shows instability.

20 October 2005 LCG Generator Services monthly meeting, CERN 11 Small improvements concerning some generator packages All references to Pythia in BuildFiles is set to All references to Herwig in Buildfiles is set to All references to Photos in Buildfiles is set to 2.15 Some of README were modified to make statements more correct due to some changes in generators packages Added README to examples directories of some generators To produce these modifications tags of corresponding generators were modified (tag+=1) to keep the same versions and do not interfere with previous GENSER releases. In /hijing/examples/BuildFile was added string because compiler complains about missing paw library. Tag was tot changed.

20 October 2005 LCG Generator Services monthly meeting, CERN 12 New Tools buildLhapdf script installs lhapdf from tgz file buildAlpgen script installs Alpgen generator from tgz cmpgen script makes comparison of file structures between different versions of the same generator cmpgenHEAD script makes comparison of file structures between HEAD version of generator and another version The last two scripts produces the list of files marked them as an old or new ones if any difference exists in file systems. Scripts skips CVS service files. From this list one can decide if file should be removed from CVS repository or added. All these scripts work from the genser directory in the following directory structure /genser/simu/GENSER/ - the HEAD version /genser/simu/GENSER_1_2_0/ - the current version

20 October 2005 LCG Generator Services monthly meeting, CERN 13 Order of libraries in examples Up to GENSER_1_1_0 in examples directories of each generator using scram the order of libraries during link time was the following: user-archive, lcg-archive, user-shared, lcg-shared, where lcg = /afs/cern.ch/sw/lcg/app/release/GENSER/GENSER_x_x_x/$SCRAM_ARCH/lib By default GENSER is producing shared libraries. In this order of libraries any user modifications in generator codes could be applied only to archive libraries. Shared libraries are unreachable in this configuration. For the new release GENSER_1_2_0 only two libraries was left for default configuration user-shared, lcg-shared. For this purpose in the file /GENSER_1_2_0/config/compilers.mk two strings were commented #LDFLAGS+=-L$(LOCALTOP)/$(SCRAM_ARCH)/lib/archive \ # -L$(RELEASETOP)/$(SCRAM_ARCH)/lib/archive To have possibility to use archive libraries from tests package in automatical testing procedure for some generators these two strings were added to BuildFile-xxx-arch in the corresponding packages. These strings could be inserted into any BuildFile to use archive libraries. To have archive libraries in all project by default one can uncomment these strings in the file compilers.mk.

20 October 2005 LCG Generator Services monthly meeting, CERN 14 ROOT libraries GENSER_1_2_0 is constructed using official LCG configuration tools from SPI. It has only 3 ROOT libraries connected by default Cint, Core, Tree. In /evtgenlhc/1_3/examples and /tests/1_00/examples we need also Hist library. A string was added to the BuildFiles of these packages. In the same way another ROOT applications (Gpad, Graf, Matrix, Physics, Postscript) could be connected to your program. In previous release of GENSER these applications were added in the file /GENSER_1_1_0/.SCRAM/ToolFiles/root_x_xx_xx.

20 October 2005 LCG Generator Services monthly meeting, CERN 15 Conclusions  The new release GENSER_1_2_0 is tested and ready to use.  Some modifications were done in ordering of libraries in examples directories to improve performance.  The number of generators involved into automatical testing procedure by using physical processes should be increased.