Krzysztof Genser/Fermilab For the Fermilab Geant4 Performance Team.

Slides:



Advertisements
Similar presentations
Making the System Operational
Advertisements

Copyright © SoftTree Technologies, Inc. DB Tuning Expert.
Company Confidential 1 © 2005 Nokia DBUpgradeTool_ ppt / / JMa A Database Upgrade Tool Nokia Networks Jukka Maaranen.
Ns-2 tutorial Karthik Sadasivam Banuprasad Samudrala CSCI 5931 Network Security Instructor : Dr. T. Andrew Yang.
Software Delivery. Software Delivery Management  Managing Requirements and Changes  Managing Resources  Managing Configuration  Managing Defects 
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The Division of Labor on a Campus Hosting Open Journal Systems and Open Conference Systems.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
The Geant4 physics validation repository
INSTALLATION OF WORDPRESS. WORDPRESS WordPress is an open source CMS, often used as a blog publishing application powered by PHP and MySQL. It has many.
GRID Workload Management System Massimo Sgaravatto INFN Padova.
1 Software Testing and Quality Assurance Lecture 30 – Testing Systems.
Swami NatarajanJuly 14, 2015 RIT Software Engineering Reliability: Introduction.
MSF Testing Introduction Functional Testing Performance Testing.
Microsoft ® Official Course Monitoring and Troubleshooting Custom SharePoint Solutions SharePoint Practice Microsoft SharePoint 2013.
FCC Software Status Report from a User’s Perspective Colin Bernet (IPNL) 18 March 2015 Code Contributors: Michele De Gruttola, Benedikt Hegner, Clément.
Presenter: Shant Mandossian EFFECTIVE TESTING OF HEALTHCARE SIMULATION SOFTWARE.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Chocolate Bar! luqili. Milestone 3 Speed 11% of final mark 7%: path quality and speed –Some cleverness required for full marks –Implement some A* techniques.
TESTING STRATEGY Requires a focus because there are many possible test areas and different types of testing available for each one of those areas. Because.
The D0 Monte Carlo Challenge Gregory E. Graham University of Maryland (for the D0 Collaboration) February 8, 2000 CHEP 2000.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
Working Out with KURL! Shayne Koestler Kinetic Data.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
RUP Implementation and Testing
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
XSEDE14 Reproducibility Workshop: Reproducibility in Large Scale Computing – Where do we stand Mark R. Fahey, NICS Robert McLay, TACC XSEDE14 - Reproducibility.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
HERA/LHC Workshop, MC Tools working group, HzTool, JetWeb and CEDAR Tools for validating and tuning MC models Ben Waugh, UCL Workshop on.
FNAL Geant4 Performance Group Issues and Progress Daniel Elvira for M. Fischler, J. Kowalkowski, M. Paterno.
Updating JUPITER framework using XML interface Kobe University Susumu Kishimoto.
A Networked Machine Management System 16, 1999.
Development, validation and maintenance of Monte Carlo event generators & generator services in the LHC era Dmitri Konstantinov 26 March
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Alexander Richards, UCL 1 Atlfast and RTT (plus DCube) Christmas Meeting 18/12/2007.
Semi-Automatic patch upgrade kit
Introduction to CMSSW Framework Concepts Simulation & Reconstruction Liz Sexton-Kennedy January 10, 2008.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
NSF Review, 18 Nov 2003 Peter Shawhan (LIGO/Caltech)1 How to Develop a LIGO Search Peter Shawhan (LIGO / Caltech) NSF Review November 18, 2003 LIGO-G E.
D R A T D R A T ABSTRACT Every semester each department at Iowa State University has to assign its faculty members and teaching assistants (TAs) to the.
Condor week – March 2005©Gabriel Kliot, Technion1 Adding High Availability to Condor Central Manager Gabi Kliot Technion – Israel Institute of Technology.
Network management Network management refers to the activities, methods, procedures, and tools that pertain to the operation, administration, maintenance,
Andrea Valassi (CERN IT-DB)CHEP 2004 Poster Session (Thursday, 30 September 2004) 1 HARP DATA AND SOFTWARE MIGRATION FROM TO ORACLE Authors: A.Valassi,
Software Tools for Layout Optimization (Fermilab) Software Tools for Layout Optimization Harry Cheung (Fermilab) For the Tracker Upgrade Simulations Working.
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
T EST T OOLS U NIT VI This unit contains the overview of the test tools. Also prerequisites for applying these tools, tools selection and implementation.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
20 October 2005 LCG Generator Services monthly meeting, CERN Validation of GENSER & News on GENSER Alexander Toropin LCG Generator Services monthly meeting.
The interface to EvtGen in CMS Roberto Covarelli University of Rochester EvtGen workshop, 06/12/2010.
SCD Monthly Projects Meeting 2014 Scientific Linux Update Rennie Scott January 14, 2014.
C++ Working Group Project Status Report Marc Paterno.
Geant4 GRID production Sangwan Kim, Vu Trong Hieu, AD At KISTI.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
CERN, 7 November 2011 Anton Pytel Slovak Technical University TRIP FROM GENERATORS TO GEOMETRIES.
Geant4 Computing Performance Task with Open|Speedshop Soon Yung Jun, Krzysztof Genser, Philippe Canal (Fermilab) 21 st Geant4 Collaboration Meeting, Ferrara,
SOFTWARE TESTING TRAINING TOOLS SUPPORT FOR SOFTWARE TESTING Chapter 6 immaculateres 1.
Marian Ivanov, Anar Manafov
The Use of AMET and Automated Scripts for Model Evaluation
Work report Xianghu Zhao Nov 11, 2014.
Kilohertz Decision Making on Petabytes
LCG Generator Services project
Generator Services planning meeting
ARTIFICIAL INTELLIGENCE IN SOFTWARE TESTING
Karthik Sadasivam Banuprasad Samudrala
Selecting detector geometry by Run Number
Data Challenge 1 Closeout Lessons Learned Already
Presentation transcript:

Krzysztof Genser/Fermilab For the Fermilab Geant4 Performance Team

 Walter Brown, Mark Fischler, Krzysztof Genser, Jim Kowalkowski, Marc Paterno, Ron Rechenmacher, Jason Torola  a part time involvement for all the members  With thanks to Sunanda Banerjee, Julia Yarba, Liz Sexton-Kennedy for their assistance. G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application2

 The goal is to routinely profile Geant4 using a realistic application.  Given Fermilab involvement in CMS using CMS software application was a natural choice.  Over last few months we have undertaken an effort to upgrade and to automate as much as possible the infrastructure/process we used for profiling of Geant4 in the past (e.g. when doing code reviews or optimizing the code).  The application is built/run on set of Fermilab US CMS nodes with CMSSW software installed. G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application3

 The full infrastructure is a set of scripts which take as an input a Geant4 tarball, a version of the CMSSW release, a configuration file specifying simulation parameters and an event generator input file. The Geant4 tarball replaces the Geant4 version used by CMS for a given CMSSW release.  The output is a set of performance related numbers/plots.  The simulation package is build on an interactive US CMS build node and run on a Condor farm. The build and run parameters are recorded in a database for each run.  As of now QGSP_BERT physics list & Z'->dijets Pythia event input file are used. G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application4

 The profiling itself is done using SimpleProfiler  C++ dynamic library collecting detailed call stack samples, using "libunwind" plus a set of auxiliary tools ▪ SimpleProfiler is a part of the FAST package, a collection of tools for gathering, managing, and analyzing data about code performance. See:  The data is uploaded into PerformanceDataBase  system (written using Ruby on Rails and MySQL) for recording performance run data and handling the assessment of the statistical significance of the timing differences.  Timing and function call measurements are a result of a number of runs on the previously mentioned Condor farm and uploading the information into the database. G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application5

 Migrating the system from the old to the new version of the SimpleProfiler  Debugging situations where SimpleProfiler does not recognize call stack functions or when libunwind incorrectly processes call stack or crashes.  Modifying the Performance Data Base to make classification of run and build configurations more convenient.  Adding scripts for automatic performance data analysis and presentation including plots pertaining to comparisons between different collections of test runs. G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application6

G4CPT Meeting, March 8th,2010Geant4 Profiling using CMS Simulation Application7