Marco Cattaneo Core software programme of work Short term tasks (before April 2012) 1.

Slides:



Advertisements
Similar presentations
Module 13: Performance Tuning. Overview Performance tuning methodologies Instance level Database level Application level Overview of tools and techniques.
Advertisements

6/4/20151 Introduction LHCb experiment. LHCb experiment. Common schema of the LHCb computing organisation. Common schema of the LHCb computing organisation.
INFSO-RI An On-Demand Dynamic Virtualization Manager Øyvind Valen-Sendstad CERN – IT/GD, ETICS Virtual Node bootstrapper.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
Configuration Management Process and Environment MACS Review 1 February 5th, 2010 Roland Moser PR a-RMO, February 5 th, 2010 R. Moser 1 R. Gutleber.
Abstract The automated multi-platform software nightly build system is a major component in the ATLAS collaborative software organization, validation and.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
INFSO-RI Enabling Grids for E-sciencE The gLite Software Development Process Alberto Di Meglio CERN.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Overview of LHCb applications and software environment LHCb software tutorial - March
Nick Brook Current status Future Collaboration Plans Future UK plans.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
Progress with migration to SVN Part3: How to work with g4svn and geant4tags tools. Geant4.
Module 10 Administering and Configuring SharePoint Search.
ATLAS Grid Data Processing: system evolution and scalability D Golubkov, B Kersevan, A Klimentov, A Minaenko, P Nevski, A Vaniachine and R Walker for the.
Organization and Management of ATLAS Nightly Builds F. Luehring a, E. Obreshkov b, D.Quarrie c, G. Rybkine d, A. Undrus e University of Indiana, USA a,
Future Framework John Baines for the Future Framework Requirements Group 1.
U.S. ATLAS S&C Planning Meeting - June ATLAS Software Infrastructure : Requirements and Goals at Run 2 Period Alex Undrus.
LHCb Lausanne Workshop, 21st March /12 Tracking Software for DC’06 E. Rodrigues, NIKHEF LHCb Tracking and Alignment Workshop  To do list, and done.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LHCb-ATLAS GANGA Workshop, 21 April 2004, CERN 1 DIRAC Software distribution A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
LHCbComputing Manpower requirements. Disclaimer m In the absence of a manpower planning officer, all FTE figures in the following slides are approximate.
B. Hegner, P. Mato, P. Mendez CERN, PH-SFT Group 1 ST FORUM CERN 28-SEP-2015 THE QUALITY AND TESTING INFRASTRUCTURE OF PH-SFT.
Providing a coherent view of SFT products to potential new users Stefan Roiser PH/SFT.
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
Firmware - 1 CMS Upgrade Workshop October SLHC CMS Firmware SLHC CMS Firmware Organization, Validation, and Commissioning M. Schulte, University.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
LHCbComputing LHCC status report. Operations June 2014 to September m Running jobs by activity o Montecarlo simulation continues as main activity.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
LHCbComputing Lessons learnt from Run I. LHCbComputing Lessons learnt from Run I Growing pains of a lively teenager.
LHCb report to LHCC and C-RSG Philippe Charpentier CERN on behalf of LHCb.
Geant4 is a toolkit to simulate the passage of particles through matter, and is widely used in HEP, in medical physics and for space applications. Ongoing.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
LHCbDirac and Core Software. LHCbDirac and Core SW Core Software workshop, PhC2 Running Gaudi Applications on the Grid m Application deployment o CVMFS.
CERN Tutorial, September Overview of LHCb applications and software environment.
11/01/2012B.Couturier - Core Software Workshop 1 Software Development Infrastructure Main Topics Development tools Build and Release tools Tracking/Management.
Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
JRA1 Meeting – 09/02/ Software Configuration Management and Integration EGEE is proposed as a project funded by the European Union under contract.
LHCb 2009-Q4 report Q4 report LHCb 2009-Q4 report, PhC2 Activities in 2009-Q4 m Core Software o Stable versions of Gaudi and LCG-AA m Applications.
LHCb/DIRAC week A.Tsaregorodtsev, CPPM 7 April 2011.
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Analysis Model Zhengyun You University of California Irvine Mu2e Computing Review March 5-6, 2015 Mu2e-doc-5227.
Use of CMT in LHCb CMT Workshop, LAL (Orsay) 28 th February - 1 st March 2002 P. Mato / CERN.
Modularization of Geant4 Dynamic loading of modules Configurable build using CMake Pere Mato Witek Pokorski
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
Marco Cattaneo, 20-May Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Software Release Build Process and Components in ATLAS Offline Emil Obreshkov for the ATLAS collaboration.
Installation of the ALICE Software
How to Contribute to System Testing and Extract Results
Dockerize OpenEdge Srinivasa Rao Nalla.
CMS High Level Trigger Configuration Management
ALICE analysis preservation
BDII Performance Tests
ATLAS Software Distribution
Generator Services planning meeting
Status of Brunel team and next steps
LHCb Conditions Database TEG Workshop 7 November 2011 Marco Clemencic
Presented by: Anusha Kolla
Oracle Architecture Overview
SEAL Project Core Libraries and Services
Planning next release of GAUDI
Presentation transcript:

Marco Cattaneo Core software programme of work Short term tasks (before April 2012) 1

Marco Cattaneo Software development tools  Development infrastructure Nothing urgent?  Build and release tools Major activity: reorganisation of procedures+infrastructure for software build, release, distribution, removal Many ideas, coupled also to introduction of CMake, dependencies DB Needs further discussion and design First steps:  Produce design document  build tar balls in the nightlies, repository for tarballs  use /cvmfs as default shared area in CERN login  Tagging and branching Set up working group to collect requirements for “tag collector” and prepare new design Provide low level tools to support SVN branches  Infrastructure monitoring Identify someone with experience with SLS sensors 2

Marco Cattaneo Platforms, compilers  gcc 4.6 on slc5 Almost there, include in next release stack Default platform at CERN if successful validation Use in HLT 2012?  Python 2.7 Prepare deployment plan including Dirac SetupProject LHCb + LHCbDirac must use compatible versions  icc11 on slc5 Only if requested for HLT 2012  CMake Finish Gaudi prototype by CHEP 2012  SetupProject + CMT Profiling. Deploy new CMT version if it speeds up setting the environment 3

Marco Cattaneo I/O optimisation  Working group to measure Root I/O performance of existing event data Memory, CPU, Latency with protocol access Dynamic tuning of Root I/O for typical access patterns Sequential access (reconstruction, stripping, event selection from (m)DST) Sparse access (analysis of selected (m)DST events)  Packed containers/converters for (m)DST Particles  Review of (m)DST content Necessity of Track States, Stripping reports, MC truth etc. 4

Marco Cattaneo CondDB  Deploy “pull” SQLite distribution with semi-automatic snapshots Urgent because current SQLDDDB release model not scaling SQLite distribution via CVMFS servers later  Implement run level skipping of events based on DQ flags File level skipping postponed indefinitely  Document use cases for tag “compatibility” Prerequisite for design of a tag compatibility database 5

Marco Cattaneo Software Optimisation  Identify a leader for software optimisation activity Set up working group to share experience, organise work  Define and document rules for reproducible results Files to download, job options etc.  In short term, concentrate on what could be deployed in HLT 2012 gcc46 + -O3 + architecture specific compiler flags icc11? Sasha’s profiling of Moore? 6

Marco Cattaneo Parallelisation and multi-core  Commission GaudiParallel for use in production Validation tools Handling of counters Interface to Dirac  Participation in concurrency project Define relevant demonstrators Involve applications experts to identify constraints of real applications 7

Marco Cattaneo Gaudi+LHCb  Release v23r0 Refactoring of GaudiSvc Migration to Gaudi of DetDesc etc. Support for gcc 4.6 LCGCMT 62 (or 63)?  Extension of DataOnDemandSvc 8

Marco Cattaneo Interface to LHCbDirac  Put XmlSummary in production to replace CheckLogFile Iterate with core software if necessary  Document API between Applications and Dirac To be implemented in ProdJob configurable etc.  Deploy persistency of XmlSummary What goes in bkk What goes to FSR What stays only in XmlSummary, available for how long  Bkk to add CondDB to job options 9