Outline: LHCb and LCG-AA Ph.Charpentier 01 10 100 111 01 1 01 01 00 01 01 010 10 11 01 00 B 00 l e.

Slides:



Advertisements
Similar presentations
CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Persistency Framework CORAL, POOL, COOL – Status and Outlook A. Valassi, R. Basset,
Advertisements

Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
1 Grid services based architectures Growing consensus that Grid services is the right concept for building the computing grids; Recent ARDA work has provoked.
6/4/20151 Introduction LHCb experiment. LHCb experiment. Common schema of the LHCb computing organisation. Common schema of the LHCb computing organisation.
Simulation Project Organization update & review of recommendations Gabriele Cosmo, CERN/PH-SFT Application Area Internal.
LHCb Quarterly Report October Core Software (Gaudi) m Stable version was ready for 2008 data taking o Gaudi based on latest LCG 55a o Applications.
TILC09, April 2009, Tsukuba P. Mato /CERN.  Former LHCb core software coordination ◦ Architect of the GAUDI framework  Applications Area manager.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
LCG Applications Area – Overview, Planning, Resources Torre Wenaus, BNL/CERN LCG Applications Area Manager LHCC Comprehensive Review.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
ROOT Application Area Internal Review September 2006.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
1 LCG-France sites contribution to the LHC activities in 2007 A.Tsaregorodtsev, CPPM, Marseille 14 January 2008, LCG-France Direction.
20/09/2006LCG AA 2006 Review1 Committee feedback to SPI.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
ARDA Prototypes Andrew Maier CERN. ARDA WorkshopAndrew Maier, CERN2 Overview ARDA in a nutshell –Experiments –Middleware Experiment prototypes (basic.
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
LHCb The LHCb Data Management System Philippe Charpentier CERN On behalf of the LHCb Collaboration.
1 LHCb on the Grid Raja Nandakumar (with contributions from Greig Cowan) ‏ GridPP21 3 rd September 2008.
CERN - IT Department CH-1211 Genève 23 Switzerland t COOL Conditions Database for the LHC Experiments Development and Deployment Status Andrea.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LHCb-ATLAS GANGA Workshop, 21 April 2004, CERN 1 DIRAC Software distribution A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
David Quarrie: ATLAS LCG Apps Area Feedback LCG Applications Area Internal Review – 30 March - 1 April ATLAS LCG Applications Area Feedback David.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
Feedback from LHC Experiments on using CLHEP Lorenzo Moneta CLHEP workshop 28 January 2003.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
CERN IT Department t LHCb Software Distribution Roberto Santinelli CERN IT/GS.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
LHCC Comprehensive Review of LCG - 25 Nov 2003 Experiment Integration and Validation David R. Quarrie CERN/LBNL
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
SEAL Project Overview LCG-AA Internal Review October 2003 P. Mato / CERN.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
LCG – AA review 1 Simulation LCG/AA review Sept 2006.
LHCb report to LHCC and C-RSG Philippe Charpentier CERN on behalf of LHCb.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
CERN Tutorial, September Overview of LHCb applications and software environment.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
LHCb status and plans Ph.Charpentier CERN. LHCb status and plans WLCG Workshop 1-2 Sept 2007, Victoria, BC 2 Ph.C. Status of DC06  Reminder:  Two-fold.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
Bologna Tutorial, June Overview of LHCb applications and software environment.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
LHCb Computing activities Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group.
LHCb 2009-Q4 report Q4 report LHCb 2009-Q4 report, PhC2 Activities in 2009-Q4 m Core Software o Stable versions of Gaudi and LCG-AA m Applications.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
LHCb D ata P rocessing S oftware J. Blouw, A. Zhelezov Physikalisches Institut, Universitaet Heidelberg DESY Computing Seminar, Nov. 29th, 2010.
Database Readiness Workshop Intro & Goals
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Gfal/lcg-util -> Gfal2/gfal2-util
LCG Generator Services project
LHCb Computing Model and Data Handling Angelo Carbone 5° workshop italiano sulla fisica p-p ad LHC 31st January 2008.
Generator Services planning meeting
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
Data Management cluster summary
R. Graciani for LHCb Mumbay, Feb 2006
LHCb Computing Philippe Charpentier CERN
LHCb status and plans Ph.Charpentier CERN.
Simulation and Physics
ATLAS DC2 & Continuous production
SEAL Project Core Libraries and Services
Presentation transcript:

Outline: LHCb and LCG-AA Ph.Charpentier B 00 l e

PhC LCG-AA Internal review2 LHCb Applications Simul. Gauss Analysis DaVinci MCHits DST Raw Data (r)DST MCParts GenParts Event model / Physics event model AOD Conditions Database Gaudi Digit. Boole Trigger Moore Recons. Brunel

PhC LCG-AA Internal review3 LHCb packages dependencies LHCb Online SEALPOOL RootExt.Libs GaussBooleBrunelPanoramixMoore Gaudi LCG Framework Applications PhysRecLbcom Event Model DaVinci Component projects COOL CORAL Geant4 GENSER : depends : uses

PhC LCG-AA Internal review4 LCG-AA dependencies m LHCb applications depend on LCG-AA through Gaudi o Persistency: POOL o Conditions DB: COOL o Event model: physics vectors, SVectors, SMatrix from ROOT P No more CLHEP dependency (new event model) except through Geant4, HepMC o Simulation: Geant4 (Giga), generators from GENSER, HepMC o No direct dependency on CORAL nor on SEAL (but need all libraries…) o Minimum of PI needed integrated in Gaudi m SPI dependencies o Externals: direct dependency (GSL, Boost, Python, Xerces…), plugins (gfal, lfc, castor, dcache…) o LCGCMT for build (LHCb uses CMT) o Savannah for bug and feature tracing P Gaudi, applications, but also DIRAC, GANGA m Platforms used o slc3_gcc323, moving to slc4_gcc34. Windows VC debug version o Interest in MacOS

PhC LCG-AA Internal review5 SPI m LHCb build relies on LCGCMT o Acknowledge CMT interfaces for external projects P Should separate build and runtime dependencies P LHCb script used for setting run time environment for plugins o LHCb would like to be able to rebuild from source (for non- supported platforms) P Might be facilitated by AA using CMT m LCG externals o Very positive, AA flexible for adding new packages m Releases o Tarfiles should be built automatically and systematically o doxytag files should be produced automatically (our doc relies on it)

PhC LCG-AA Internal review6 SPI (cont’d) m Middleware client libraries (part of lcg/externals) o Good (necessary) to have full control of versions P Impossible to rely on Grid-installed versions o Better liaison needed with developers o Why not deploy client libraries only through lcg/externals? P Libraries (gfal, lfc, castor, dcache_client) P Setting the UI environment breaks AA dependencies P … thus release most common LCG commands (already there) d lcg_utils, grid-proxy-init… d need for repackaging (globus comes through globusrls ;-))

PhC LCG-AA Internal review7 Persistency m POOL o No need for File Catalog support besides XML (gfal ROOT plugin) o Stable and reliable o LHCb contributes to storage manager (M.Frank) m CORAL o No direct dependency m COOL o Basis for our Conditions DB o LHCb contributes to COOL Core development (M.Clemencic) o Framework completed for seamless update of calibrations and alignment from Conditions o Migration from XML files to CondDB to take place in coming months P SQLite slice used for simulation P ORACLE DB used at Tier1s & CERN for reconstruction / analysis P Replication through 3D (ORACLE streaming)

PhC LCG-AA Internal review8 ROOT m REFLEX, RELAX used by persistency (+ ROOT IO) and GaudiPython (through PyROOT) m Event model moved from CLHEP to ROOT new vector and matrix classes o Contribution to packages evaluation and SMatrix (symmetric matrices) o Used successfully for DC06 software releases m File access: support for all file access protocols needed o rfio, rootd, dcap, gsidcap o Use gfal for file access and/or file staging (Gaudi event access service) - from LFN, SURL or tURL o Plugins need testing and version control P Problems of server version compatibility? P Client libraries should all be backward compatible P How to back port bug fix releases of plugins (cf rfio recently)

PhC LCG-AA Internal review9 ROOT (cont’d) m LHCb still has legacy data and hence software…. o Uses ROOT 3! o Ported Castor2 plugin to ROOT 3 o Not clear how long this support can go (LHCb would need it until end 2006) m PROOF o LHCb watching developments o Currently considering more batch analysis using Ganga / DIRAC / LCG grid (job splitting, result merging) m Plugin and component model o Convergence needed between SEAL and ROOT. o Gaudi could use it instead of its own (see review 2005) m General remark o Beware to concentrate on LHC top priorities….

PhC LCG-AA Internal review10 Simulation m Simulation production performed on the GRID o all software distributed to the sites  ship only necessary libraries and input data m Almost all generator libraries from GENSER area o HepMC for event record P schema evolution o Generators integrated in Gauss simulation framework o Pythia , LHAPDF 4.2, Photos for DC06 production (PDFLIB in DC04 no longer used) P libraries cannot be removed from LCG area without agreement o Herwig , Hijing 1.383bs not yet used for central productions P work in progress for integration of Sherpa o Private LHCb version of EvtGen (adapted from BaBar) and of BcVegPy P EvtGenLHC in GENSER based on LHCb version o Initial problems with granularity of libraries P better now for remote distributions, could be improved further P at CERN link directly with GENSER areas

PhC LCG-AA Internal review11 Simulation (cont’d) m GEANT4 used in Gauss for production of data for physics studies since DC04 o Version 7.1.p01a used in DC06 o Due to DC06 production Gauss has not yet been ported to version 8.1 o Stable production ongoing m Source taken from GEANT4 area and global libraries built in LHCb with CMT o allow fast bug fixes to be introduced for example for problems identified in production P good communication with GEANT4 team m FLUKA used for radiation studies at CERN o library downloaded from web site

PhC LCG-AA Internal review12 Management and release cycles m Management o Very effective Architects Forum biweekly meetings o Easy to reach consensus for next steps o Need for closer integration of Grid client libraries P LCG developers’ and deployment representative in AF m Release cycles o Improvement with the policy used since spring o Still could be faster for rebuild releases o Tarfiles and doc to be built automatically with releases o Useful to have a preview (LCGCMT_HEAD) o LHCb cannot pick up all releases, but easy to make plans if LCG- AA follows the agreed schedule

PhC LCG-AA Internal review13 Conclusions m LHCb is fully using LCG-AA o All projects, directly or indirectly m LHCb is generally satisfied with the service provided o Efficient organisation o Improved release cycle m Looking forward to better integration of external Grid / fabric software m Ready to face the challenge of real data… when they come