Short to middle term GRID deployment plan for LHCb Eric van Herwijnen Wednesday, 5 July 2000

Overview GRID unique opportunity to unify CPU resources in the collaborating institutes Need a common deployment plan Mini project EU GRID project submitted

LHCb WP8 application (F. Harris) MAP Farm(300 cpu) at Liverpool to generate 107 events over 4 months. Data volumes transferred between facilities: Liverpool to RAL 3TB (RAW,ESD,AOD,TAG) RAL to Lyon/CERN 0.3TB (AOD and TAG) Lyon to LHCb inst. 0.3TB (AOD and TAG) RAL to LHCb inst. 100GB (ESD for sys. studies) Physicists run jobs at regional centre or move AOD & TAG data to local institute and run jobs there. Also, copy ESD for 10% of events for systematic studies. Formal Production scheduled  start 2002 to mid-2002 (EU schedule) BUT we are pushing ahead to get experience so we can define project requirements Aim for a ‘production’ run by end 2000 On basis of experience will give input on HEP application needs to the Middleware groups

LHCb GRID working group Glenn Patrick Chris Brew Frank Harris Ian McArthur Nick Brook Girish Patel Themis Bowcock Eric van Herwijnen first meeting june 14th, RAL

Mini project (1) Install Globus 1.1.3 at CERN, RAL and Liverpool CERN: installation completed on a single Linux node (pcrd25.cern.ch) running Redhat 6.1, not available to public yet RAL: installed but not yet tested MAP: being installed Members to get access to respective sites Eric and Glenn have access to CERN. Eric, Glenn, and Chris have access to RAL. Girish has access to MAP. Timescale: 2nd week in july

Mini project (2) 1st checkpoint during LHCb software week, Wednesday 5 july inform collaboration invite other members to join Run SICBMC at CERN, RAL and Liverpool Eric to prepare a script using Globus commands to run sicbmc and copy the data back to the host where the job was executed from Other partners to test the script from their sites Timescale: end of july

Mini project (3) Verify data can be shipped back to CERN and written onto tape Use globus commands Some scripting required to use SHIFT and update bookkeeping database Time scale: early August Second checkpoint meeting at Liverpool 2nd half of August Benchmark sustained datatransfer rates Report completed project at LHCb week in Milano

Integration of the GRID between CERN, RAL and MAP (1) Eric, Chris, Glenn, Girish and Gareth attended course at RAL during 21,22 june: Globus toolkit has a C API (easy to integrate with Gaudi) Globus commands for remotely running scripts (or executables), recovering data from std output, saving consulting metadata through LDAP The gains: Everyone uses the same executable Everyone uses the same scripts Data is handled in a uniform way Batch system (LSF, PBS, Condor) to be discussed in Lyon on june 30th

Integration of the GRID between CERN, RAL and MAP (2) Explore the use of LDAP for our bookkeeping database: API in C would solve current Oracle -> Gaudi interface problem Simplification of DB updating by MC production Everybody is heading in this direction Oracle have an LDAP server product, someone should investigate Java job submission tools should be modified to create Globus jobs. Timescale: October (to be done in parallel with current NT production)

Integration of the GRID between CERN, RAL and MAP (3) RAL NT farm to be converted to Linux this autumn MAP uses Linux CERN have been asked to install Globus on the Linux batch service (Tony Cass) Should LHCb abandon NT for MC production? To be discussed with collaboration next sw week A full MC production run using Globus is aimed for in december

Extension to other institutes Establish a “GRID” architecture: Intel PCs running Linux Redhat 6.1 LSF, PBS or Condor for job scheduling Globus 1.1.3 for managing the GRID LDAP for our bookkeeping database java tools for connecting production, bookkeeping & GRID