1. Short to middle term GRID deployment plan for LHCb
Eric van Herwijnen
Wednesday, 5 July 2000

2. Overview
GRID unique opportunity to unify CPU resources in the collaborating institutes
Need a common deployment plan
Mini project
EU GRID project submitted

3. LHCb WP8 application (F. Harris)
MAP Farm(300 cpu) at Liverpool to generate 107 events over 4 months.
Data volumes transferred between facilities:
Liverpool to RAL 3TB (RAW,ESD,AOD,TAG)
RAL to Lyon/CERN 0.3TB (AOD and TAG)
Lyon to LHCb inst. 0.3TB (AOD and TAG)
RAL to LHCb inst. 100GB (ESD for sys. studies)
Physicists run jobs at regional centre or move AOD & TAG data to local institute and run jobs there.
Also, copy ESD for 10% of events for systematic studies.
Formal Production scheduled  start 2002 to mid-2002 (EU schedule)
BUT we are pushing ahead to get experience so we can define project requirements
Aim for a ‘production’ run by end 2000
On basis of experience will give input on HEP application needs to the Middleware groups

4. LHCb GRID working group
Glenn Patrick
Chris Brew
Frank Harris
Ian McArthur
Nick Brook
Girish Patel
Themis Bowcock
Eric van Herwijnen
first meeting june 14th, RAL

5. Mini project (1) Install Globus 1.1.3 at CERN, RAL and Liverpool
CERN: installation completed on a single Linux node (pcrd25.cern.ch) running Redhat 6.1, not available to public yet
RAL: installed but not yet tested
MAP: being installed
Members to get access to respective sites
Eric and Glenn have access to CERN.
Eric, Glenn, and Chris have access to RAL.
Girish has access to MAP.
Timescale: 2nd week in july

6. Mini project (2)
1st checkpoint during LHCb software week, Wednesday 5 july
inform collaboration
invite other members to join
Run SICBMC at CERN, RAL and Liverpool
Eric to prepare a script using Globus commands to run sicbmc and copy the data back to the host where the job was executed from
Other partners to test the script from their sites
Timescale: end of july

7. Mini project (3)
Verify data can be shipped back to CERN and written onto tape
Use globus commands
Some scripting required to use SHIFT and update bookkeeping database
Time scale: early August
Second checkpoint meeting at Liverpool 2nd half of August
Benchmark sustained datatransfer rates
Report completed project at LHCb week in Milano

8. Integration of the GRID between CERN, RAL and MAP (1)
Eric, Chris, Glenn, Girish and Gareth attended course at RAL during 21,22 june:
Globus toolkit has a C API (easy to integrate with Gaudi)
Globus commands for remotely running scripts (or executables), recovering data from std output, saving consulting metadata through LDAP
The gains:
Everyone uses the same executable
Everyone uses the same scripts
Data is handled in a uniform way
Batch system (LSF, PBS, Condor) to be discussed in Lyon on june 30th

9. Integration of the GRID between CERN, RAL and MAP (2)
Explore the use of LDAP for our bookkeeping database:
API in C would solve current Oracle -> Gaudi interface problem
Simplification of DB updating by MC production
Everybody is heading in this direction
Oracle have an LDAP server product, someone should investigate
Java job submission tools should be modified to create Globus jobs. Timescale: October (to be done in parallel with current NT production)

10. Integration of the GRID between CERN, RAL and MAP (3)
RAL NT farm to be converted to Linux this autumn
MAP uses Linux
CERN have been asked to install Globus on the Linux batch service (Tony Cass)
Should LHCb abandon NT for MC production? To be discussed with collaboration next sw week
A full MC production run using Globus is aimed for in december

11. Extension to other institutes
Establish a “GRID” architecture:
Intel PCs running Linux Redhat 6.1
LSF, PBS or Condor for job scheduling
Globus for managing the GRID
LDAP for our bookkeeping database
java tools for connecting production, bookkeeping & GRID