The EDG Testbed Introduction and Setup The European DataGrid Project Team

The EDG Testbed Intro and Setup Tutorial - n° 2 Contents  User’s Perspective of the Grid  Grid Services  Hardware Components of an EDG Testbed  The EDG Testbed Configuration  How to set up an EDG Testbed n Obtaining code n Configuring different machines

The EDG Testbed Intro and Setup Tutorial - n° 3 A 3 Tier Business Architecture ClientApplication Server Data Server Request Result Data Request User Interface Computing Element/ Worker Nodes Storage Element On the EDG:

The EDG Testbed Intro and Setup Tutorial - n° 4 Situation on a Grid

The EDG Testbed Intro and Setup Tutorial - n° 5 Information Services  Hardware: n EDG Information Service n Information Providers  Data: n Replica Catalog  Software & Services: n EDG Grid Services: s Information Service n Application Services: s Currently only EDG applications directly supported Machine Types:  Information Service (IS)  Replica Catalog (RC)

The EDG Testbed Intro and Setup Tutorial - n° 6 Situation on a Grid Cont’d Info Service Information Providers Replica Catalog

The EDG Testbed Intro and Setup Tutorial - n° 7 Main EDG Grid Services  Authentication & Authorization  Job submission service n Resource Broker  Replica Management n Grid Data Mirroring Package (GDMP) n EDG-Replica-Manager (Globus Replica Manager) n Mass storage system support  Logging & Bookkeeping

The EDG Testbed Intro and Setup Tutorial - n° 8 EDG Logical Machine Types  User Interface (UI)  Information Service (IS)  Computing Element (CE) n Frontend Node n Worker Nodes (WN)  Storage Element (SE)  Replica Catalog (RC)  Resource Broker (RB)

The EDG Testbed Intro and Setup Tutorial - n° 9 Services per Machine Type DeamonUIISCE (frontend ) WNSERCRB Globus Gatekeeper Replica Catalog GSI-enabled FTPd Globus MDS Info-MDS Broker Job submission Information Index Logging & Bookkeeping Local Logger CRL Update Grid mapfile Update RFIO GDMP

The EDG Testbed Intro and Setup Tutorial - n° 10 A Simple Testbed Configuration User Interface Resource Broker Replica Catalog Information Service Storage Element 1 Storage Element 2 Computing Element 1 Computing Element 2 “CLOSE”

The EDG Testbed Intro and Setup Tutorial - n° 11 Current EDG Testbed CERN Lyon RAL ManchesterNIKHEF Reference site: CERN Testbed1 EDG sites NorduGrid Italy: Bologna Cagliari Catania Milano Padova Parma Pisa Roma Torino NorduGrid: Bergen Copenhagen Helsinki Lund Oslo Stockholm Uppsala

The EDG Testbed Intro and Setup Tutorial - n° 12 Example CERN Testbed Structure

The EDG Testbed Intro and Setup Tutorial - n° 13 Example IS Content Site: NIKHEF CE tbn09.nikhef.nl:2119/jobmanager-pbs-qlong: - PBS queue "qlong" with 96 hours time limit - Software installed: CMS ATLAS ALICE LHCb IDL-5.4 NIKHEF D0MCC There are 0 jobs running and 0 waiting, with 16 CPUs free Close SE tbn03.nikhef.nl with mount point /flatfiles CE tbn09.nikhef.nl:2119/jobmanager-pbs- qshort: - PBS queue "qshort" with 240 minutes time limit - Software installed: CMS ATLAS ALICE LHCb IDL-5.4 NIKHEF D0MCC There are 0 jobs running and 0 waiting, with 16 CPUs free Close SE tbn03.nikhef.nl with mount point /flatfiles SE tbn03.nikhef.nl close to 2 CEs: - tbn09.nikhef.nl:2119/jobmanager-pbs- qshort - tbn09.nikhef.nl:2119/jobmanager-pbs- qlong - VOs supported: alice atlas biomedical cms earthob lhcb iteam - gridftp on port rfio on port file Mb of free space

The EDG Testbed Intro and Setup Tutorial - n° 14 EDG Software Distribution  All software available as source & binary RPMs  Binaries for RedHat 6.2 (transition to RedHat 7.2 on its way)  > 600 packages including n Complete globus distribution n EDG packages n Support tools (perl, ant, jdk, …)  Pre-packaged for different machine types

The EDG Testbed Intro and Setup Tutorial - n° 15 EDG Fabric Management Setup Tasks  Node Installation & Management  Configuration Management Runtime Tasks  Monitoring & Fault Tolerance  Resource Management Runtime tasks may automatically trigger setup tasks n New machines join the grid n Failure detection/repair (e.g. restarting daemons)

The EDG Testbed Intro and Setup Tutorial - n° 16 LCFG (Local ConFiGuration system)  Developed at University of Edinburgh  Widely used fabric tool  Automated installation and configuration in a very diverse and evolving environment LCFG configuration files Compiler (mkxprof) Web Server XML Profile LCFG SERVER HTTP ldxprof Generic Component Generic Component rdxprof LCFG Components DBM File LCFG CLIENT Notif y UDP Acknowledge

The EDG Testbed Intro and Setup Tutorial - n° 17 Example LCFG Configuration File +inet.services telnet login ftp +inet.allow telnet login ftp sshd +inet.allow_telnet ALLOWED_NETWORKS +inet.allow_login ALLOWED_NETWORKS +inet.allow_ftp ALLOWED_NETWORKS +inet.allow_sshd ALL +inet.daemon_sshd yes auth.users myckey +auth.userhome_mickey /home/mickey +auth.usershell_mickey /bin/tcsh +inet.services telnet login ftp +inet.allow telnet login ftp sshd +inet.allow_telnet ALLOWED_NETWORKS +inet.allow_login ALLOWED_NETWORKS +inet.allow_ftp ALLOWED_NETWORKS +inet.allow_sshd ALL +inet.daemon_sshd yes auth.users myckey +auth.userhome_mickey /home/mickey +auth.usershell_mickey /bin/tcsh Config files , /home/MickeyMouseHome /bin/tcsh , /home/MickeyMouseHome /bin/tcsh XML profiles mkxprof

The EDG Testbed Intro and Setup Tutorial - n° 18 Wrap Up  Logical machine types of an EDG Testbed  Mapping of services to logical machines  Example and current EDG Testbed configuration  Code distribution strategy  Fabric management strategy è How to set up an EDG Testbed

The EDG Testbed Intro and Setup Tutorial - n° 19 LCFG Installation Server setup:  Download rpms (perl + lcfg + apache)  Install rpms  Start http server (apache, …)  Download and modify example configuration files  Run mkxprof on them Client setup:  Download rpms (perl + lcfg)  Install rpms  Download configuration manually (only needed for the first time)  Reboot (rdxprof will be started) Configuration management (server):  Update config files  Run mkxprof

The EDG Testbed Intro and Setup Tutorial - n° 20 Machine Setup On the LCFG server:  Create directories for rpms  Download rpms from central edg repository  Create LCFG profile for each client machine: n Filename = hostname; includes machine type specific config file and site specific config file (needs to be customized!) n Example templates are provided n Run mkxprof on each of these files On the LCFG clients:  Setup clients as describe before  Some machines require some manual config: n E.g. batch system on CE (pbs) D O N E

The EDG Testbed Intro and Setup Tutorial - n° 21 Manual Setup (without LCFG)  Download rpms directly on machine (RPM-lists per machine type exist)  Install rpms  Configure individual services (see installation guide)

The EDG Testbed Intro and Setup Tutorial - n° 22 Issues when Adding new Sites to the Testbed  EDG is currently setting-up procedures explaining how to add new sites n Variations already tested with Taiwan and Romania n Step-by-step instructions produced which we expect to become simpler over time  Need to clarify the “minimum requirements” for a site to become a member of the testbed n A number of regular tasks have to be performed by the sites administrators n A maximum delay needs to be defined for responding to requests/problems if the testbed is to run efficiently  Sites from new countries have to identify/create a supporting CA n Since CAs need mutual trust this could lead to an explosion of inspection activities  Some tasks will fall on the people responsible for managing the VOs n HEP experiment secretariats already perform some level of authentication of their institutes and members. How an we get some leverage from this?

The EDG Testbed Intro and Setup Tutorial - n° 23 Summary  Logical machine types of an EDG Testbed  Mapping of services to logical machines  Example and current EDG Testbed configuration  Code distribution strategy  Fabric management strategy  How to obtains EDG software  How to automatically configure machines

The EDG Testbed Intro and Setup Tutorial - n° 24 Outlook  EDG Testbed 1.x contains basic services  EDG Testbed 2 (autumn 2002) will contain more advanced services n Advanced information systems (based upon relational databases) n Enhanced security n Optimization (resource broker and replica management) n Fabric management with monitoring, automatic fault detection & recovery

The EDG Testbed Intro and Setup Tutorial - n° 25 Further Information  EDG Testbed homepage:  Fabric management: fabric/  LCFG on EDG Testbed information: