LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow

LCG Lev Shamardin LCG Geography LCG covers a number of sites both in Europe and US LCG covers a number of sites both in Europe and US LCG-1 testbed covers 13 sites including SINP MSU LCG-1 testbed covers 13 sites including SINP MSU

LCG Lev Shamardin LCG-1 LCG-1 is the production version of the LCG software which is now installed on the 13 LCG-1 sites and running in production mode LCG-1 is the production version of the LCG software which is now installed on the 13 LCG-1 sites and running in production mode New LCG-2 is expected in production in November New LCG-2 is expected in production in November

LCG Lev Shamardin LCG-1 Architecture Minimal LCG-1 site must have a Computing Element with worker nodes and a Storage Element Minimal LCG-1 site must have a Computing Element with worker nodes and a Storage Element There are no limitations to the number of other components installed on each site There are no limitations to the number of other components installed on each site These components do not have to be registered in LCG-1 These components do not have to be registered in LCG-1 LCG-1 site MDS west MDS east RB LCG-1 site

LCG Lev Shamardin LCG-1 Architecture Current version LCG-1 is based on the EDG middleware with MDS information system Current version LCG-1 is based on the EDG middleware with MDS information system R-GMA is not yet stable enough for the production usage R-GMA is not yet stable enough for the production usage LCG-2 will be using new R-GMA information system LCG-2 will be using new R-GMA information system

LCG Lev Shamardin LCFGng and LCG-1 deployment The base middleware LCFGng configuration profiles are stored in the central LCG CVS repository The base middleware LCFGng configuration profiles are stored in the central LCG CVS repository Sites create their own site-specific profiles based on the CVS configuration Sites create their own site-specific profiles based on the CVS configuration No manual installation supported yet No manual installation supported yet LCG CVS Generic LCG-1 configuration LCG-1 Site Site-specific configuration LCG-1 SiteLCG-1 Site… LCG-1 Deployment group

LCG Lev Shamardin SINP MSU PC Farm 20 dual-CPU PIII nodes 20 dual-CPU PIII nodes Two 1.2 TB fileservers Two 1.2 TB fileservers Gigabit Ethernet uplinks to the fileservers Gigabit Ethernet uplinks to the fileservers Fast Ethernet links to the nodes Fast Ethernet links to the nodes Storage switch non-interactive nodes PC Farm batch master node

LCG Lev Shamardin Software installation system on SINP MSU PC Farm Based on Etherboot network boot package Based on Etherboot network boot package Nodes are installed with anaconda kickstart Nodes are installed with anaconda kickstart Nodes without a boot ROM are installed using a fake linux “kernel” or a boot disk Nodes without a boot ROM are installed using a fake linux “kernel” or a boot disk Supports both completely unattended automatic installation and manual installation Supports both completely unattended automatic installation and manual installation DHCP TFTP configuration server NFS node file server

LCG Lev Shamardin LCFGng support on SINP MSU PC Farm LCFGng server was installed for configuring and installing LCG-1 nodes LCFGng server was installed for configuring and installing LCG-1 nodes LCFGng enabled nodes configuration is controlled from the LCFGng server LCFGng enabled nodes configuration is controlled from the LCFGng server Nodes configuration and health status information provided with LCFGng components can be observed on the web Nodes configuration and health status information provided with LCFGng components can be observed on the web DHCP TFTP configuration server NFS node file server LCFGng server LCFG, HTTP

LCG Lev Shamardin Current LCG-1 status in SINP MSU For the LCG-1 testbed part of the PC Farm was configured as LCG-1 nodes For the LCG-1 testbed part of the PC Farm was configured as LCG-1 nodes These nodes are logically disconnected from the main farm These nodes are logically disconnected from the main farm Installed LCG-1 components are: Computing Element with several Worker Nodes, Storage Element, Resource Broker, BDII and User Interface Installed LCG-1 components are: Computing Element with several Worker Nodes, Storage Element, Resource Broker, BDII and User Interface MyProxy and MDS servers are coming soon MyProxy and MDS servers are coming soon Storage switch non-interactive nodes PC Farm batch master node LCG-1

LCG Lev Shamardin MSU PC Clusters LCG middleware installation on the SRCC MSU (Scientific Research Computing Center) parallel cluster LCG middleware installation on the SRCC MSU (Scientific Research Computing Center) parallel cluster Site specifics: Site specifics: Exotic batch system. Interface for the globus package is ready but was not completely tested Exotic batch system. Interface for the globus package is ready but was not completely tested Only manual node configuration can be done Only manual node configuration can be done Middleware for the worker nodes must be installed on the shared filesystem Middleware for the worker nodes must be installed on the shared filesystem Connect the Physical faculty and the faculty of Computing Mathematics and Cybernetics clusters to the SINP MSU Resource Broker Connect the Physical faculty and the faculty of Computing Mathematics and Cybernetics clusters to the SINP MSU Resource Broker Experience with SRCC is required, similar site-specific limitations Experience with SRCC is required, similar site-specific limitations

LCG Lev Shamardin Conclusion What difficulties will emerge if a site wants to install the LCG middleware What difficulties will emerge if a site wants to install the LCG middleware What LCG can give you right now What LCG can give you right now Future plans Future plans

LCG Lev Shamardin Difficulties At the moment the only documented way to install LCG software requires using the LCFGng configuration server At the moment the only documented way to install LCG software requires using the LCFGng configuration server Using LCFGng is not possible in a number of cases, in general due to the administrative reasons Using LCFGng is not possible in a number of cases, in general due to the administrative reasons Minimal stand-alone site must be running quite a big number of nodes supporting the infrastructure Minimal stand-alone site must be running quite a big number of nodes supporting the infrastructure The minimal set is: The minimal set is: Resource Broker Resource Broker BDII & MDS BDII & MDS Computing Element with Worker Nodes Computing Element with Worker Nodes Storage Element(s) Storage Element(s) MyProxy if long-time jobs support is required MyProxy if long-time jobs support is required This gives us at least 5 nodes will be supporting the infrastructure This gives us at least 5 nodes will be supporting the infrastructure

LCG Lev Shamardin What LCG-1 can give you right now Convenient way for job balancing between several sites Convenient way for job balancing between several sites Common way of user authentication and authorization for job submission Common way of user authentication and authorization for job submission Some basic accounting Some basic accounting Data replication Data replication

LCG Lev Shamardin Future plans SINP MSU Site is one of the sites participating in the LCG-1 SINP MSU Site is one of the sites participating in the LCG-1 New Russian sites will be connected to the SINP MSU Resource Broker in the nearest future New Russian sites will be connected to the SINP MSU Resource Broker in the nearest future IHEP Protvino will be connected soon IHEP Protvino will be connected soon ITEP and JINR Dubna in future ITEP and JINR Dubna in future Internal MSU sites (SRCC and others) as soon as manual installation is possible Internal MSU sites (SRCC and others) as soon as manual installation is possible