Bob Jones – Project Architecture - 1 March n° 1 Information & Monitoring Services Antony Wilson WP3, RAL
Antony Wilson –SysMan Meeting- 22 April n° 2 Introduction u information systems – LDAP (Lightweight Directory Access Protocol) n Ftree n Globus MDS u information providers n RPMs n configuration u starting ftree u configuration of the GRIS/GIIS registration u starting Globus MDS u example searches u summary
Antony Wilson –SysMan Meeting- 22 April n° 3 LDAP Information Systems u 2 configuration files n /etc/edg/info-mds.conf n /etc/globus.conf u info-mds.conf n configuration of the information providers u globus.conf n configuration of Globus MDS s includes registration details
Antony Wilson –SysMan Meeting- 22 April n° 4 Information Providers - RPMs u configuration n edg-info-main-*.i386.rpm u computing element information provider n CEInformationProviders-*.i386.rpm u netmon information provider n edg-info-netmon-*.i386.rpm u storage element information provider n edg-info-se-*.i386.rpm u replica catalogue information provider n edg-info-rc-*.i386.rpm
Antony Wilson –SysMan Meeting- 22 April n° 5 Information Providers - Configuration u configuration via /etc/edg/info-mds.conf n generic information n site information provider n computing element information provider n netmon information provider n storage element information provider n replica catalogue information provider u static data via /opt/edg/info/mds/etc/ldif/*.ldif n computing element n replica catalogue
Antony Wilson –SysMan Meeting- 22 April n° 6 info-mds.conf - Generic WP3_DEPLOY=/opt/edg/info/mds FTREE_INFO_PORT=2171 FTREE_DEBUG_LEVEL=0 # the default value is "Mds-Vo-name=local,o=grid SITE_DN=Mds-Vo-name=local,o=grid
Antony Wilson –SysMan Meeting- 22 April n° 7 info-mds.conf - Site u Note this is usually combined with computing element SITE_INFO=yes SITE_NAME=RAL SITE_INSTALLATION_DATE= Z SITE_DATAGRID_VERSION=1 SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk # comma separated list with no spaces SITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces SITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April n° 8 info-mds.conf – Computing Element CE_PRESENT=yes CE_HOST=gppce05.gridpp.rl.ac.uk CE_BATCHSYSTEM=pbs CE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin # comma separated list with no spaces CE_QUEUE=workq # comma separated list with no spaces CE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID CE_CLOSE_SE_MOUNT_POINT=data
Antony Wilson –SysMan Meeting- 22 April n° 9 info-mds.conf – Netmon u This will be changing in the next release u This is also usually combined with computing element NETMON_PRESENT=yes NETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April n° 10 info-mds.conf – Storage Element SE_PRESENT=yes SE_ID=gppse05.gridpp.rl.ac.uk SE_SIZE= SE_TYPE=disk # comma separated list with no spaces, this is a list of Vos supported by the SE SE_VO=alice,atlas,biomedical,cms,earthob,lhcb # comma separated list with no spaces, values used in df to obtain freespace SE_FILESYSTEMS=/dev/hda2,/dev/hda4 # comma separated list with no spaces SE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq # comma separated list with no spaces SE_PROTOCOLS=gridftp,rfio,file # comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS SE_PROTOCOL_PORTS=2811,3147,
Antony Wilson –SysMan Meeting- 22 April n° 11 info-mds.conf – Replica Catalogue RC_PRESENT=yes RC_HOST=gpprc05.gridpp.rl.ac.uk # comma separated list with no spaces RC_VO=alice,atlas,biomedical,cms.earthob,lhcb
Antony Wilson –SysMan Meeting- 22 April n° 12 Static Information – Computing Element u makes use of static information n /opt/edg/info/mds/etc/ldif/ce-static.ldif n this will be changing to /opt/edg/etc/info/mds/ce-static.ldif u ldif file can be customized for a queue n /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif Architecture:intel OpSys:RH 6.2 MinPhysMemory:512 MinLocalDiskSpace:24000 NumSMPs:2 MinSPUProcessors:2 MaxSPUProcessors:2 AverageSI00:450 MinSI00:450 MaxSI00:450 RunTimeEnvironment:CMS4.2 RunTimeEnvironment:ATLAS1.1 AFSAvailable:FALSE OutboundIP:TRUE InboundIP:TRUE The architecture of the hosts composing the CE The operating system of the hosts composing the CE The minimum value of the physical memory among the hosts composing the CE The minimum local disk footprint Number of SMP hosts The minimum number of SPU processors (for SMP hosts) The Maximum number of SPU processors (for SMP hosts The Average of the SpecInt2000 benchmark of the nodes associated with the CE The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE A List of software/packages installed on this CE Defines if AFS is installed Defines if outbound connectivity is allowed Defines if inbound connectivity is allowed
Antony Wilson –SysMan Meeting- 22 April n° 13 Static Information – Replica Catalogue u makes use of static information n /opt/edg/info/mds/etc/ldif/rc-static.ldif n this will be changing to /opt/edg/etc/info/mds/rc-static.ldif u ldif file can be customized for a virtual organization n /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif Rcport: 2001 RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu- datagrid,dc=org Rcurl: ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu- datagrid,dc-org
Antony Wilson –SysMan Meeting- 22 April n° 14 Starting Ftree u /etc/rc.d/init.d/edginfo-mds n start n stop n restart n status u use information provided in /etc/edg/info-mds.conf u produces 2 ldif files n one for ftree n one for Globus MDS n both point to the same information providers u starts/stops ftree
Antony Wilson –SysMan Meeting- 22 April n° 15 Configuration of the GRIS/GIIS Registration u GRIS Grid Resource Information Server u GIIS Grid Index Information Server u there is a GRIS on any machine running an information provider u there is a GIIS at site level u the GRISs register with the site GIIS u the site GIIS registers with the country GIIS/VO GIIS u registration is controlled via /etc/globus.conf
Antony Wilson –SysMan Meeting- 22 April n° 16 globus.conf - Resource GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April n° 17 globus.conf - Site GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk GRID_INFO_GIIS_1=ral #Register with the country GIIS GRID_INFO_REG_GIIS_1=uk GRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk
Antony Wilson –SysMan Meeting- 22 April n° 18 globus.conf - Country GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=uk GRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk GRID_INFO_GIIS_1=uk #Register with the top level GIIs for the testbed GRID_INFO_REG_GIIS_1=datagrid GRID_INFO_REG_HOST_1=lxshare0225.cern.ch
Antony Wilson –SysMan Meeting- 22 April n° 19 Starting Globus MDS u /etc/rc.d/init.d/globus-mds n start n stop n restart n status u use information provided in /etc/globus.conf u starts/stops Globus MDS
Antony Wilson –SysMan Meeting- 22 April n° 20 Example Searches u Ftree is on port 2171 u Globus MDS is on 2135 u search a resource: ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=local,o=grid objectclass=* u search a site: ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=ral,o=grid objectclass=* u search a country/VO: ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=uk,o=grid objectclass=* u or use an LDAP browser such as mapcentre as provided by WP7 n
Antony Wilson –SysMan Meeting- 22 April n° 21 Summary u edit n /etc/edg/info-mds.conf n /etc/globus.conf n /opt/edg/info/mds/etc/ldif/*.ldif s this will be changing to /opt/edg/etc/info/mds/*.ldif u produce ldifs and start ftree n /etc/rc.d/init.d/edginfo-mds u start Globus MDS n /etc/rc.d/init.d/globus-mds u documentation available at: n