Presentation is loading. Please wait.

Presentation is loading. Please wait.

Bob Jones – Project Architecture - 1 March 2002 - n° 1 Information & Monitoring Services Antony Wilson WP3, RAL

Published byGabriella Connolly Modified over 10 years ago

Similar presentations

Presentation on theme: "Bob Jones – Project Architecture - 1 March 2002 - n° 1 Information & Monitoring Services Antony Wilson WP3, RAL"— Presentation transcript:

1 Bob Jones – Project Architecture - 1 March 2002 - n° 1 Information & Monitoring Services Antony Wilson WP3, RAL a.j.wilson@rl.ac.uk

2 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 2 Introduction u information systems – LDAP (Lightweight Directory Access Protocol) n Ftree n Globus MDS u information providers n RPMs n configuration u starting ftree u configuration of the GRIS/GIIS registration u starting Globus MDS u example searches u summary

3 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 3 LDAP Information Systems u 2 configuration files n /etc/edg/info-mds.conf n /etc/globus.conf u info-mds.conf n configuration of the information providers u globus.conf n configuration of Globus MDS s includes registration details

4 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 4 Information Providers - RPMs u configuration n edg-info-main-*.i386.rpm u computing element information provider n CEInformationProviders-*.i386.rpm u netmon information provider n edg-info-netmon-*.i386.rpm u storage element information provider n edg-info-se-*.i386.rpm u replica catalogue information provider n edg-info-rc-*.i386.rpm

5 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 5 Information Providers - Configuration u configuration via /etc/edg/info-mds.conf n generic information n site information provider n computing element information provider n netmon information provider n storage element information provider n replica catalogue information provider u static data via /opt/edg/info/mds/etc/ldif/*.ldif n computing element n replica catalogue

6 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 6 info-mds.conf - Generic WP3_DEPLOY=/opt/edg/info/mds FTREE_INFO_PORT=2171 FTREE_DEBUG_LEVEL=0 # the default value is "Mds-Vo-name=local,o=grid SITE_DN=Mds-Vo-name=local,o=grid

7 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 7 info-mds.conf - Site u Note this is usually combined with computing element SITE_INFO=yes SITE_NAME=RAL SITE_INSTALLATION_DATE=20011115123410Z SITE_SYSADMIN_CONTACT=grid.sysadmin@gridpp.rl.ac.uk SITE_USER_SUPPORT_CONTACT=grid.support@gridpp.rl.ac.uk SITE_SECURITY_CONTACT=grid.security@gridpp.rl.ac.uk SITE_DATAGRID_VERSION=1 SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk # comma separated list with no spaces SITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces SITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk

8 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 8 info-mds.conf – Computing Element CE_PRESENT=yes CE_HOST=gppce05.gridpp.rl.ac.uk CE_BATCHSYSTEM=pbs CE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin # comma separated list with no spaces CE_QUEUE=workq # comma separated list with no spaces CE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID CE_CLOSE_SE_MOUNT_POINT=data

9 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 9 info-mds.conf – Netmon u This will be changing in the next release u This is also usually combined with computing element NETMON_PRESENT=yes NETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk

10 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 10 info-mds.conf – Storage Element SE_PRESENT=yes SE_ID=gppse05.gridpp.rl.ac.uk SE_SIZE=500000 SE_CONTACT=grid.support@gridpp.rl.ac.uk SE_TYPE=disk # comma separated list with no spaces, this is a list of Vos supported by the SE SE_VO=alice,atlas,biomedical,cms,earthob,lhcb # comma separated list with no spaces, values used in df to obtain freespace SE_FILESYSTEMS=/dev/hda2,/dev/hda4 # comma separated list with no spaces SE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq # comma separated list with no spaces SE_PROTOCOLS=gridftp,rfio,file # comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS SE_PROTOCOL_PORTS=2811,3147,

11 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 11 info-mds.conf – Replica Catalogue RC_PRESENT=yes RC_HOST=gpprc05.gridpp.rl.ac.uk # comma separated list with no spaces RC_VO=alice,atlas,biomedical,cms.earthob,lhcb

12 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 12 Static Information – Computing Element u makes use of static information n /opt/edg/info/mds/etc/ldif/ce-static.ldif n this will be changing to /opt/edg/etc/info/mds/ce-static.ldif u ldif file can be customized for a queue n /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif Architecture:intel OpSys:RH 6.2 MinPhysMemory:512 MinLocalDiskSpace:24000 NumSMPs:2 MinSPUProcessors:2 MaxSPUProcessors:2 AverageSI00:450 MinSI00:450 MaxSI00:450 RunTimeEnvironment:CMS4.2 RunTimeEnvironment:ATLAS1.1 AFSAvailable:FALSE OutboundIP:TRUE InboundIP:TRUE The architecture of the hosts composing the CE The operating system of the hosts composing the CE The minimum value of the physical memory among the hosts composing the CE The minimum local disk footprint Number of SMP hosts The minimum number of SPU processors (for SMP hosts) The Maximum number of SPU processors (for SMP hosts The Average of the SpecInt2000 benchmark of the nodes associated with the CE The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE A List of software/packages installed on this CE Defines if AFS is installed Defines if outbound connectivity is allowed Defines if inbound connectivity is allowed

13 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 13 Static Information – Replica Catalogue u makes use of static information n /opt/edg/info/mds/etc/ldif/rc-static.ldif n this will be changing to /opt/edg/etc/info/mds/rc-static.ldif u ldif file can be customized for a virtual organization n /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif Rcport: 2001 RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu- datagrid,dc=org Rcurl: ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu- datagrid,dc-org

14 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 14 Starting Ftree u /etc/rc.d/init.d/edginfo-mds n start n stop n restart n status u use information provided in /etc/edg/info-mds.conf u produces 2 ldif files n one for ftree n one for Globus MDS n both point to the same information providers u starts/stops ftree

15 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 15 Configuration of the GRIS/GIIS Registration u GRIS Grid Resource Information Server u GIIS Grid Index Information Server u there is a GRIS on any machine running an information provider u there is a GIIS at site level u the GRISs register with the site GIIS u the site GIIS registers with the country GIIS/VO GIIS u registration is controlled via /etc/globus.conf

16 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 16 globus.conf - Resource GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

17 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 17 globus.conf - Site GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk GRID_INFO_GIIS_1=ral #Register with the country GIIS GRID_INFO_REG_GIIS_1=uk GRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk

18 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 18 globus.conf - Country GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=uk GRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk GRID_INFO_GIIS_1=uk #Register with the top level GIIs for the testbed GRID_INFO_REG_GIIS_1=datagrid GRID_INFO_REG_HOST_1=lxshare0225.cern.ch

19 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 19 Starting Globus MDS u /etc/rc.d/init.d/globus-mds n start n stop n restart n status u use information provided in /etc/globus.conf u starts/stops Globus MDS

20 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 20 Example Searches u Ftree is on port 2171 u Globus MDS is on 2135 u search a resource: ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=local,o=grid objectclass=* u search a site: ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=ral,o=grid objectclass=* u search a country/VO: ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo- name=uk,o=grid objectclass=* u or use an LDAP browser such as mapcentre as provided by WP7 n http://ccwp7.in2p3.fr/mapcenter/ http://ccwp7.in2p3.fr/mapcenter/

21 Antony Wilson –SysMan Meeting- 22 April 2002 - n° 21 Summary u edit n /etc/edg/info-mds.conf n /etc/globus.conf n /opt/edg/info/mds/etc/ldif/*.ldif s this will be changing to /opt/edg/etc/info/mds/*.ldif u produce ldifs and start ftree n /etc/rc.d/init.d/edginfo-mds u start Globus MDS n /etc/rc.d/init.d/globus-mds u documentation available at: n http://hepunx.rl.ac.uk/edg/wp3/ http://hepunx.rl.ac.uk/edg/wp3/

Download ppt "Bob Jones – Project Architecture - 1 March 2002 - n° 1 Information & Monitoring Services Antony Wilson WP3, RAL"

Similar presentations

LNL M.Biasotto, Roma, 22 novembre 2001 1 Some notes on WP6 INFN Testbed.

LNL M.Biasotto, Roma, 22 novembre Some notes on WP6 INFN Testbed.
E. Ferro, CNAF, aprile 2002 1 LCFG: testbed upgrade Enrico Ferro INFN-LNL.

E. Ferro, CNAF, aprile LCFG: testbed upgrade Enrico Ferro INFN-LNL.
Open Science Grid Living on the Edge: OSG Edge Services Framework Kate Keahey Abhishek Rana.

Open Science Grid Living on the Edge: OSG Edge Services Framework Kate Keahey Abhishek Rana.
Grid Tech Team Certificates, Monitoring, & Firewall September 15, 2003 Chiang Mai, Thailand Allan Doyle, NASA With the help of the entire Grid Tech Team.

Grid Tech Team Certificates, Monitoring, & Firewall September 15, 2003 Chiang Mai, Thailand Allan Doyle, NASA With the help of the entire Grid Tech Team.
DIVIDING INTEGERS 1. IF THE SIGNS ARE THE SAME THE ANSWER IS POSITIVE 2. IF THE SIGNS ARE DIFFERENT THE ANSWER IS NEGATIVE.

DIVIDING INTEGERS 1. IF THE SIGNS ARE THE SAME THE ANSWER IS POSITIVE 2. IF THE SIGNS ARE DIFFERENT THE ANSWER IS NEGATIVE.
Addition Facts 1 - 20.

Addition Facts
Antony WilsonGridPP - November 2001 The Data Grid DIT & Schema.

Antony WilsonGridPP - November 2001 The Data Grid DIT & Schema.
Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.

Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.
DataGrid is a project funded by the European Union CHEP 2003 – 24-28 March 2003 – HEP Assessment of EDG – n° 1 HEP Applications Evaluation of the EDG Testbed.

DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – HEP Assessment of EDG – n° 1 HEP Applications Evaluation of the EDG Testbed.
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.

S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.

WP2: Data Management Gavin McCance University of Glasgow November 5, 2001.
All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,

All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,
S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.

S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.

Tony Doyle - University of Glasgow GridPP EDG - UK Contributions Architecture Testbed-1 Network Monitoring Certificates & Security Storage Element R-GMA.
GridPP Meeting, Cambridge, 15 Feb 2002 Paul Mealor, UCL UCL Testbed 1 status report Paul Mealor.

GridPP Meeting, Cambridge, 15 Feb 2002 Paul Mealor, UCL UCL Testbed 1 status report Paul Mealor.
Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.

Andrew McNab - Manchester HEP - 10 May 2002 UK Testbed Deployment Aim of this talk is to the answer the questions: –What are other sites doing? –What are.
Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.

Status Report University of Bristol 3 rd GridPP Collaboration Meeting 14/15 February, 2002Marc Kelly University of Bristol 1 Marc Kelly University of Bristol.
Stephen Burke - WP8 Status - 14/2/2002 Partner Logo WP8 Status Stephen Burke, PPARC/RAL.

Stephen Burke - WP8 Status - 14/2/2002 Partner Logo WP8 Status Stephen Burke, PPARC/RAL.
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.

Similar presentations

Ads by Google