1. gLite Information System Overview
Raquel Pezoa
LA EPIKH School for Application Porting
Valparaíso,

2. Outline
This presentation is based on previous presentations from EPIKH Schools for Application Porting

3. Outline
Motivation / Introduction Background GLUE Schema LDAP MDS Architecture Monitoring Information system in practice lcg-infosites lcg-info

4. Introduction

5. The power Grid paradigm
wind
coal
Electric
Power Grid
System
Users can access electrical power coming from different (and heterogeneous) sources
nuclear
hydroelectric

6. The computing Grid approach
System
Users can access storage and computing resources coming from different (and heterogeneous) sources
The resources shared within the Grid can be physical objects (CPUs, storage devices) or logical resources (computing queues, distributed file systems)

7. Information System
An Information System is a vital component in a grid, because of in a heterogeneous and dynamic grid environment it is necessary to be aware about the diverse resources and services that compose the grid.
A Grid Information System (GIS) provides special services to discover, characterize and monitor the resources and services.

8. Information System What is? Why? How?
System to collect information on the state of resources
Why?
To discover resources of the grid and their nature
To have useful data in order to who is in charge of managing the workload to do it more efficiently.
To check for health status of resources.
How?
Monitoring state of resources locally and publishing fresh data on the information system.
Adopting a data model that MUST be well known to all components that want to access monitored information
Using different approaches that we are going to investigate in the next slides

9. The Info. system scope Discover new added resources
Make available updated information about the resources
Monitor resources load and status
How does it work?
Collecting information from the resources and publishing fresh data periodically.
Adopting a data model that MUST be well known to all Grid components.

10. How it is used and by whom?
Users
Retrieve information about resources:
Where can I run my job?
Where can I copy my files?
Which software packages are available on a given CE?
Site managers
Publish information about the resources and services they provide
Middleware
WMS: matching job requirements and allocating the resources
Monitoring Services: retrieving information about the status and availability of resources.

11. GLUE Schema LDAP MDS Architecture
Background
GLUE Schema LDAP MDS Architecture

12. GLUE Schema - Overview
Stands for “Grid Laboratory Uniform Environment”
Provides a standardized description of a Grid computing system
It is not tied to any particular implementation
The Grid components are represented as objects which have attributes and relations to other objects

13. GLUE Schema – Why we need it?
The Grid is a paradigm of distributed computing that enables the coordination of resources and services not subject to centralized control. These resources are geographically dispersed, span multiple trust domains and are heterogeneous.
Resources can be dynamically contributed by different owner institutions, so a precise and shared description of resources among information consumers and resource providers is necessary.
This description should also be common to different Grid infrastructures in order to contribute to the interoperability among them.

14. GLUE Schema – Core entities

15. GLUE Schema – Site properties
Site entity – Properties:
Property
Type
Description
UniqueID
string
Unique Identifier of the Site
Name
Human-readable name
Short description of this site
Contact
The main contact for the site. Syntax rule: "mailto:" followed by a list of addresses separated by a comma
UserSupportContact
addresses of the support service
SysAdminContact
addresses of the system administrator
SecurityContact
addresses of the security manager
Location
Geographical location of this site (e.g., city, state, country)
Latitude
real32
The position of a place north or south of the equator measured from -90º to 90º, with positive values going north and negative values going south
Longitude
The position of a place east or west of Greenwich, England measured from -180º to 180º with positive values going east and negative values going west
Web
uri
The URI identifying a web page with more information about this site
Sponsor
VO sponsoring the site; the syntax should allow the expression of the percentage of sponsorship
OtherInfo
This attribute is to be used to publish info that does not fit in any other attribute of the site entity

16. GLUE Schema – Service properties
Service entity – Properties:
Property
Type
Description
UniqueID
string
Unique Identifier of this service
Name
Human-friendly name
serviceType_t
The service type
Version
Version of the service: <major version number>.<minor version number>.<patch version number>
Endpoint
uri
Network endpoint for this service
Status
serviceStatus_t
Status of the service. String enumeration: OK, Warning, Critical, Unknown, Other
StatusInfo
Textual explanation for the status of the service
WSDL
URI of the WSDL describing the service
Semantics
URL of detailed description
StartTime
dateTime_xs_t
The timestamp related to last start time of this service
Owner
Owner of the service
AccessControlBase.Rule
ACL_t
Authorization rule for this entity

17. GLUE Schema – CE entity

18. LDAP - Overview Stands for “Lightweight Directory Access Protocol”
It is a protocol that defines the method by which directory data is accessed
Optimized for reading, browsing and searching information (‘write-once-read-many-times’ service)
Data is represented as a hierarchy of objects (entities) forming a tree structure
Data Information Tree (DIT)

19. LDAP – Data Information Tree
Attribute Type String representation
Distinguished Name (DN)
Unique name (path) that unambiguously identifies a single entry
dc=grid (root of the DIT)
Attribute Type
String
domainComponent DC
CountryName C
OrganizationName O
OrganizationUnitName OU
CommonName CN
c= Brazil c=Italy c=Spain
o=INFN
ou=Catania ou=Roma
cn=Elisa Ingra
cn=Elisa Ingra,ou=Catania,o=INFN,c=Italy,dc=grid

20. LDAP – Data Information Tree
The tree hierarchy is described by textual files following the LDIF format (LDAP Data Interchange Files)
dn: dc=example,dc=root
dc: example
description: My company
objectClass: dcObject
objectClass: organization
o: Example, Inc.
## FIRST Level hierarchy - people
# this is an ENTRY sequence and is preceded by a BLANK line
dn: ou=people, dc=example,dc=root
ou: people
description: All people in organisation
objectClass: organizationalUnit
## SECOND Level hierarchy - people entries
dn: cn=Joe Schmo,ou=people,dc=example,dc=root
objectclass: inetOrgPerson
cn: Joe Schmo
sn: Schmo
uid: jschmo
mail:
ou: sales

21. LDAP – Referrals
An individual LDAP server might not store the entire DIT
Servers need to be linked together in order to form a distributed directory that contains the whole DIT
All client requests start at the global directory LDAP 1
LDAP 1 server
LDAP 2 server
LDAP 3 server
c=USA,dc=example
o=IBM,c=USA,dc=example
dc=example
referral
c= USA
o=CISCO o=IBM
ou=IT ou=Web
referral

22. MDS
gLite adopts the Globus Monitoring and Discovery Service (MDS) architecture as its Information System
It implements the GLUE Schema using OpenLDAP
Grid Resource Information Server (GRIS)
LDAP server at Grid Elements level (e.g. GRIS runs in a CE)
Local CEs and SEs run an Information Provider software, which collects info about the resource
Grid Index Information Server (or site BDII) (GIIS)
LDAP server at a site level
each Grid site to collect information by all GRISes present in that site
Berkeley Database Information Index (BDII)
Top level database
Store and publish data gathered from the site
Uses LDAP as protocol and GLUE Schema as data model

23. MDS - Architecture Site level BDII
Computational resources available within a confederation of laboratories, the distributed data storage systems owned by a particular agency.
Site level BDII
Grid Index Information Server (GIIS)
GIIS
GIIS allows to onstruct aggregate directories and it provides a means of combining arbitrary GRIS
Operating System , versions, CPU and memory availability

24. MDS - Architecture
BDII consists of 2 servers: one contains a ready-only database and the other a write-only database
Every 2 minutes a cron-job runs a script and collects info from lower-level servers (GIIS)
Once updated, the 2 servers change roles

25. LDAP browser showing BDII info
Top BDII

26. LDAP browser showing BDII info
Site BDII
LDAP browser: LUMA,

27. lcg-infosites
In this section, two higher level tools will be presented: lcg-infosites and lcg-info.
These tools should be enough for most common user needs and will usually avoid the necessity of raw LDAP queries.
The lcg-infosites command is actually just a perl script wrapping a series of LDAP commands and was developed to allow users to retrieve information on Grid resources for the most common cases

28. Practicals: lcg-infosites
USAGE: lcg-infosites --vo options -v --is
-h/--help: help option
--vo: VO name (mandatory)
--is: it's possible to specify a not default Top BDII
Some options:
se: The names of the SEs supported by the user's VO
ce: The information relative to number of CPUs, running jobs,etc.
rb: Names of the Rbs available for each VO
sitenames: Names of the LCG sites
tag: The names of the tags relative to the software installed in site is printed together with the corresponding CE
closeSE: The names of the CEs where the user's VO is allowed to run together with their corresponding closest SEs are provided

29. Practicals: lcg-infosites
Login to a UI machine and do the following:
ssh cluster29.fis.utfsm.cl -l valparaiso18
password:
Last login: Mon Nov 29 08:09: from ip priv.inf.utfsm.cl

30. Practicals: lcg-infosites
Initiate a proxy to be able to run the grid commands
~]$ voms-proxy-init --voms gilda
Enter GRID pass phrase:
Your identity: /C=IT/O=GILDA/OU=Personal Certificate/L=VALPARAISO/CN=VALPARAISO22
Creating temporary proxy Done
Contacting voms.ct.infn.it:15001 [/C=IT/O=INFN/OU=Host/L=Catania/CN=voms.ct.infn.it] "gilda" Done
Creating proxy Done
Your proxy is valid until Mon Nov 29 21:53:

31. Practicals: lcg-infosites
~]$ lcg-infosites --vo gilda ce
#CPU Free Total Jobs Running Waiting ComputingElement
ce-edu.grid.acad.bg:2119/jobmanager-pbs-gilda
ce.hpc.iit.bme.hu:2119/jobmanager-lcgpbs-gilda
ce1-egee.srce.hr:2119/jobmanager-sge-prod
grid010.ct.infn.it:2119/jobmanager-lcgpbs-gilda
gilda-01.pd.infn.it:2119/jobmanager-lcgpbs-gilda
sirius-ce.ct.infn.it:2119/jobmanager-lcgpbs-gilda
grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_short
grisuce.scope.unina.it:2119/jobmanager-lcgpbs-grisu_long
iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-gilda
gn0.hpcc.sztaki.hu:2119/jobmanager-lcgpbs-gilda
ce1.grid.edges-grid.eu:2119/jobmanager-edges-szdgr
ce1.grid.edges-grid.eu:2119/jobmanager-edges-xwlal
ce1.grid.edges-grid.eu:2119/jobmanager-edges-homeboinc
ce1.grid.edges-grid.eu:2119/jobmanager-edges-uow
ce1.grid.edges-grid.eu:2119/jobmanager-edges-xwlripub
ce1.grid.edges-grid.eu:2119/jobmanager-edges-asgctwdg
[...]

32. Practicals: lcg-infosites
~]$ lcg-infosites --vo gilda se
Avail Space(Kb) Used Space(Kb) Type SEs
n.a n.a n.a se-edu.grid.acad.bg
n.a se.hpc.iit.bme.hu
n.a se1-egee.srce.hr
n.a gilda-02.pd.infn.it
n.a sirius-se.ct.infn.it
n.a grisuse.scope.unina.it
n.a iceage-se-01.ct.infn.it
n.a dgt02.ui.savba.sk
n.a fn2.hpcc.sztaki.hu
n.a se.scope.unina.it

33. lcg-info
The lcg-info command can be used to list either CEs or the SEs that satisfy a given set of conditions on their attributes, and to print, for each of them, the values of a given set of attributes.
The information is taken from the BDII specified by the $LCG_GFAL_INFOSYS environment variable or in the command line.
~]$ echo $LCG_GFAL_INFOSYS
gilda-bdii.ct.infn.it:2170

34. Practicals: lcg-info -h/--help: to see the help
USAGE: lcg-info [--list-ce | --list-se] [--query ] [--attrs ]
-h/--help: to see the help
–list-attrs: print the list of the possible attributes
--list-ce: lists the CEs which satisfy a query, or all the CEs if no query is given.
--list-se: lists the SEs which satisfy a query, or all the SEs if no query is given.
--bdii: allows to specify a BDII in the form <hostname>:<port>. If not given, the value of the environmental variable LCG_GFAL_INFOSYS is used. If that is not defined, the command returns an error.
--vo: restricts the output to CEs or SEs where the given VO is authorized.

35. Practicals: lcg-info
~]$ lcg-info --vo gilda --list-ce --query 'TotalCPUs>=10' --attrs 'RunningJobs,FreeCPUs'
- CE: ce.hpc.iit.bme.hu:2119/jobmanager-lcgpbs-gilda
- RunningJobs
- FreeCPUs
- CE: ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_long
- RunningJobs
- FreeCPUs
- CE: ce.scope.unina.it:2119/jobmanager-lcgpbs-egee_short
- RunningJobs
List all the Computing Elements in the BDII satisfying the given conditions (TotalCPUs=10) and print the desired attributes (FreeCPUs,!Total Jobs)

36. Practicals: lcg-info
~]$ lcg-info --vo gilda --list-ce --attrs Tag
- CE: ce-edu.grid.acad.bg:2119/jobmanager-pbs-gilda
- Tag GLITE-3_0_0
GLITE-3_0_1
GLITE-3_0_2
GLITE-3_1_0
LCG-2
LCG-2_1_0
LCG-2_1_1
[...]
MPICH
MPICH-1.2.7
MPICH-1.2.7p1
MPIEXEC
MPIRUN
MPI_SHARED_HOME
R-GMA
- CE: ce.hpc.iit.bme.hu:2119/jobmanager-lcgpbs-gilda
- Tag ASTRA-STK
One of the most common use of the "lcg-info" is to check which software packages are available on CE's. The software packages are stored in the "Tag" attribute.

37. Practicals
$ lcg-info --vo gilda --list-ce --query 'Tag=MPICH' --attrs 'FreeCPUs‘
$ lcg-infosites --vo gilda ce
$ lcg-infosites --vo gilda ce -v 2
$ lcg-infosites --vo gilda se
$ lcg-infosites --vo eumed tag
$ lcg-infosites --vo eumed closeSE
$ lcg-info --vo eumed --list-ce --query 'Tag=MPICH' --attrs 'FreeCPUs‘
$lcg-info --vo eumed --list-ce --query 'TotalCPUs>=10' --attrs 'RunningJobs,FreeCPUs’
One of the most common use of the "lcg-info" is to check which software packages are available on CE's. The software packages are stored in the "Tag" attribute.

38. References gLite documentation LDAP Concepts & Overview
LDAP Concepts & Overview
OpenLDAP community
GLUE Schema Specification version 1.3 Final
Lilongwe, EELA-2 Workshop,