Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.

Slides:



Advertisements
Similar presentations
Hands-on on Information System Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
Advertisements

INFSO-RI Enabling Grids for E-sciencE Workload Management System and Job Description Language.
Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.
The Information service Alessandro Costa INAF Catania Corso di Calcolo Parallelo Grid Computing Catania - ITALY September 2006.
INFSO-RI Enabling Grids for E-sciencE Information System : a detailed overview Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos.
БАЗОВЫЕ СРЕДСТВА РАБОТЫ С ФАЙЛАМИ В GRID. The gLite3 Architecture Security Service: Grid Security Infrastructure (GSI) Secure Sockets Layer (SSL) communication.
A proposal for standardizing the working environment for a LCG/EGEE job David Bouvet - Grid Computing team - CCIN2P3 HEPIX Karlsruhe 13/05/2005.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware: gLite Information Systems (IS) EGEE Tutorial 23 rd APAN Meeting,
INFSO-RI Enabling Grids for E-sciencE Information System Valeria Ardizzone INFN Singapore, 1st South East Asia Forum -- EGEE tutorial.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Information System (IS) Valeria Ardizzone.
EGEE is a project funded by the European Union under contract IST SEE-GRID tutorial, Istanbul, Information services.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
LCG Information and Monitoring System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
Mar 28, 20071/18 The OSG Resource Selection Service (ReSS) Gabriele Garzoglio OSG Resource Selection Service (ReSS) Don Petravick for Gabriele Garzoglio.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
INFSO-RI Enabling Grids for E-sciencE BDII installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial Clermont-Ferrand,
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America BDII Server Installation and Configuration.
gLite Information System UNIANDES OOD Team Daniel Alberto Burbano Sefair, Michael Angel.
Information System Status and Evolution Maria Alandes Pradillo, CERN CERN IT Department, Grid Technology Group GDB 13 th June 2012.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using EGEE middleware Dr. Mike Mineter & Gergely Sipos Taipei, 1 May 2006.
INFSO-RI Enabling Grids for E-sciencE GILDA Practicals Giuseppe Andronico Roberto Barbera Mike Mineter EGEE Tutorial, Taipei,
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
CE: compute element TP: CE & WN Compute Element Worker Node Installation configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Practicals on Security – Infosys -- WMS.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical: The Information Systems.
WLCG Information System Use Cases Review WLCG Operations Coordination Meeting 18 th June 2015 Maria Alandes IT/SDC.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.
User Interface UI TP: UI User Interface installation & configuration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Data Management Hands-on Juan Eduardo Murrieta.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania 4th EGEE Conference Pisa 23.October.2005.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
12th EELA Tutorial for Users and Managers E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
LCG Information and Monitoring System Jason Shih ASGC Grid Administrator Tutorial March 15-16, Academia Sinica.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
GRID commands lines Original presentation from David Bouvet CC/IN2P3/CNRS.
Create an script to print “hello world” in an output file with also the information of an input file. The input file should be previously register in the.
INFSO-SSA International Collaboration to Extend and Advance Grid Education Information System Valeria Ardizzone INFN Catania Corso di Grid Computing.
INFSO-RI Enabling Grids for E-sciencE Information System Giuseppe La Rocca Valeria Ardizzone INFN Catania 4th EGEE Conference Pisa.
The Information System in gLite middleware
Practicals on gLite Information Systems
gLite Information System
The Information System
Information System: Hands On
Practical: The Information Systems
Introductions Using gLite Grid Miguel Angel Díaz Corchero
gLite Information System overview
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
The Information System in gLite
The gLite API – Part II Giuseppe LA ROCCA ACGRID-II School
Practicals on gLite Information System
Hands-on on Information System
Tutorial Grille (LCG/EGEE)
gLite Information System(s)
gLite Information System Practicals
gLite Information System overview
EGEE Middleware: gLite Information Systems (IS)
gLite Information System Overview
Architecture of the gLite Data Management System
WMS+LB Server Installation and Configuration
Hands-on on the gLite Information System
Information System (BDII)
Presentation transcript:

Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006

2 Querying the Information System In order to query directly the IS elements two high level tools are provided: These tools should be enough for most common user needs and can be used to hide the complexity of raw LDAP queries. lcg-infositeslcg-info

3 lcg-infosites This tool provides information related to Grid services: lcg-infosites --vo option –-is It’s mandatory to include the vo and the option The --is option specifies the BDII you want to query If not supplied, the BDII defined into the environment variable LCG_GFAL_INFOSYS will be used

4 lcg-infosites - options It groups all the features just described all Prints all the available options and exit help Name of the BDII which the user wants query is Name of the lfc Catalog for the user’s VO lfc Names of the CEs where the user’s VO is allowed to run together with their corresponding closest SEs closeSE Name of the tags relative to the software installed in site with the corresponding CE tag SEs names together with the available and used space se Number of CPUs, running and waiting jobs and names of the CEs ce

5 Initial Step Please set the environment variable: export LCG_GFAL_INFOSYS=grid004.ct.infn.it:2 170

6 Exercise 1 Obtaining information about CE

7 lcg-infosites - 1 valor del bdii: mnto04.uniandes.edu.co:2170 *********************************************************************************************** #CPU Free Total Jobs Running Waiting ComputingElement grid004.iucc.ac.il:2119/jobmanager-lcgpbs-long cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-long grid004.iucc.ac.il:2119/jobmanager-lcgpbs-short cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-short grid010.ct.infn.it:2119/jobmanager-lcgpbs-long.... lcg-infosites --vo gilda ce

8 Exercise 2 Obtaining information about SE

9 lcg-infosites - 2 lcg-infosites --vo gilda se Avail Space(Kb) Used Space(Kb) Type SEs n.a grid005.iucc.ac.il n.a egee016.cnaf.infn.it n.a grid038.ct.infn.it n.a aliserv6.ct.infn.it n.a gilda02.lcca.usp.br n.a testbed005.cnaf.infn.it n.a gildase01.roma3.infn.it n.a trigrid-ce01.unime.it n.a grid038.ct.infn.it

10 Exercise 3 Listing the closeSE

11 lcg-infosites --vo gilda closeSE lcg-infosites - 3 valor del bdii: mnto04.uniandes.edu.co:2170 Name of the CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-long aliserv6.ct.infn.it grid038.ct.infn.it Name of the CE: grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long testbed005.cnaf.infn.it egee016.cnaf.infn.it Name of the CE: gilda03.lcca.usp.br:2119/jobmanager-lcgpbs-long gilda02.lcca.usp.br Name of the CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-short aliserv6.ct.infn.it grid038.ct.infn.it

12 Exercise 4 Obtaining information about software

13 lcg-infosites - 4 ************************************************************** Information for gilda relative to their software tags included in each CE ************************************************************** Name of the TAG: VO-gilda-GEANT Name of the TAG: VO-gilda-GKS05 Name of the CE:cn01.be.itu.edu.tr Name of the TAG: VO-gilda-slc3_ia32_gcc323 Name of the TAG: VO-gilda-CMKIN_5_1_1 Name of the TAG: VO-gilda-GEANT Name of the TAG: VO-gilda-GKS05 Name of the CE:grid010.ct.infn.it.... lcg-infosites --vo gilda tag

14 lcg-info This tool allows the users to query, in a deeper way, the BDII It requires the environment variable LCG_GFAL_INFOSYS to be set to the value of the BDII to be queried e.g. grid004.ct.infn.it:2170 Prints the list of the CEs or SEs satisfying a given query along with a list of specified attributes.

15 lcg-info The query syntax is like this: attr1 op1 valueN,... attrN opN valueN  where attrN is an attribute name  op is =, >= or <=, and the cuts are ANDed  A combination of attribute is supported  The cuts are comma-separated and spaces are not allowed SINCE THE LATEST GLUE- SCHEMA UPDATE ONLY “=“ OPERATOR IS SUPPORTED!

16 lcg-info options Restricts the output to CEs or SEs where the given VO is authorized. Mandatory when VO-dependent attributes are queried upon. --vo Specifies the attributes whose values should be printed.--attrs Print the output in a "sed-friendly" format.--sed Allows to specify a BDII in the form :. If not given, the value of the environmental variable LCG_GFAL_INFOSYS is used. If that is not defined, the command returns an error. --bdii Restricts the output to the CEs (SEs) which satisfy the given query.--query Lists the SEs which satisfy a query, or all the SEs if no query is given.--list-se Lists the CEs which satisfy a query, or all the CEs if no query is given.--list-ce Prints a list of attributes that can be queried.--list-attrs

17 Exercise 1 List all the attributes

18 lcg-info - 1 lcg-info --list-attrs Attribute name Glue object class Glue attribute name MaxTime GlueCE GlueCEPolicyMaxWallClockTime CEStatus GlueCE GlueCEStateStatus TotalJobs GlueCE GlueCEStateTotalJobs CEVOs GlueCE GlueCEAccessControlBaseRule TotalCPUs GlueCE GlueCEInfoTotalCPUs FreeCPUs GlueCE GlueCEStateFreeCPUs CE GlueCE GlueCEUniqueID WaitingJobs GlueCE GlueCEStateWaitingJobs RunningJobs GlueCE GlueCEStateRunningJobs CloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueID CloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueID SEVOs GlueSA GlueSAAccessControlBaseRule UsedSpace GlueSA GlueSAStateUsedSpace AvailableSpace GlueSA GlueSAStateAvailableSpace Type GlueSE GlueSEType SE GlueSE GlueSEUniqueID Protocol GlueSEAccessProtocol GlueSEAccessProtocolType....

19 Exercise 2 Listing tags of installed software

20 lcg-info - 2 lcg-info --list-ce --attrs Tag - CE: gilda03.lcca.usp.br:2119/jobmanager-lcgpbs-infinite - Tag LCG-2 LCG-2_1_0 LCG-2_1_1 LCG-2_2_0 LCG-2_3_0 LCG-2_3_1 LCG-2_4_0 LCG-2_6_0 GLITE-3_0_0 AFS CMS ATLAS GATE LHCb IDL-5.4 CMSIM-125 ALICE ALIEN

21 Exercise 3 Listing all the CEs with their FreeCPUs and TotalJobs attributes

22 lcg-info - 3 lcg-info --list-ce --attrs FreeCPUs,TotalJobs - CE: gilda03.lcca.usp.br:2119/jobmanager-lcgpbs-infinite - FreeCPUs 4 - TotalJobs 0 - CE: gilda03.lcca.usp.br:2119/jobmanager-lcgpbs-long - FreeCPUs 4 - TotalJobs 0 - CE: gilda03.lcca.usp.br:2119/jobmanager-lcgpbs-short - FreeCPUs 4 - TotalJobs 0 - CE: gildace01.roma3.infn.it:2119/jobmanager-lcgpbs-infinite - FreeCPUs 4 - TotalJobs 0

23 Exercise 4 List FreeCPUs and TotalJobs attributes of all the CEs that have TotalCPUs=10

24 lcg-info --list-ce --attrs FreeCPUs,TotalJobs --query TotalCPUs=10 lcg-info CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-infinite - FreeCPUs 10 - TotalJobs 0 - CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-long - FreeCPUs 10 - TotalJobs 0 - CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-short - FreeCPUs 10 - TotalJobs 0

25 Questions …