EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org Practical: The Information Systems.

Slides:



Advertisements
Similar presentations
Hands-on on Information System Antonio Juan Rubio Montero CIEMAT 10 th EELA Tutorial. Madrid, May 7 th -11 th,2007.
Advertisements

FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.
Hands-on on Information System Antonio Fuentes Bermejo Oviedo, 20 de Noviembre de 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Introduction to R-GMA: Relational Grid Monitoring Architecture.
The Information service Alessandro Costa INAF Catania Corso di Calcolo Parallelo Grid Computing Catania - ITALY September 2006.
INFSO-RI Enabling Grids for E-sciencE Information System : a detailed overview Giuseppe La Rocca INFN – Catania ICTP/INFM-Democritos.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with the GLUE information schema.
E-science grid facility for Europe and Latin America Installation and configuration of a top BDII Gianni M. Ricciardi – Consorzio COMETA.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Middleware: gLite Information Systems (IS) EGEE Tutorial 23 rd APAN Meeting,
INFSO-RI Enabling Grids for E-sciencE Information System Valeria Ardizzone INFN Singapore, 1st South East Asia Forum -- EGEE tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Configuring and Maintaining EGEE Production.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Information System (IS) Valeria Ardizzone.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
EGEE is a project funded by the European Union under contract IST SEE-GRID tutorial, Istanbul, Information services.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Felix Ehm CERN IT-GD EGEE 2008 GLUE 2.0.
INFSO-RI Enabling Grids for E-sciencE Workload Management System Mike Mineter
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Migration to the GLUE 2.0 information schema in the LCG/EGEE/EGI.
LCG Information and Monitoring System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
Mar 28, 20071/18 The OSG Resource Selection Service (ReSS) Gabriele Garzoglio OSG Resource Selection Service (ReSS) Don Petravick for Gabriele Garzoglio.
GLUE Schema: LDIF to old classad mapping Gabriele Garzoglio Computing Division, Fermilab May 31, 2006.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
Jan 31, 2006 SEE-GRID Nis Training Session Hands-on V: Standard Grid Usage Dušan Vudragović SCL and ATLAS group Institute of Physics, Belgrade.
July 25, 20071/21 OSG Information Services Gabriele Garzoglio, Rob Quick, Chris Green OSG Information Services, VO Monitoring Services and Resource Selection.
INFSO-RI Enabling Grids for E-sciencE BDII installation & configuration Giuseppe Platania INFN Catania EMBRACE Tutorial Clermont-Ferrand,
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
gLite Information System UNIANDES OOD Team Daniel Alberto Burbano Sefair, Michael Angel.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America gLite Information System Claudio Cherubino.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Command Line Grid Programming Spiros Spirou Greek Application Support Team NCSR “Demokritos”
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System Tutorial Laurence Field.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.
INFSO-RI Enabling Grids for E-sciencE GILDA Praticals GILDA Tutors INFN Catania 4th EGEE Conference Pisa 23.October.2005.
FESR Trinacria Grid Virtual Laboratory gLite Information System Muoio Annamaria INFN - Catania gLite 3.0 Tutorial Trigrid Catania,
LCG Information and Monitoring System Jason Shih ASGC Grid Administrator Tutorial March 15-16, Academia Sinica.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
First South Africa Grid Training Installation and configuration of BDII Gianni M. Ricciardi Consorzio COMETA First South Africa Grid Training Catania,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks BDII Server Installation & Configuration.
E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.
Enabling Grids for E-sciencE EGEE-II INFSO-RI Status of SRB/SRM interface development Fu-Ming Tsai Academia Sinica Grid Computing.
INFSO-RI Enabling Grids for E-sciencE Information System Giuseppe La Rocca Valeria Ardizzone INFN Catania 4th EGEE Conference Pisa.
The Information System in gLite middleware
Practicals on gLite Information Systems
gLite Information System
The Information System
Information System: Hands On
Practical: The Information Systems
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
The Information System in gLite
Information System Virginia Martín-Rubio Pascual
gLite Information System
Practicals on gLite Information System
gLite Information System
Hands-on on Information System
Tutorial Grille (LCG/EGEE)
gLite Information System Practicals
gLite Information System overview
EGEE Middleware: gLite Information Systems (IS)
gLite Information System Overview
The gLite information system: Top BDII
The gLite Information System
Hands-on on the gLite Information System
Information System (BDII)
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical: The Information Systems

Enabling Grids for E-sciencE EGEE-II INFSO-RI Overview of gLite Middleware

Enabling Grids for E-sciencE EGEE-II INFSO-RI Uses of the Information System If you are a middleware developer Workload Management System: Matching job requirements and Grid resources Monitoring Services: Retrieving information about Grid Resources status and availability If you are a user Retrieve information about Grid resources and status Resources that can run your job Status of your jobs If you are site manager or service You “generate” the information for example relative to your site or to a given service

Enabling Grids for E-sciencE EGEE-II INFSO-RI Evolution The data published in the Information System (IS) conforms to the GLUE (Grid Laboratory for a Uniform Environment) Schema. The GLUE Schema aims to define a common conceptual data model to be used for Grid resources. The BDII (Berkeley DB Information Index), based on an updated version of the Monitoring and Discovery Service (MDS), from Globus, is adopted as main provider of the Information Service.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Overview Of Practicals BDII Information System –main Information System for the current production grid –Two sets of commands:  lcg-infosites: simple, meets most needs  lcg-info: supports more complex queries

Enabling Grids for E-sciencE EGEE-II INFSO-RI lcg-infosites

Enabling Grids for E-sciencE EGEE-II INFSO-RI a user or a service can query – the BDII (usual mode) – LDAP servers on each site LCG Information Service

Enabling Grids for E-sciencE EGEE-II INFSO-RI The LDAP Protocol ► Lightweight Directory Access Protocol: structures data as a tree ► Following a path from the node back to the root of the DIT, a unique name is built (the DN): “id=pml,ou=IT,or=CERN,st=Geneva, \ c=Switzerland,o=grid” o = grid (root of the DIT) c= US c=Switzerland c=Spain st = Geneva or = CERN ou = IT ou = EP id = pml id=gv id=fd objectClass:person cn: Patricia M. L. phone: office: 28-r019

Enabling Grids for E-sciencE EGEE-II INFSO-RI lcg-infosites The lcg-infosites command can be used as an easy way to retrieve information on Grid resources for most use cases. USAGE: lcg-infosites --vo options -v --is

Enabling Grids for E-sciencE EGEE-II INFSO-RI lcg-infosites options

Enabling Grids for E-sciencE EGEE-II INFSO-RI PRACTICAL This introduces use of the commands to access the information system You will be exploring the GILDA grid, seeing what computing elements and storage elements exist. Please go to the link from this practical.

Enabling Grids for E-sciencE EGEE-II INFSO-RI lcg-info options

Enabling Grids for E-sciencE EGEE-II INFSO-RI Get the list of supported attributes $ lcg-info --list-attrs Attribute name Glue object class Glue attribute name MaxTime GlueCE GlueCEPolicyMaxWallClockTime CEStatus GlueCE GlueCEStateStatus TotalJobs GlueCE GlueCEStateTotalJobs CEVOs GlueCE GlueCEAccessControlBaseRule TotalCPUs GlueCE GlueCEInfoTotalCPUs FreeCPUs GlueCE GlueCEStateFreeCPUs CE GlueCE GlueCEUniqueID WaitingJobs GlueCE GlueCEStateWaitingJobs RunningJobs GlueCE GlueCEStateRunningJobs CloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueID CloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueID SEVOs GlueSA GlueSAAccessControlBaseRule UsedSpace GlueSA GlueSAStateUsedSpace AvailableSpace GlueSA GlueSAStateAvailableSpace Type GlueSE GlueSEType SE GlueSE GlueSEUniqueID Protocol GlueSEAccessProtocol GlueSEAccessProtocolType ArchType GlueSL GlueSLArchitectureType Processor GlueSubCluster GlueHostProcessorModel OS GlueSubCluster GlueHostOperatingSystemName Cluster GlueSubCluster GlueSubClusterUniqueID Tag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironment Memory GlueSubCluster GlueHostMainMemoryRAMSize

Enabling Grids for E-sciencE EGEE-II INFSO-RI lcg-info examples $ lcg-info --vo gilda --list-ce --query 'Tag=MPICH' --attrs 'FreeCPUs,Tag' List all the CE(s) that can run MPICH, giving the number of free CPUs and the tags of installed software No space allowed here! Careful here! -….. CE: grid-ce.bio.dist.unige.it:2119/jobmanager-lcgpbs-long - FreeCPUs 6 - Tag LCG-2 LCG-2_1_0 LCG-2_1_1 ….

Enabling Grids for E-sciencE EGEE-II INFSO-RI Monitoring Two examples of monitoring systems (Not using EGEE middleware directly – its an additional service deployed by the visible sites) CEWorkhttp://infnforge.cnaf.infn.it/gridice/index.php/Main/GridI CEWork –Select a URL for GILDA  VO view (menu)  Select GILDA (column, far left)  Charts –Try also for LCG