DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,

Slides:



Advertisements
Similar presentations
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
Advertisements

LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL.
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – Title – n° 1 Grid Data Management in Action Experience in Running and.
Massimo Cafaro GridLab Review GridLab WP10 Information Services Massimo Cafaro CACT/ISUFI University of Lecce, Italy.
EDG Resource Broker for the Glue Schema Sergio Andreozzi INFN-CNAF Bologna (Italy)
Andrew McNab - Manchester HEP - 22 April 2002 UK Rollout and Support Plan Aim of this talk is to the answer question “As a site admin, what are the steps.
INFSO-RI Enabling Grids for E-sciencE XACML and G-PBox update MWSG 14-15/09/2005 Presenter: Vincenzo Ciaschini.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
The EDG Testbed Deployment Details The European DataGrid Project
GLUE Schema: conceptual model and implementation
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with the GLUE information schema.
OSG Services at Tier2 Centers Rob Gardner University of Chicago WLCG Tier2 Workshop CERN June 12-14, 2006.
OSG Site Provide one or more of the following capabilities: – access to local computational resources using a batch queue – interactive access to local.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
Managing Computational Activities on the Grid - from Specifications to Implementation: The GLUE 2 information model OGF25, 2nd March 2009, Catania Balázs.
1 BIG FARMS AND THE GRID Job Submission and Monitoring issues ATF Meeting, 20/06/03 Sergio Andreozzi.
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
27-28 August 2002Flavia Donno, INFN-Pisa1 Report on GLUE activities Flavia Donno, INFN-Pisa EDG Retreat August 2002.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
São Paulo Regional Analysis Center SPRACE Status Report 22/Aug/2006 SPRACE Status Report 22/Aug/2006.
First attempt for validating/testing Testbed 1 Globus and middleware services WP6 Meeting, December 2001 Flavia Donno, Marco Serra for IT and WPs.
Glue Schema Status Jennifer Schopf Argonne National Lab May 23,2002.
Virtual Batch Queues A Service Oriented View of “The Fabric” Rich Baker Brookhaven National Laboratory April 4, 2002.
EGEE is a project funded by the European Union under contract INFSO-RI Copyright (c) Members of the EGEE Collaboration GLUE Schema Sergio.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG GDB, CERN 10 December 2008.
Resource Management Task Report Thomas Röblitz 19th June 2002.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
EGEE is a project funded by the European Union under contract INFSO-RI Practical approaches to Grid workload management in the EGEE project Massimo.
VO Privilege Activity. The VO Privilege Project develops and implements fine-grained authorization to grid- enabled resources and services Started Spring.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
DataTAG Work Package 4 Meeting Bologna Simone Ludwig Brunel University 23rd and 24th of May 2002.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
DataTAG: Glue schema test C.Vistoli DataTAG Wp4 Meeting 23/5/2002.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
OSG Site Admin Workshop - Mar 2008Using gLExec to improve security1 OSG Site Administrators Workshop Using gLExec to improve security of Grid jobs by Alain.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 29 GridICE The eyes of the grid A monitoring tool for a Grid Operation Center.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Report on Installed Resource Capacity Flavia Donno CERN/IT-GS WLCG Management Board, CERN 25 November 2008.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
April 25, 2006Parag Mhashilkar, Fermilab1 Resource Selection in OSG & SAM-On-The-Fly Parag Mhashilkar Fermi National Accelerator Laboratory Condor Week.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
Architecture of monitoring elements for the network element modeling in a Grid infrastructure Authors: Augusto Ciuffoletti Tiziana Ferrari Antonia Ghiselli.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi
OSG Status and Rob Gardner University of Chicago US ATLAS Tier2 Meeting Harvard University, August 17-18, 2006.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Implementation of GLUE 2.0 support in the EMI Data Area Elisabetta Ronchieri on behalf of JRA1’s GLUE 2.0 Working Group INFN-CNAF 13 April 2011, EGI User.
The EDG Testbed Deployment Details
Monitoring and Information Services Technical Group Report
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Towards GLUE Schema v Sergio Andreozzi – INFN/CNAF sergio
Resource monitoring and discovery in OGSA
Sergio Fantinel, INFN LNL/PD
EDT-WP4 monitoring group status report
CMS report from FNAL demo week Marco Verlato (INFN-Padova)
A conceptual model of grid resources and services
5th EU DataGrid Conference
Report on GLUE activities 5th EU-DataGRID Conference
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna, 29 July 2003 Sergio Andreozzi INFN-CNAF

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 2 OUTLINE The Information Model – open issues Computing resources Storage resources Monitoring extensions The LDAP Implementation for MDS Integration status

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 3 Computing resources Issue 1: CE viewpoint of the cluster The subcluster concept is suitable to provide a summary description of the nature of a cluster in term of host characteristics It does not properly suits brokering needs This leads to the current EDG constraint of one subcluster per cluster This is a limitation because: Does not accommodate the hypothesis of heterogeneous clusters Does not accommodate flexibility in batch system configuration MISSING TO EXPRESS DESCRIPTION OF NODES ASSIGNED TO A SPECIFIC QUEUE

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 4 Computing resources Issue 1: CE viewpoint of the cluster CPU:PIII RAM:0.5GB OS:Linux … Head node gatekeeper infoService CPU:PIII RAM:0.5GB OS:Linux CPU:PIV RAM:2GB OS:Linux CMS CPU:PIV RAM:2GB OS:Linux ATLAS Batch server In this cluster, a computing element is configured with a node assigned to CMS VO. A specific software is installed in that node.

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 5 Computing resources Issue 1: CE viewpoint of the cluster CPU:PIII RAM:0.5GB OS:Linux … Head node gatekeeper infoService CPU:PIII RAM:0.5GB OS:Linux CPU:PIV RAM:2GB OS:Linux CMS CPU:PIV RAM:2GB OS:Linux ATLAS Batch server In this cluster, a computing element is configured with a node assigned to ATLAS VO. A specific software is installed in that node.

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 6 Computing resources Issue 1: CE viewpoint of the cluster this association needs to be introduced and described

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 7 Computing resources Issue 2: multiple entry points to a queue The CE Unique ID contains the contact point For scalability issues, in big cluster it is envisioned: To separate gatekeeper from batch server To deploy more than one gatekeeper This leads to the duplication of CE entities Needs to refine the CE definition Possible solution: refine the CE ID, (informally) from the grid entry point into a queue of a batch system, to the queue of a batch system Entry points are properties of the CE

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 8 Computing resources Issue 2: multiple entry points to a queue Worker node Worker node Worker node Worker node … Head node Batch server Access node1 gatekeeper Access node2 gatekeeper Access noden gatekeeper … queue gris Can run on an access node, on the Head node or on another machine e.g.: from CEUniqueID: accessnode1:2119/jobmanager-pbs-red accessnoden:2119/jobmanager-pbs-red to CEUniqueID: headnode/jobmanager-pbs-red (the list of accesspoints are attributes)

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 9 Storage resources The Grid Resource is the space being shared Glue SE Schema aims at provide a generalization for several Storage Resource Manager Glue SE Schema 1.1 is mainly based on experience on using disk-servers with a set of protocol to access/transfer data design documents related to SRM

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 10 Storage resources Current deployment experience within EDG 2.0 (where SE is the EDG-SE) is providing useful feedback Several refinements are needed in order to deal with new use cases I’m working on a proposal with use cases; this will take into account most of the features discussed during last CHEP (ref:

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 11 GLUE Schema extended for monitoring within DataTAG we have extended the host entity with several metrics these have not been proposed for inclusion in the GLUE schema any action on this?

DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 12 GLUE Schema integration in VDT Early July, meeting with Alain Roy at CNAF Achievement: By this week in VDT there will be: Updated GLUE Schema, extended version EDG CE Info provider properly configured for CONDOR LRMS