EDG Resource Broker for the Glue Schema Sergio Andreozzi INFN-CNAF Bologna (Italy)

Slides:



Advertisements
Similar presentations
Grid Workload Management (WP 1) Report to INFN-GRID TB Massimo Sgaravatto INFN Padova.
Advertisements

DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Job Submission The European DataGrid Project Team
WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
10 April 2003Deploy Grid in Israel Universities1 Deploy Grid testbed in Israel universities Lorne Levinson David Front Weizmann Institute.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
Basic Grid Job Submission Alessandra Forti 28 March 2006.
GLUE Schema: conceptual model and implementation
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Experiences with the GLUE information schema.
1 BIG FARMS AND THE GRID Job Submission and Monitoring issues ATF Meeting, 20/06/03 Sergio Andreozzi.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
M. Sgaravatto – n° 1 The EDG Workload Management System: release 2 Massimo Sgaravatto INFN Padova - DataGrid WP1
DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Information System on gLite middleware Vincent.
A monitoring tool for a GRID operation center Sergio Andreozzi (INFN CNAF), Sergio Fantinel (INFN Padova), David Rebatto (INFN Milano), Gennaro Tortone.
LCG / ARC Interoperability Status Michael Grønager, PhD (UNI-C / NBI) January 19, 2006, Uppsala.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Glue Schema Status Jennifer Schopf Argonne National Lab May 23,2002.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
EGEE is a project funded by the European Union under contract INFSO-RI Copyright (c) Members of the EGEE Collaboration GLUE Schema Sergio.
DataGRID Testbed Enlargement EDG Retreat Chavannes, august 2002 Fabio HERNANDEZ
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
Towards a WBEM-based Implementation of the OGF GLUE Information Model Sergio Andreozzi, INFN-CNAF, Bologna (Italy) Third EGEE User Forum 13 Feb 2008, Clermont-Ferrand,
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
University of Catania, Engineering Faculty Department of Computer Science and Telecommunications Report about the Development of Scheduling Algorithm in.
DataTAG Work Package 4 Meeting Bologna Simone Ludwig Brunel University 23rd and 24th of May 2002.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
EGEE is a project funded by the European Union under contract IST WS-Based Advance Reservation and Co-allocation Architecture Proposal T.Ferrari,
DataTAG: Glue schema test C.Vistoli DataTAG Wp4 Meeting 23/5/2002.
DataTAG is a project funded by the European Union DataTAG WP4 meeting, Bologna 29/07/2003 – n o 1 GLUE Schema - Status Report DataTAG WP4 meeting Bologna,
Workload Management System Jason Shih WLCG T2 Asia Workshop Dec 2, 2006: TIFR.
Your university or experiment logo here Performance Monitoring Gidon Moont e-Science, HEP, Imperial College London Talk to JRA1.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 29 GridICE The eyes of the grid A monitoring tool for a Grid Operation Center.
Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.
Author - Title- Date - n° 1 Partner Logo WP5 Status John Gordon Budapest September 2002.
Testing the HEPCAL use cases J.J. Blaising, F. Harris, Andrea Sciabà GAG Meeting April,
Site Certification Process (Round Table) Fabio Hernandez IN2P3 Computing Center - Lyon October
EDG - WP1 (Grid Work Scheduling) Status and plans Massimo Sgaravatto INFN Padova.
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES L. Betev, A. Grigoras, C. Grigoras, P. Saiz, S. Schreiner AliEn.
Gennaro Tortone, Sergio Fantinel – Bologna, LCG-EDT Monitoring Service DataTAG WP4 Monitoring Group DataTAG WP4 meeting Bologna –
Architecture of monitoring elements for the network element modeling in a Grid infrastructure Authors: Augusto Ciuffoletti Tiziana Ferrari Antonia Ghiselli.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Ideal information system - CMS Andrea Sciabà IS.
INFSO-RI Enabling Grids for E-sciencE Enabling Grids for E-sciencE Storage Element Model and Proposal for Glue 1.3 Flavia Donno,
DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi
E-science grid facility for Europe and Latin America Updates on Information System Annamaria Muoio - INFN Tutorials for trainers 01/07/2008.
The EDG Testbed Deployment Details
gLite Information System
Classic Storage Element
Practical: The Information Systems
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
Towards GLUE Schema v Sergio Andreozzi – INFN/CNAF sergio
The Information System in gLite
Resource monitoring and discovery in OGSA
Sergio Fantinel, INFN LNL/PD
SRM2 Migration Strategy
CMS report from FNAL demo week Marco Verlato (INFN-Padova)
A conceptual model of grid resources and services
Report on GLUE activities 5th EU-DataGRID Conference
EGEE Middleware: gLite Information Systems (IS)
GLUEMan: A WBEM-based Implementation of GLUE 2.0
Information Services Claudio Cherubino INFN Catania Bologna
Presentation transcript:

EDG Resource Broker for the Glue Schema Sergio Andreozzi INFN-CNAF Bologna (Italy)

Bologna Feb 18,2003DataTAG WP4 meeting 2 OUTLINE Activity summary – Aug ’02->now Main encountered problems and their solutions Future evolutions

Bologna Feb 18,2003DataTAG WP4 meeting 3 From the beginning to the current status Aug ’02 – first Glue schema LDAP implementation for the CE and draft implementation for the SE Sep ’02 – S.Monforte has started RB porting (version , 1 week) Oct-Nov ’02 – S.Andreozzi, V.Ciaschini, E.Ronchieri finalized a working version for the SC2002 demo Gen ’02 – S.Andreozzi, V.Ciaschini, E.Ronchieri ported the RB, vers _2

Bologna Feb 18,2003DataTAG WP4 meeting 4 Problems and solutions: services and systems separation Glue Schema: separation between service and systems implementing them – > different information types before were in the same entry (CE), now are split in two entries (CE, Subcluster) CE1CE2 Cluster CE1CE2 Sub Cluster Vo name Vo name

Bologna Feb 18,2003DataTAG WP4 meeting 5 Problems and solutions: services and systems separation For each CE – first query for the service – Second query for the system – Merge of results – classAd transformation This does not sensitive affect performances It can be possible to improve it – Possible strategies: query one time the subcluster for all CE’s use of ‘entry keys’ (fictious) to get both CE and subcluster data at once

Bologna Feb 18,2003DataTAG WP4 meeting 6 Problems and solutions: matchmaking when local SE Problem: – Data Access Protocols are published in the SE – Required DAP for a job are specified in the JDL – IF at least one required DAP matches one SE DAP, THEN OK DOES THIS ALWAYS WORK? – NO E.g. – For the SE edt001 file, gridftp and rfio are advertised – The user specifies file as DAP – The broker might match this SE with a CE that does not have local access to the SE

Bologna Feb 18,2003DataTAG WP4 meeting 7 Problems and solutions: matchmaking when local SE Glue Broker strategy: – Data Access Protocols are published in the SE – Required DAP for a job are specified in the JDL – IF (at least one required DAP matches one SE DAP) AND NOT (only DAP file matches on a SE not locally accessible by the CE), THEN OK

Bologna Feb 18,2003DataTAG WP4 meeting 8 Problems and solutions: matchmaking when local SE Ideal strategy: – Each system advertises its Data Access Protocols ( a system can provide Computing or Storage Services) – Each Computing/Storage Service advertises enabled DAP’s – Required DAP for a job are specified in the JDL – IF (at least there is one common required DAP among enabled by an SE, enabled by a CE and required in the JDL, THEN OK This is the most general!!!

Bologna Feb 18,2003DataTAG WP4 meeting 9 Future evolutions With Glue Schema 1.x, for each service the related Information Service URL will be published – Use this info to free the broker from the constraint of ALL GRIS’s on the same port Enable the possibility of specify a minimum amount of disk space for the SE RLS testing OTHER IDEAS???