INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org Resource allocation and negotiation update C. Vistoli, R. Rumler Operations workshop Bologna.

Slides:



Advertisements
Similar presentations
– n° 1 VO Magic – Planck – Compchem in the production infrastructure.
Advertisements

INFSO-RI Enabling Grids for E-sciencE XACML and G-PBox update MWSG 14-15/09/2005 Presenter: Vincenzo Ciaschini.
INFSO-RI Enabling Grids for E-sciencE EGEODE VO « Expanding GEosciences On DEmand » Geocluster©: Generic Seismic Processing Platform.
Dave Kant Grid Monitoring and Accounting Dave Kant CCLRC e-Science Centre, UK HEPiX at Brookhaven 18 th – 22 nd Oct 2004.
INFSO-RI Enabling Grids for E-sciencE Earth Sciences Requirements and Resources OAG Wed 18 May 2005.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
© 2006 Open Grid Forum Enabling Pervasive Grids The OGF GIN Effort Erwin Laure GIN-CG co-chair, EGEE Technical Director
INFSO-RI Enabling Grids for E-sciencE VO BOX Summary Conclusions from Joint OSG and EGEE Operations Workshop - 3 Abingdon, 27 -
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE is a project funded by the European Union under contract IST User support in EGEE Alistair Mills Torsten Antoni EGEE-3 Conference 20 April.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Bazaar Vision Ideas of RC/VO coordination,
EGEE is a project funded by the European Union under contract IST Support Operation Challenge – 1 SOC-1 Alistair Mills Torsten Antoni ARM-4,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Performance Improvements to BDII - Grid Information.
Enabling Grids for E- sciencE EGEE and gLite are registered trademarks EGEE-III INFSO-RI Analysis of Overhead and waiting times.
Certification and test activity IT ROC/CIC Deployment Team LCG WorkShop on Operations, CERN 2-4 Nov
INFSO-RI Enabling Grids for E-sciencE “Round the regions” - France P. Girard ARM-7, Krakow,
INFSO-RI Enabling Grids for E-sciencE Earth Sciences: EGEODE « Expanding Geosciences On Demand » EGEE 1 st EU Review – 9 th to 11.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
INFSO-RI Enabling Grids for E-sciencE Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives - Plovdiv,
Enabling Grids for E-sciencE INFSO-RI Tools for CIC Operations, Bologna, 24th May Monitoring workflow in EGEE GOC DB is used to get the list.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Operations Automation Team KoM, May ROC VIEW (SWE)‏ Javier Lopez Cacheiro/
INFSO-RI Enabling Grids for E-sciencE GridICE: Grid and Fabric Monitoring Integrated for gLite-based Sites Sergio Fantinel INFN.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Support for New and Existing Users Gergely.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks DSA1.4 – Objectives and Status Ioannis Liabotis.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC Security Contacts R. Rumler Lyon/Villeurbanne.
Cracow Grid Workshop, October 15-17, 2007 Polish Grid Polish NGI Contribution to EGI Resource Provisioning Function Automatized Direct Communication Tomasz.
Certification and test activity ROC/CIC Deployment Team EGEE-SA1 Conference, CNAF – Bologna 05 Oct
Last update 31/01/ :41 LCG 1 Maria Dimou Procedures for introducing new Virtual Organisations to EGEE NA4 Open Meeting Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Deliverable DSA1.4 Jules Wolfrat ARM-9 –
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Alistair.
INFSO-RI Enabling Grids for E-sciencE Introduction to Grid Computing, EGEE and Bulgarian Grid Initiatives, Sofia, South.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
ROC managers meeting, Barcelona, Luciano Gaido (thanks to Paolo Veronesi for the slides) ROC-IT status.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Software Licensing in the EGEE Grid infrastructure.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC FR - On the way to the EGI/NGI structure.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
INFSO-RI Enabling Grids for E-sciencE Round the regions ROC managers Lyon.
EGEE is a project funded by the European Union under contract IST New VO Integration Fabio Hernandez ROC Managers Workshop,
EGEE is a project funded by the European Union under contract IST Service Activity 1 M.Cristina Vistoli ROC Coordinator All activity meeting,
LCG Workshop User Support Working Group 2-4 November 2004 – n o 1 Some thoughts on planning and organization of User Support in LCG/EGEE Flavia Donno LCG.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Overview of gLite, the EGEE middleware Mike Mineter Training Outreach Education National.
EGEE-III INFSO-RI Enabling Grids for E-sciencE VO Authorization in EGEE Erwin Laure EGEE Technical Director Joint EGEE and OSG Workshop.
II EGEE conference Den Haag November, ROC-CIC status in Italy
– n° 1 Grid di produzione INFN – GRID Cristina Vistoli INFN-CNAF Bologna Workshop di INFN-Grid ottobre 2004 Bari.
EGEE is a project funded by the European Union under contract IST Compchem VO's user support EGEE Workshop for VOs Karlsruhe (Germany) March.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
1/3/2006 Grid operations: structure and organization Cristina Vistoli INFN CNAF – Bologna - Italy.
INFSO-RI Enabling Grids for E-sciencE GOCDB Requirements John Gordon, STFC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Support for New and Existing Users Gergely.
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
Regional Operations Centres Core infrastructure Centres
EGEE is a project funded by the European Union
Support Operation Challenge – 1 SOC-1 Alistair Mills Torsten Antoni
User Support Workflow in EGEE
Ian Bird GDB Meeting CERN 9 September 2003
Brief overview on GridICE and Ticketing System
INFN – GRID status and activities
The CCIN2P3 and its role in EGEE/LCG
SA1 ROC Meeting Bologna, October 2004
Education and Training Statistics Working Group, May 2011
EGEE Operation Tools and Procedures
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE Resource allocation and negotiation update C. Vistoli, R. Rumler Operations workshop Bologna

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 2 Contents Resource update (selection) –Biomed –CompChem –ESR –Magic –Planck –Grid Services for recent VOs Highlighting needs of recent VOs Resource negotiation –Problems –Workflow suggestion –Other possible organizational solutions

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 3 Status of Biomed support in EGEE LCG 40 resource centers 70 queues About 200 slots, running jobs Countries: –IT, FR, UK, TW, RU, GR, CY, PL, ES, DE, RO, BG –NE ROC Services: RBs: France, Italy, RLS: France, VO server: France

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 4 Status of CompChem support in EGEE LCG 12 resource centers 17 queues About 100 slots, running jobs Countries: –IT: 11 RC –SEE: 1 GR RC Services: RB: Italy, France, RLS: Italy, VOMS: Italy

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 5 COMPCHEM VO

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 6 Status of ESR support in EGEE LCG 25 resource centers 50 queues About 300 slots, running jobs Countries: –FR, IT, GR, BG, SK, DE Services: RBs: France, Italy, RLS: ?, VO server: NL

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 7 Status of MAGIC support in EGEE LCG 18 resource centers 24 queues About 500 slots, running jobs Countries: –IT: 13 RC –SWE: 2 RC ES (Pic,Ifae) –SEE: 2 RC BG, GR –CE: 1 RC SK Services: RB: Italy, RLS: Spain, VO server: NL

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 8 MAGIC VO

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 9 Status of Planck support in EGEE LCG 14 resource centers 22 queues About 100 slots, running jobs Country: –IT: 14 RC Services: RB: Italy, France, RLS: Italy, VOMS: Italy

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 10 Planck Vo

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 11 Grid Services for recent VOs (1) Resource Brokers: Magic - Planck - CompChem –egee-rb-01.cnaf.infn.it ; –grid008g.cnaf.infn.it (DAG enabled) BDIIs: –egee-bdii-01.cnaf.infn.it Replica Location Service CompChem and Planck –datatag2.cnaf.infn.it Replica Location Service Magic –rlsmagic.pic.es

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 12 Grid Services for recent VOs (2) Monitoring:GridICE server: –EGEE/LCG Production infrastructure  VOMS server Planck CompChem –testbed008.cnaf.infn.it VO server Magic –grid-vo.sara.nl

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 13 Highlighting needs of recent VOs VOs CompChem, Magic, Planck Main requirements are: –CPU power –MPI –Licensed software –“High” volume of local disk space on WNs All need secure data access

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 14 Resource negotiation: Problems Only general percentages by region available Interpretation of numbers not always the same No indication on availability of specific resources (MPI, licensed software) Allocation has to be done site by site Gap between OAG and sites, to be filled by ROCs ROCs don’t decide on scientific priorities Exact workflow description missing

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 15 Resource negotiation: Workflow EGAAP, with OAG participation, decides on VO acceptance OAG starts MOU process, informs ROCs ROCs query sites on possible participation OAG and ROCs do the follow up VOs, ROCs, and OAG are informed of result OAG does follow up on VO reaction to site answers OAG signals problems to VOs and/or PEB

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 16 Resource negotiation: Implementation Implementation via CIC portal, “OAG view” (and VO/RC) –Readable to everybody –Role-specific actions reserved to authorized people  Sites: support yes/no, free cycles only / more detailed description  OAG/ROCs: (re-)trigger requests to sites/ROCs (specific broadcast)  VOs: contact point for discussions with specific sites –Shows site status by region: Solicited, Answered (+answer details) Automate statistics, summaries, steps of the procedure

Enabling Grids for E-sciencE INFSO-RI Resource allocation and negotiation update, , C. Vistoli, R. Rumler 17 Resource negotiation: Other Other possible organizational solutions ?