EGEE-II INFSO-RI-031688 Enabling Grids for E-sciencE www.eu-egee.org EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &

Slides:



Advertisements
Similar presentations
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks From ROCs to NGIs The pole1 and pole 2 people.
Advertisements

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Romanian SA1 report Alexandru Stanciu ICI.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 – Training & Induction Robin McConnell,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks General relationships with EGEE JRA1 SA3.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
Enabling Grids for E-sciencE SA1 EGEE-II INFSO-RI The Pre-Production Service in WLCG/EGEE A. Retico, N. Thackray CERN – Geneva, Switzerland PPS.
INFSO-RI Enabling Grids for E-sciencE Plan until the end of the project and beyond, sustainability plans Dieter Kranzlmüller Deputy.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE-III INFSO-RI Enabling Grids for E-sciencE Monitoring and enforcement of Service Level Agreements John Shade EGEE-II / EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Bazaar Vision Ideas of RC/VO coordination,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team James Casey EGEE’08.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE Gergely Sipos
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Multi-level monitoring - an overview James.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Performance Improvements to BDII - Grid Information.
Enabling Grids for E- sciencE EGEE and gLite are registered trademarks EGEE-III INFSO-RI Analysis of Overhead and waiting times.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Report from GGUS BoF Session at the WLCG.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 – Procedures for Training Event Robin.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III Proposal Draft Summary of activity.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Operations Automation Team KoM, May ROC VIEW (SWE)‏ Javier Lopez Cacheiro/
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Gergely Sipos Activity Deputy Manager MTA.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Pre-production in EGEEIII Operation principles Antonio Retico EGEE-II / EGEE II SA1.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Support for New and Existing Users Gergely.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MSG - A messaging system for efficient and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks DSA1.4 – Objectives and Status Ioannis Liabotis.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Using GStat 2.0 for Information Validation.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Operational Architecture of PL-Grid project M.Radecki,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks NA3 – Procedures for Training Event Robin.
Cracow Grid Workshop, October 15-17, 2007 Polish Grid Polish NGI Contribution to EGI Resource Provisioning Function Automatized Direct Communication Tomasz.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell NA3 Activity Manager 28.
Last update 31/01/ :41 LCG 1 Maria Dimou Procedures for introducing new Virtual Organisations to EGEE NA4 Open Meeting Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CIC portal Requirements from users WLCG service.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Deliverable DSA1.4 Jules Wolfrat ARM-9 –
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Alistair.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks User Support for Distributed Computing Infrastructures.
Grid Operations in EGI / NGIs The EGI mw function Panagiotis Louridas, GRNET Tomasz Szepieniec, CYFRONET Report from the 1st Session Rome, March.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks UK-Ireland-France Regional Participation.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA2 Networking support for EGEE III Xavier.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks LHCOPN Operations WS: Introduction & Objectives.
Components Selection Validation Integration Deployment What it could mean inside EGI
EGEE-II INFSO-RI Enabling Grids for E-sciencE Training in EGEE-II Mike Mineter (Some slides from Brendan Hamill)
EGEE is a project funded by the European Union under contract IST New VO Integration Fabio Hernandez ROC Managers Workshop,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Robin McConnell Activity Manager UEDIN (NeSC)
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Astrophysical Cluster Session Claudio Vuerli,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks COD-16 (Transition to EGEE-III) Report to.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations automation team presentazione.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks IT ROC: Vision for EGEE III Tiziana Ferrari.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Training in EGEE-III and beyond Robin McConnell,
Regional Operations Centres Core infrastructure Centres
Ian Bird GDB Meeting CERN 9 September 2003
Service Level Agreement/Description between CE ROC and Sites
The CCIN2P3 and its role in EGEE/LCG
Presentation transcript:

EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview & Related Activites Tomasz Szepieniec, Resource Allocation Group, ACC CYFRONET AGH

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 2 Resource Allocation in EGEEII From EGEEII periodic report (SA1 part): „VO must get access to resources […]. Until now this allocation of resources to new VO is not working very well. For the smaller VOs, it is very difficult to negotiate with the resource centres separately” Current VO Registration Procedur, „Once a VO registration has been approved by the OAG,…” „The OAG will work with you in parallel to arrange more permanent resources and other grid services for the VO.” „To obtain more resources, the VO manager will have to interact with the OAG and the ROCs. The OAG will drive this process to ensure that the VO has the necessary resources”

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 3 RA Group Mandate 1/2 Hand-over activities of Operational Advisory Group:  decide the way the activities will be continued in EGEEIII  update procedures (especially VO registration) accordingly  monitor if the activities are running properly Organize the central seed-resources pool  prepare conditions for a tender  prepare and update all related procedures  prepare SLD related to a VO running on central seed resources pool and to sites contributing to this pool,  support VOs allocated to central-pool of seed resources in the process of resource allocation,  monitor activity and development of VOs allocated to seed resources

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 4 RA Group Mandate 2/2 Work-out a scalable model of resources allocation for the EGEE infrastructure that would be applicable both to large and to small VOs and cover all areas listed below:  core infrastructure services for the VO (e.g. VOMS, LFC,...);  seed resources (both central and regional pools),  "permanent" resources (i.e. VOs that would like to expand the number of sites/resources supporting them),  "campaign" resources (i.e. large-scale resources for short-term calculation campaigns). Providing reports about:  resources allocation process,  usage of seed resources both in central and regional pools based on accounting and related commitments.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 5 RA Group Participation NA4 representative(s), OCC representative, All ROCs representatives responsible for "Application - Resource Provider Coordination" (subtask 1.1.4), Representatives of sites maintaining central pool of seed resources

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 6 Central-pool of seed resources The pool works as a ‘VO incubator’ The resources will be used to be made available to new user communities not linked to the partners of the EGEE consortium VO allocated to the pool can use it for maximum 6 months VO is expected to evolve towards more pernament resources

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 7 Central-pool of seed resources 1/2 Money (51k EUR) should be allocated to two or three sites which have experience in operation (including grid core services for VO) and agree to follow the requirements defined in the tender Winning offers should guarantee: –substantial number of CPUs, storage and a full set of core services, –possibility to set-up the pool within one month after announcing results of this tender (it is crucial to be –independent from won money transfer and hardware acquire procedures). Money won in the tender should be spent on hardware only (not personnel), but sites need to provide relevant man-power for maintaining services and collaborate on operation of seed- resources pool.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 8 Future Resource Allocation What is missing: –Clear view on VOs demands for resources –Well defined procedures for negotiations, agreement, re- configuration and approval –Support for the communication between people –Possibility of tracking contracts changes –Easy way to negotiate agreement conditions/SLD –Feedback A challenge for RA Group is to change previous heading into „What we have”

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 9 Promising experience in CE Bazaar – a tool supporting resource management  Supports comunication between sites and VOs  Integrated with CIC-Portal  No cost of entry – data obtained from GOCDB and CIC-Portal VO- card  Easy in use The most important features of Bazaar v1.0:  Call and contract between VOs and RCs management  Clear view on VOs demands for resources  Support for the process of resource negotiation  notifications for VO and RC Managers  Tracking of contract changes

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 10 Summary Resources Allocation it is recognized as less developed 'service' in EGEE-grid We have few urgent actions –Reorganize VO registration –Organize central-seed resources pool A challenge is to work-out solution that would be substantially better.

Enabling Grids for E-sciencE EGEE-II INFSO-RI Resource Allocation Group 11 Disscusion Who will 'do the work' in Resources Allocation? –Evaluation of new VO registration, decisions –Managing the central-pool –Organize communication in resource allocation process between VOs and ROC/sites –Maintaing and update tools (VO-cards, automatization of the process)‏ –Collect information about active VOs and efficiency of allocation process