Centrally Managed Resource Allocation

Slides:



Advertisements
Similar presentations
1 EGI Federated Clouds Task Force HEPiX Spring 2012 Workshop Matteo Turilli
Advertisements

Defining France Grilles resource allocation strategy Gilles Mathieu, IN2P3 Computing Centre France Grilles International Advisory Committee – March 2011.
23 June Strategy Proposal Heinz Stockinger on behalf of the Executive Board SwiNG Assembly Meeting Berne, 23 June 2008.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE EGI services for the long tail of science Peter Solagna Senior Operations.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
EGI: SA1 Operations John Gordon EGEE09 Barcelona September 2009.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EG recent developments T. Ferrari/EGI.eu ADC Weekly Meeting 15/05/
Policy-based CPU-scheduling in VOs Catalin Dumitrescu, Mike Wilde, Ian Foster.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Steven Newhouse EGEE’s plans for transition.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Future Plans T. Ferrari/EGI.eu 1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Towards H2020 Tiziana Ferrari/EGI.eu WLCG Collaboration Workshop.
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-EGI Grid Operations Transition Maite.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Enforcement of the personal data retention policy Peter Solagna, EGI.eu WLCG.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI (Present and) Future of the EGI Services for WLCG Peter Solagna – EGI.eu.
EGEE-III-INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE-III All Activity Meeting Brussels,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGI Operations Tiziana Ferrari EGEE User.
EGI-InSPIRE Steven Newhouse Interim EGI.eu Director EGI-InSPIRE Project Director Technical Director EGEE-III 1GDB - December 2009.
Cracow Grid Workshop, October 15-17, 2007 Polish Grid Polish NGI Contribution to EGI Resource Provisioning Function Automatized Direct Communication Tomasz.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI On the EGI Operational Level Agreement Framework Tiziana Ferrari, EGI.eu.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Grid Oversight in Service Level Agreement environment Małgorzata Krakowian,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Policy Development in EGI.eu/EGI-InSPIRE Damir Marinovic (EGI.eu)
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Plans for PY2 Steven Newhouse Project Director, EGI.eu 30/05/2011 Future.
EGI Process Assessment and Improvement Plan – EGI core services – Tiziana Ferrari FedSM project 1EGI Process Assessment and Improvement Plan (Core Services)
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation Małgorzata Krakowian 1.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation brainstorming space
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI EGI and PRACE ecosystem.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Engagement meeting Gergely Sipos EGI.eu 1.
RI EGI-InSPIRE RI Puppet community Next steps Peter Solagna – EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Session Intro and Pay-for-Use Overview Sy Holsinger Senior Strategy and.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VT-GPGPU Working Group First Conference Call.
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Role and Challenges of the Resource Centre in the EGI Ecosystem Tiziana Ferrari,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Scientific Publications Repository
NGI International Liaisons Meeting
A. Candiello, D. Cresti, T. Ferrari1, F. Karagiannis, D
E-GRANT: EGI Resource Allocation Tool Current status
Ian Bird GDB Meeting CERN 9 September 2003
Steven Newhouse EGI-InSPIRE Project Director, EGI.eu
Steven Newhouse Project Director, EGI.eu
Status after last telco
Networking support (SA2) tasks for EGI
NA3: User Community Support Team
Agenda Welcome Project Status (inc. Activity Reports)
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
Status report of the LToS platform
Connecting the European Grid Infrastructure to Research Communities
European Grid Infrastructure for Life Science
Peter Solagna – EGI Foundation
Interaction with resource providers: selection, SLA, support
EGI Webinar - Introduction -
Introduction OMB, T. Ferrari/EGI.eu 12/4/2018
Operations Management Board April 30
EGI operations - news T. Ferrari/EGI.eu 12/9/2018.
Operations sustainability
Mapping ELIXIR projects to EGI VOs
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
Operations Management Board January 29
OLA/SLA framework update
EGI-Engage T. Ferrari/EGI.eu.
Sergio Andreozzi Strategy and Policy Manager (EGI.eu)
Introdicution to EGI.eu
Roksana Dobrzańska, Tomasz Szepieniec
User Support in EGI Reactive and proactive services
Expand portfolio of EGI services
Operations Management Board March 26
Presentation transcript:

Centrally Managed Resource Allocation T. Ferrari/EGI.eu OMB 18-12-2012 12/1/2018 Centrally Managed Resource Allocation

Centrally Managed Resource Allocation Problem No processes for allocation of resource as a service to international collaboration (unless they contribute own resources) Different site-level allocation policies Uncertain (if not less than best effort) commitment of many RCs supporting opportunistic usage of resources to VOs – see BIOMED presentation at the Resource Centre Forum, EGITF12 Usage is not acknowledged Lack of processes to Express a demand Reply to demand 12/1/2018 Centrally Managed Resource Allocation

Centrally Managed Resource Allocation Proposal Proposal for centrally managed allocation of resources approved by EGI Council in Nov for experimentation What is central management of allocation? EGI.eu collects demand from international VOs RCs and NGIs contribute a fraction of resources to constitute a distributed pool of resources available for allocation Demand is peer reviewed and resources are offered by RCs  policies issues will be investigated by the Council (out of scope here) 12/1/2018 Centrally Managed Resource Allocation

Centrally Managed Resource Allocation OMB actions Propose processes around management of demand and offer (see draft), presentation at the Jan workshop “Evolving EGI” Demand: user  SLA  EGI.eu How are resource demand formally expressed? Offer: EGI.eu  OLA  Resource providers Match demand with offer Usage of resources must be acknowledged in scientific publications Other issues: accounting of usage, automation of processes and support tools 12/1/2018 Centrally Managed Resource Allocation

Centrally Managed Resource Allocation Next steps Setup a working group of NGIs in January to Collect information about existing NGI activities and best practices Some NGIs already are experimenting resource offering as a service nationally Many processes applicable at a national scope can be easily extended to a EGI level Mandate Propose procedures for the handling of resource allocation – see attached draft (Jan OMB discussion  Evolving EGI workshop) Expressions of interest to be part of the WG by 21-12-2012 (mail to resource-allocation at mailman.egi.eu) Organize a testbed with the involvement of Resource providers (NGIs/RCs) VOs (e.g. BIOMED, discussions at the Resource Centre forum at EGITF12 Expressions of interest to participate to the testbed as resource provider: 21-01-2013 (mail to resource-allocation at mailman.egi.eu). A small set of dedicated CPUs and storage is required as contribution to the testbed. 12/1/2018 Centrally Managed Resource Allocation