Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Grid Resource Bazaar Platform for resource allocation.

Slides:



Advertisements
Similar presentations
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Services and Operations in Polish NGI M. Radecki,
Advertisements

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Ab initio grid chemical software ports – transferring.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Operations in PL-Grid M. Radecki, T. Szepieniec,
Polish Infrastructure for Supporting Computational Science in the European Research Space QoS provisioning for data-oriented applications in PL-Grid D.
GILDA testbed GILDA Certification Authority GILDA Certification Authority User Support and Training Services in IGI IGI Site Administrators IGI Users IGI.
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp - SWITCH EGI TF Prague.
Polish Infrastructure for Supporting Computational Science in the European Research Space FiVO/QStorMan: toolkit for supporting data-oriented applications.
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Operational Architecture of PL-Grid project M.Radecki,
EMI INFSO-RI Argus Policies in Action Valery Tschopp (SWITCH) on behalf of the Argus PT.
Cracow Grid Workshop, October 15-17, 2007 Polish Grid Polish NGI Contribution to EGI Resource Provisioning Function Automatized Direct Communication Tomasz.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Resource Allocation in EGEEIII Overview &
The National Grid Service User Accounting System Katie Weeks Science and Technology Facilities Council.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Grid Oversight in Service Level Agreement environment Małgorzata Krakowian,
Mardi 8 mars 2016 Status of new features in CIC Portal Latest Release of 22/08/07 Osman Aidel, Hélène Cordier, Cyril L’Orphelin, Gilles Mathieu IN2P3/CNRS.
E-GRANT: EGI Resource Allocation Tool Current status and development roadmap Roksana Różańska, Tomasz Szepieniec ACC Cyfronet AGH, Poland EGI CF 2014,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal Development Update on Requirements Cyril L'Orphelin IN2P3/CNRS.
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp (SWITCH) – Argus Product Team.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
EGI Process Assessment and Improvement Plan – EGI core services – Tiziana Ferrari FedSM project 1EGI Process Assessment and Improvement Plan (Core Services)
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation Małgorzata Krakowian 1.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Resource allocation brainstorming space
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
OSG User Group August 14, Progress since last meeting OSG Users meeting at BNL (Jun 16-17) –Core Discussions on: Workload Management; Security.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Operations Portal OTAG September, 21th 2011 Cyril L’Orphelin – CCIN2P3/CNRS.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
1 The Life-Science Grid Community Tristan Glatard 1 1 Creatis, CNRS, INSERM, Université de Lyon, France The Spanish Network for e-Science 2/12/2010.
Polish NGI: PL-Grid Marcin Radecki EGI-InSPIRE – SA1 Kickoff Meeting 1.
PLG-Data and rimrock Services as Building
Piotr Bała, Marcin Radecki, Krzysztof Benedyczak
Accessing the VI-SEEM infrastructure
Regional Operations Centres Core infrastructure Centres
EGI: advanced computing for research in Europe… and beyond!
Use of Nagios in Central European ROC
E-GRANT: EGI Resource Allocation Tool Current status
UVOS and VOMS differences
Business and Pricing Models
PL-Grid – an example of NGI support structure Marcin Radecki
EMI Interoperability Activities
PRACE-EGI helpdesk integration
Accounting at the T1/T2 Sites of the Italian Grid
Cloud Management Mechanisms
Advancements in Availability and Reliability computation Introduction and current status of the Comp Reports mini project C. Kanellopoulos GRNET.
E-GRANT development plans
Operations & Coordination Tools
Maite Barroso, SA1 activity leader CERN 27th January 2009
LCG Monte-Carlo Events Data Base: current status and plans
TS4.10 Comp Reports A new approach to Computing Availability/Reliability reports for EGI Progress Report C. Kanellopoulos GRNET 9/14/2018.
Status report of the LToS platform
Management of Virtual Execution Environments 3 June 2008
Connecting the European Grid Infrastructure to Research Communities
Solutions for federated services management EGI

Leigh Grundhoefer Indiana University
Cloud Management Mechanisms
Operations Management Board April 30
Benefits and vision for the VRC community model
Platform for the long tail of science
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
HLRmon accounting portal
EUDAT Site and Service Registry
Roksana Dobrzańska, Tomasz Szepieniec
EGI support services Science gateway developers
User Support in EGI Reactive and proactive services
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Grid Resource Bazaar Platform for resource allocation for VOs (AKA Service Level Management) T. Szepieniec, M. Tomanek and M. Radecki ACC CYFRONET AGH EGI TF'2011 Lyon

Motivation: Resource Allocation for VOs Customer/VO NGI operator SLA Resource/Service Providers  General: Providing services for VOs that maintain customer satisfaction  VOs  Need way to express their expectations related to resources and services they need  Want to know capacity of resources allocated for them to plan experiments  Sites  Are autonomous in managing resource allocations for VOs  Need to know what are the expectations  NGI  Has role of single contact point for national VOs  Coordinates and mediates in the resource allocation process

3 Platform for traceable, efficient SLAs negotiations

4 Main Features  Lightweight SLA negotiations process  View of all offers at once, support for decision making  Possibility to customize NGI-role  Intuitive set of metrics to describe computational and storage resources: aggregated walltime, max. walltime for a single job, max. cores per job  Customized views for actors:  VOs, Sites, NGI  Integration with EGI authorization sources:  GOC DB for site managers  VO-id cards for VO managers  Notifications on actions and events  Full history of SLA changes  Mechanism for SLA blocking

5 NEW: Bazaar Site Admin Toolkit  Motivation: Integration with LRMS for automatic SLA configuration  Torque/MAUI support; MOAB support soon  BazaarSAT-asd – Active SLAs Download  Using RestFul API for getting active SLAs for a site  Output: XML specification ready for tools processing used by other tools  BazaarSAT-mcg – Maui Configuration Generator  Generate fair shares for group/account based on current SLAs metrics, timeframe  Process maui config customized with Bazaar rules Regexp expression to set-up maui priorities and other specification details  Site admin retains full control  BazaarSAT-tsf – Torque Submit Filter  Block new jobs from blocked SLAs  Modify job description according SLA Example: account string, limit wall-time

6 Status  Bazaar has been deployed for production environment in PL-Grid since April 2011  some NGI-specific extensions including integration with PL-Grid User Portal,  Ready for collaboration with interested NGIs Contact us: bazaar.grid.cyfronet.pl