Biomed tutorial 1 Enabling Grids for E-sciencE INFSO-RI-508833 Virtual Organisations in EGEE.

Slides:



Advertisements
Similar presentations
The gLite Support System Giuseppe LA ROCCA INFN Catania
Advertisements

Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Torsten Antoni – LCG Operations Workshop, CERN 02-04/11/04 Global Grid User Support - GGUS -
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Helmut Dres, Institute For Scientific Computing – GDB Meeting Global Grid User Support.
Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft Wofgang Thöne, Institute For Scientific Computing – EGEE-Meeting August 2004 Welcome to the User.
INFSO-RI Enabling Grids for E-sciencE NA4 Biomed Applications Athens meeting, April 20, 2005 Johan Montagnat.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE model and experiences in providing support services to users (as a basis.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Romanian SA1 report Alexandru Stanciu ICI.
Operational Workshop, Abingdon Alistair Mills, CERN 27 September 2005 Global Grid User Support Alistair Mills Flavia Donno for the LCG/GGUS Executive Support.
INFSO-RI Enabling Grids for E-sciencE GLOBAL GRID USER SUPPORT THE MODEL AND EXPERIENCE IN LCG/EGEE Gilles Mathieu(1), Torsten Antoni(2),
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What GGUS can do for you JRA1 All hands.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks David Kelsey RAL/STFC,
EGEE is a project funded by the European Union under contract IST User support in EGEE Alistair Mills Torsten Antoni EGEE-3 Conference 20 April.
INFSO-RI Enabling Grids for E-sciencE User Support in EGEE Torsten Antoni, FZK
EGEE is a project funded by the European Union under contract IST Support Operation Challenge – 1 SOC-1 Alistair Mills Torsten Antoni ARM-4,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Next steps with EGEE EGEE training community.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES GGUS Overview ROC_LA CERN
GGUS at PEB – –- page 1 LCG Klaus-Peter Mickel, GridKa Karlsruhe LCG-PEB-Meeting ( ) The Global Grid User Support Model (Report of GDB.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Report from GGUS BoF Session at the WLCG.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
Next Steps: becoming users of the NGS Mike Mineter
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks SA1: Grid Operations Maite Barroso (CERN)
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Torsten.
EGEE is a project funded by the European Union under contract IST Support in EGEE Ron Trompert SARA NEROC Meeting, 28 October
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
INFSO-RI Enabling Grids for E-sciencE An overview of EGEE operations & support procedures Jules Wolfrat SARA.
LCG GDB LCG User Support 8 February 2005 – n o 1 LCG/EGEE User Support Flavia Donno LCG/INFN-Pisa
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
1Maria Dimou- cern-it-gd LCG GDB May 2008 USAG and direct GGUS ticket routing to Sites Grid Deployment.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The EGEE User Support Infrastructure Alistair.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks User Support for Distributed Computing Infrastructures.
INFSO-RI SA2 ETICS2 first Review Valerio Venturi INFN Bruxelles, 3 April 2009 Infrastructure Support.
INFSO-RI Enabling Grids for E-sciencE User and Virtual Organisation Support in EGEE Flavia Donno, CERN Torsten Antoni, FZK Alistair.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
INFSO-RI Enabling Grids for E-sciencE Operations Parallel Session Summary Markus Schulz CERN IT/GD Joint OSG and EGEE Operations.
INFSO-RI Enabling Grids for E-sciencE Database Services and Grid User Support Flavia Donno on behalf of GGUS/ESC.
EGEE is a project funded by the European Union under contract IST New VO Integration Fabio Hernandez ROC Managers Workshop,
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks What all NGIs need to do: Helpdesk / User.
LCG Workshop User Support Working Group 2-4 November 2004 – n o 1 Some thoughts on planning and organization of User Support in LCG/EGEE Flavia Donno LCG.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operational Procedures (Contacts, procedures,
EMI INFSO-RI Testbed for project continuous Integration Danilo Dongiovanni (INFN-CNAF) -SA2.6 Task Leader Jozef Cernak(UPJŠ, Kosice, Slovakia)
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid is a Bazaar of Resource Providers and.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ROC model assessment AP ROC ShuTing Liao.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The Dashboard for Operations Cyril L’Orphelin.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
EGEE is a project funded by the European Union under contract IST ROC-IT User Support in the EGEE infrastructure Riccardo Brunetti INFN-Torino.
Scuola Grid - Martina Franca, Thursday 08 November Il Sistema di Supporto INFNGrid & GGUS ( Global Grid User.
CERN LCG Grid Deployment Board Flavia Donno, INFN 8 September 2005 Global Grid User Support Flavia Donno for the LCG/GGUS Executive Support Committee (ESC)
INFSO-RI Enabling Grids for E-sciencE Support Model for SC4 Pilot WLCG Service Flavia Donno CERN.
INFSO-RI Enabling Grids for E-sciencE The role of the Virtual Organization Ticket Processing Manager Guido Negri INFN – CNAF Italy.
CERN WLCG Grid Storage Systems Deployment Flavia Donno, CERN 6 November 2007 Organization of Storage Support through GGUS Flavia Donno CERN/IT-GD CERN.
Bob Jones EGEE Technical Director
Il Sistema di Supporto INFNGrid & GGUS (Global Grid User Support )
Grid.It Grid Managers Tutorial
Regional Operations Centres Core infrastructure Centres
User Support Workflow in EGEE
Ian Bird GDB Meeting CERN 9 September 2003
Brief overview on GridICE and Ticketing System
ATLAS support in LCG.
Nordic ROC Organization
GGUS Partnership between FZK and ASCC
LCG Operations Workshop, e-IRG Workshop
Leigh Grundhoefer Indiana University
EGEE Operation Tools and Procedures
Presentation transcript:

Biomed tutorial 1 Enabling Grids for E-sciencE INFSO-RI Virtual Organisations in EGEE

Biomed tutorial 2 Enabling Grids for E-sciencE INFSO-RI What is a VO? A group of people sharing networked resources Cross oganisational Shared authorisation/authentication It is only ‘Virtual’ in that it is mediated by network communications

Biomed tutorial 3 Enabling Grids for E-sciencE INFSO-RI VOs in EGEE VODisciplinesNb of users AtlasPhysics274 AlicePhysics31 LHCbPhysics46 CMSPhysics243 CDFPhysics5 BaBarPhysics4 DzeroPhysics4 ZEUSPhysics3 Biomed 41 ESREarth Sciences18 Comp ChemChemistry9 MagicAstronomy5 EGEODEGeo-Physics2 Total 685 dteamInfrastructure testing306

Biomed tutorial 4 Enabling Grids for E-sciencE INFSO-RI Overview of EGEE Middleware The gLite Grid services follow a Service Oriented Architecture –facilitate interoperability among Grid services –allow easier compliance with upcoming standards Architecture is not bound to specific implementations –services are expected to work together –services can be deployed and used independently The gLite service decomposition has been largely influenced by the work performed in the LCG project

Biomed tutorial 5 Enabling Grids for E-sciencE INFSO-RI Overview of EGEE Middleware The gLite services are characterised by the scopes and enforcement of their policies: user, site, VO and global (i.e. multi-vo)

Biomed tutorial 6 Enabling Grids for E-sciencE INFSO-RI Overview of EGEE Middleware Most services are managed by a VO –independent service instances per VO –service instances will in most cases serve multiple VOs  performance  scalabilityGVS SV G SV V V SV SV G GVS UV UV V V S V VSG

Biomed tutorial 7 Enabling Grids for E-sciencE INFSO-RI Overview of EGEE Middleware Security services –Authentication, Authorization, and Auditing  identification of entities (users, systems, and services)  allow or deny access to services and resources  provide information for post-mortem analysis of security related events. –Data confidentiality and a Site Proxy  control network access patterns of applications and Grid services utilising its resources.

Biomed tutorial 8 Enabling Grids for E-sciencE INFSO-RI VOMS

Biomed tutorial 9 Enabling Grids for E-sciencE INFSO-RI LCG-2 VOMS. Flavia Donno

Biomed tutorial 10 Enabling Grids for E-sciencE INFSO-RI gLite VOMS

Biomed tutorial 11 Enabling Grids for E-sciencE INFSO-RI VOMS and biomed VOMS provides flexible security and brings the concept of roles (finer grained security). –ie. A user could have the role of a clinician in one context and the role of a researcher in another.

Biomed tutorial 12 Enabling Grids for E-sciencE INFSO-RI Virtual Organizations and authorization LCG-2 users MUST belong to a Virtual Organization –Sets of users belonging to a collaboration –Each VO user has the same access privileges to Grid resources –List of supported VOs:  VOs maintain a list of their members –The list is downloaded by Grid machines to map user certificate subjects to local “pool” accounts: only mapped users are authorized in LCG –Sites decide which VOs to accept... "/C=CH/O=CERN/OU=GRID/CN=Simone Campana 7461".dteam "/C=CH/O=CERN/OU=GRID/CN=Andrea Sciaba 8968".cms "/C=CH/O=CERN/OU=GRID/CN=Patricia Mendez Lorenzo-ALICE".alice... grid-mapfile

Biomed tutorial 13 Enabling Grids for E-sciencE INFSO-RI Infrastructure usage JRA2 statistics –~15Kjobs per month '

Biomed tutorial 14 Enabling Grids for E-sciencE INFSO-RI Biomed status Focus on demonstration of grid interest for applications –Contact taken with the decrypthon project –Nicolas Jacq proposal for a data challenge organisation –Focus on scientific content of applications A data challenge in biomed this summer Need for input for response to EU review –JRA2 statistics –Application gains Number of targets Number of drug candidates Total CPU time Gain of time Done days years? ? Challenge years? ?

Biomed tutorial 15 Enabling Grids for E-sciencE INFSO-RI EGEE is taking “doing big biology” seriously The use of the Biomed VO in EGEE is increasing EGEE is beginning to do biomed challenges –Finding highly challenging resource intensive biological applications to demonstrate the ability of the grid to stimulate the imagination of the bio-community

Biomed tutorial 16 Enabling Grids for E-sciencE INFSO-RI Biomed status gLite –Lot of testing activity inside biomed –Release 1.0 available –pre-production service expected to bring much more robustness Non-application specific work initiated in the biomed activity –Workflows –DICOM-SRM interface

Biomed tutorial 17 Enabling Grids for E-sciencE INFSO-RI User support coordination Experts and GGUS ticket flow –First and second line of support –Site problems (CIC and ROCs) –Generic problems –VO support –Middleware developers Role of biomed task force –Provide application-specific support –Participate to the grid knowledge acquisition of biomed users Current organization –Tickets sent to technical team mailing list and assigned to 'biomed VO' –Christophe Pera to assign messages to experts –Use the GGUS portal to follow on tickets 1 st and 2 nd front line ROCs and CICs Middleware support VO support GGUS VO support (A. Delgado, P. Mendez) Biomed Task Force support

Biomed tutorial 18 Enabling Grids for E-sciencE INFSO-RI User support coordination We have to learn –Biomed experts to register as 'ticket administrators' and learn the GGUS ticket management tool –Christophe to identify the correct targets –People to whom tickets are assigned to should be reactive –Need for a rollback procedure (expect redirection errors at least in the first phasis) –Need to check that all tickets are followed on

Biomed tutorial 19 Enabling Grids for E-sciencE INFSO-RI SUPPORT

Biomed tutorial 20 Enabling Grids for E-sciencE INFSO-RI Grid User Support What does a user expect ? Correct answers and general help with middleware usage (how-to, new features, errors, etc.) Solving user problems while running on Grid User support should provide correct documentation, examples, “templates”, powerful search engines, links to EGEE infrastructure contacts, ing lists, etc. A unique way to submit problems/requests for help and receive response. A unique entry point for information, for problem escalation, broadcasting news,... User/Site notification about site related problems, Grid status,etc. User Support is different from VO and Operations Support with a lot of overlap – tools are the same

Biomed tutorial 21 Enabling Grids for E-sciencE INFSO-RI EGEE User Support: infrastructure General approach: 3 main support centers to guarantee coverage 24/7 and 365 day support and provide a single point of contact to customers and to local Grid operations. To ensure 24x7 support, it was decided to have 3 GGUS teams in different time zones. Germany Taiwan North America GGUS started off at Forschungszentrum Karlsruhe in Germany in 2003 and has had a partner group at Academia Sinica in Taiwan since April A third partner in North America will complete the 24 hours cycle. Forschungszentrum KarlsruheAcademia Sinica

Biomed tutorial 22 Enabling Grids for E-sciencE INFSO-RI EGEE User Support: infrastructure The support model in EGEE can be captioned "regional support with central coordination". Users can make a support request via their Regional Operations' Center (ROC) or their Virtual Organisation (V0). Within GGUS there is an internal support structure for all support requests.ROC The User Central GGUS Application Deployment Support (DS) Resource Centers (RC) VO Specific Support Regional Operations Center (ROC) Can use the System directly via Webview Use the Webview Local User Support Application Interface Report Problem Resource Centers (RC) Resource Centers (RC)

Biomed tutorial 23 Enabling Grids for E-sciencE INFSO-RI EGEE User Support: infrastructure The ROCs and VOs and the other project wide groups such as the Core Infrastructure Center (CIC), middleware groups (JRA), network groups (NA), service groups (SA) will be connected via a central integration platform provided by GGUS. This central helpdesk keeps track of all service requests and assigns them to the appropriate support groups. In this way, formal communication between all support groups is possible. To enable this, each group has to build only one interface between its internal support structure and the central GGUS application.

Biomed tutorial 24 Enabling Grids for E-sciencE INFSO-RI The GGUS Portal register You need to register in order to be able To use this portal (GSI or password based) You can register User as User or as Supporter Supporter. Supporter ? If you think you have a good knowledge in Grid and have time to provide support, please contact your ROC or directly ESC at: Please forward Users with Grid problems to the GGUS portal

Biomed tutorial 25 Enabling Grids for E-sciencE INFSO-RI The GGUS Portal: uploading your certificate into your browser Instructions can be found:

Biomed tutorial 26 Enabling Grids for E-sciencE INFSO-RI The GGUS Portal: the User view Quite useful FAQ Compiled using Wiki And Knowledge DB A group is working on this to fill in the pages Check Documentation For more useful Links Stay tuned!

Biomed tutorial 27 Enabling Grids for E-sciencE INFSO-RI The GGUS Portal: the User view Very useful page. It is kept updated with the most recent, valid and correct Documentation Please, signal useful docs to ESC. We need help to provide more documentation

Biomed tutorial 28 Enabling Grids for E-sciencE INFSO-RI The GGUS Portal: the User view At the moment a user can only request help through the GGUS Web portal, using the Web interface to the Ticketing system The CC field allows you to notify others that will follow the problem and solutions With “Type of problem” you can preliminary categorize your problem. Specify “other” if you do not know. Short description required. It is used to build knowledgebase.

Biomed tutorial 29 Enabling Grids for E-sciencE INFSO-RI What is it going to be available ?

Biomed tutorial 30 Enabling Grids for E-sciencE INFSO-RI VO Support TPM I need help! I send to automatically converted in GGUS ticket VO Support Units ROC Support Units Middleware Support Units Other Grids Support Units Mailing lists Ticket Process Manager: Monitor ticket assignments. Direct to correct support unit VO Support: Receive tickets VO related and follows them. Solves/forward problems VO specific. Recognize Grid related problems and assign them to specific support units CIC Support Unit GGUS Support: The Model

Biomed tutorial 31 Enabling Grids for E-sciencE INFSO-RI VO Support Units VO Support TPM I need help! I send to automatically converted in GGUS ticket ROC Support Units Middleware Support Units Other Grids Support Units Mailing lists Ticket Process Manager: Monitor ticket assignments. Direct to correct support unit VO Support: Receive tickets VO related and follows them. Solves/forward problems VO specific. Recognize Grid related problems and assign them to specific support units CIC Support Unit TPM GGUS Support: The Model

Biomed tutorial 32 Enabling Grids for E-sciencE INFSO-RI Feedback It is very important for us to get your feedback An electronic feedback form is available on the GGUS portal. You can always send to The electronic feedback is completely anonymous. If you want to provide personal information you have to do it in the feedback field.