WMS Options: DIRAC and GlideIN-WMS

Slides:



Advertisements
Similar presentations
GridWorld 2006 Use of MyProxy for the FusionGrid Mary Thompson Monte Goode GridWorld 2006.
Advertisements

29 June 2006 GridSite Andrew McNabwww.gridsite.org VOMS and VOs Andrew McNab University of Manchester.
Open Science Grid Discovering and understanding the site environment Or, yet another site test kit.
Haga clic para cambiar el estilo de título Haga clic para modificar el estilo de subtítulo del patrón DIRAC Framework A.Casajus and R.Graciani (Universitat.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
SCD FIFE Workshop - GlideinWMS Overview GlideinWMS Overview FIFE Workshop (June 04, 2013) - Parag Mhashilkar Why GlideinWMS? GlideinWMS Architecture Summary.
FESR Consorzio COMETA Grid Introduction and gLite Overview Corso di formazione sul Calcolo Parallelo ad Alte Prestazioni (edizione.
YAN, Tian On behalf of distributed computing group Institute of High Energy Physics (IHEP), CAS, China CHEP-2015, Apr th, OIST, Okinawa.
PanDA Multi-User Pilot Jobs Maxim Potekhin Brookhaven National Laboratory Open Science Grid WLCG GDB Meeting CERN March 11, 2009.
GILDA testbed GILDA Certification Authority GILDA Certification Authority User Support and Training Services in IGI IGI Site Administrators IGI Users IGI.
Use of Condor on the Open Science Grid Chris Green, OSG User Group / FNAL Condor Week, April
Grid job submission using HTCondor Andrew Lahiff.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security and Job Management.
Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Feb. 06, Introduction to High Performance and Grid Computing Faculty of Sciences,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Direct gLExec integration with PanDA Fernando H. Barreiro Megino CERN IT-ES-VOS.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
Grid, Web services and Taverna Machiel Jansen Richard Holland.
GLIDEINWMS - PARAG MHASHILKAR Department Meeting, August 07, 2013.
VO management: Progress since Chicago Workshop Vincenzo Ciaschini 23/5/2002 CNAF – Bologna.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
DTI Mission – 29 June LCG Security Ian Neilson LCG Security Officer Grid Deployment Group CERN.
Workload management, virtualisation, clouds & multicore Andrew Lahiff.
Eileen Berman. Condor in the Fermilab Grid FacilitiesApril 30, 2008  Fermi National Accelerator Laboratory is a high energy physics laboratory outside.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
INFSO-RI Enabling Grids for E-sciencE Policy management and fair share in gLite Andrea Guarise HPDC 2006 Paris June 19th, 2006.
LHCb Pilot Job Tests. We have not started this test due to several reasons: our analysis job submission (ganga) was not interfaced in time to DIRAC3,
WLCG Information System Use Cases Review WLCG Operations Coordination Meeting 18 th June 2015 Maria Alandes IT/SDC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.
Troubleshooting Grid authentication from the client side By Adriaan van der Zee Big Grid meeting
The GridPP DIRAC project DIRAC for non-LHC communities.
Maarten Litmaath (CERN), EGEE’08 1 Pilot Job Frameworks Review Introduction Summary GDB presentation.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI CSIRT Procedure for Compromised Certificates and Central Security Emergency.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VOMS Proxy Lifetime UCB 21 Aug 2012 David Kelsey STFC.
Running User Jobs In the Grid without End User Certificates - Assessing Traceability Anand Padmanabhan CyberGIS Center for Advanced Digital and Spatial.
INFSO-RI Enabling Grids for E-sciencE Padova site report Massimo Sgaravatto On behalf of the JRA1 IT-CZ Padova group.
Job submission overview Marco Mambelli – August OSG Summer Workshop TTU - Lubbock, TX THE UNIVERSITY OF CHICAGO.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
3 Compute Elements are manageable By hand 2 ? We need middleware – specifically a Workload Management System (and more specifically, “glideinWMS”) 3.
Bringing Federated Identity to Grid Computing Dave Dykstra CISRC16 April 6, 2016.
UCS D OSG Summer School 2011 Overlay systems OSG Summer School An introduction to Overlay systems Also known as Pilot systems by Igor Sfiligoi University.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Direct gLExec integration with PanDA Fernando H. Barreiro Megino Simone Campana.
Maarten Litmaath, GDB, 2008/06/11 1 Pilot Job Frameworks Review GDB working group mandated by WLCG MB on Jan. 22, 2008 Mission –Review security issues.
Honolulu - Oct 31st, 2007 Using Glideins to Maximize Scientific Output 1 IEEE NSS 2007 Making Science in the Grid World - Using Glideins to Maximize Scientific.
WLCG IPv6 deployment strategy
CEMon
VOs and ARC Florido Paganelli, Lund University
Operating a glideinWMS frontend by Igor Sfiligoi (UCSD)
Design rationale and status of the org.glite.overlay component
Workload Management System
Summary on PPS-pilot activity on CREAM CE
CREAM Status and Plans Massimo Sgaravatto – INFN Padova
The CREAM CE: When can the LCG-CE be replaced?
The CMS use of glideinWMS by Igor Sfiligoi (UCSD)
Grid Services Ouafa Bentaleb CERIST, Algeria
Compute Area Marco Cecchi Massimo Sgaravatto
Grid Deployment Board meeting, 8 November 2006, CERN
Short update on the latest gLite status
Francesco Giacomini – INFN JRA1 All-Hands Nikhef, February 2008
Update on EDG Security (VOMS)
The GENIUS portal and the GILDA t-Infrastructure
gLite Grid Services Riccardo Bruno
Overview of gLite Middleware
Job Submission M. Jouvin (LAL-Orsay)
MB Maarten Litmaath CERN v1.0
The LHCb Computing Data Challenge DC06
Presentation transcript:

WMS Options: DIRAC and GlideIN-WMS V. Spinoso – A. Paolini OMB June 30, 2016

glideinWMS and DIRAC Only alternatives Both pilot oriented

Functionalities needed discovery of resources through the information system and matching with the user requirements authentication and authorization: only with VOMS proxy proxy delegation and renewal: before the user proxy expires, a MyProxy server can be contacted to renew the credentials Job types: normal, MPI, parametric, collections, DAG. Multi-VOs support submission to CREAM and ARC-CE PUSP support: purpose of a per-user sub-proxy (PUSP) is to allow identification of the individual users that operate using a common robot certificate Options explored: glideinWMS and DIRAC

glideinWMS Workload is managed by Not integrated with BDII GlideinWMS VO Frontend (Glidein Frontend, VO Frontend) a service that looks at the queued jobs, resources available to run them and applies VO defined policies to request glideins at desired sites (resources) Must be one per VO! GlideinWMS Factory (Glidein Factory) a service submitting glidein to the available resources Not integrated with BDII Can submit to CREAM and ARC (and condor) It is not possible to easily identify the user that submitted the job under the same robot certificate PUSP not supported Some work was done in the past to support this, that can be reused but it is not supported and not used at the moment Several job types supported by condor, verification is needed if those jobs are supported by the glideinWMS as well Pilot job submission workflow very well tested and in production since years Supported by FNAL, used by CMS Runs on top of condor (well supported and stable as well) http://glideinwms.fnal.gov/doc.prd/index.html

DIRAC Devoted initially to LHCb, it offers multi-VO support (i.e. wENMR is using it) Supports browsing information on BDII Robot certificates support available PUSP not yet fully implemented Authorization using robot certs is working, but But submission through a PUSP is still not working Can submit to CREAM and ARC

Summary glideinWMS DIRAC BDII support No Yes VOMS proxy auth Identification of individual users (PUSP) Not yet, investigate more Multi VO support Yes (but multiple factories needed) Submit to CREAM/ARC normal, MPI, parametric, collections, DAG jobs Yes (parametric, MPI)