2010/05/07 Glexec, CREAM CE Pierre Girard Réunion CAF 2010-05-07.

Slides:



Advertisements
Similar presentations
American Society Chapter 07.
Advertisements

Marc Holness, Product Line Architect, Ciena
Northgrid Status Alessandra Forti Gridpp24 RHUL 15 April 2010.
05/07/00LHCb Computing Model Meeting (CERN) LHCb(UK) Computing Status Glenn Patrick Prototype (Tier 1) UK national computing centre Bid to Joint.
LCG-France Project Status Fabio Hernandez Frédérique Chollet Fairouz Malek Réunion Sites LCG-France Annecy, May
Site Report HEPHY-UIBK Austrian federated Tier 2 meeting
L. Arrabito, D. Bouvet, X. Canehan, P. Girard, Y. Perret, S. Poulat, R. Rumler SW distribution tests at Lyon Pierre Girard Luisa Arrabito, David Bouvet.
Pilots 2.0: DIRAC pilots for all the skies Federico Stagni, A.McNab, C.Luzzi, A.Tsaregorodtsev On behalf of the DIRAC consortium and the LHCb collaboration.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
PanDA Multi-User Pilot Jobs Maxim Potekhin Brookhaven National Laboratory Open Science Grid WLCG GDB Meeting CERN March 11, 2009.
Ideas for a virtual analysis facility Stefano Bagnasco, INFN Torino CAF & PROOF Workshop CERN Nov 29-30, 2007.
Ian Bird LCG Project Leader LHCC Referee Meeting Project Status & Overview 22 nd September 2008.
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp - SWITCH EGI TF Prague.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Angela Poschlad (PPS-FZK), Antonio Retico.
Maarten Litmaath (CERN), GDB meeting, CERN, 2006/02/08 VOMS deployment Extent of VOMS usage in LCG-2 –Node types gLite 3.0 Issues Conclusions.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
Pilot Jobs John Gordon Management Board 23/10/2007.
Glexec, SCAS & CREAM. Milestones CREAM-CE capable of large-scale direct job submission Glexec & SCAS capable of large-scale use on WN in logging only.
1 User Analysis Workgroup Discussion  Understand and document analysis models  Best in a way that allows to compare them easily.
8 th CIC on Duty meeting Krakow /2006 Enabling Grids for E-sciencE Feedback from SEE first COD shift Emanoil Atanassov Todor Gurov.
OSG Area Coordinator’s Report: Workload Management May14 th, 2009 Maxim Potekhin BNL
LCG Introduction John Gordon, STFC GDB September 14 th 2011.
EMI INFSO-RI Argus Policies in Action Valery Tschopp (SWITCH) on behalf of the Argus PT.
INFSO-RI Enabling Grids for E-sciencE glexec deployment models local credentials and grid identity mapping in the presence of complex.
CE extensions requirements for the Information System Pre-GDB 11 th July 2012 Maria Alandes Pradillo CERN IT Department, Grid Technology Group With contributions.
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
LCG Support for Pilot Jobs John Gordon, STFC GDB December 2 nd 2009.
Last update 29/01/ :01 LCG 1Maria Dimou- cern-it-gd Maria Dimou IT/GD CERN VOMS server deployment LCG Grid Deployment Board
Workload management, virtualisation, clouds & multicore Andrew Lahiff.
INFSO-RI Enabling Grids for E-sciencE glexec deployment models local credentials and grid identity mapping in the presence of complex.
GRID Security & DIRAC A. Casajus R. Graciani A. Tsaregorodtsev.
LCG Pilot Jobs and glexec John Gordon.
EMI INFSO-RI Argus The EMI Authorization Service Valery Tschopp (SWITCH) Argus Product Team.
DIRAC Pilot Jobs A. Casajus, R. Graciani, A. Tsaregorodtsev for the LHCb DIRAC team Pilot Framework and the DIRAC WMS DIRAC Workload Management System.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Update Authorization Service Christoph Witzig,
OSG Area Coordinator’s Report: Workload Management Maxim Potekhin BNL May 8 th, 2008.
Security aspects of the WLCG infrastructure: clients and services Maarten Litmaath CERN.
INFSO-RI Enabling Grids for E-sciencE SAML-XACML interoperability Oscar Koeroo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks The LCG interface Stefano BAGNASCO INFN Torino.
2011/11/03 Partial downtimes management Pierre Girard WLCG T1 Service Coordination Meeting.
Accounting in LCG/EGEE Can We Gauge Grid Usage via RBs? Dave Kant CCLRC, e-Science Centre.
EGEE is a project funded by the European Union under contract INFSO-RI Grid accounting with GridICE Sergio Fantinel, INFN LNL/PD LCG Workshop November.
Criteria for Deploying gLite WMS and CE Ian Bird CERN IT LCG MB 6 th March 2007.
Analysis of job submissions through the EGEE Grid Overview The Grid as an environment for large scale job execution is now moving beyond the prototyping.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks glexec/SCAS pilot service Status and short-term.
Placeholder ES 1 CERN IT EGI Technical Forum, Experiment Support group AAI usage, issues and wishes for WLCG Maarten Litmaath CERN.
SAM Status Update Piotr Nyczyk LCG Management Board CERN, 5 June 2007.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Study on Authorization Christoph Witzig,
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
LHCb 2009-Q4 report Q4 report LHCb 2009-Q4 report, PhC2 Activities in 2009-Q4 m Core Software o Stable versions of Gaudi and LCG-AA m Applications.
EMI is partially funded by the European Commission under Grant Agreement RI Argus Policies Tutorial Valery Tschopp (SWITCH) – Argus Product Team.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Job Management Claudio Grandi.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
2007/05/22 Integration of virtualization software Pierre Girard ATLAS 3T1 Meeting
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Argus gLite Authorization Service Workplan.
SuperB – INFN-Bari Giacinto DONVITO.
Security aspects of the CREAM-CE
Glexec deployment models local credentials and grid identity mapping in the presence of complex schedulers David Groep NIKHEF.
John Gordon, STFC-RAL GDB 10 October 2007
Global Banning List and Authorization Service
lcg-infosites documentation (v2.1, LCG2.3.1) 10/03/05
Pierre Girard Réunion CMS
Grid services for CMS at CC-IN2P3
Nicolas Jacq LPC, IN2P3/CNRS, France
glexec/SCAS pilot service
Compute Area Marco Cecchi Massimo Sgaravatto
Short update on the latest gLite status
Glexec/SCAS Pilot: IN2P3-CC status
Pierre Girard ATLAS Visit
Romanian Sites Current Status
Presentation transcript:

2010/05/07 Glexec, CREAM CE Pierre Girard Réunion CAF

2010/05/07Pierre Girard / CAF / Glexec et CREAM CE2 Content Glexec –Principles –Deployment at IN2P3-CC CREAM CE –Today –Asap CREAM CE and Atlas ?

Site Access Control (Now) Pilotagent userpilot Glexec / Principles (1) 2010/05/073Pierre Girard / CAF / Glexec et CREAM CE qsub CAs DNxDNy… ban_users.db Хuserpilot DN1 Хuser002 DN2 user003 user003 … gridmapdir « /vo/role ».user mapfiles userpilot CE submit Pilot Job DN1 Task of User1 WN VO tasks

userpilot Pilotagent WN VO tasks Glexec / Principles (2) Site Access Control (Glexec/SCAS) 2010/01/22 Хuser001 DN1 Хuser002 DN2 user003 user003 user004 user004 … gridmapdir CAs DNxDNy… ban_users.db Glexec qsub Task of User1 with DN1 DN1 Task of User2 with DN2 user002 user001 CE

Glexec / Deployment at IN2P3-CC (1) First setup at CCIN2P3 (may/july 2009) –Setuid/SCAS mode –Glite-WN shared on AFS –But additional module « glite-GLEXEC_wn » not entirely shareable /etc/ld.so.conf –no static version of Glexec –LD_LIBRARY_PATH not an alternative because of setuid /etc/syslog.conf –Grid environment variables problem glexec cleared most of the environment variables But a glexec wrapper should be now available to rebuild the grid environment –2 load-balanced SCAS nodes Not really tested with a real production load Tighten collaboration –With Glexec developers –With VO testers (lhcb/atlas) 2010/05/075Pierre Girard / CAF / Glexec et CREAM CE

Glexec / Deployment at IN2P3-CC (2) New deployment (2010) –With an enhanced version of Glexec_WN –By the end of may (hopefully) –By starting with SCAS service –But, by probably switching from SCAS to ARGUS Service asap Requires to be tested and well-understood 2010/05/076Pierre Girard / CAF / Glexec et CREAM CE

CREAM CE Today 2010/05/077Pierre Girard / CAF / Glexec et CREAM CE LCG CE8 LCGCE4 LCG CE7 LCG CE2 LCG CE1 LCG CE3 IN2P3-CC (T1) ATLASALICECMSLHCBEGEEs LCGCE5 LCG CE6 IN2P3-CC-T2 (T2) SL5 SL5 SL4 CREAM CE1 CREAM CE3 Glite3.1 Glite3.2

CREAM CE ASAP –Only CREAM CE –Glite 3.2 / SL5 2010/05/078Pierre Girard / CAF / Glexec et CREAM CE CREAM CE5 CREAM CE6 IN2P3-CC (T1) ATLASALICECMSLHCBEGEEs IN2P3-CC-T2 (T2) SL5 SL5 CREAM CE2 CREAM CE4 Glite 3.2 CREAM CE3 CREAM CE1 Glite 3.2

Use of cccreamceli01 / VOs Suzanne Poulat

CREAM CE vs LCG CEs (T1) Suzanne Poulat

CREAM CE vs LCG CE / RAM 2010/05/0711Pierre Girard / CAF / Glexec et CREAM CE

CREAM CE vs LCG CE / CPUs 2010/05/07Pierre Girard / CAF / Glexec et CREAM CE12

CREAM CE vs LCG CE / Load 2010/05/07Pierre Girard / CAF / Glexec et CREAM CE13

CREAM CE and Atlas ??? 2010/05/07Pierre Girard / CAF / Glexec et CREAM CE14