WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014.

Slides:



Advertisements
Similar presentations
Operations Coordination Team Maria Girone, CERN IT-ES GDB 10 th October 2012.
Advertisements

Operations Coordination Team Maria Girone, CERN IT-ES Kick-off meeting 24 th September 2012.
WLCG Operations and Tools TEG Monitoring – Experiment Perspective Simone Campana and Pepe Flix Operations TEG Workshop, 23 January 2012.
The Middleware Readiness Working Group LHCb Computing Workshop LHCb Computing Workshop Maria Dimou IT/SDC 2014/05/22.
Integrating Network and Transfer Metrics to Optimize Transfer Efficiency and Experiment Workflows Shawn McKee, Marian Babik for the WLCG Network and Transfer.
New VOMS servers campaign GDB, 8 th Oct 2014 Maarten Litmaath IT/SDC.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPiX, Oxford 24 Mar 2015.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
OSG Area Coordinators Meeting Security Team Report Mine Altunay 01/29/2014.
WLCG Operations Coordination report Maria Dimou / CERN With input and on behalf of the WLCG Operations Coordination team May 2015 GDB CERN indico event.
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
Use Cases. Summary Define and understand slow transfers – Identify weak links, narrow down the source – Understand what perfSONAR measurements mean wrt.
Network and Transfer WG Metrics Area Meeting Shawn McKee, Marian Babik Network and Transfer Metrics Kick-off Meeting 26 h November 2014.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) WLCG GDB, CERN 8 July 2015.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP35, Liverpool 11 Sep 2015.
The production deployment of IPv6 on WLCG David Kelsey (STFC-RAL) CHEP2015, OIST, Okinawa 16 Apr 2015.
Network and Transfer Metrics WG Meeting Shawn McKee, Marian Babik Network and Transfer Metrics WG Meeting 8 th April 2015.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.
CERN11 th February WLCG Ops Coordination [GDB Report] Josep Flix (PIC/CIEMAT) On behalf of the WLCG Operations Coordination Team GDB – CERN.
Stefano Belforte INFN Trieste 1 Middleware February 14, 2007 Resource Broker, gLite etc. CMS vs. middleware.
WLCG operations A. Sciabà, M. Alandes, J. Flix, A. Forti WLCG collaboration workshop July , Barcelona.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons 10/12/2014.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
Handling ALARMs for Critical Services Maria Girone, IT-ES Maite Barroso IT-PES, Maria Dimou, IT-ES WLCG MB, 19 February 2013.
HEPiX IPv6 Working Group David Kelsey GDB, CERN 11 Jan 2012.
Report from the WLCG Operations and Tools TEG Maria Girone / CERN & Jeff Templon / NIKHEF WLCG Workshop, 19 th May 2012.
Network and Transfer WG perfSONAR operations Shawn McKee, Marian Babik Network and Transfer Metrics WG Meeting 28 h January 2015.
Julia Andreeva on behalf of the MND section MND review.
PIC port d’informació científica EGEE – EGI Transition for WLCG in Spain M. Delfino, G. Merino, PIC Spanish Tier-1 WLCG CB 13-Nov-2009.
December GDB Brief summary – J Coles. Meetings January meeting moved to 15 th 2014 events created. Check March meeting outside CERN. Copenhagen workshop.
NIKHEF11 th March WLCG Operational Costs M. Dimou, J. Flix, A. Forti, A. Sciabà WLCG Operations Coordination Team GDB – NIKHEF [11 th March.
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
WLCG Operations Coordination Andrea Sciabà IT/SDC 10 th July 2013.
WLCG critical services update Andrea Sciabà WLCG operations coordination meeting December 18, 2014.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
LCG Issues from GDB John Gordon, STFC WLCG MB meeting September 28 th 2010.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
News and Status WLCG Information System Task Force Maria Alandes IT/SDC.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
ATLAS Distributed Computing ATLAS session WLCG pre-CHEP Workshop New York May 19-20, 2012 Alexei Klimentov Stephane Jezequel Ikuo Ueda For ATLAS Distributed.
MW Readiness WG Update Andrea Manzi Maria Dimou Lionel Cons Maarten Litmaath On behalf of the WG participants GDB 09/09/2015.
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
WLCG Service Report ~~~ WLCG Management Board, 17 th February 2009.
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
WLCG Operations Coordination and Commissioning Maria Girone, CERN IT On behalf of the Operations Coordination Team 11 th March OSG All Hands Meeting,
The HEPiX IPv6 Working Group David Kelsey HEPiX, Prague 26 April 2012.
II EGEE conference Den Haag November, ROC-CIC status in Italy
HEPiX IPv6 Working Group David Kelsey david DOT kelsey AT stfc DOT ac DOT uk (STFC-RAL) HEPiX, Vancouver 26 Oct 2011.
WLCG Operations Coordination news and meeting restructuring Maria Alandes Pradillo Josep Flix Alessandra Forti Andrea Sciabà WLCG operations coordination.
News from the HEPiX IPv6 Working Group David Kelsey (STFC-RAL) HEPIX, BNL 13 Oct 2015.
The HEPiX IPv6 Working Group David Kelsey (STFC-RAL) EGI OMB 19 Dec 2013.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
Acronyms GAS - Grid Acronym Soup, LCG - LHC Computing Project EGEE - Enabling Grids for E-sciencE.
Outcome should be a documented strategy Not everything needs to go back to square one! – Some things work! – Some work has already been (is being) done.
HEPiX IPv6 Working Group David Kelsey (STFC-RAL) GridPP33 Ambleside 22 Aug 2014.
WLCG Operations Coordination Andrea Sciabà IT/SDC GDB 11 th September 2013.
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
PerfSONAR operations meeting 3 rd October Agenda Propose changes to the current operations of perfSONAR Discuss current and future deployment model.
WLCG IPv6 deployment strategy
perfSONAR-PS Deployment: Status/Plans
gLite->EMI2/UMD2 transition
WLCG Operations Coordination
Deployment of IPv6-only CPU on WLCG – an update from the HEPiX IPv6 WG
Update from the HEPiX IPv6 WG
Summary from last MB “The MB agreed that a detailed deployment plan and a realistic time scale are required for deploying glexec with setuid mode at WLCG.
WLCG and support for IPv6-only CPU
Presentation transcript:

WLCG Operations Coordination report Maria Dimou Andrea Sciabà IT/SDC On behalf of the WLCG Operations Coordination team GDB 12 th November 2014

Outline  News  Experiments  Status of Task Forces & Working Groups  Conclusions WLCG Operations Coordination – A. Sciabà 2

WLCG operations site survey  The goal of the survey is to understand how sites use their effort to contribute to WLCG operations and to ask their opinion on several of its aspects  It will be essential data for the WLCG operations cost optimisation  Questions summarised at   Some very useful feedback received and taken into account  The official deadline for feedback is today, but you can send it until the survey is launched  The final survey will be launched in a matter of days  The questions are for sites, not individuals: it is assumed that only one answer per site will be submitted, after having been agreed internally  The goal is to have a large fraction of sites having answered by the end of the year  Sites are strongly encouraged to answer, as their input will be used to elaborate strategies that should eventually result in less effort being required WLCG Operations Coordination – A. Sciabà 3

WLCG Critical Services  The criticality of the WLCG services was reviewed for the last time two years ago   It included values for urgency and impact for the Tier-0/CERN services by experiment  A review is now needed  Some services have disappeared (e.g. gLite WMS) and some have appeared (e.g. Agile Infrastructure)  All experiments sent or are reviewing their numbers  Need to understand if to extend the scope  E.g. to Tier-1/2, and to better deal with distributed services (FTS3, CVMFS Stratum1, …)  A dedicated meeting will be scheduled and the results presented to WLCG  Please let us know if you would like to participate! WLCG Operations Coordination – A. Sciabà 4

Experiment news  ALICE  Very high activity level (~70K running jobs)  Successfully using the new VOMS server since a few weeks  ATLAS  Rucio/Prodsys2 commissioning: full test chain successful (~1 Mfiles/day), many workflows tested. Migration will start mid-November  CMS  Preparing for the PHYS14 campaign  Reconfiguration of Xrootd at EU sites to report to the EU GLED collector is ongoing  LHCb  Massive data staging ongoing in preparation for the stripping campaign which just started  Setting up a prototype HTTP federation with 70% of the storage endpoints accessible WLCG Operations Coordination – A. Sciabà 5

Middleware news  The WLCG repository is signed as of November 11  The change is backward-compatible  lcg-util is now unsupported and removed from the baseline services table  It will not be removed from the repositories any time soon WLCG Operations Coordination – A. Sciabà 6

Task Force (TF) news (1/2)  gLexec deployment  Integration in PanDA completed  Each site can be independently configured whether to use gLexec never/always/when it works  Ongoing deployment in ATLAS, then will study effects on success rates and based on it decide on the migration  SHA-2 migration  OSG added the new VOMS servers to their vomses files yesterday  ALICE is already happily using them, the other experiments still need to conclude their tests WLCG Operations Coordination – A. Sciabà 7

TF news (2/2)  Machine/job features  Converged on a single implementation for Cloud infrastructures, to be proposed to WLCG  TF conclusion expected by the next GDB  IPv6 deployment  Discussed at HEPix, agreed to strengthen the collaboration with OSG to avoid effort duplication  Recommendation to install perfSONAR in dual-stack from version 3.4  Squid monitoring and HTTP proxy discovery  Campaign this month to register all squid instances in GOCDB and OIM (instructions)instructions  It is needed to know which squid servers need to be monitored WLCG Operations Coordination – A. Sciabà 8

Working Group (WG) news  Middleware Readiness  ATLAS requested the WG to include HTCondor  The Tier-0 will contribute for EOS and FTS3  DPM being tested at the Volunteer Sites  Setting up for dCache at TRIUMF, NDGF and PIC  Setting up for StoRM at CNAF and QMUL  Developing a “MW readiness dashboard”  Next meeting November 19 th at 4pm CET with Vidyo  Network and transfer metrics  pS 3.4 patched to address the POODLE vulnerability  All sites must upgrade to 3.4+ according to broadcasted instructions  Validating the Datastore  Very soon the metrics will be usable for production and instructions made available to troubleshoot network problems WLCG Operations Coordination – A. Sciabà 9

Conclusions  ATLAS, CMS and LHCb must complete their migration to the new VOMS servers  November 26 th is the hard deadline as the CA of the current host certificate expires  Filling the Site survey is an investment beneficial to the whole of WLCG to improve operational practices  The TFs and WGs are essential for WLCG Operations  More participation is always welcome!  The Critical Services review will set new priorities for WLCG Operations during Run2 WLCG Operations Coordination – A. Sciabà 10