CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.

Slides:



Advertisements
Similar presentations
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS CASTOR Status Alberto Pace.
Advertisements

S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.
12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status
CASTOR Upgrade, Testing and Issues Shaun de Witt GRIDPP August 2010.
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle and Streams Diagnostics and Monitoring Eva Dafonte Pérez Florbela Tique Aires.
CERN IT Department CH-1211 Genève 23 Switzerland t Integrating Lemon Monitoring and Alarming System with the new CERN Agile Infrastructure.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES News on monitoring for CMS distributed computing operations Andrea.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
October 24, 2000Milestones, Funding of USCMS S&C Matthias Kasemann1 US CMS Software and Computing Milestones and Funding Profiles Matthias Kasemann Fermilab.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
RAL Site Report HEPiX Fall 2013, Ann Arbor, MI 28 Oct – 1 Nov Martin Bly, STFC-RAL.
CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
CERN IT Department CH-1211 Genève 23 Switzerland t Tape-dev update Castor F2F meeting, 14/10/09 Nicola Bessone, German Cancio, Steven Murray,
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status Tony Cass (With thanks to Miguel Coelho dos Santos & Alex Iribarren) LCG-LHCC.
CERN IT Department CH-1211 Geneva 23 Switzerland t The Experiment Dashboard ISGC th April 2008 Pablo Saiz, Julia Andreeva, Benjamin.
CERN IT Department CH-1211 Genève 23 Switzerland t Service Management GLM 15 November 2010 Mats Moller IT-DI-SM.
CERN IT Department CH-1211 Genève 23 Switzerland t Plans and Architectural Options for Physics Data Analysis at CERN D. Duellmann, A. Pace.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
CERN IT Department CH-1211 Genève 23 Switzerland t Data Management Evolution and Strategy at CERN G. Cancio, D. Duellmann, A. Pace With input.
SRM 2.2: status of the implementations and GSSD 6 th March 2007 Flavia Donno, Maarten Litmaath INFN and IT/GD, CERN.
Your university or experiment logo here NextGen Storage Shaun de Witt (STFC) With Contributions from: James Adams, Rob Appleyard, Ian Collier, Brian Davies,
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
John Gordon STFC-RAL Tier1 Status 9 th July, 2008 Grid Deployment Board.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 6 th July 2009.
CERN IT Department CH-1211 Genève 23 Switzerland t Castor development status Alberto Pace LCG-LHCC Referees Meeting, May 5 th, 2008 DRAFT.
CERN - IT Department CH-1211 Genève 23 Switzerland t CASTOR Status March 19 th 2007 CASTOR dev+ops teams Presented by Germán Cancio.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Update on Windows 7 at CERN & Remote Desktop.
Report from CASTOR external operations F2F meeting held at RAL in February Barbara Martelli INFN - CNAF.
Ian Bird LCG Project Leader WLCG Status Report 23 rd February 2009 Overview Board.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF CERN Computer Centre Upgrade Project Wayne Salter HEPiX November.
CASTOR evolution Presentation to HEPiX 2003, Vancouver 20/10/2003 Jean-Damien Durand, CERN-IT.
CERN IT Department CH-1211 Genève 23 Switzerland t Frédéric Hemmer IT Department Head - CERN 23 rd August 2010 Status of LHC Computing from.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
Oracle for Physics Services and Support Levels Maria Girone, IT-ADC 24 January 2005.
Data & Storage Services CERN IT Department CH-1211 Genève 23 Switzerland t DSS New tape server software Status and plans CASTOR face-to-face.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
Plans for Service Challenge 3 Ian Bird LHCC Referees Meeting 27 th June 2005.
CERN IT Department CH-1211 Genève 23 Switzerland t HEPiX Conference, ASGC, Taiwan, Oct 20-24, 2008 The CASTOR SRM2 Interface Status and plans.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
LCG Service Challenges SC2 Goals Jamie Shiers, CERN-IT-GD 24 February 2005.
CERN - IT Department CH-1211 Genève 23 Switzerland Operations procedures CERN Site Report Grid operations workshop Stockholm 13 June 2007.
Handling of T1D0 in CCRC’08 Tier-0 data handling Tier-1 data handling Experiment data handling Reprocessing Recalling files from tape Tier-0 data handling,
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
Site Services and Policies Summary Dirk Düllmann, CERN IT More details at
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
CERN IT Department CH-1211 Genève 23 Switzerland t The Tape Service at CERN Vladimír Bahyl IT-FIO-TSI June 2009.
SRM v2.2 Production Deployment SRM v2.2 production deployment at CERN now underway. – One ‘endpoint’ per LHC experiment, plus a public one (as for CASTOR2).
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
Grid Deployment Board 5 December 2007 GSSD Status Report Flavia Donno CERN/IT-GD.
CERN - IT Department CH-1211 Genève 23 Switzerland t Grid Reliability Pablo Saiz On behalf of the Dashboard team: J. Andreeva, C. Cirstoiu,
WLCG Operations Coordination report Maria Alandes, Andrea Sciabà IT-SDC On behalf of the WLCG Operations Coordination team GDB 9 th April 2014.
CERN IT Department CH-1211 Genève 23 Switzerland t Increasing Tape Efficiency Original slides from HEPiX Fall 2008 Taipei RAL f2f meeting,
CASTOR in SC Operational aspects Vladimír Bahyl CERN IT-FIO 3 2.
CERN IT Department CH-1211 Genève 23 Switzerland t Managing changes - 1 Managing changes Olof Bärring WLCG 2009, 14 th November 2008.
Tape write efficiency improvements in CASTOR Department CERN IT CERN IT Department CH-1211 Genève 23 Switzerland DSS Data Storage.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
Dissemination and User Feedback Castor deployment team Castor Readiness Review – June 2006.
CERN IT Department CH-1211 Genève 23 Switzerland t DPM status and plans David Smith CERN, IT-DM-SGT Pre-GDB, Grid Storage Services 11 November.
CASTOR: possible evolution into the LHC era
Luca dell’Agnello INFN-CNAF
Olof Bärring LCG-LHCC Review, 22nd September 2008
Ákos Frohner EGEE'08 September 2008
Presentation transcript:

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 2 Agenda Resource Ramp-up CASTOR status and performance Progress with new data centre project

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 3 Agenda Resource Ramp-up CASTOR status and performance Progress with new data centre project

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 4 Status of 2009 procurements CPU – First batch Ordered out in late August Delivery before November Production in December or early 2009 – Second batch Received the tender answers Target FC approval in December Delivery before March 2009 Production in March – April 2009 Disk – First batch FC approval last week Delivery in December Production January 2009 – Second batch Received the tender answers Target FC approval in December Delivery before March 2009 Production in March – April 2009 Tape – Media availability not a problem but exact procurement schedule depends on progress with new repack service between now and beginning of of 3 batches already on site FC approval not required, but delivery schedule unchanged (installation depends on readiness of racks) January February 70 Sun T10KB drives ordered (1TB/cartridge) T10KA drives to be phased out as repack advances.

Tier0 Status - 5

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 6 Agenda Resource Ramp-up CASTOR status and performance Progress with new data centre project

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 7 Agenda Resource Ramp-up CASTOR status and performance – Upstream services (SRM, FTS) – CASTOR status & plans Progress with new data centre project

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 8 SRM & FTS SRM 2.7 release is delayed – Originally foreseen in June but has still not yet passed testing/certification – Continue with 1.3 until LHC shutdown SLC3 – hardware running out of warranty  retire/replace Cannot be deployed in a fully redundant configuration Built with an old castor client  constrains the stager deployment FTS 2.1 passed certification too close to LHC startup – Continue with 2.0 service (SLC3) – Setting up an independent 2.1 production service (SLC4) in parallel allowing VOs to move when convenient Pre-production clusters in service for all LHC VOs Production deployment before end-2008 FTS 2.1 production service available Still being “tested” by experiments but most production transfers already with this version

CERN IT Department CH-1211 Genève 23 Switzerland t Current CASTOR activity No accelerator... still there is data moving Disk Layer Tape Layer Tier0 Status - 9

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 10 Performance metrics Metrics have been implemented and deployed on preproduction cluster – Data collected in lemon – RRD graphs not yet implemented Production deployment delayed for several reasons – New metrics imply several changes to exception/alarms and automated actions used in production – An unexpected technical dependency on the late SRM 2.7 version Ongoing work to back-port the implementation All still true 

CERN IT Department CH-1211 Genève 23 Switzerland t 11 Security, SRM and Monitoring Strong authentication now implemented –End user access to CASTOR has been secured (nameserver, disk cache, protocols) –Support both PKI (Grid certificates) and Kerberos Consolidation ongoing, Performance optimizations planned –See Frohner, Garcia, Ponce at Hepix Fall Castor Monitoring and SRM interface being improved –See De Witt, Lo Presti, Pokorski, Rekatsinas at Hepix Fall D.Duellmann, A.Pace – Grid Deployment Board, 12 November 2008 Today (on v2.1.8) Spring 2009 Mid 2009

CERN IT Department CH-1211 Genève 23 Switzerland t 12 Increasing Tape Efficiency New tape queue management supporting recall / migration policies, access control lists, and user / group based priorities New tape format with no performance drop when handling small files Data aggregation to allow managed tape migration / recall to try to match the drive speed (increased efficiency) See Bessone, Cancio, Murray, Taurelli at Hepix Fall See plan and timelines at D.Duellmann, A.Pace – Grid Deployment Board, 12 November 2008 Mid / End 2009 End 2009 Today (on v2.1.8)

CERN IT Department CH-1211 Genève 23 Switzerland t 13 Reduced access latency for analysis Removed the LSF job scheduling for reading disk files –Latency reduces from seconds to milliseconds (like a file system) –Plan to remove job scheduling also for write operation Focussed to offer direct access to storage on Castor disk pools –Direct access offered with the XROOT interface which is already part of the current service definition –Excellent integration with root –Mountable file system possible –Additional access protocols can be added (eg. NFS 4.1) Performances can be increased by improving the name server See A.Peters at ACAT D.Duellmann, A.Pace – Grid Deployment Board, 12 November 2008 Mid / End 2009 Today (on v2.1.8) End 2010 (if agreed) Today using FUSE (on v2.1.8) Today (on v2.1.8)

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 14 Agenda Resource Ramp-up CASTOR status and performance Progress with new data centre project

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 15 New data centre project Reminder: the selected strategy is to do a single tender for an overall solution Four phase process developed: 1.Request (many) conceptual designs 2.Commission 3-4 companies submitting conceptual designs to develop an outline design 3.In-house, turn a selected outline design into plans and documents enabling 4.Single tender for overall construction.

CERN IT Department CH-1211 Genève 23 Switzerland t Deadline: 28 th November – Contacts with all 4 companies during design phase – All 4 companies say deadline will be met Meetings to review proposed designs scheduled in week of December 8 th. Market Survey in preparation as first stage in selection of company for detailed design & construction. Discussions in Oslo on 28 th November to further investigate possible remote server installation in 2011 (and beyond) – RAL also have power available in 2011, but not as much and for a shorter period. Tier0 Status - 16 Outline Design Phase

CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 17 Questions? Comments?