CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.

Slides:



Advertisements
Similar presentations
ATLAS Tier-3 in Geneva Szymon Gadomski, Uni GE at CSCS, November 2009 S. Gadomski, ”ATLAS T3 in Geneva", CSCS meeting, Nov 091 the Geneva ATLAS Tier-3.
Advertisements

LCG-France Project Status Fabio Hernandez Frédérique Chollet Fairouz Malek Réunion Sites LCG-France Annecy, May
CERN IT Department CH-1211 Genève 23 Switzerland t CERN-IT Plans on Virtualization Ian Bird On behalf of IT WLCG Workshop, 9 th July 2010.
Duke Atlas Tier 3 Site Doug Benjamin (Duke University)
CERN - IT Department CH-1211 Genève 23 Switzerland t LCG Persistency Framework CORAL, POOL, COOL – Status and Outlook A. Valassi, R. Basset,
12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status
A comparison between xen and kvm Andrea Chierici Riccardo Veraldi INFN-CNAF.
CERN IT Department CH-1211 Genève 23 Switzerland t Next generation of virtual infrastructure with Hyper-V Michal Kwiatek, Juraj Sucik, Rafal.
CERN IT Department CH-1211 Genève 23 Switzerland t Integrating Lemon Monitoring and Alarming System with the new CERN Agile Infrastructure.
CERN IT Department CH-1211 Genève 23 Switzerland t Virtualization with Windows at CERN Juraj Sucik, Emmanuel Ormancey Internet Services Group.
Status of WLCG Tier-0 Maite Barroso, CERN-IT With input from T0 service managers Grid Deployment Board 9 April Apr-2014 Maite Barroso Lopez (at)
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status Tony Cass (With thanks to Miguel Coelho dos Santos & Alex Iribarren) LCG-LHCC.
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
CERN IT Department CH-1211 Genève 23 Switzerland t Experience with Windows Vista at CERN Rafal Otto Internet Services Group IT Department.
CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.
LAL Site Report Michel Jouvin LAL / IN2P3
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t Evolution of virtual infrastructure with Hyper-V Juraj Sucik, Slavomir Kubacka Internet.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 18 th November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t Tier0 Status - 1 Tier0 Status Tony Cass LCG-LHCC Referees Meeting 6 th July 2009.
CERN IT Department CH-1211 Genève 23 Switzerland t Castor development status Alberto Pace LCG-LHCC Referees Meeting, May 5 th, 2008 DRAFT.
F. Rademakers - CERN/EPLinux Certification - FOCUS Linux Certification Fons Rademakers.
CERN Physics Database Services and Plans Maria Girone, CERN-IT
CERN - IT Department CH-1211 Genève 23 Switzerland t CASTOR Status March 19 th 2007 CASTOR dev+ops teams Presented by Germán Cancio.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Update on Windows 7 at CERN & Remote Desktop.
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
CERN IT Department CH-1211 Genève 23 Switzerland t CERN-IT Update Ian Bird On behalf of IT Multi-core and Virtualisation Workshop,
CERN - IT Department CH-1211 Genève 23 Switzerland t Oracle Real Application Clusters (RAC) Techniques for implementing & running robust.
1 Moving Linux in CMS Vincenzo. 2 Generic Certification backward compatibility SLC4 is binary backward compatible: –Binaries built on SLC3 are usable.
CERN IT Department CH-1211 Genève 23 Switzerland t Frédéric Hemmer IT Department Head - CERN 23 rd August 2010 Status of LHC Computing from.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Automatic server registration and burn-in framework HEPIX’13 28.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Priorities update Andrea Sciabà IT/GS Ulrich Schwickerath IT/FIO.
CERN IT Department CH-1211 Genève 23 Switzerland t IT Configuration Activities Gavin McCance Online Cross-experiment Meeting, 14 June 2012.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
CERN - IT Department CH-1211 Genève 23 Switzerland t High Availability Databases based on Oracle 10g RAC on Linux WLCG Tier2 Tutorials, CERN,
LCG Report from GDB John Gordon, STFC-RAL MB meeting February24 th, 2009.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
CERN IT Department CH-1211 Genève 23 Switzerland t HEPiX Conference, ASGC, Taiwan, Oct 20-24, 2008 The CASTOR SRM2 Interface Status and plans.
CERN IT Department CH-1211 Geneva 23 Switzerland t WLCG Operation Coordination Luca Canali (for IT-DB) Oracle Upgrades.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal at CERN Juraj Sucik Jarosław Polok.
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
Participation of JINR in CERN- INTAS project ( ) Korenkov V., Mitcin V., Nikonov E., Oleynik D., Pose V., Tikhonenko E. 19 march 2004.
RAL PPD Tier 2 (and stuff) Site Report Rob Harper HEP SysMan 30 th June
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
CERN - IT Department CH-1211 Genève 23 Switzerland t Operating systems and Information Services OIS Proposed Drupal Service Definition IT-OIS.
1 Update at RAL and in the Quattor community Ian Collier - RAL Tier1 HEPiX FAll 2010, Cornell.
SL5 Site Status GDB, September 2009 John Gordon. LCG SL5 Site Status ASGC T1 - will be finished before mid September. Actually the OS migration process.
Evangelos Markatos and Charalampos Gkikas FORTH-ICS Athens, th Mar Institute of Computer Science - FORTH Christos.
INRNE's participation in LCG Elena Puncheva Preslav Konstantinov IT Department.
CERN - IT Department CH-1211 Genève 23 Switzerland t IT-GD-OPS attendance to EGEE’09 IT/GD Group Meeting, 09 October 2009.
CERN IT Department CH-1211 Genève 23 Switzerland t Managing changes - 1 Managing changes Olof Bärring WLCG 2009, 14 th November 2008.
CERN IT Department CH-1211 Genève 23 Switzerland t CHEP 2009, Monday 26rd March 2009 (Prague) Patricia Méndez Lorenzo on behalf of the IT/GS-EIS.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Improving resilience of T0 grid services Manuel Guijarro.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Cluman: Advanced Cluster Management for Large-scale Infrastructures.
2-December Offline Report Matthias Schröder Topics: Monte Carlo Production New Linux Version Tape Handling Desktop Computers.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Agile Infrastructure Project Overview : Status and.
Farming Andrea Chierici CNAF Review Current situation.
CERN LCG1 to LCG2 Transition Markus Schulz LCG Workshop March 2004.
CNAF - 24 September 2004 EGEE SA-1 SPACI Activity Italo Epicoco.
gLite->EMI2/UMD2 transition
The CREAM CE: When can the LCG-CE be replaced?
Status and plans of central CERN Linux facilities
PES Lessons learned from large scale LSF scalability tests
ETICS Services Management
FCT Follow-up Meeting 31 March, 2017 Fernando Meireles
Presentation transcript:

CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS

CERN IT Department CH-1211 Genève 23 Switzerland t What will be covered? Motivation –Context and lifecycle –Software –Hardware Opportunities Issues Current status Plans for the future Conclusions SL(C) 5 Migration at CERN - 2

CERN IT Department CH-1211 Genève 23 Switzerland t Motivation – Context and lifecycle (1) SL(C) 5 Migration at CERN - 3 RHEL 4 (Feb Feb 2009*) ▼ SL 4 (Apr Oct 2010) ▼ SLC 4 SLF 4 RHEL 5 (Mar Mar 2011*) ▼ SL 5 (May (?)) ▼ SLC 5 SLF 5 * (End of Production 1 Phase)

CERN IT Department CH-1211 Genève 23 Switzerland t Motivation – Context and lifecycle (2) We want stability during the LHC run period! SL(C) 5 Migration at CERN SLC 5 LHC SLC 4

CERN IT Department CH-1211 Genève 23 Switzerland t Motivation – Software (1) Newer versions of software which include new features and bug fixes are not available for SL(C) 4 –Bug fixes and increased performance in the XFS code Security –Some security fixes need to be back-ported to our versions of the software Virtualization support –No support for virtualization tools in SL(C)4 –We want to increase the use of VMs for consolidation of resources SL(C) 5 Migration at CERN - 5

CERN IT Department CH-1211 Genève 23 Switzerland t Motivation – Software (2) New compiler –gcc-4.1 is the default system compiler for SL(C) 5 –the Architects Forum selected gcc as the official compiler for SLC5 gcc is in SL(C) 5.3 –We expect significant performance increases with compiler support for new architectures SL(C) 5 Migration at CERN - 6

CERN IT Department CH-1211 Genève 23 Switzerland t Motivation – Hardware Performance Power saving features Hardware drivers Virtualization features of newer CPUs Support for new CPU architectures –AMD Shanghai CPUs –INTEL Nehalem CPUs SL(C) 5 Migration at CERN - 7

CERN IT Department CH-1211 Genève 23 Switzerland t Opportunities Changing the operating system enables us to deploy other major changes internally New tools for management of large clusters –Improved user management (ldap based) –New service oriented, name space approach for our internal fabric management tools (Quattor / CDB) Security –SElinux enabled by default –Run monitoring agents under a non privileged account (Lemon) SL(C) 5 Migration at CERN - 8

CERN IT Department CH-1211 Genève 23 Switzerland t Issues (1) We need to keep backwards compatibility with 32 bit SLC4 –Code compiled on 32 bit SLC4 must be able to run on SLC5 –Experiments have lots of code which won’t be ported soon –In some extreme cases only binaries exist SL(C) 5 Migration at CERN - 9

CERN IT Department CH-1211 Genève 23 Switzerland t Issues (2) Change of lxplus (interactive cluster) alias –Until this switch is done code is compiled on SLC4; after that point software will by default be compiled on SLC5 –Should happen once the majority of the resources are migrated on WLCG –All the VOs are confident they can move to SLC5 by the summer SL(C) 5 Migration at CERN - 10

CERN IT Department CH-1211 Genève 23 Switzerland t Current status Fabric management tools ported to SLC5 –Installation –Monitoring –New user management system in place 10% of existing worker node capacity is on SLC5 –Behind 4 CEs (2 LCG + 2 CREAM) –SL5 WN software was released yesterday (23 rd of March) Ramping up of the interactive cluster (lxplus) as demand increases SL(C) 5 Migration at CERN - 11

CERN IT Department CH-1211 Genève 23 Switzerland t Future plans (1) Move CASTOR disk servers to SLC5 Move GRID services to SLC5 –As the software is released into production –UI in the horizon Interactive Linux cluster (lxplus) alias switch is being discussed with the VOs SL(C) 5 Migration at CERN - 12

CERN IT Department CH-1211 Genève 23 Switzerland t Future plans (2) All pledged CPU capacity for the LHC experiments for 2009 will be on SLC5 by the summer –SLC4 resources will be kept for other user communities at CERN –No “big bang” approach SL(C) 5 Migration at CERN - 13

CERN IT Department CH-1211 Genève 23 Switzerland t Conclusions Move to SLC5 as main operating system well ahead of data taking –GDB: “Every experiment is interested on a transition to SLC5/64bit of the Grid resources as soon and as short as possible.” CERN has been providing SLC5 resources for several months Close collaboration with the experiments in the move to SLC5 Extensively tested and production ready Confident on a quick and painless transition No known showstoppers for a large scale migration SL(C) 5 Migration at CERN - 14

CERN IT Department CH-1211 Genève 23 Switzerland t Questions? Thank you for listening! Questions? SL(C) 5 Migration at CERN - 15

CERN IT Department CH-1211 Genève 23 Switzerland t References SL(C) 5 Migration at CERN - 16

CERN IT Department CH-1211 Genève 23 Switzerland t Abstract SLC5 deployment at CERN Despite of the unfortunate delay of LHC data taking, the ramping up of available resources at CERN continues. New deliveries of CPU resources are expected for early In order to be able to make optimal use of the expected modern hardware, appropriate Linux hardware drivers must be provided. For the current main stream SLC4 it becomes increasingly difficult to get suitable backports and support for such drivers. The delay of the LHC data taking offers the opportunity to migrate to the more recent SL5 which should solve this problem. In autumn 2008, CERN has set up a couple of public interactive and batch worker nodes for evaluation by the experiments, and has set up a Grid preproduction pilot. The current plan foresees that the coming computing resources are made available under this new operating system. The status of the migration, feedback and challenges are described in the presentation. Beyond this, the migration to a new operating system also offers an excellent opportunity to upgrade the infrastructure used to manage the servers. Upgrades which directly affect users will be described. SL(C) 5 Migration at CERN - 17