F. Rademakers - CERN/EPLinux Certification - FOCUS Linux Certification Fons Rademakers.

Slides:



Advertisements
Similar presentations
NIKHEF Testbed 1 Plans for the coming three months.
Advertisements

12. March 2003Bernd Panzer-Steindel, CERN/IT1 LCG Fabric status
Site report: CERN Helge Meinhard (at) cern ch HEPiX fall SLAC.
Unix Presentation. What is an Operating System An operating system (OS) is a program that allows you to interact with the computer -- all of the software.
Desktop Security: Worms and Viruses Brian Arkills, C&C NDC-Sysmgt.
HEPiX Catania 19 th April 2002 Alan Silverman HEPiX Large Cluster SIG Report Alan Silverman 19 th April 2002 HEPiX 2002, Catania.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
CERN - European Laboratory for Particle Physics HEP Computer Farms Frédéric Hemmer CERN Information Technology Division Physics Data processing Group.
Testing Virtual Machine Performance Running ATLAS Software Yushu Yao Paolo Calafiura LBNL April 15,
Overview of Linux Dr. Michael L. Collard 1.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
08/06/00 LHCb(UK) Meeting Glenn Patrick LHCb(UK) Computing/Grid: RAL Perspective Glenn Patrick Central UK Computing (what.
1 Linux in the Computer Center at CERN Zeuthen Thorsten Kleinwort CERN-IT.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
13 th May 2004LINUX, which LINUX?1 Presentation to the AB/CO Technical Committee – Linux as the Future Console O/S Alastair Bland, 13 th May 2004.
19-May-2003 Solaris service: Status and plans at CERN Ignacio Reguero IT / Product Support / Unix Infrastructure Presented by Manuel Guijarro.
28 April 2003Imperial College1 Imperial College Site Report HEP Sysman meeting 28 April 2003.
21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
Manchester HEP Desktop/ Laptop 30 Desktop running RH Laptop Windows XP & RH OS X Home server AFS using openafs 3 DB servers Kerberos 4 we will move.
1 The new Fabric Management Tools in Production at CERN Thorsten Kleinwort for CERN IT/FIO HEPiX Autumn 2003 Triumf Vancouver Monday, October 20, 2003.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
CCRC’08 Weekly Update Jamie Shiers ~~~ LCG MB, 1 st April 2008.
CERN Physics Database Services and Plans Maria Girone, CERN-IT
EGEE is a project funded by the European Union under contract IST JRA1-SA1 requirement gathering Maite Barroso JRA1 Integration and Testing.
4-8 th October 1999CERN Site Report, HEPiX SLAC. A.Silverman CERN Site Report HEPNT/HEPiX October 1999 SLAC Alan Silverman CERN/IT/DIS.
Deployment work at CERN: installation and configuration tasks WP4 workshop Barcelona project conference 5/03 German Cancio CERN IT/FIO.
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Long Term Data Preservation Frank Berghaus On Behalf of the DPHEP Collaboration 06/03/15 Data Preservation - Frank Berghaus1.
HEPiX 2002, CataniaI. Reguero M. Manent – IT/PS/UI Solaris 8 Certification Status at CERN Ignacio Reguero and Michel Manent Presented by Alan Lovell
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Public Batch and Interactive Services on Linux FOCUS — July 1 st 1999 Tony Cass —
HepNT - January 15, 1997 : PCSF Frederic Hemmer IT/PDP 1 PCSF - A Pentium ® /Windows NT ® Based simulation farm Frederic Hemmer CERN IT/PDP.
Cluster Configuration Update Including LSF Status Thorsten Kleinwort for CERN IT/PDP-IS HEPiX I/2001 LAL Orsay Tuesday, December 08, 2015.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
2-Dec Offline Report Matthias Schröder Topics: Scientific Linux Fatmen Monte Carlo Production.
1 LHCC RRB SG 16 Sep P. Vande Vyvre CERN-PH On-line Computing M&O LHCC RRB SG 16 Sep 2004 P. Vande Vyvre CERN/PH for 4 LHC DAQ project leaders.
HEPiX 2 nd Nov 2000 Alan Silverman Proposal to form a Large Cluster SIG Alan Silverman 2 nd Nov 2000 HEPiX – Jefferson Lab.
Database Competence Centre openlab Major Review Meeting nd February 2012 Maaike Limper Zbigniew Baranowski Luigi Gallerani Mariusz Piorkowski Anton.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
Feb. 14, 2002DØRAM Proposal DØ IB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) Introduction Partial Workshop Results DØRAM Architecture.
5 June 2003Alan Norton / Focus / EP Topics1 Other EP Topics Some 2003 Running Experiments - NA48/2 (Flavio Marchetto) - Compass (Benigno Gobbo) - NA60.
Lisa Giacchetti AFS: What is everyone doing? LISA GIACCHETTI Operating Systems Support.
David Foster LCG Project 12-March-02 Fabric Automation The Challenge of LHC Scale Fabrics LHC Computing Grid Workshop David Foster 12 th March 2002.
CERN IT Department CH-1211 Genève 23 Switzerland t Migration from ELFMs to Agile Infrastructure CERN, IT Department.
1 july 99 Minimising RISC  General strategy - converge on PCs with Linux & NT to avoid wasting manpower in support teams and.
Alignment in real-time in current detector and upgrade 6th LHCb Computing Workshop 18 November 2015 Beat Jost / Cern.
1 Comments to SPI. 2 General remarks Impressed by progress since last review Widespread adoption by experiments and projects Savannah, ExtSoft Build system.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
Choosing and Installing a Linux Distribution Tutor: George Papamarkos City University October 5, 2004.
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
Linux 7.3 Migration S. O’Neale Review Feedback –Lots of machines running 7.3 –Certification started well –Then what went wrong ? –Suggestions for overall.
Feedback from CMS Andrew Lahiff STFC Rutherford Appleton Laboratory Contributions from Christoph Wissing, Bockjoo Kim, Alessandro Degano CernVM Users Workshop.
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
Status report of the new NA60 “cluster” Our OpenMosix farm will increase our computing power, using the DAQ/monitoring computers. NA60 weekly meetings.
2-December Offline Report Matthias Schröder Topics: Monte Carlo Production New Linux Version Tape Handling Desktop Computers.
This slide deck is for LPI Academy instructors to use for lectures for LPI Academy courses. ©Copyright Network Development Group Module 01 Introduction.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
SPI Report for the LHCC Comprehensive Review Stefan Roiser for the SPI project.
Software Release Build Process and Components in ATLAS Offline Emil Obreshkov for the ATLAS collaboration.
Application Support Environment Based on experience in High Energy Physics at CERN Presented at the UNESCO/CERN Workshop April 2002 Jürgen Knobloch.
Choosing and Installing a Linux Distribution
Virtualisation for NA49/NA61
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
Virtualisation for NA49/NA61
CernVM Status Report Predrag Buncic (CERN/PH-SFT).
Linux Cluster Tools Development
Presentation transcript:

F. Rademakers - CERN/EPLinux Certification - FOCUS Linux Certification Fons Rademakers

F. Rademakers - CERN/EPLinux Certification - FOCUS2 Foreword An up-to-date version of RedHat Linux is a key issue for almost all computing activities and experiments Certification process must be discussed in FOCUS Experiment input collected by –4 LHC experiments –Most LEP experiments –Compass, NA49 DAQ, HLT and Offline projects

F. Rademakers - CERN/EPLinux Certification - FOCUS3 Linux Ubiquitous Linux ubiquitous: –All experiments are using it; most as main platform Windows mentioned only by LHCb as DAQ development platform Sun Solaris alternative platform (CMS) –Desktop: Standalone, dual-boot, VMware Code (DAQ, HLT, Offline) development TRG/DAQ simulation –Large farms (50 to 200 nodes): Either private or in the computing centre Data taking periods (Compass) Data Challenges (LHC exp.) Physics simulation, reconstruction and analysis RISC is now minimal –Transition of experiments to Linux completed

F. Rademakers - CERN/EPLinux Certification - FOCUS4 Reasons to Stick to RH 6.1 Mainly compatibility with CERN version Ease system management until RH 7.2 validated Objectivity (Compass), GPHIGS (Delphi, OPAL) CERN RH 7.2 validation platform not yet ready Each experiment developed its own migration strategy due to the strong need to move to RH 7.2 (next slide) –RH kernel 2.4 –RH gcc 2.95 –RH 7.2

F. Rademakers - CERN/EPLinux Certification - FOCUS5 Motivation to Convert to RH 7.2 RH 6 becoming obsolete –Recent packages do not support it any longer –Need to use latest desktop environments (KDE, Gnome) Improved and more robust security Collaboration home institutes have already converted (Compass, Delphi, ALICE, ATLAS, LHCb) –Often home labs member of several collaborations New hardware needs it (ALICE, ATLAS, CMS) Latest version of gcc (CMS) Kernel 2.4 required for better I/O (TCP/IP stack, disk I/O), better VM system and support for recent motherboards All experiments request to go to RH 7.2 ASAP

F. Rademakers - CERN/EPLinux Certification - FOCUS6 Linux Environments at CERN IT computer centre public farms: –LXPLUS, LXBATCH, LXSHARE Private experiment machines and farms –CMS DAQ test benches, e.g. to test switch fabrics (70 nodes) –Development and test of DAQ framework –To run DAQ simulation (based on ptolemy) –Many smaller, 4-5 machine, clusters

F. Rademakers - CERN/EPLinux Certification - FOCUS7 Proposal for Certification Process Step 1: –RH Linux is certified by RH, no need to redo it In case of problems RH releases promptly fixes, these can be installed via a SUE mechanism or RH’s up2date Step 2: –IT only needs to certify the packages it is responsible for 1.Special drivers (OpenAFS, etc), mostly kernel and not RH specific 2.What used to be in ASIS (mostly obsolete with new RH releases), SUE, hepix, cernlib 3.Commercial packages used by (some) experiments (NAG, Objy) Step 3: –Ask external package providers to certify their programs –Ask the experiments to certify their codes

F. Rademakers - CERN/EPLinux Certification - FOCUS8 Proposal for Certification Process Steps 2.1 and 2.2 can be done within a few days, but surely within 2-3 weeks after release of a new RH At this stage the new RH can be certified for users not relying on commercial products Stage 2.3 depends on vendors. Avoid vendors without commitment to release very timely new version in response to major Linux releases –Should take not more than two months, otherwise renegotiate contract or dump vendor

F. Rademakers - CERN/EPLinux Certification - FOCUS9 Proposal for Certification Process Step 3 can be completed within two weeks after finishing 2.2 for experiments like ALICE and after 2.3 for other experiments Certification of the non-commercial version should not take more than 4-5 weeks from the release of a new RH version Full certification can take considerably longer due to 2.3 Therefore there should be a two stage certification process IT should be able to switch entire clusters between two RH versions if certification step 2.3 cannot be achieved within a couple of months –E.g. ALICE will need RH7.2 for its data challenges on LXSHARE, while CMS will still need RH6.1 –If not then, in extremis, an experiment like COMPASS can hold ALICE hostage for the coming years

F. Rademakers - CERN/EPLinux Certification - FOCUS10 More Comments on RH 7.2 CERN should distribute its additions as RPM’s (all) Software needed with RH 7.2: –Bigphys area patch (ATLAS DAQ, CMS DAQ) –CERN environment: AFS, SUE –CMT, GEANT4, CLHEP, ANAPHE, AIDA, ROOT –Doxygen, Ptolemy, Python version 2, REXX, Xemacs, Xerces XML Work on a network booting service for diskless VMEbus SBCs based on a server with CERN RH 7.2.1beta2 and version 3.0 of the LTSP (Linux Terminal Server Project) software which is also kernel (ATLAS DAQ) CERN store should have on stock machine with both Win2K and Linux installed (dual boot or VMWare)

F. Rademakers - CERN/EPLinux Certification - FOCUS11 What Next ? Finish as soon as possible the RH 7.2 certification –RH 7.3 is imminent Review certification process along the lines proposed Involve 1 person of each experiment in the certification process to improve coordination and to ensure timely feedback on the certification of experiment codes Evaluate in parallel a second Linux distribution like SuSE –installing SuSE AFS by a non-experienced person and running the complete CMS code took only one day