LCG/EGEE Installation J. A. Templon Undecided (NIKHEF)

Slides:



Advertisements
Similar presentations
ASIS et le projet EU DataGrid (EDG) Germán Cancio IT/FIO.
Advertisements

Va-scanCopyright 2002, Marchany Unit 3 – Installing Solaris Randy Marchany VA Tech Computing Center.
ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.
WP4-install task report WP4 workshop Barcelona project conference 5/03 German Cancio.
EGEE is a project funded by the European Union under contract IST Quattor Installation of Grid Software C. Loomis (LAL-Orsay) GDB (CERN) Sept.
EDG LCFGng: concepts Fabric Management Tutorial - n° 2 LCFG (Local ConFiGuration system)  LCFG is originally developed by the.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
EDG WP4: installation task LSCCW/HEPiX hands-on, NIKHEF 5/03 German Cancio CERN IT/FIO
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2
LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed in conjunction with GridPP and EGEE Running LCG, Handy Hints and Tips.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 LCFGng configuration examples Updated 10/2002
EDG Testbed installation and configuration with LCFGng Maite Barroso - WP4
1 The new Fabric Management Tools in Production at CERN Thorsten Kleinwort for CERN IT/FIO HEPiX Autumn 2003 Triumf Vancouver Monday, October 20, 2003.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Stephen Childs Trinity College Dublin &
EGEE is a project funded by the European Union under contract IST HellasGrid Hardware Tender Christos Aposkitis GRNET EGEE 3 rd parties Advanced.
Large Farm 'Real Life Problems' and their Solutions Thorsten Kleinwort CERN IT/FIO HEPiX II/2004 BNL.
Deployment work at CERN: installation and configuration tasks WP4 workshop Barcelona project conference 5/03 German Cancio CERN IT/FIO.
20-May-2003HEPiX Amsterdam EDG Fabric Management on Solaris G. Cancio Melia, L. Cons, Ph. Defert, I. Reguero, J. Pelegrin, P. Poznanski, C. Ungil Presented.
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
G. Cancio, L. Cons, Ph. Defert - n°1 October 2002 Software Packages Management System for the EU DataGrid G. Cancio Melia, L. Cons, Ph. Defert. CERN/IT.
Maite Barroso – WP4 Barcelona – 13/05/ n° 1 -WP4 Barcelona- Closure Maite Barroso 13/05/2003
Ariel Garcia LCG cluster installation, EGEE training, Ariel Garcia - IWR LCG Cluster Installation Forschungszentrum Karlsruhe in der Helmholtz-Gemeinschaft.
Lemon Monitoring Miroslav Siket, German Cancio, David Front, Maciej Stepniewski CERN-IT/FIO-FS LCG Operations Workshop Bologna, May 2005.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
Software Management with Quattor German Cancio CERN/IT.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
22nd April 2002 Steve Traylen, RAL, 1 LCFG Installation Steve Traylen. LCFG – A tool for installation and configuration. UK HEP SYSMAN,
Installing a Quattor Server and Client German Cancio CERN/IT.
Fabric Management with ELFms BARC-CERN collaboration meeting B.A.R.C. Mumbai 28/10/05 Presented by G. Cancio – CERN/IT.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
E. Ferro, CNAF, april Enrico Ferro INFN-LNL Installation of a LCFG server.
Maite Barroso - 10/05/01 - n° 1 WP4 PM9 Deliverable Presentation: Interim Installation System Configuration Management Prototype
The EDG Testbed The European DataGrid Project Team
Linux Configuration using April 12 th 2010 L. Brarda / CERN (some slides & pictures taken from the Quattor website) ‏
EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.
Configuration & Management for Joachim Flammer Integration Team EGEE is a project funded by the European Union under contract IST JRA1 all-hands-meeting,
EGEE is a project funded by the European Union under contract IST Installation and configuration of gLite services Robert Harakaly, CERN,
Grid-Ireland test facilities Stephen Childs Dept. of Computer Science Trinity College Dublin.
2007/05/22 Integration of virtualization software Pierre Girard ATLAS 3T1 Meeting
Quattor installation and use feedback from CNAF/T1 LCG Operation Workshop 25 may 2005 Andrea Chierici – INFN CNAF
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Nagios Grid Monitor E. Imamagic, SRCE OAT.
CERN Openlab Openlab II virtualization developments Havard Bjerke.
INFNGRID Technical Board, Feb
Regional Operations Centres Core infrastructure Centres
SPGrid Status in Ferrara
AII v2 Ronald Starink Luis Fernando Muñoz Mejías
Support Operation Challenge – 1 SOC-1 Alistair Mills Torsten Antoni
IBCP - CNRS STATUS Christelle Eloto Lyon - France
CE-Monitor Luigi Zangrando INFN-Padova
Status of Fabric Management at CERN
GILDA Project Valeria Ardizzone INFN Catania Italy
Quattor in Amazon Cloud
WP4-install status update
Kiyoshi Kodama, SE Japan 07-Oct-2008
Status and plans of central CERN Linux facilities
German Cancio CERN IT .quattro architecture German Cancio CERN IT.
StratusLab Cloud Installation
Quattor Usage at Nikhef
Leanne Guy EGEE JRA1 Test Team Manager
Network Requirements Javier Orellana
NA4 Test Team Status Test meeting, 07/09/04
Transactional Grid Deployment
Quattor Advanced Tutorial, LAL
Edge Recorder Client
The EU DataGrid Fabric Management Services
INFNGRID Workshop – Bari, Italy, October 2004
Installation/Configuration
Presentation transcript:

LCG/EGEE Installation J. A. Templon Undecided (NIKHEF) NROC Meeting, Amsterdam, 28 October 2004 LCG/EGEE Installation J. A. Templon Undecided (NIKHEF) www.eu-egee.org EGEE is a project funded by the European Union under contract IST-2003-508833

Contents The Installation Problem The Current Solution (LCFGng) (LCFGng)ng == Quattor How to proceed NROC Meeting, 28 October 2004 - 2

The Installation Problem Installation of large numbers of nodes Configuration of large numbers of nodes Interchangeability of node functions (or even identities) Configuration management Allow for site customizations NROC Meeting, 28 October 2004 - 3

Config & Install Server Or in pictures Config & Install Server Grid site Worker nodes ce ? se Software Repository NROC Meeting, 28 October 2004 - 4

Current Solution: LCFGng Configuration is a CPP macro #define HOSTNAME node16-32 #define SITE_LOCALDOMAIN farmnet.nikhef.nl #include "local/site-config-lcgprod.h" #include "local/nikhef-sys-core.h" #include "local/nikhef-sys-hw-amdncf.h" #include "local/nikhef-sys-disk-generic.h" #include "local/nikhef-fs-autofs.h" #include "local/nikhef-auth-lusers.h" #include "lcgprod/WorkerNode-cfg.h" #include "local/nikhef-postconfig-lcgprod.h" #ifdef SYS_LMSENSORS_SUPPORT EXTRA(cron.additions) gangliatemp cron.add_gangliatemp * * * * * /path/prog arg1 arg2 arg3 #endif +updaterpms.rpmcfg rpmlist-wnlcgprod NROC Meeting, 28 October 2004 - 5

LCFGng cont’d #include "lcgprod/WN-rpm" #include "nikhef-local-rpm.h" -edg-pbs-utils-1.0.7-1 -openpbs-*-* -openpbs-server-*-* -openpbs-sched-*-* -openpbs-mom-*-* +edg-pbs-utils-1.0.7-1 +torque-common-1.0.1p6-ttd5 +torque-mom-1.0.1p6-ttd5 NROC Meeting, 28 October 2004 - 6

Sequence of LCFGng Node boots under dhcp -> hostname + profile Bootstraps enough to get ‘rpm’ object (deals with RPMs) and installs rpm list Reboots and does configs Config changes are applied when profile changes NROC Meeting, 28 October 2004 - 7

Assessment Installation of large numbers of nodes Configuration of large numbers of nodes Interchangeability of node functions (or even identities) Configuration management Allow for site customizations NROC Meeting, 28 October 2004 - 8

Quattor Structured Configuration Database Structured Software Repository Management Tools for Each Configuration “components” for various functionality Compiler for configuration profiles (handles dependencies) Automatic Install System integrated with dhcp NROC Meeting, 28 October 2004 - 9

Configuration Database [INFO] Subtree: /software/components/aii/osinstall +-osinstall +-options $ cdb : (string) 'trog.nikhef.nl' $ confserver : (string) 'trog.nikhef.nl/' $ distserver : (string) 'www.dutchgrid.nl/linux/7.3/en/os/i386/' $ firewall : (string) '--disabled' $ rootpw : (string) '$1$aRNMtjV30' $ template : (string) 'rh73_ks_pizza0.conf' [INFO] Subtree: /system/network +-network $ domainname : (string) 'nikhef.nl' $ hostname : (string) 'tbn03' +-interfaces +-eth0 $ broadcast : (string) '192.16.186.255' $ gateway : (string) '192.16.186.254' $ ip : (string) '192.16.186.228' NROC Meeting, 28 October 2004 - 10

SW Repository Management trog:~> edg-swrep-client listplatforms Available platforms: test_jeff i386_rh73 trog:~> edg-swrep-client listareas i386_rh73 Available areas for platform i386_rh73: /base 0 /quattor 39 /updates 0 trog:~> edg-swrep-client list i386_rh73 Platform i386_rh73 contents: aii-1.0.2-1.noarch.rpm /quattor aii-client-1.0.2-1.noarch.rpm /quattor cdb-cli-1.8.4-1.noarch.rpm /quattor cdb-simple-cli-1.0.6-1.noarch.rpm /quattor NROC Meeting, 28 October 2004 - 11

Architecture NROC Meeting, 28 October 2004 - 12

Assessment Installation of large numbers of nodes (looks promising) Configuration of large numbers of nodes (looks promising) Interchangeability of node functions (looks promising) Configuration management Allow for site customizations NROC Meeting, 28 October 2004 - 13

How to Proceed LCG-2 profiles for Quattor exist (C. Loomis) Quattor support materializing in GDB Community action to develop, share, and support tools NIKHEF is developing Quattor install for two systems (P4 Cert TB of VL-E and EGEE PPS) NROC Meeting, 28 October 2004 - 14