CDB Namespaces, “service templates” and profile structure Véronique Lefébure June the 13 th 2008 ELFms Brainstorming meeting.

Slides:



Advertisements
Similar presentations
CCTracker Presented by Dinesh Sarode Leaf : Bill Tomlin IT/FIO URL
Advertisements

Project Management Summary Castor Development Team Castor Readiness Review – June 2006 German Cancio, Giuseppe Lo Presti, Sebastien Ponce CERN / IT.
The CERN Computer Centres October 14 th 2005 CERN.ch.
Site report: CERN Helge Meinhard (at) cern ch HEPiX fall SLAC.
Operating Systems Concepts 1. A Computer Model An operating system has to deal with the fact that a computer is made up of a CPU, random access memory.
Welcome Course 20410B Module 0: Introduction Audience
Automating Linux Installations at CERN G. Cancio, L. Cons, P. Defert, M. Olive, I. Reguero, C. Rossi IT/PDP, CERN presented by G. Cancio.
CERN IT Department CH-1211 Genève 23 Switzerland t Some Hints for “Best Practice” Regarding VO Boxes Running Critical Services and Real Use-cases.
Installation Overview Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
Dan Lawson, All Sites VectorBase Releases. 2 VectorBase 2012 A release cycle for VectorBase Regular release every 2 months In place since June 2010 Latest.
EGEE is a project funded by the European Union under contract IST Quattor Installation of Grid Software C. Loomis (LAL-Orsay) GDB (CERN) Sept.
AI project components: Facter and Hiera
INFSO-RI Enabling Grids for E-sciencE Status of LCG-2 porting Stephen Childs, Brian Coghlan and Eamonn Kenny Grid-Ireland/EGEE October.
October, Scientific Linux INFN/Trieste B.Gobbo – Compass R.Gomezel - T.Macorini - L.Strizzolo INFN - Trieste.
Large Computer Centres Tony Cass Leader, Fabric Infrastructure & Operations Group Information Technology Department 14 th January and medium.
EGEE is a project funded by the European Union under contract IST Build Infrastructure & Release Procedures Integration.
CERN Manual Installation of a UI – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2
CERN IT Department CH-1211 Genève 23 Switzerland t Evolution of virtual infrastructure with Hyper-V Juraj Sucik, Slavomir Kubacka Internet.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
1 The new Fabric Management Tools in Production at CERN Thorsten Kleinwort for CERN IT/FIO HEPiX Autumn 2003 Triumf Vancouver Monday, October 20, 2003.
Quattor-for-Castor Jan van Eldik Sept 7, Outline Overview of CERN –Central bits CDB template structure SWREP –Local bits Updating profiles.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Stephen Childs Trinity College Dublin &
Pan Tutorial: A Whirlwind Tour of the Pan Language C. Loomis (CNRS/LAL) 11 th Quattor Workshop (CERN) March 2011.
Security monitoring boxes Andrew McNab University of Manchester.
Large Farm 'Real Life Problems' and their Solutions Thorsten Kleinwort CERN IT/FIO HEPiX II/2004 BNL.
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
An Agile Service Deployment Framework and its Application Quattor System Management Tool and HyperV Virtualisation applied to CASTOR Hierarchical Storage.
Lemon Monitoring Miroslav Siket, German Cancio, David Front, Maciej Stepniewski CERN-IT/FIO-FS LCG Operations Workshop Bologna, May 2005.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Update on Windows 7 at CERN & Remote Desktop.
Installing, running, and maintaining large Linux Clusters at CERN Thorsten Kleinwort CERN-IT/FIO CHEP
Olof Bärring – WP4 summary- 4/9/ n° 1 Partner Logo WP4 report Plans for testbed 2 [Including slides prepared by Lex Holt.]
HEPiX 2002, CataniaI. Reguero M. Manent – IT/PS/UI Solaris 8 Certification Status at CERN Ignacio Reguero and Michel Manent Presented by Alan Lovell
QWG Errata Management Framework Ian Collier 10 th Quattor Workshop Rutherford Appleton Laboratory October 2010.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
Fabric Management with ELFms BARC-CERN collaboration meeting B.A.R.C. Mumbai 28/10/05 Presented by G. Cancio – CERN/IT.
INFSO-RI Enabling Grids for E-sciencE Pan Compiler C. Loomis (LAL-Orsay) Quattor Workshop (Madrid) October 2007.
Quattor and ELFms An introduction for the new Sysadmins (and others) Sophie Lemaitre Véronique Lefébure April 2011 CF-ASI.
Computing Facilities CERN IT Department CH-1211 Geneva 23 Switzerland t CF Alarming with GNI VOC WG meeting 12 th September.
IBM Software Group ® Software Distribution of ClearCase Artifacts with Tivoli Software Eitan Shomrai, IBM Software Group – Rational Yuval Kimel, IBM Software.
Linux Configuration using April 12 th 2010 L. Brarda / CERN (some slides & pictures taken from the Quattor website) ‏
CERN - IT Department CH-1211 Genève 23 Switzerland t Operating systems and Information Services OIS Proposed Drupal Service Definition IT-OIS.
R. Krempaska, October, 2013 Wir schaffen Wissen – heute für morgen Controls Security at PSI Current Status R. Krempaska, A. Bertrand, C. Higgs, R. Kapeller,
CERN 19/06/2002 Kickstart file generator Andrea Chierici (INFN-CNAF) Enrico Ferro (INFN-LNL) Marco Serra (INFN-Roma)
CERN IT Department CH-1211 Genève 23 Switzerland t SL(C) 5 Migration at CERN CHEP 2009, Prague Ulrich SCHWICKERATH Ricardo SILVA CERN, IT-FIO-FS.
Quattor tutorial Introduction German Cancio, Rafael Garcia, Cal Loomis.
CERN 13-Jun-2002 Andreas Pfeiffer, CERN/IT-API, Development Infrastructure Andreas Pfeiffer CERN IT/API
Windows Certification Paths OR MCSA Windows Server 2012 Installing and Configuring Windows Server 2012 Exam (20410) Administering Windows Server.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Agile Infrastructure Project Overview : Status and.
SCDB Update Michel Jouvin LAL, Orsay March 17, 2010 Quattor Workshop, Thessaloniki.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
Fabric Management: Progress and Plans PEB Tim Smith IT/FIO.
Managing Large Linux Farms at CERN OpenLab: Fabric Management Workshop Tim Smith CERN/IT.
Scientific Linux Connie Sieh CSAM Meeting May 2, 2006.
The CDB evolution - part 4
AII v2 Ronald Starink Luis Fernando Muñoz Mejías
Cluster / Grid Status Update
Status of Fabric Management at CERN
WP4-install status update
Running Computers in CC
Spring Cleaning the Software Repositories Matthias Schröder
Status and plans of central CERN Linux facilities
Generator Services planning meeting
Package functions and tools in CDB
Quattor Usage at Nikhef
CERN Windows Roadmap Tim Bell 8th June 2011.
June 2011 David Front Weizmann Institute
Quattor Advanced Tutorial, LAL
Grid Management Challenge - M. Jouvin
Presentation transcript:

CDB Namespaces, “service templates” and profile structure Véronique Lefébure June the 13 th 2008 ELFms Brainstorming meeting

OUTLINE Namespaces –Organisation of templates ACLs Alignment to latest Quattor release Service templates Profile structure –Environment variables –Configuration tree MISC –Future PANC, SLC5, security timeline

Namespaces Top directories: –test –preprod –prod –usertest – –profiles –repository –retired (new, to be populated) stages Contain templates

Namespaces Under any stage: –pan/ –quattor/ –components/ –monitoring/lemon/ –hardware/ –services/ –os/ –site/cern_cc/ –cluster/ –vpd/ –netinfo/ –serialmap/ Quattor base templates Quattor base templates with cern configuration Make use of all above, service per service OS releases (defaults) Make use of all above, site-specific Make use of all above, cluster-specific Machine data (Serial numbers, mac addresses, …) “vital product data”

components/ components/[component_name]/ –config.tpl Pkg_add (“ncm-[component_name]”,version,arch) Default configuration –schema.tpl –[ functions.tpl ]

monitoring/lemon/ configuration/ infrastructure/ rpms/ metrics/ sensors/ ACLs: monitoring Service Managers only

hardware/ cards/ cpus/ disks/ memory/ rams/ contracts/ vendors/ monitoring/ machines/ ACLs: procurement team only Make use of all above: HW types, ex: “ex_07_3” Make use of /prod/monitoring/*

Services/ services/[service_name]/config.tpl Contains: –Packages (use default versions) –Component(s) –Monitoring –Chkconfig –Iptables config

Service template: ex: afs_client template services/afs_client/config; # # Packages # variable architecture = if (value("/system/architecture") == "i386") { "i686"; } else { value("/system/architecture") }; variable kernelversion = value("/system/kernel/version"); variable openafsversion = " SL5"; "/software/packages" = pkg_add("openafs", openafsversion, architecture); "/software/packages" = pkg_add("openafs-client", openafsversion, architecture); "/software/packages" = pkg_add("openafs-kpasswd", openafsversion, architecture); "/software/packages" = pkg_add("openafs-krb5", openafsversion, architecture); "/software/packages"=pkg_add("kernel-module-openafs-"+kernelversion,openafsversion, architecture); # # Start the service # "/software/components/chkconfig/service/afs/on" = "345"; "/software/components/chkconfig/service/afs/add" = true; "/software/components/chkconfig/service/afs/startstop" = true; # # Monitoring # include pro_monitoring_metrics_afs; include pro_monitoring_sensor_afscm; # # Component # include components/afsclt/config;

os/ –i386_slc5/ –x86_64_slc5/ rpms/ –defaults.tpl

site/ site/cern_cc/ –configuration/ no_network/config.tpl only_monitoring/config.tpl i386_slc5/ x86_64_slc5/ –core/config.tpl –minimal/config.tpl –components/ –infrastructure/ –rpms/ –services/ –people_acls/ One of them to be included in the cluster template Used by the above (internal) Smods, sysadmins, etc

“core” and “minimal” “core” installation: –Aims and PrepareInstall work Incl. sindes, sms-set-state –Quattor –Console and ssh “minimal” installation: –= Core configuration + Lemon monitoring of: hardware, Quattor and “minimal” services User access (krb5 client) Sendmail, ntp, nscd, chkconfig Operator, sysadmins, smods acls

ACL’s : ex: root access for sysadmins template site/cern_cc/people_acls/sysadmins; variable sysadmin_list = list("jjmarin","grossir","bclement","tfabio","obouffet","ebonfill","ccor reia","hroussea","rbernard","dhoang","anovais","lgoguey","cguiller","console"); variable number_of_people = length(sysadmin_list); "/software/components/useraccess/users/root/roles" = { i = 0; result = self; while (i < number_of_people) { name = sysadmin_list[i]; result = push(name); i = i + 1; }; result; }; "/software/components/useraccess/roles/" = { i = 0; result = self; while (i < number_of_people) { name = sysadmin_list[i]; result[name]= nlist ("kerberos5", list(nlist("principal",name,"realm","CERN.CH"))); i = i + 1; }; result; };

cluster/ cluster/[cluster_name]/config.tpl Contains –Base configuration include site/cern_cc/configuration/x86_64_slc5/minimal/config; –Additionnal services include services/afs_client/config; –Acls include site/cern_cc/people_acls/sysadmin; –Aob “/system/cluster/usercontact” =

Cluster example: lxdev template cluster/lxdev/config; include {'site/cern_cc/configuration/'+ELFMS_ARCH+'_'+ELFMS_OS+'/minimal/config'}; "/system/cluster/name" = ELFMS_SVCCLASS; "/system/ccdomain" = "FIO"; "/system/defaultstate" = "maintenance"; "/system/contract" = "E"; "/system/importance" = 5; "/system/cluster/description" = "The development cluster for FIO"; "/system/cluster/usercontact" = "/system/accounting/name" = ELFMS_RESOURCE ; "/system/rootmail" = include cluster/lxdev/filepartition; include services/afs_client/config; "/system/cluster/tplname" = "lxdev";

Profile structure Proposed by FIO/FS object template profile_lxdev30; include stages/prod; include quattor/profile_declarations; variable ELFMS_OS = "slc5"; variable ELFMS_ARCH = "x86_64"; variable ELFMS_SVCCLASS = "lxdev"; variable ELFMS_RESOURCE = "c3"; variable ELFMS_CUSTOMIZATION = undef; include hardware/machines/elonex_2800_64; include vpd/lxdev30; #include monitoring/lemon/hardware/machines/elonex_2800_64; #not ready for slc5 include netinfo_lxdev30; include serial_map_lxc2ri25; "/hardware/rack/name" = "rb46"; include { ‘cluster/’+ELFMS_SVCCLASS+’/config’}; include { if (exists('resources/'+ ELFMS_RESOURCE)) 'resources/'+ ELFMS_RESOURCE }; include quattor/repository_cleanup;

Misc Future PANC : See new coding rules and syntax on SLC5 progress on Security review for sensors and components: coming ELFms meeting

Timeline From now on: ALL SLC5 machine profiles have to comply to the new profile content Beginning of September 2008: update LEAF scripts (used by Remedy/HMS) to support the new profile structure, with backward compatibility By end of September 2008: ALL SLC5 machines should not include ANY pro_* template anymore As far as possible, replace the usage of pro_* templates by the new templates everywhere (i.e. not only slc5 but also slc4(3) )