Puppet and Cobbler for the configuration of multiple grid sites

Slides:



Advertisements
Similar presentations
Experiences with GridWay on CRO NGI infrastructure / EGEE User Forum 2009 Experiences with GridWay on CRO NGI infrastructure Emir Imamagic, Srce EGEE User.
Advertisements

TNC 2008 / Short Lived Credential Service Implementation Based on National AAI Short Lived Credential Service Implementation Based on National AAI Emir.
Modeling and Maintaining Virtualized Services Microsoft System Center Virtual Machine Manager 2012 (c) 2011 Microsoft. All rights reserved.
Configurations Management System Chris Boyd.  Time consuming task of provisioning a number of systems with STIG compliance  Managing a number of systems.
Minerva Infrastructure Meeting – October 04, 2011.
Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.
HPDC 2007 / Grid Infrastructure Monitoring System Based on Nagios Grid Infrastructure Monitoring System Based on Nagios E. Imamagic, D. Dobrenic SRCE HPDC.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
R2 Automation IT service management Windows Azure Pack App Controller Self-service Service Manager Service model Orchestrator Service Manager.
G RID M IDDLEWARE AND S ECURITY Suchandra Thapa Computation Institute University of Chicago.
Configuration Management with Cobbler and Puppet Kashif Mohammad University of Oxford.
Support in setting up a non-grid Atlas Tier 3 Doug Benjamin Duke University.
20-May-2003HEPiX Amsterdam EDG Fabric Management on Solaris G. Cancio Melia, L. Cons, Ph. Defert, I. Reguero, J. Pelegrin, P. Poznanski, C. Ungil Presented.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Usage of virtualization in gLite certification Andreas Unterkircher.
Nara Institute of Science and Technology, Nara Prefecture, Japan CONFIGURATION AND DEPLOYMENT OF A SCALABLE VIRTUAL MACHINE CLUSTER FOR MOLECULAR DOCKING.
EVGM081 Multi-Site Virtual Cluster: A User-Oriented, Distributed Deployment and Management Mechanism for Grid Computing Environments Takahiro Hirofuchi,
Module 4 Planning for Group Policy. Module Overview Planning Group Policy Application Planning Group Policy Processing Planning the Management of Group.
Managing the CERN LHC Tier0/Tier1 centre Status and Plans March 27 th 2003 CERN.ch.
Stairway to the cloud or can we take the highway? Taivo Liik.
December 26, 2015 RHIC/USATLAS Grid Computing Facility Overview Dantong Yu Brookhaven National Lab.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Regional Nagios Emir Imamagic /SRCE EGEE’09,
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
Grid-Ireland test facilities Stephen Childs Dept. of Computer Science Trinity College Dublin.
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
PLATFORM TO EASE THE DEPLOYMENT AND IMPROVE THE AVAILABILITY OF TRENCADIS INFRASTRUCTURE IberGrid 2013 Miguel Caballer GRyCAP – I3M - UPV.
Overview of cluster management tools Marco Mambelli – August OSG Summer Workshop TTU - Lubbock, TX THE UNIVERSITY OF CHICAGO.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Agile Infrastructure Project Overview : Status and.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CYFRONET site report Marcin Radecki CYFRONET.
3 Compute Elements are manageable By hand 2 ? We need middleware – specifically a Workload Management System (and more specifically, “glideinWMS”) 3.
Self Service Service Delivery & Automation Deploy Configure Service Model DC Admin Operate Monitor Virtual Physical Public Cloud Private Cloud Virtual.
1 Policy Based Systems Management with Puppet Sean Dague
INFSO-RI Enabling Grids for E-sciencE Workshop WLCG Security for Grid Sites Louis Poncet System Engineer SA3 - OSCT.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
CERN Openlab Openlab II virtualization developments Havard Bjerke.
New Paradigms: Clouds, Virtualization and Co.
WLCG IPv6 deployment strategy
Cumulus - dynamic cluster available under Clusterix
Introduction to VMware Virtualization
Use of HLT farm and Clouds in ALICE
Administration Tools Cluster.exe is a command line tool that you can use for scripting or remote administration through slow WAN links. Cluadmin.exe is.
NGI and Site Nagios Monitoring
Smart Cities and Communities and Social Innovation
Blueprint of Persistent Infrastructure as a Service
NA4/medical imaging. Medical Data Manager Installation
Use of Nagios in Central European ROC
ATLAS Cloud Operations
Management of Virtual Machines in Grids Infrastructures
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Globus —— Toolkits for Grid Computing
CREAM-CE/HTCondor site
Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel
Quattor Usage at Nikhef
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
FCT Follow-up Meeting 31 March, 2017 Fernando Meireles
Drupal VM and Docker4Drupal For Drupal Development Platform
Management of Virtual Machines in Grids Infrastructures
This Presentation Covers Training Modules for SCCM
Drupal VM and Docker4Drupal as Consistent Drupal Development Platform
Grid Means Business OGF-20, Manchester, May 2007
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Managing Services with VMM and App Controller
The Problem ~6,000 PCs Another ~1,000 boxes But! Affected by:
Module 1: Overview of Systems Management Server 2003
Installation/Configuration
Pete Gronbech, Kashif Mohammad and Vipul Davda
Presentation transcript:

Puppet and Cobbler for the configuration of multiple grid sites Emir Imamagić University Computing Centre (Srce) Zagreb Croatia

Overview CRO NGI Grid Management Experiences Cobbler Puppet Deployment Conclusions References

CRO NGI Croatian National Grid Infrastructure Provides computing and data resources to A&R community Permanently funded service since 2007.

CRO NGI

Grid Management Experiences Cluster middleware OSCAR Issues image based easy deployment of software without packages reinstallation/major upgrade nightmares difficult tracking of worker nodes status (c3 tools) not convenient for service nodes not so actively developed

Grid Management Experiences Grid middleware Globus Toolkit, CREAM, BDII, SRM home-made packages, scripts, Yaim Issues home-made packages got stale scripts broken with component updates

Cobbler Bare metal and VM provisioning Package based Enables definition of different profiles Managed by Puppet module for definition of all cobbler components definition of machines in one system

Puppet Configuration management Module sources OS configuration services management Module sources from Puppet forge & other places modified existing modules modules developed from scratch

Puppet Modules for cluster and grid services File systems (FhGFS, Gluster, Gfarm) Batching systems (Gridengine, HTCondor) Monitoring systems (Ganglia, Zabbix) Globus Toolkit (GRAM, GridFTP) UMD services – unfortunately Yaim-based

Deployment Central management server Cluster frontends Cobbler for service nodes Puppet for all nodes Cluster frontends Cobbler for nodes on private networks

Conclusions Cobbler & Puppet “easy” (re)installation and management of service and worker nodes actively developed and widely used Additional modules developed for grid services planning to extend for new grid/cloud services

References CRO NGI Puppet modules Cobbler Puppet module http://www.cro-ngi.hr Puppet modules https://code.google.com/p/lutak Cobbler Puppet module managed by Jakov Sosic https://bitbucket.org/jsosic/puppet-cobbler