Puppet and Cobbler for the configuration of multiple grid sites Emir Imamagić University Computing Centre (Srce) Zagreb Croatia
Overview CRO NGI Grid Management Experiences Cobbler Puppet Deployment Conclusions References
CRO NGI Croatian National Grid Infrastructure Provides computing and data resources to A&R community Permanently funded service since 2007.
CRO NGI
Grid Management Experiences Cluster middleware OSCAR Issues image based easy deployment of software without packages reinstallation/major upgrade nightmares difficult tracking of worker nodes status (c3 tools) not convenient for service nodes not so actively developed
Grid Management Experiences Grid middleware Globus Toolkit, CREAM, BDII, SRM home-made packages, scripts, Yaim Issues home-made packages got stale scripts broken with component updates
Cobbler Bare metal and VM provisioning Package based Enables definition of different profiles Managed by Puppet module for definition of all cobbler components definition of machines in one system
Puppet Configuration management Module sources OS configuration services management Module sources from Puppet forge & other places modified existing modules modules developed from scratch
Puppet Modules for cluster and grid services File systems (FhGFS, Gluster, Gfarm) Batching systems (Gridengine, HTCondor) Monitoring systems (Ganglia, Zabbix) Globus Toolkit (GRAM, GridFTP) UMD services – unfortunately Yaim-based
Deployment Central management server Cluster frontends Cobbler for service nodes Puppet for all nodes Cluster frontends Cobbler for nodes on private networks
Conclusions Cobbler & Puppet “easy” (re)installation and management of service and worker nodes actively developed and widely used Additional modules developed for grid services planning to extend for new grid/cloud services
References CRO NGI Puppet modules Cobbler Puppet module http://www.cro-ngi.hr Puppet modules https://code.google.com/p/lutak Cobbler Puppet module managed by Jakov Sosic https://bitbucket.org/jsosic/puppet-cobbler