Automating Xen Virtual Machine Deployment Kris Buytaert

Whoami ? ● Linux and Open Source Consultant ● „Infrastructure Architect“ ● Linux since 0.98 ● IANAKH ● HPC (openMosix) ● HA, LSI (Telco Environment)

Agenda ● Large Scale System Installation theory ● Hybrid Automated Installs ● Xen ● Automated Xen Installations

Why Virtualisation Matters ? ● Consolidation ● Security ● Testing Large Scale Rollouts ● Separating Development/Staging/Production platforms ●...

Our specific reasons for this work ● Testing Large Scale System Deployment – How to you test bootstrapping a large environment ? ● Actually deploying Virtual machines in a large environment – Repeated work is boring and error prone – We automated the physical machine deployment already so...

Goals ● Hands off Virtual Machine Deployment ● Minimal impact on the current infrastructure ● Fast deployments ● Easy to redeploy / reproducable ● I hate vendor Lock In‘s ● I hate doing the same stuff for different distros

The 10 th Floor Test ● Grab a random machine (don’t take a backup before) ● Throw it out a 10 th floor window ● Can you recover it in <10 minutes ? ● Even for Virtual Machines ?

Imaging vs Installing Imaging Speed Identical machines Multicasting Installing Finegrained “slower”

Systemimager Suite ● SystemImager ● Fast deployment ● Golden client based ● Multicast features ● Centrally Stored Images ● Boel framework

SystemImager Suite (2) ● SystemInstaller ● Evolved from LUI ● Generates Images based on ● Packagelist ● Distro type ● Partition Definition

SystemImager Suite (3) ● SystemConfigurator ● Post install configuration ● Hardware detection / bootloader config ● Distro integration

Beyond Installing ● Package management ● Central Repository – Updates of relevant packages ● Yum ● Apt ● current.tigris.net

Beyond Installing(2) ● Configuration Management – Isconf – Cfengine – Puppet

Hybrid Deployment Image a basic image Generate that image Then install the delta's on a per host basis via packages Use a repository to update systems Keep everything in CVS Use a config management tool.

Our Environment ● A SystemImager based framework ● System Imager Suite is platform independent, we can use it with Suse/Redhat/Debian etc ● Config data an installation scripts are being stored in CVS ● Base Image of the basic Linux tools and common applications is generated with SystemInstaller ● apt-repository for host specific applications (rpm v3 compliant)

Overriding „standard“ configs ● SystemImager Concept ● Over-rides an image per host ● Used for „non packagable“ files ● Contains machine specific information e.g. Package lists

Autoinstall, the script / the cd

What‘s to be found on a central Repository ?

Let‘s talk about Xen ● ParaVirtualisation ● You‘ve already seen Xen enough internals stuff these days ;) ● Going Mainstream real fast ! ● Stable and performant platform ● Scriptable

Typical Xen DomainX installations ● Copy an existing image ● Yum –installroot=/path/ -y groupinstall Base ● Debootstrap ● Urpmi –root=/path basesystem urpmi ssh- server ● Yast ● rpmstrap

A Typical Large Environment Bootstrap?

Why Typical Installs don‘t work

Existing Alternatives ● The alternatives – Preseeding d-i – Supercharge ● Issues with them : – Distro Specific – Valid in Isolated environments

Building your own ? What do we need ? ● Installing a basic image in a chroot ● Creating „partitions“ ● Creating/Updating configurations ● Booting

Modifying an Autoinstall Script create_vhost : { ● Create LVM partitions ● Chroot ● Rsync }

The full monty Install hostX reboot into non xen, lvm enabled kernel if (xen=enabled) then add xen packages from repository overrides include /etc/xen/auto files for $vhost in /etc/xen/auto/* ; create_vhost done reboot into xen enabled / lvm enabled kernel

From here to.. ● Management of virtual machine is identical to physical machine ● Deploy new virtual machine is as easy as running create_vhost $hostname ● Cfengine and repositories are being used as within physical machines

Future Work ● Eliminate 2 phase bootstrap ● Integrate with mksiimage ● Look at COW enhancements

Conclusions: ● Pass the 10 th floor test ● Hybrid deployments enable best of breed deploying techniques ● Not „Yet Another Systeminstallation Tool“ :), but tools you already use for a physical purpose !

Thank you Contact: Kris Buytaert Further Reading

? ! ● Questions ?