1. Automating Xen Virtual Machine Deployment Kris Buytaert Kris.Buytaert@x-tend.be

2. Whoami ? ● Linux and Open Source Consultant ● „Infrastructure Architect“ ● Linux since 0.98 ● IANAKH ● HPC (openMosix) ● HA, LSI (Telco Environment)

3. Agenda ● Large Scale System Installation theory ● Hybrid Automated Installs ● Xen ● Automated Xen Installations

4. Why Virtualisation Matters ? ● Consolidation ● Security ● Testing Large Scale Rollouts ● Separating Development/Staging/Production platforms ●...

5. Our specific reasons for this work ● Testing Large Scale System Deployment – How to you test bootstrapping a large environment ? ● Actually deploying Virtual machines in a large environment – Repeated work is boring and error prone – We automated the physical machine deployment already so...

6. Goals ● Hands off Virtual Machine Deployment ● Minimal impact on the current infrastructure ● Fast deployments ● Easy to redeploy / reproducable ● I hate vendor Lock In‘s ● I hate doing the same stuff for different distros

7. The 10 th Floor Test ● Grab a random machine (don’t take a backup before) ● Throw it out a 10 th floor window ● Can you recover it in <10 minutes ? ● Even for Virtual Machines ?

8. Imaging vs Installing Imaging Speed Identical machines Multicasting Installing Finegrained “slower”

9. Systemimager Suite ● SystemImager ● Fast deployment ● Golden client based ● Multicast features ● Centrally Stored Images ● Boel framework

10. SystemImager Suite (2) ● SystemInstaller ● Evolved from LUI ● Generates Images based on ● Packagelist ● Distro type ● Partition Definition

11. SystemImager Suite (3) ● SystemConfigurator ● Post install configuration ● Hardware detection / bootloader config ● Distro integration

12. Beyond Installing ● Package management ● Central Repository – Updates of relevant packages ● Yum ● Apt ● current.tigris.net

13. Beyond Installing(2) ● Configuration Management – Isconf – Cfengine – Puppet

14. Hybrid Deployment Image a basic image Generate that image Then install the delta's on a per host basis via packages Use a repository to update systems Keep everything in CVS Use a config management tool.

15. Our Environment ● A SystemImager based framework ● System Imager Suite is platform independent, we can use it with Suse/Redhat/Debian etc ● Config data an installation scripts are being stored in CVS ● Base Image of the basic Linux tools and common applications is generated with SystemInstaller ● apt-repository for host specific applications (rpm v3 compliant)

16. Overriding „standard“ configs ● SystemImager Concept ● Over-rides an image per host ● Used for „non packagable“ files ● Contains machine specific information e.g. Package lists

17. Autoinstall, the script / the cd

18. What‘s to be found on a central Repository ?

19. Let‘s talk about Xen ● ParaVirtualisation ● You‘ve already seen Xen enough internals stuff these days ;) ● Going Mainstream real fast ! ● Stable and performant platform ● Scriptable

20. Typical Xen DomainX installations ● Copy an existing image ● Yum –installroot=/path/ -y groupinstall Base ● Debootstrap ● Urpmi –root=/path basesystem urpmi ssh- server ● Yast ● rpmstrap

21. A Typical Large Environment Bootstrap?

22. Why Typical Installs don‘t work

23. Existing Alternatives ● The alternatives – Preseeding d-i – Supercharge ● Issues with them : – Distro Specific – Valid in Isolated environments

24. Building your own ? What do we need ? ● Installing a basic image in a chroot ● Creating „partitions“ ● Creating/Updating configurations ● Booting

25. Modifying an Autoinstall Script create_vhost : { ● Create LVM partitions ● Chroot ● Rsync }

26. The full monty Install hostX reboot into non xen, lvm enabled kernel if (xen=enabled) then add xen packages from repository overrides include /etc/xen/auto files for $vhost in /etc/xen/auto/* ; create_vhost done reboot into xen enabled / lvm enabled kernel

27. From here to.. ● Management of virtual machine is identical to physical machine ● Deploy new virtual machine is as easy as running create_vhost $hostname ● Cfengine and repositories are being used as within physical machines

28. Future Work ● Eliminate 2 phase bootstrap ● Integrate with mksiimage ● Look at COW enhancements

29. Conclusions: ● Pass the 10 th floor test ● Hybrid deployments enable best of breed deploying techniques ● Not „Yet Another Systeminstallation Tool“ :), but tools you already use for a physical purpose !

30. Thank you Contact: Kris Buytaert Kris.Buytaert@x-tend.be Further Reading http://www.x-tend.be/~kb/ http://www.infrastructures.org/ http://www.sisuite.org/

31. ? ! ● Questions ?