Systematic Experimentation: Automating Experiments and ExoGENI Image Snapshots Paul Ruth, RENCI / UNC Chapel Hill

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA GENI Experiments GENI ≠Amazon EC2

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA GENI Experiments GENI ≠Amazon EC2 Amazon EC2 ≅ Buying a machine from Dell

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA GENI Experiments GENI ≅ Getting time on a shared instrument (e.g. telescope or large cluster computer) GENI ≠Amazon EC2 Amazon EC2 ≅ Buying a machine from Dell

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA GENI Experiments Automated Experiments: –Repeatable –Scalable –Use resources only when running the experiment Hand-run/Hand-built Experiments: –Not repeatable –Not scalable –Waste resources with slices that “can’t be shutdown” Tips (should be rules): –Long lived experiments are allowed (even encouraged). –However, long lived slices for short experiments should be avoided. Especially if the reason is that its difficult reproduce the slice –Only configure slices by hand when developing experiments –Always automate configuration for execution of experiments

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA GENI Experiments Automated Experiments: –Repeatable –Scalable –Use resources only when running the experiment Hand-run/Hand-built Experiments: –Not repeatable –Not scalable –Waste resources with slices that “can’t be shutdown” Tips (should be rules): –Long lived experiments are allowed (even encouraged). –However, long lived slices for short experiments should be avoided. Especially if the reason is that its difficult reproduce the slice –Only configure slices by hand when developing experiments –Always automate configuration for execution of experiments If you can not easily shutdown your experiment and re-run it, then you are doing it wrong!!!

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA Automating GENI Experiments Basic experiments should include: –Request (RSpec or NDL) –Base image(s) (custom or standard image) –Post boot scripts to configure each VM Install software not include in image Configure unique setup for each VM Start services, clients, etc. Scalable experiment should include –Request (RSpec or NDL) –Base image(s) (custom or standard image) –Templated Post Boot scripts to configure arbitrary sized slice. Potions of slice can be scaled using common boot scripts More details on the ExoBlog:

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA Systematic Post Boot Scripts 8

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Basic Example

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Basic Example #!/bin/bash echo Server >> /etc/hosts echo Client1 >> /etc/hosts echo Client2 >> /etc/hosts /path/to/my/software/client-start Server Experiment is repeatable Each client has its own post boot script Adding an additional client requires modifying all post boot scripts Changing the IP address of any VM requires modifying all post boot scripts

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Basic Templated Example #!/bin/bash echo $Server.IP(“VLAN0”) $Server.Name() >> /etc/hosts echo $Client1.IP(“VLAN0”) $Client1.Name() >> /etc/hosts echo $Client2.IP(“VLAN0”) $Client2.Name() >> /etc/hosts /path/to/my/software/client-start $Server.Name() Experiment is repeatable Each client has its own post boot script Adding an additional client requires modifying all client post boot scripts Changing the IP address of any VM does NOT require modifying any post boot scripts

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Basic Templated Example #!/bin/bash echo $Server.IP(“VLAN0”) $Server.Name() >> /etc/hosts echo $Client1.IP(“VLAN0”) $Client1.Name() >> /etc/hosts echo $Client2.IP(“VLAN0”) $Client2.Name() >> /etc/hosts /path/to/my/software/client-start $Server.Name() #!/bin/bash echo Server >> /etc/hosts echo Client1 >> /etc/hosts echo Client2 >> /etc/hosts /path/to/my/software/client-start Server

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Scalable Example

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Scalable Example #!/bin/bash Echo $Server.IP(”VLAN0") $Server.Name() >> /etc/hosts #set ( $max = $Client.size() - 1 ) #foreach ( $i in [0..$max] ) echo $Client.get($i).IP(”VLAN0") `echo $Client.get($i).Name()| \ sed 's/\//-/g'` >> /etc/hosts #end /path/to/my/software/client-start $Server.Name() Experiment is repeatable Experiment is scalable Clients share post boot script Adding an additional clients DOES NOT require modifying post boot scripts Changing the IP address of any VM DOES NOT require modifying post boot scripts

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Scalable Example #!/bin/bash echo $Server.IP(”VLAN0") $Server.Name() >> /etc/hosts #set ( $max = $Client.size() - 1 ) #foreach ( $i in [0..$max] ) echo $Client.get($i).IP(”VLAN0") `echo $Client.get($i).Name()| \ sed 's/\//-/g'` >> /etc/hosts #end /path/to/my/software/client-start $Server.Name() #!/bin/bash echo Server >> /etc/hosts echo `echo Client/0 | sed 's/\//-/g'` >> /etc/hosts echo `echo Client/1 | sed 's/\//-/g'` >> /etc/hosts /path/to/my/software/client-start Server

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts Scalable Example #!/bin/bash echo $Server.IP(”VLAN0") $Server.Name() >> /etc/hosts #set ( $max = $Client.size() - 1 ) #foreach ( $i in [0..$max] ) echo $Client.get($i).IP(”VLAN0") `echo $Client.get($i).Name()| \ sed 's/\//-/g'` >> /etc/hosts #end /path/to/my/software/client-start $Server.Name() #!/bin/bash echo Server >> /etc/hosts echo `echo Client/0 | sed 's/\//-/g'` >> /etc/hosts echo `echo Client/1 | sed 's/\//-/g'` >> /etc/hosts echo `echo Client/2 | sed 's/\//-/g'` >> /etc/hosts echo `echo Client/3 | sed 's/\//-/g'` >> /etc/hosts /path/to/my/software/client-start Server

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Postboot Scripts 17

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA Custom ExoGENI Images 18

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA Custom ExoGENI Images Motivation –Advanced experiments need custom images Difficult for most users –Need for simple tool to create custom images

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA Custom ExoGENI Images Motivation –Advanced experiments need custom images Difficult for most users –Need for simple tool to create custom images NEW script: Create an ExoGENI image from a running ExoGENI VM

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Image Background Images defined by XML metadata file –Image (AMI) - mandatory –Kernel (AKI) - optional –Ramdisk (ARI) - optional Hosted on HTTP server –Permanent server at your institution –Soon will work with DropBox and Google Drive Slice requests require –URL to metadata file – goes into the ‘name’ in RSpec –Hash of metadata file – goes into the ‘version’ in RSpec

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Image Background: Metadata ZFILESYSTEM 9efee8fa9c c87a42477bd4ebd04d39c81 KERNEL 5e76d034e27cb861275fc3d1bd9d97c3905ef5a el6.x86_64 RAMDISK c999527cc0d8739a3d3f38d48f03fa6c73151cca el6.x86_64.img

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Image Snapshot (NEW) Snapshot of running ExoGENI VM –Creates: image, kernel, ramdisk, metadata High level steps –Create/modify a VM –Run the script –Copy the new image files to an http server –Insert metadata URL and hash into a request More details on the ExoBlog:

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Image Snapshot: Running the Script Example: Creates image files and metadata in /tmp -n : The name of the new image. -d : The directory to put the image files. -s : Size of the image -u : The http url of the web server where you will host your image../imgcapture.sh -n new_image -s 2G –d /tmp \ -u -d /tmp./imgcapture.sh -n -d -s -u

The 20th GENI Engineering Conference June 21-24, 2014 University of California Davis, Davis, CA ExoGENI Image Snapshot: Future Work Snapshot non-ExoGENI VMs –e.g. IG, Virtual Box, physical machine –Requires installation of NEuca tools Currently available as rpm, deb, and source

Thank you GENI Project Office Award#: 1934, 1872, 1582