Sponsored by the National Science Foundation Configuration Management For Experimenters: Ansible Hands-On Sarah Edwards, GPO.

Slides:



Advertisements
Similar presentations
Devops – The Last Mile. Jay Flowers
Advertisements

Chapter 17: WEB COMPONENTS
Sponsored by the National Science Foundation Systematic Experimentation Case Study: Virtual Router Failure Restoration Xuan Liu UMKC/GENI Project Office.
Sponsored by the National Science Foundation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Virtual Machine and UNIX. What is a VM? VM stands for Virtual Machine. It is a software emulation of hardware. By using a VM, you can have the same hardware.
LING 408/508: Programming for Linguists Lecture 16 October 16 th.
APACHE SERVER By Innovationframes.com »
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Free Powerpoint Templates Working on remote computers by Pedro Henriques June 1, 2012.
A crash course in njit’s Afs
Linux Operations and Administration
Sponsored by the National Science Foundation Configuration Management For Experimenters Sarah Edwards, GPO Max Ott, NICTA.
Deploying Experiments with Raven Scott Baker SB-Software John H. Hartman University of Arizona.
Sarah Edwards, GENI Project Office
Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing Experiment in GENI Sarah Edwards GENI Project Office Xuan.
SharePoint 2010 Development Environment A Guide to Setup SharePoint 2010 Development Environment on Windows 7 Machine.
MSc. Miriel Martín Mesa, DIC, UCLV. The idea Installing a High Performance Cluster in the UCLV, using professional servers with open source operating.
By Rashid Khan Lesson 10-From Here to There: Remote Installation of the Windows XP Professional Client.
Source Control How to be the 1337 in project management source control.
Sponsored by the National Science Foundation Scaling Up: Growing the Topology of an Existing Experiment in GENI Sarah Edwards GENI Project Office with.
Sponsored by the National Science Foundation 1 September 15, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do the.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 GREESC15– May 25, 2015 Are you ready for the tutorial? 1.Grab a Worksheet and instructions 2.Did you do.
Introduction to HDFS Prasanth Kothuri, CERN 2 What’s HDFS HDFS is a distributed file system that is fault tolerant, scalable and extremely easy to expand.
Sponsored by the National Science Foundation Lab Zero: A First Experiment using GENI Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 Last updated April 1, 2013 Are you ready for the tutorial? 1.Sign In 2.Grab a Worksheet 3.Did you do the.
Systematic Experimentation: Automating Experiments and ExoGENI Image Snapshots Paul Ruth, RENCI / UNC Chapel Hill.
Sponsored by the National Science Foundation Getting Started With Your Own Experiment Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation 1 GEC16: March 20, 2013 Are you ready for the tutorial? 1.Did you do the pre-work? A.Are you able to login.
Networking in Linux. ♦ Introduction A computer network is defined as a number of systems that are connected to each other and exchange information across.
Member: Wei-Jie Hsiao 、 Hui-Hsiung Chung Advisor: Quicy Wu Date: Mar.23 1.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Weekly Report By: Devin Trejo Week of June 14, 2015-> June 20, 2015.
Introduction to HDFS Prasanth Kothuri, CERN 2 What’s HDFS HDFS is a distributed file system that is fault tolerant, scalable and extremely easy to expand.
1 Network Information System (NIS). 2 Module – Network Information System (NIS) ♦ Overview This module focuses on configuring and managing Network Information.
Setting up linux webcam server Juho Launonen & Sami Kulmala.
Linux Services Configuration
C. Aiftimiei, E. Ferro / January LCFGng server installation Cristina Aiftimiei, Enrico Ferro INFN-LNL.
Behind the Scenes of GENI Experimentation Understanding GENI AM API and RSpec Sponsored by the National Science Foundation
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards, GENI Project Office.
Sponsored by the National Science Foundation Today’s Exercise.
Linux Operations and Administration
Lab 8 Overview Apache Web Server. SCRIPTS Linux Tricks.
1 CS3695 – Network Vulnerability Assessment & Risk Mitigation – Introduction to Unix & Linux.
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation featuring Named Data Networking Sarah Edwards.
Selenium server By, Kartikeya Rastogi Mayur Sapre Mosheca. R
Sponsored by the National Science Foundation Behind the Scenes of GENI Experimentation An Introduction to GENI Tools Sarah Edwards GENI Project Office.
Your EC2 Instance. How to Connect to your EC2 Instance?
Sponsored by the National Science Foundation Understanding the AM API through a simple Hadoop experiment.
Installing VERITAS Cluster Server. Topic 1: Using the VERITAS Product Installer After completing this topic, you will be able to install VCS using the.
 Prepared by: Eng. Maryam Adel Abdel-Hady
Sponsored by the National Science Foundation Click Software Routers Sarah Edwards GENI Project Office.
Sponsored by the National Science Foundation Systematic Experimentation Sarah Edwards GENI Project Office.
WordPress and Etherpad with BlueMix and Docker. Our aim is to run on BlueMix containers (now in beta) these two famous services In the BlueMix dashboard,
Introduction to Ansible
1 Policy Based Systems Management with Puppet Sean Dague
Linux, Apache, MySQL, PHP/Python/PERL ● a.k.a. LAMP ● Standard set of tools for configuring a Linux-based web server with database & interfacing capabilities.
Introduction to Ansible
GRID COMPUTING.
Chapter 9 Router Configuration (Ospf, Rip) Webmin, usermin Team viewer
IT Atoumation / Conf. Mgmt...
Vagrant Managing Virtual Machines
ECE544: Software Assignment 3
INSTALLING AND SETTING UP APACHE2 IN A LINUX ENVIRONMENT
LING 408/508: Computational Techniques for Linguists
Scaling Experiments.
Introduction to Ansible
Presented By - Avinash Pawar
GBIF CESP Workshop, Madrid 2018 Dave Martin
Presentation transcript:

Sponsored by the National Science Foundation Configuration Management For Experimenters: Ansible Hands-On Sarah Edwards, GPO

Sponsored by the National Science Foundation 2 What do experimenters need? Ensure experiment is in a known configuration Easily repeat existing experiment setups (for multiple runs, changing parameters, etc) Reproduce configuration across space and time Easy to build many nodes that look the same Useful for scaling up the size of topologies (space) Useful for rebuilding a topology repeatedly (time)

Sponsored by the National Science Foundation 3 CM Systems are Idempotent CM systems are usually idempotent Repeated runs generates the same state Contrast to a shell script which encodes how to transition between two known states The state is usually easy to describe. iperf should be (or not be) installed File foo.html should exist (or not) Describing all possible transitions from every possible previous state is hard. If iperf is not already installed, then install it, else do nothing Known State A Known State B Shell script A -> B Unknown State A Known State B ? CM Idempotent

Sponsored by the National Science Foundation 4 Ansible Setup Experimenter ssh  Public key is stored on each remote machine  Private key is stored on local machine  Ansible client installed GENI Slice  Inventory file describes substrate

Sponsored by the National Science Foundation 5 Using Ansible Ad Hoc mode Execute individual commands on one or more nodes Playbooks Enforce configurations written in YAML

Sponsored by the National Science Foundation 6 #!/bin/bash # Usual directory for downloading software in ProtoGENI hosts is `/local` cd /local #Get the hostname to see if we are at the server or the client hn=`echo $HOSTNAME | cut -d'.' -f 1` ##### Check if file is there ##### if [ ! -f "./installed.txt" ] then #### Create the file #### sh -i -c `sudo touch "./installed.txt"` #### Run one-time commands #### #Install necessary packages sudo apt-get update sudo apt-get -y install apache2 iperf & EPID=$! wait $EPID fi

Sponsored by the National Science Foundation 7 #!/bin/bash # Usual directory for downloading software in ProtoGENI hosts is `/local` cd /local #Get the hostname to see if we are at the server or the client hn=`echo $HOSTNAME | cut -d'.' -f 1` ##### Run Boot-time commands # Start services # If this is the server then start the iperf and configure and start the http server if [ $hn == "server" ] then # Enable web server stats sudo /usr/sbin/a2enmod status sudo rm /etc/apache2/mods-enabled/status.conf echo " " | sudo tee -a /etc/apache2/sites-available/default > /dev/null echo " SetHandler server-status" |sudo tee -a /etc/apache2/sites-available/default > /dev/null echo " Allow from all" | sudo tee -a /etc/apache2/sites-available/default > /dev/null echo " " | sudo tee -a /etc/apache2/sites-available/default > /dev/null echo "ExtendedStatus On" | sudo tee -a /etc/apache2/conf.d/extendedstatus > /dev/null # Copy the website under /var/www/ sudo cp -R./website/* /var/www/ sudo rm -rf /var/www/html sudo ln -s /var/www/ /var/www/html # Start the webserver sudo /usr/sbin/apache2ctl restart sudo service apache2 restart # Start the iperf server sudo mkdir -p /var/www/iperflogs iperf_server_log="/var/www/iperflogs/iperf-server.log" sudo bash -c "iperf -s -i 10 &> $iperf_server_log" else # If this is the client start the script for transfers # Wait 60 seconds just to give some time to the server to come up sleep 60./scripts/client-wget.sh&./scripts/client-iperf.sh& fi # Start my service -- assume it was installed at /usr/local/bin