Interoperability Between Modern Clouds using DevOps Probing Presentation Sean Bird and Mike Corley CSE 775 (Spring 2017)

Project Goal (refresher) Establish a Hybrid Cloud (environment) composed of cutting edge technologies to enable DevOps. What is DevOps DevOps ("software DEVelopment" and "information technology OPerationS") is a term used to refer to a set of practices that emphasize the collaboration and communication of both software developers and information technology (IT) professionals while automating the process of software delivery and infrastructure changes. It aims at establishing a culture and environment where building, testing, and releasing software can happen rapidly, frequently, and more reliably [1] [1] https://en.wikipedia.org/wiki/DevOps

DevOps Overview DevOps (Development and Ops)– out growth of Agile manifesto Agile embraces constant change, DevOps embraces constant test, constant delivery How? Break down the silos sub teams (Dev, Ops, Test, Q/A). Everyone becomes a first class citizen. Principles Collaboration - TFS, etc. Infrastructure as Code (IaC) entire environment (servers/links/platforms/apps/configuration) all represented as scripts stored in version control Tools: Heat, AWS Cloud Formation, Docker, Chef, Puppet, Vagrant, Docker Automation Script as much manual processing as possible! Continuous Integration/Test/Delivery/Deployment Tools: Jenkins/Team City/AWS DevOps Monitoring: Cloud watch (AWS), Ceilometer (Openstack), VictorOPs

Enabling Technologies Openstack (complete private Cloud deployment) Multi-level virtualization libvirt – hypervisor management Traditional virtual machines augmented with micro services Containers (Docker) Lots of tools that enable DevOps Focus on automation, orchestration, and configuration management. Linux Interesting: https://msdn.microsoft.com/en-us/commandline/wsl/about Hybrid Cloud (private cloud and public cloud) deployment and a public Cloud such a Rackpace/TryStack, Amazon Web AWS->EC2, Azure

Demonstration for today Complete Openstack (Private) Cloud (IaaS) Build/install cooperative service(s) model -- 8 to 10 processing nodes Keystone (identity) management service (controller) (1 node) Horizon (Dashboard) service ( 1 node) Nova (Compute -- hypervisor) service (2-3 nodes) Neuron (Networking) (virtual networking) service (1 node) Cinder (Block storage – LVM partition management) (1-2) nodes Glance (Image) service (1 node) Swift (Object storage) service (1-2 nodes) Heat (Application orchestration – Restful) service (1 node) Demonstrate: Automation, infrastructure as Code (IaC) examples Survey Public Cloud Providers Amazon (AWS -> EC2), Azure, Rackspace/Trystack (public Openstack SandBox): www.trystack.org Docker Container Examples Running Windows 7 in a container (yes! Windows 7)

Openstack deployment on a VMware Hardware: Dell Precision m6500 (Intel i7-CPU), 32g memory Windows 10 Professional (Host Operating System) VMWARE Workstation pro (v12) VM

Openstack Cooperative services Concept http://cdn.ttgtmedia.com/microsites/netappinsights/images/diagram616.png

Containers https://www.docker.com/

Container Image layer (Stack) Concept

Flexible OS Stack (Run Linux or Windows) XenServer Hypervisor Linux Virtual Machine Docker Engine Base Image: Bins/Libs /Dependencies QEMU (Bin) Windows OS Guest Image Layers QEMU: Machine Hardware Configuration 1 Linux OS Guest QEMU: Machine Hardware Configuration 2 Update respective layers to extend new machine hardware and Operating System type Running container instance: build from image Shares host OS with other containers

Hardware Emulation (x86 Intel) Container 1 eth0 tap0 VM_NET (eth0) br0 QEMU Hardware Emulation (x86 Intel) Container 2 Virtual Machine (VM) Host tap1 E1000 NIC NIC NIC (eth0) qemu-system-x86_64 -m 8192 -vnc :2 –net nic,vlan=0,macaddr=00:80:7F:31:41:72,model=e1000 -net tap,vlan=0,ifname=tap0,script=/etc/qemu-ifup -usbdevice tablet [windows-image.qcow2] | [android-image.qcow2] Hypervisor

https://blog.docker.com/2014/03/docker-will-be-in-openstack-icehouse/ https://wiki.openstack.org/wiki/Docker

Next Steps: Finishing Surveying Tools and standup DevOps environment Openstack, and (AWS or Azure) Chef, Heat, Develop, deploy ZeroMQ application in the Public cloud and consume expose/share data in private (on premises) cloud