Interoperability in Modern Clouds using DevOps Final Presentation Sean Bird and Mike Corley CSE 775 (Spring 2017)

Outline Overview Design Implementation/Demonstration Previous presentations Devops, Cloud Technologies Design Private Cloud: Openstack Public Cloud: AWS & Azure Application Setup Implementation/Demonstration Public Cloud: AWS Application

Project Goal (refresher) Establish a Hybrid Cloud (an environment) composed of cutting edge technologies to enable DevOps. What is DevOps? DevOps ("software DEVelopment" and "information technology OPerationS") is a term used to refer to a set of practices that emphasize the collaboration and communication of both software developers and information technology (IT) professionals while automating the process of software delivery and infrastructure changes. It aims at establishing a culture and environment where building, testing, and releasing software can happen rapidly, frequently, and more reliably [1] [1] https://en.wikipedia.org/wiki/DevOps

DevOps Overview DevOps (Development and Ops)– out growth of Agile manifesto Agile embraces continuous change, DevOps embraces continuous test/integration/delivery/deployment How? Break down the silos sub teams (Dev, Ops, Test, Q/A). Everyone becomes a first class citizen. Principles Collaboration Use tools that influence collaborations/enforce policy Infrastructure as Code (IaC) entire environment (servers/links/platforms/apps/configuration) all represented as scripts stored in version control Tools: Heat, AWS Cloud Formation, Docker, Chef, Puppet, Vagrant, Docker Automation Script as much manual processing as possible! Continuous Integration/Test/Delivery/Deployment Tools: Jenkins/Team City/AWS DevOps Monitoring: Cloud watch (AWS), Ceilometer (Openstack), VictorOPs

Containers https://www.docker.com/

Container Image layer (Stack) Concept

Flexible OS Stack (Run Linux or Windows) XenServer Hypervisor Linux Virtual Machine Docker Engine Base Image: Bins/Libs /Dependencies QEMU (Bin) Windows OS Guest Image Layers QEMU: Machine Hardware Configuration 1 Linux OS Guest QEMU: Machine Hardware Configuration 2 Update respective layers to extend new machine hardware and Operating System type Running container instance: build from image Shares host OS with other containers

Implementation/Demonstration

Demonstration for today Demonstrate: (DevOps principles: Automation and Infrastructure as Code) in a hybrid cloud composed solution Openstack (private/on premises), Public Cloud Provider: Amazon (AWS -> EC2) Key component is the orchestration tools: HEAT, Cloud Formation Complete Openstack (Private) Cloud (IaaS) deployment Cooperative service(s) model -- 1 controller, 10 processing nodes Keystone (identity) management service (controller) (1 node) Horizon (Dashboard) service ( 1 node) Nova (Compute -- hypervisor) service (2-3 nodes) Neuron (Networking) (virtual networking) service (1 node) Cinder (Block storage – LVM partition management) (1-2) nodes Glance (Image) service (1 node) Swift (Object storage) service (1-2 nodes) Heat (Application orchestration – Restful) service (1 node) AWS-EC2 (Amazon Elastic cloud)

Demonstration: Application Deployment MariaDB instance hosted inside AWS Docker container Containing SQL database for wordpress wiki page Open public IP with MariaDB service hosted on port 3306 Wordpress web host deployed in Openstack Using Openstack Heat orchestration

Design: Highest Level (10,000 ft view) Public - AWS Public Data Storage MariaDB Private Data Storage Wordpress Front End Private - Openstack

Openstack deployment on a VMware Hardware: Dell Precision m6500 (Intel i7-CPU), 32g memory Windows 10 Professional (Host Operating System) VMWARE Workstation pro (v12) VM

Hardware Emulation (x86 Intel) Container 1 eth0 tap0 VM_NET (eth0) br0 QEMU Hardware Emulation (x86 Intel) Container 2 Virtual Machine (VM) Host tap1 E1000 NIC NIC NIC (eth0) qemu-system-x86_64 -m 8192 -vnc :2 –net nic,vlan=0,macaddr=00:80:7F:31:41:72,model=e1000 -net tap,vlan=0,ifname=tap0,script=/etc/qemu-ifup -usbdevice tablet [windows-image.qcow2] | [android-image.qcow2] Hypervisor

Openstack Cooperative services Concept http://cdn.ttgtmedia.com/microsites/netappinsights/images/diagram616.png

https://blog.docker.com/2014/03/docker-will-be-in-openstack-icehouse/ https://wiki.openstack.org/wiki/Docker

Summary Accomplishments Challenges Survey of cloud providers (pros/cons) Setup/configuration of VM/Containers on AWS Setup/configuration of full Openstack deployment in private cloud Setup/configuration of VM/Containers on Openstack deployment Deployment of hybrid application across Private and Public clouds MariaDB Docker container hosted in AWS Wordpress web front end hosted in Openstack deployment Challenges Hardware requirements for Openstack deployment Orchestration tool management for both private and public clouds Network configuration for application hybrid cloud communication