Pulling the Galaxy’s Strings

Slides:



Advertisements
Similar presentations
Implementing Tableau Server in an Enterprise Environment
Advertisements

Ch 7-1 Working with workgroups-1. Objectives Working with workgroups Creating a workgroup Determining whether to use centralized or group sharing.
© 2012 Whamcloud, Inc. Lustre Automation Challenges John Spray Whamcloud, Inc. 0.4.
© Copyright 2015 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential – For.
(NHA) The Laboratory of Computer Communication and Networking Network Host Analyzer.
Basic Unix Dr Tim Cutts Team Leader Systems Support Group Infrastructure Management Team.
ANDROID PROGRAMMING MODULE 1 – GETTING STARTED
Your CMDB and PowerShell DSC: DevOps Techniques
1 Introduction to Tool chains. 2 Tool chain for the Sitara Family (but it is true for other ARM based devices as well) A tool chain is a collection of.
STIG Compliance and Remediation with Ansible April 2015.
Puppetize It! An Introduction to Puppet Mike Seda CEO, Seda Systems, Inc.
AI project components: Facter and Hiera
The Art and Zen of Managing Nagios with Puppet Michael Merideth - VictorOps
CERN IT Department CH-1211 Genève 23 Switzerland t Experiences running a production Puppet Ben Jones HEPiX Bologna Spring.
Configuration Management with Cobbler and Puppet Kashif Mohammad University of Oxford.
Ansible with vCloud Air Workshop
Presentation Name / 1 Visual C++ Builds and External Dependencies NAME.
® IBM Software Group ©IBM Corporation IBM Information Server Architecture Overview.
Selenium server By, Kartikeya Rastogi Mayur Sapre Mosheca. R
How EPA/ORD Moved to Drupal 7 Jessica Dearie U.S. EPA, Office of Research and Development Office of Science Information Management.
Automating Legacy Network Devices
Ansible and Ansible Tower 1 A simple IT automation platform November 2015 Leandro Fernandez and Blaž Zupanc.
Cloud Installation & Configuration Management. Outline  Definitions  Tools, “Comparison”  References.
Sponsored by the National Science Foundation Systematic Experimentation Sarah Edwards GENI Project Office.
Introduction to Ansible
Survive and Thrive in a DevOps World Steven Murawski
Configuration Management, Continuous Integration, Continuous Delivery Revealed.
Introduction to Ansible
Agenda:- DevOps Tools Chef Jenkins Puppet Apache Ant Apache Maven Logstash Docker New Relic Gradle Git.
Open-O Integration Project Introduction
@ Bucharest DevOps Hacker Meetup
Modernize Your Operations
InGenius Connector Enterprise Microsoft Dynamics CRM
How to open source your Puppet configuration
Docker and Azure Container Service
Infrastructure Orchestration to Optimize Testing
Integrate Agile Testing into the Process
PYTHON: AN INTRODUCTION
When and Why to Use a Framework Simon Horwith CIO, AboutWeb
Microservices, Docker, .NET, Windows, Linux, Azure. Oh, My!
IT Atoumation / Conf. Mgmt...
Dmytro Mykhailov How HashiCorp platform tools can make the difference in development and deployment Target and goal of HashiCorp.
Configuration Management with Azure Automation DSC
Kinetic Data Your business. Your process
Drupal VM and Docker4Drupal For Drupal Development Platform
Acutelearn Best Devops Online Training in Hyderabad Classroom Training Instructor led trainings at Acutelearn premises Corporate Training Custom tailored.
Drupal VM and Docker4Drupal as Consistent Drupal Development Platform
Using the Parallel Universe beyond MPI
Intro to Config Management Using Salt Open Source
Ansible and Zabbix Rushikesh Prabhune (Software Technical Consultant)
DHCP, DNS, Client Connection, Assignment 1 1.3
X in [Integration, Delivery, Deployment]
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Confidential – Oracle Internal/Restricted/Highly Restricted
Red Hat Cloud Courses.
Introduction to Ansible
Getting Started with PowerShell Desired State Configuration (DSC)
Presented By - Avinash Pawar
GBIF CESP Workshop, Madrid 2018 Dave Martin
Orchestration & Container Management in EGI FedCloud
Cloud Computing.
Technical Capabilities
Test Driven Infrastructure
Bite sized training sessions: CASE tools
OpenStack Summit Berlin – November 14, 2018
Azure Container Service
Securing IaaS in the cloud
Data Science Infrastructure as Code
Mark Quirk Head of Technology Developer & Platform Group
SQL Server on Containers
Presentation transcript:

Pulling the Galaxy’s Strings Jeffrey Miller Senior Systems Administrator Brenna Miller The university of Iowa – ITS Research Services

The project: using puppet to deploy Galaxy HTTPS://GITHUB.COM/MILLERJL1701/PUPPET-GALAXY JEFF-L-MILLER@UIOWA.EDU Please send me your stories, good and bad!

The Scientific Committee ASKED: we would like to hear the authors' perspective on the strengths and weaknesses of Puppet compared to Ansible for Galaxy orchestration.

A VS. P: Comments from Puppet admins crayfishx: “If automation is the (only) goal, then ansible probably has a lesser learning curve, if true configuration management is the goal, then that's betters suited to Puppet. (IMO)” rnelson0:  ”Puppet can run on nodes and enforce CM state on a regular basis. Ansible runs *against* things, which has some negatives but *it can run on things where there's no Puppet binary*.”

A VS. P: Comments from ANSIBLE admins edgan: “I call (OP) configuration drift. It isn’t guaranteed, but the [ansible] style encourages it. Open source Ansible isn’t designed to scale. It tries with Tower, but the speed of SSH holds it back.” tilraunaalit: “Ansible however excels in its agility: playbooks seem to run an order of magnitude faster than their puppet equivalents, and writing roles and playbooks is easier too simply because playbooks are not expected to be so thorough. Writing a puppet module is a greater undertaking. Ansible is great for quick-and-dirty configuration management; but for projects that require more quality control I'd favour the competition.” absolutejam: “I find Ansible is best looked at as an execution engine that has CM, orchestration, etc. features. I love Ansible but I know that if I was building an infrastructure that was designed to auto-remediate drift (which is what a lot of people think of when CM gets mentioned), I'd look elsewhere.”

How ansible and puppet appear to be similar Infrastructure as Code: Cows vs Pets Test Driven Development Ideally you only login to a system when things go sideways All changes occur through a versioned controlled repository Concept of facts that can be used in developing configurations can be run agentless with cron jobs running the binaries locally Community of admins creating and sharing modules (Puppet Forge, Ansible Galaxy) with fixed standard layouts Working hard and succeeding at cm on Docker and other container technologies

Strengths of puppet Ansible Cross-platform support (Linux, Windows, *IX, Docker, Kubernetes, Mesos) Puppet can easily revert changes it made Data and Code Separation with Hiera Hierarchies can be driven by facts Types and Providers Ordered execution of commands Execute commands over SSH to target systems allows easy device management (IoT, Network switches/Routers, etc.) Vault integration Ansible includes a standard lib out of the box

Strengths of puppet Ansible Manifests in Puppet DSL; Hiera Data in YAML Capabilities to scale number of agents configure with puppet infrastructure Reporting and Compliance Resource Duplicate Declarations Puppet Community Playbooks in YAML Inventory file driven ??? PROFIT!

Weaknesses of puppet Ansible Puppet DSL Learning curve Server infrastructure management for puppet components Lack of orchestration of puppet runs Application of configuration items is not ordered Playbooks in YAML makes difficult changes more difficult Inventory file driven doesn’t allow for dynamic environments easily Resource flipping Ansible doesn’t cleanup well

How to work around some of the weaknesses? Purchase Puppet Enterprise (free for up to 10 nodes) Purchase Ansible Tower (free for up to 10 nodes)

How about for galaxy Configuration management and orchestration? I’d put them on equal footing. But, right now infrastructures that rely on puppet as their CM platform don’t have an option for the management of Galaxy. HTTPS://GITHUB.COM/MILLERJL1701/PUPPET-GALAXY JEFF-L-MILLER@UIOWA.EDU Please send me your stories, good and bad!

References and Resources https://galaxyproject.github.io/dagobah-training/2017-montpellier/14-ansible/ansible-introduction.html https://slack.puppet.com/ https://docs.puppet.com/ https://www.ansible.com/ansible-best-practices https://www.ansible.com/blog/ansible-best-practices-essentials https://www.reddit.com/r/Puppet/comments/6ibvxj/puppet_for_dissimilar_servers/ https://www.reddit.com/r/ansible/comments/68x4wn/to_me_ansible_is_not_a_configuration_management/

Thank you! GCC 2017 Organizing Committee for organizing this most excellent conference GCC 2017 Scientific Committee for the opportunity to speak Galaxy Community Especially: natefoo, jmchilton erasche Dr. Richard Smith, Director, Iowa Institute of Human Genetics, and IIHG Team. Ben Rogers, Senior IT Director, ITS Research Services and the ITS RS Team.