© 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- © 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
From DevOps to Planned Ops - Managing your OpenStack environment to Maturity Don Bourque - OnCommand Insight product Management TME Kevin Lambright - SR. Cloud Architect – Engineering Shared Infrastructure services May 2017 © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
© 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Agenda 1) Engineering cloud challenges at scale 2) Introduction to OnCommand Insight 3) Bringing visibility to OpenStack 4) Demo Recap - Q&A © 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Global Engineering Cloud Key stats At-a-Glance 42,000 Total VM Capacity 15,000 VM Capacity for OpenStack 5300 OpenStack VMs actively running today 36% KVM, 32% Hyper-V and 32% VMware FlexPod Datacenter OpenStack RDO Liberty NetApp FAS, E-Series Storage, or SolidFIre Cisco Nexus Networking Cisco UCS Compute Automation Deployed Puppet Open Source Jenkins Git Why OpenStack? Massively scalable shared virtual data center infrastructure Dave 3 minutes 8gb Mem now the standard IaaS Puppet comfort Today our Global Engg cloud GEC as we call it is a self-service cloud portal that has 3 different hypervisors under its belt. Vmware, HyperV and KVM on OpenStack. Why OpenStack? NetApp made a strategic decision to embrace OpenStack, we are Customer Zero NetApp has been involved with OpenStack since 2011, both from a development perspective (Folsom release) and from an internal deployment perspective Needed to reduce Hypervisor licensing costs Increase breadth of NetApp QA testing Match customer expectations and deployments Scalable Multi-Region Design 15 compute nodes in each region (1000 VM per region) Ceilometer in each region for performance Secure Multi-Tenancy (71 SVMs, GEC Service based Tenancy model, build environment as service) Modular Scale as you Grow Architecture © 2017 NetApp, Inc. All rights reserved.
Monitoring Challenges Basic Monitoring Up/Down status, alerts/thresholds, etc. Use Zenoss – not using OpenStack Zenpack Logging No centralized logging Use Graylog Gaps Lack end-to-end view of entire OpenStack environment No correlation engine Difficulty triaging latency issues No visibility into stranded resources Lack visibility of VM utilization © 2017 NetApp, Inc. All rights reserved.
End the finger pointing across teams.. Speed, Agility & Cost Understanding consumption of shared resources Forecast Capacity across multi- cloud environments Reclaim under utilized or dormant resources Rule out infrastructure performance concerns when troubleshooting applications © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
Openstack KVM Datasource Data source to report on OpenStack KVM End to End KVM Compute to Storage correlation Supports Cinder and Manila Communicates via REST API IP address of the OpenStack controller OpenStack admin role credential & sudo access to Linux KVM hypervisor Ceilometer module required to be installed on OpenStack controller & compute nodes Liberty and greater releases From a configuration standpoint; OCI should understand all guest to host relationships. Report on Host CPU utilization VMs CPU Utilization Memory Utilization Disk Throughput (read/write/total) Disk IOPs (read/write/total) Network throughput (read/write/total) OCI should know what virtual disks the guest has. From a performance standpoint, and will be able to get virtual disk IOPS Read/write/total, and virtual disk throughput R/W/Total. There is NOT response time available. Virtual Disks IOPs (read/write/total) Throughput (read/write/total) OCI maps virtual disk to which LUN – if the LUN is a storage platform OCI supports for Perform, we generally can get response time that way. If the virtual disks are using cinder, we should additionally understand which LUN they sit on. Prerequisites: and support for: For CPU stats, compute_monitors=ComputeDriverCPUMonitor needs to be turned on in /etc/nova.conf on compute nodes Port requirements: 5000 (keystone service), 22, 8774 (Nova Compute Service), 8776 (Cinder Block Service), 8777 (Ceilometer Performance Service), 9292 (Glance Image Service) Hypervisor performance limited to CPU utilization © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
Consistent insights across your multi-vendor, multi-platform infrastructure Whether its the traditional reliable IT, private cloud or public cloud environments, OCI enables unified Infrastructure monitoring © 2016 NetApp, Inc. All rights reserved.
Monitor where the data lives... Support for Public and private Cloud AWS S3, EC2, EBS volumes AZURE Host/hypervisors, compute and VHD volumes Cloud ONTAP, Netapp Private Storage (NPS) Align workloads to the appropriate instance types Track growth and identify under utilized instances Identify stranded EBS capacity to lower costs © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
OnCommand Insight deployment Federated Views into Global Infrastructure Consolidated Global Reporting OCI Operational Server OCI Reporting Server (Data Warehouse) Remote Acquisition VM (optional) OCI Deployments: Supports 20,000 VMs, 250 storage arrays, 10,000 ports, 100,000 FC Paths Multi-Protocol: SMIS, SYMCLI, REST, SSH, CLI, SNMP, 3rd party APIs 100% Agentless out-of-band over IP- data collection Read-only; non-intrusive Open Platform- REST, MySQL Licensed by Raw TB OCI Operational Server © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
Benefits to Openstack Visibility across compute, hypervisors, network and storage Machine learning detects emerging anomalies in Infrastructure stack supporting your applications Correlation analytics Identify greedy and degraded resources in shared resource environments © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
“The best ticket is one that is never opened” CPU is the bottleneck Insight © 2015 NetApp, Inc. All rights reserved. NetApp Confidential – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
Help desk integration and self service portals URL to impacted Asset © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
OnCommand ® Insight & NetApp Service path topologies FC, ISCSI, NAS, FCoE Service Path risk management for: Redundancy/SPF Zones Masking/Mapping Sessions Count Understand historical activity and baseline for future production deployments © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
Inventory Change Management and Tracking © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
OpenStack Usage and Trends… Report across OpenStack Private cloud/Multi cloud environments Track CPU& Memory usage IOP and Latency trends and thresholds VM to storage correlation IOP to Latency comparisons. © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
NetApp Confidential - Limited Use © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
NetApp Confidential - Limited Use Aligning IT to business objectives and predict future growth NetApp Confidential - Limited Use © 2015 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only
© 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Sorry – Embedded Demo was removed due to size limitation © 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
© 2017 NetApp, Inc. All rights reserved. Why OCI for customer 0 ? Introduction of SDS Solution in Global Engineering Cloud Performance/Non-performance offerings Latency sensitive Bully/Victim Better overall visibility for performance/utilization End-to-end monitoring of the entire stack With event correlation © 2017 NetApp, Inc. All rights reserved.
© 2017 NetApp, Inc. All rights reserved. What’s Next? In GEC OpenStack dev environment Exploring capabilities/features What value does OCI bring Deploy with our SDS Offering 2 regions, performance/non-performance Show value Deploy widely across OpenStack environment Explore OCI integration with other tools Zenoss Graylog CMDB © 2017 NetApp, Inc. All rights reserved.
© 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL --- Recap.. Challenges of managing an Enterprise OpenStack environment at scale. Visibility and Analytics into infrastructure supporting our development environments. Integration capabilities enables developers and application enables to self serve How NetApp is advancing its maturity of its OpenStack platforms. © 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
© 2017 NetApp, Inc. All rights reserved. --- NETAPP CONFIDENTIAL ---
Thank You © 2017 NetApp, Inc. All rights reserved. NetApp Proprietary – Limited Use Only