1EMC CONFIDENTIAL—INTERNAL USE ONLY EMC OPENSTACK CLOUD SOLUTIONS REFERENCE ARCHITECTURE WITH MIRANTIS OPENSTACK PLATFORM

2EMC CONFIDENTIAL—INTERNAL USE ONLY IT AS A SERVICE DELIVERS BUSINESS AGILITY

3EMC CONFIDENTIAL—INTERNAL USE ONLY OpenStack As An Enabler For Transformation Metering Engine Service Catalog Orchestration Engine User PortalUser Portal Policy Engine Dev-Ops New Roles Dev-Ops Agile Processes New Apps Application Fabric Data Fabric Lends itself nicely to 3 rd Platform Apps Developer Friendly Cloud Software Platform a foundation for SDDC enablement API provide capability to Automate Services for Cost Effective Operations. Need new skill sets and roles PaaS SOFTWARE DEFINED DC TRANSFORMATION Service APIs

4EMC CONFIDENTIAL—INTERNAL USE ONLY Why OpenStack? source: OpenStack User Survey,

5EMC CONFIDENTIAL—INTERNAL USE ONLY What Is OpenStack? Flexible and modular architecture. Foundation for a Software Defined DC. Delivering IaaS service : compute, networking & storage services and more. Analogous to the Linux kernel (very tunable) All services are expose via API (Infra as code)

6EMC CONFIDENTIAL—INTERNAL USE ONLY NEW USE CASES Digital Experience Real-time Analytics EXISTING APPLICATION INVENTORY & STRATEGY Application RightFit SOFTWARE DEFINED DATACENTER 3RD GEN APPS AND DATA PLATFORM Re-write / Replace Leave in place/Retire Refactor / Migrate PLATFORM 2.0 PLATFORM 2.5 PLATFORM 3.0 PLATFORM 1.0

7EMC CONFIDENTIAL—INTERNAL USE ONLY Platform Definition No-SQL Components in Monolithic Applications Components re-architected loosely coupled, elastic, fault tolerant Relational In Memory, Distributed Kernel Virtualization Kernel Virtualization / Containers Platform 2 Platform 3

8EMC CONFIDENTIAL—INTERNAL USE ONLY Personas Administrators responsible for managing and maintaining an IT infrastructure (in a private cloud) Years of experience with Unix and Linux systems administration. Manages IT infrastructure, hypervisors and Cloud platform. Interested in how to deal with failure (planned, unplanned), maintenance of system and utilization. Proficient in administering Unix and Linux systems. Competent shell and Python programmer. Early adopter of Puppet. Already using AWS for IaaS service Have been using AWS for a while. Primarily developing web applications for internal usage. API driven. Will integrate with the CI/CD tools and open to OpenSource.

9EMC CONFIDENTIAL—INTERNAL USE ONLY OpenStack Framework Currently 14 integrated projects within OpenStack All these projects communicate via public API’s Quite a few new projects focused on Mgmt and Operations Service have behavioral compatibility with AWS Horizon Dashboard Swift object store Glance image store Nova compute node Cinder volume service Keystone identity service Heat Orchestration Celiometer telemetry service Trove database Neutron networking S3 EC2 EBS vPC RDS AMI IAM Cloud Formation

10EMC CONFIDENTIAL—INTERNAL USE ONLY OpenStack Drivers EMC Integration: OpenStack Broad Portfolio Fit Your Environment Evolve With Your Cloud Isilon

11EMC CONFIDENTIAL—INTERNAL USE ONLY TECHNICAL EVIDENCE SOLUTION REFERENCE ARCHITECTURE WITH MIRANTIS – JUNO RELEASE

12EMC CONFIDENTIAL—INTERNAL USE ONLY EMC + Mirantis Technical Evidence Storage Arrays Certified & Validated Designs Partner Tools Integration Cooperative Support Joint Services EMC Solution Focused Partnered with Mirantis and provide Validated reference designs. Integrated with Mirantis tool set to enable better manageability. Joint Service and Support

13EMC CONFIDENTIAL—INTERNAL USE ONLY Mirantis OpenStack The most robust OpenStack distribution on the market Fuel takes the guesswork out of deployment Broad choice of fully-tested technologies Simply download, boot, and deploy Mirantis OpenStack

14EMC CONFIDENTIAL—INTERNAL USE ONLY Distro: Production-Ready Packages Fundamental components – Core OpenStack – Key Projects – Plug-ins & Drivers Continuous verification and community contribution – Solid Reference Architecture – Continuous Integration and Delivery – Real-world operation at scale

15EMC CONFIDENTIAL—INTERNAL USE ONLY EMC Reference Architecture with Mirantis OpenStack Cinder Drivers

16EMC CONFIDENTIAL—INTERNAL USE ONLY Solution Components CapabilityComponents Supported HardwareVNX XTREMIO SCALEIO -iSCSI, FC, -iSCSI, FC -SDC SoftwareMirantis Open StackJuno Release SoftwareCinder Block DriverJuno Release SoftwareCentOSOperating system v6.5 kernel (2.3.2) SoftwareKVMHypervisor in the CentOS Kernel Software ToolsMirantis FuelVersion 6.0

17EMC CONFIDENTIAL—INTERNAL USE ONLY Logical Architecture

18EMC CONFIDENTIAL—INTERNAL USE ONLY Fuel: Deployment and Management GUI driven experience for – Automated deployment of OpenStack – Guided configuration & management Flexible technology choices Production-ready HA deployment Health validation – Network verification – Deployment validation – Cloud health checks

19EMC CONFIDENTIAL—INTERNAL USE ONLY Unified Block and File Storage system Cinder Supported Protocols – FC and iSCSI Supports all the main volume operations. FAST, FastCache, FC SAN Zoning. Integrated into OpenStack trunk VNX Unified Hybrid Storage for the Mid-Range UNIFIED All mixed workloads All access protocols HYBRID Optimized for FLASH Benefits of tiered storage PRICE OPTIMIZED Lowest $/IO Lowest $/GB Technology Leadership Multicore Optimized Designed for Virtualization Unified Storage File and Block OpenStack Cinder Cinder Driver $ cinder type-create "AutoTieringVolume" $ cinder type-key "AutoTieringVolume" set storagetype:tiering=Auto fast_support=True fast_cache_enabled=True

20EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder.Conf - VNX enabled_backends=vnxiscsi storage_vnx_pool_name = Pool_01_SAS san_ip = storage_vnx_security_file_dir = /etc/secfile/array1 naviseccli_path = /opt/Navisphere/bin/naviseccli volume_driver = cinder.volume.drivers.emc.emc_cli_fc.EMCCLIFCDriver destroy_empty_storage_group = False initiator_auto_registration = True Volume_backend_name=vnx_40 FC Driver Enabled_backends=vnxfc storage_vnx_pool_name = Pool_02_SAS san_ip = storage_vnx_security_file_dir = /etc/secfile/array1 storage_vnx_authentication_type = global naviseccli_path = /opt/Navisphere/bin/naviseccli volume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDriver destroy_empty_storage_group = False volume_backend_name = vnx_41 iSCSI Driver Location : /etc/cinder/cinder.conf Specify the volume drivers in the cinder.conf file Restart cinder-volume service to make any configuration change to take effect.

21EMC CONFIDENTIAL—INTERNAL USE ONLY VNX: Deployment Architecture iSCSI FC

22EMC CONFIDENTIAL—INTERNAL USE ONLY All Flash array ideal for High Performance Scale Out Architecture – Scale storage resources together with cloud infra Supported Protocols: – FC and iSCSI Provide support for main Volume Operations Integrated into OpenStack trunk XTREMIO

23EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder.conf - XIO enabled_backends = XtremIO [XtremIO] volume_driver = cinder.volume.drivers.emc.xtremio XtremIOFibreChannelDriver san_ip = san_login = admin san_password = volume_backend_name = XtremIO_FC enabled_backends = XtremIO [XtremIO] volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriver san_ip = san_login = admin san_password = volume_backend_name = XtremIO_iSCSI FC Driver iSCSI Driver

24EMC CONFIDENTIAL—INTERNAL USE ONLY XTREMIO: Deployment Architecture iSCSI FC

25EMC CONFIDENTIAL—INTERNAL USE ONLY ScaleIO – Block services Hyperscale Converged Server SAN Solution for Commodity Platforms – Software runs on physical & virtual Four Key Components – SDC, SDS, MDM, GATEWAY Driver executes volume operations thru the REST Gateway to backend ScaleIO Components Available from GitHub SDC Metadata Mgr (MDM) Applications (NOVA) SDS Cinder Volume GATEWAY Driver SDS Commodity Platforms

26EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder.conf - ScaleIO enabled_backends = ScaleIO [ScaleIO] volume_driver=cinder.volume.drivers.emc.scaleio.ScaleIODriver cinder_scaleio_config_file=/etc/cinder/cinder_scaleio.config SDS Driver

27EMC CONFIDENTIAL—INTERNAL USE ONLY SCALEIO : Deployment Architecture

28EMC CONFIDENTIAL—INTERNAL USE ONLY Certified Volume Operations

29EMC CONFIDENTIAL—INTERNAL USE ONLY EMC OPENSTACK CLOUD SOLUTION CINDER FUNCTIONALITY

30EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder – Block Storage Service Persistent block level storage devices for use with OpenStack compute instances. Manages the creation, attaching and detaching of the block devices to servers Block storage volumes are fully integrated into OpenStack Compute and the Dashboard allowing for cloud users to manage their own storage needs. Snapshots are supported and can be restored or used to create a new block storage volume.

31EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder Capabilities Volumes: – Allocated block storage resources that can be attached to instances as secondary storage or they can be used as the root store to boot instances. Volumes are persistent R/W block storage devices most commonly attached to the compute node through iSCSI. Snapshots : – A read-only point in time copy of a volume. The snapshot can be created from a volume that is currently in use (through the use of --force True) or in an available state. The snapshot can then be used to create a new volume through create from snapshot. Backups: – An archived copy of a volume currently stored in OpenStack Object Storage (swift).

32EMC CONFIDENTIAL—INTERNAL USE ONLY Attached to instances as secondary storage Can be used as root store to boot instances Persistent R/W Block storage Manage volume lifecycle – Create, Delete, Extend volumes – Attach/Detach Volume Ability to create different volume type. Cinder Capabilities : VOLUME

33EMC CONFIDENTIAL—INTERNAL USE ONLY A read-only point in time copy of a volume Create snapshots, Delete snapshots Make volume out of the created Snapshots Cinder Capabilities : Snapshots

34EMC CONFIDENTIAL—INTERNAL USE ONLY Backup Operations is an admin task and done via CLI today Backup is to Swift (Object). Find the volume you want to backup. – Create backup of a volume – Make sure of backup container. – Restore the volume CINDER Capabilities - BACKUP $ cinder backup-create “volume_id” $ swift list $ cinder backup-restore “BACKUP_ID” $ cinder list

35EMC CONFIDENTIAL—INTERNAL USE ONLY Consistency Groups Today in Cinder, every operation happens at the volume level. Consistency Groups (CGs) enable – Data Protection (snapshots and backups) – Disaster Recovery (remote replication) Consistency Group function – Leverages volumes of same type to be part of CG so can be snapshot/backed up – Enable Cinder to leverage volume replication feature available in the storage backends (drivers). – Orchestration layer above Cinder that understands which volumes should be grouped together.

36EMC CONFIDENTIAL—INTERNAL USE ONLY Consistency Groups Caveats – Allow for snapshot of multiple volumes – Make sure the “storage platform” supports consistency group (ex: VNX) – Can set Consistency groups only via CLI ; no support from Portal yet – Certain operations are not permitted if a volume is in a consistency group Volume Migration, Volume Re-Type, Volume deletion. A consistency group has to deleted as whole with all volumes and same for volume snapshots.

37EMC CONFIDENTIAL—INTERNAL USE ONLY High availability for Cinder – Deploy a Multi-Node with HA OpenStack environment. – Cinder services can be installed on each controller and provide high availability in case of a controller reboot or loss. – If a controller is lost all control plane functions are lost the data plane works. High Availability Controller-1 Controller-2 Message Q Database API Services Identity Image Blk Storage Dashboard

38EMC CONFIDENTIAL—INTERNAL USE ONLY Admins have the capability to group tenants – Using Projects – Map specific users who can access the project. Quotas can be set for operational limits – Enforced per tenant (project) level Number of volumes Number of volume gigabytes allowed per Number of Block Storage snapshots allowed Projects and Quotas

39EMC CONFIDENTIAL—INTERNAL USE ONLY Configuration File: Cinder.conf enabled_backends=XtremeIO, VNX [XtremeIO] volume_driver = cinder.volume.drivers.emc.xtremio XtremIOIscsiDriver volume_backend_name=xtremIO_40 [lVNX] storage_vnx_pool_name = Pool_01_SAS volume_driver=cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDriver volume_backend_name=vnx_41 Map the backend to volume types $ cinder type-create "HighPerf” $ cinder type-key "HighPerf” volume_backend_name=xtremeIO_40 $ cinder type-create ”MedPerf” $ cinder type-key ”MedPerf” volume_backend_name=vnx_41 MULTI-BACKEND SUPPORT Cinder-Volume High Perf Med Perf Cinder- driver

40EMC CONFIDENTIAL—INTERNAL USE ONLY Log files used by Block Storage – Log file of each Block Storage service is stored in the /var/log/cinder/ directory of the host – Most Block Storage errors are caused by incorrect volume configurations that result in volume creation failures. To resolve failures, review logs: cinder-api log (/var/log/cinder/api. log) cinder-volume log (/var/log/cinder/volume.log) Forward the logs to syslog server Logging - Cinder OpenStack Controller + Data Plane Local log files Rsyslog pull Logstash ElasticsSearch Kibana ops/content/logging_monitoring.html

41EMC CONFIDENTIAL—INTERNAL USE ONLY Volume Stats – Health, Size, Usage. – Thresholds for alarm s The data can be used by external systems for – Metering/chargeback – Monitoring. Monitoring - CEILOMETER Notification BUS Volume Notification Agents Collectors External Systems

42EMC CONFIDENTIAL—INTERNAL USE ONLY Volume Type $ cinder type-create "ThickVolume" $ cinder type-create "ThinVolume" $ cinder type-create "DeduplicatedVolume" $ cinder type-create "CompressedVolume" $ cinder type-key "ThickVolume" set storagetype:provisioning=thick $ cinder type-key "ThinVolume" set storagetype:provisioning=thin $ cinder type-key "DeduplicatedVolume" set storagetype:provisioning=deduplicated deduplication_support=True $ cinder type-key "CompressedVolume" set storagetype:provisioning=compressed compression_support=True $ cinder type-create "HighPerf" $ cinder type-key "HighPerf" set storagetype:pool=Pool_02_SASFLASH volume_backend_name=vnx_41 User wants to create a volume on a certain storage pool, a volume type with an extra spec specified the storage pool should be created first, then the user can use this volume type to create the volume.

43EMC CONFIDENTIAL—INTERNAL USE ONLY CINDER ARCHITECTURE WALK THRU CINDER FUNCTIONALITY

44EMC CONFIDENTIAL—INTERNAL USE ONLY Conceptual Architecture Glance Cinder Neutron Nova KeyStone Horizon Swift Backup volumes in Heat Orchestrate Directs services Metering Celiometer Provides Auth for Poll Data From Storage Lifecycle Create Volume Attach Volume Snapshot Volume

45EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder Architectural Overview Cinder Client Cinder API Cinder Scheduler Cinder Volume Cinder Backup Cinder- driver REST AMPQ Cinder- driver sql Volume Functions Create Extend Delete Attach Detach Volume Types Snapshot Functions Create Delete Update Volume from Snapshot Backup Functions Backup Restore Delete

46EMC CONFIDENTIAL—INTERNAL USE ONLY Cinder Architecture Building Blocks Cinder API – A WSGI app that authenticates and routes requests throughout the Block Storage service. It supports the OpenStack APIs Cinder Scheduler – Schedules and routes requests to the appropriate volume service. Depending upon THE configuration, could be simple round-robin scheduling or it can be more sophisticated through the use of the Filter Scheduler. The Filter Scheduler is the default and enables filters on things like Capacity, Availability Zone, Volume Types, and Custom filters Cinder Volume – Manages Block Storage devices, specifically the back-end devices themselves Cinder Backup – Provides a means to back up a Block Storage volume to OpenStack Object Storage.

47EMC CONFIDENTIAL—INTERNAL USE ONLY Logical Flow

48EMC CONFIDENTIAL—INTERNAL USE ONLY Authentication - Keystone Provide credentials to authenticate to the system. Admin User Credentials used by all services to talk to each other

49EMC CONFIDENTIAL—INTERNAL USE ONLY Self Service Portal - Horizon

50EMC CONFIDENTIAL—INTERNAL USE ONLY Volume Creation - Cinder Group volumes based on performance SIze Data Volume Boot Volume Defaults to Nova-AZ if not specified

51EMC CONFIDENTIAL—INTERNAL USE ONLY Volume Types Volume Type Size Availability Zone

52EMC CONFIDENTIAL—INTERNAL USE ONLY Managing the volumes Increase the volume size Delete the volumes Creates snapshots of volumes

53EMC CONFIDENTIAL—INTERNAL USE ONLY Launching an instance- Nova Flavor Count Image Initiate creation of an instance. Based on flavor Based on number Based on AZ

54EMC CONFIDENTIAL—INTERNAL USE ONLY Attaching a volume to an instance

55EMC CONFIDENTIAL—INTERNAL USE ONLY Snapshot Create a volume from a snap

56© Copyright 2014 EMC Corporation. All rights reserved. References EMC Mirantis Reference Architecture design – mirantis-openstack-ra.pdf mirantis-openstack-ra.pdf Configuration guide – openstack-block-storage.html openstack-block-storage.html Fuel –