CoprHD and OpenStack Ideas for future

Agenda CoprHD in OpenStack: current approach CoprHD as SDS Controller for OpenStack Benefits Phased approach Projects

CoprHD in OpenStack (current solution) Advantages Keystone Horizon Swift Simplified Management (CoprHD side) Orchestration of complex workflows (with VPLEX, RecoverPoint) Data Lifecycle Management High Availability: service, storage Policy Based Provisioning Nova Cinder Neutron CoprHD Cinder driver OpenStack Issues CoprHD Manual configuration (cinder side) Tenant mapping – CoprHD/OpenStack Clear-text passwords (in cinder) Dual layer EMC IBM HDS NetApp …

CoprHD as Storage Controller Overview Keystone Horizon Swift Implement block storage API in CoprHD No changes to other OpenStack components Nova CoprHD Neutron OpenStack Advantages Driver approach advantages, plus: Simplified Management Eliminate extra layer (cinder) 1:1 Tenant mapping Performance Active/Active HA service Ingestion EMC IBM HDS NetApp …

CoprHD with Dual API heads CoprHD REST API clients Cinder REST API clients Port 8443 Port 8776 Auth service API service CoprHD REST API Cinder REST API System service DB service Coordinator service Controller service Cassandra database Zookeeper software Hardware

CoprHD with dual API heads Nginx enables multiple API endpoints Can register Block storage API endpoint in Keystone Tenants can be mapped 1:1 Varray can be mapped to availability zone

Some use cases Use case Current With CoprHD Storage Configuration Manual steps – CLI, edit file, restart service, … Everything possible via UI (Portal) FC network zoning Limited – doesn’t handle split networks Full capability auto zoning Storage services Basic features Advanced – HA, replication, tiering, discovery, multipath Volume types Admin has limited visibility (name only) Complete visibility to specific features (through virtual pool) Multi tenancy Limited Advanced Plus: Performance, High Availability, Upgradability, …

Deployment options Situation Use Deployment Dev/Test Small deployment No scalability requirement Using LVM or commodity storage Use native cinder Use cinder drivers Use cinder as block storage controller Use CoprHD via its cinder driver Multiple arrays of same type Simple configuration Moderate scalability requirements Use CoprHD as SDS controller Use native drivers where available Deploy cinder as a provider for CoprHD Use cinder drivers where needed Map tenants 1:1 between OpenStack and CoprHD Can apply quotas, reservations Can get metering information Offers good visibility and automation Production / Enterprise Large heterogeneous data center High scalability requirement Southbound SDK is critical for deployment

CoprHD + OpenStack: Phased approach Phase I (Enablement) Cinder driver with multiple arrays in the backend Phase II (Ease of use and Integration) API Compatibility for Block, File Ubuntu, RHEL and other platforms Distro support Physically sharing the same node (support for deployment options) Drivers -- expand the support Generic but important (not OpenStack specific Use cases which span block and object – monitoring, backup/archive Phase III (Leadership) Improve APIs, contribute features, drive improvements CoprHD to be part of major Distros

SDS Controller for OpenStack: Vision UI OpenStack Compute (nova) Other services Other services Networking Identity and authentication Other services OpenStack Storage (CoprHD) Other services block file object

Storage for Heterogeneous Private Cloud Centralized Management of Storage for all Compute Platforms OpenStack VMware Bare Metal Manila (File) Cinder (Block) vCenter vCloud/ vCenter Customer Orchestration CoprHD

API Implementation – current status Completed Not started (Curt & Anil) Volume API v1, v2 Create, delete, expand volume Attach, detach volume (FC and iSCSI) Create, delete snapshot Clone volume Create volume from snapshot Keystone v2 interface Keystone based authentication (tokens) CLI and Horizon testing Automated service registration in keystone Glance interface Keystone v3 interface – needs more analysis QoS Create image from volume Testing using tempest Needs exploration (Reddy & Anil) Volume stats ? Backup (swift) Ceilometer Work In Progress (EMC) Consistency Group Create volume from image

OpenStack projects for future Tools needed for developers Goal: CoprHD should run on Ubuntu & Centos (only instructions) Docker Co-existence (on same hardware?) with OpenStack services User deployment Currently only SLES OS, no upgrade, no multi-node Add Ubuntu and Centos Add multi-node (instructions) Co-existence (on same hardware?) with OpenStack services, don’t reboot node Keystone to be the only auth provider – remove proprietary token management (does this make sense for non-OpenStack environments?) CI tools integration – Jenkins to include tempest tests OpenStack CI setup with CoprHD

Q & A