Optimizing sds for openstack Jason brown, emc Ben silverman, mirantis

Jason brown Job: ScaleIO Product Marketing Manager Mission: Driving ScaleIO + OpenStack education and adoption with customers and community 15 years in tech Experience in ENG, PM, and PMM EMC Elect 2016

Ben silverman Job: Cloud Architect at Mirantis Mission: Make magic from unicorn tears and kitty glitter to architect OpenStack solutions. Prior to Mirantis, Architected and Engineered first OpenStack cloud at American Express (Icehouse) with 5000+ instances. Member of Performance and Scale OpenStack Group

Why we’re here To talk about software-defined storage (SDS) To talk about how automation of SDS helps with optimization To talk about various deployment methods for SDS and how they can help To show how our products help with the above topics To answer your questions To have fun!

Traditional storage challenges High SPEND on Storage Hardware Inability to SCALE to Meet Demands RIGID Acquisition & Deployment Models Vendor LOCK-IN Lack of Data Center AGILITY

What is sds? SDS = SDS Controller Software + Server-Based Storage No proprietary hardware components Custom ASICs, chipsets, CPUs, etc Runs on multiple (physical or virtual) instances Standalone / autonomous system Storage services Data persistence Source: IDC, WW Software-Defined Storage Taxonomy, 2016

50% COST SAVINGS SDS Benefits Flexible Software CLOUD Hardware Decouple Software from Hardware Lifecycle Flexible Procurement Path to CLOUD Leverage Industry Standard HW 50% COST SAVINGS Source: Gartner 2015

architecture of sds It’s like the Ben & Jerry’s of storage! Source: IDC, Worldwide Software-Defined Storage Taxonomy 2016

.NOW Trends: CEO/CFO Goals: Storage Only Hyper-Converged Information/data Make $$$ Resource Availability Save $$$ Storage Only Price/Expense Pressure Reduce Risk x86 x86 x86 x86 x86 IP Network Web/Cloud Scale validation .NOW x86 x86 x86 x86 x86 x86 x86 x86 x86 x86 IP Network Hyper-Converged Protection Mngmt Sharing x86 x86 x86 x86 x86 Operational Change Islands of SAN’s x86 x86 x86 x86 x86 20% - 40% ROI IP Network x86 x86 x86 x86 OR Capex/Opex$$$$$ 30% - 60% ROI Proprietary & Purpose Built HW Tech Refresh/Capex Cycles $$$$ Data Migrations Capacity Planning

What is EMC scaleIO? Software that uses application servers to create an elastic, scalable, and resilient Server SAN at a fraction of the cost and complexity of traditional SANs Installs on industry-standard x86 servers that run databases, hypervisors, or any other applications Aggregates application servers’ local disks Add storage and/or compute on the fly EMC® ScaleIO® is software defined storage designed with enterprise-grade resiliency to deliver, scale-out, block storage using commodity hardware. ScaleIO provides the scalability, elasticity, flexibility and performance needed to meet the demands for whatever comes next. It is also a key building block in next generation hyper-converged systems. ScaleIO agent (minimal footprint)

Scaleio consumption choices Software VCE VxRack Node VCE VxRack with FLEX Nodes Software Defined Maximum flexibility Lowest Risk, Highest Value, Lowest TCO Ultra Scale-Out SDS Scale-Out Block Storage Turnkey Software Defined IaaS Software Only Complete flexibility End user supplies server End user supplies switch End user supplies rack HW + SW Bundle Package High degree of flexibility / choice End user supplies switch & rack Fully productized platform VCE factory integrated & logically configured VCE Support & lifecycle assurance EMC ScaleIO has delivered upon the promise of software-defined, scale out, block storage on standard server hardware with extreme performance, massive scale and superior elasticity. Now you can choose how you wish to consume ScaleIO. There are 3 Consumption Models available. ScaleIO Software: Ultra Scale-out SDS Software Only Complete flexibility End user supplies server End user supplies switch EMC Offers Prof. Services Provides L1-L3 support Provides dashboard and CLI VxRack Node: Scale-out Block Storage Node HW + SW Bundle Package High degree of flexibility/choice Supports both SAN.Next and Infrastructure.Next Use Cases with a DIY approach VCE Sells server Dashboard, CLI and Web UI VCE VxRack: Turnkey Fully Engineered Solution Fully integrated Application platform Primarily Infrastructure.Next Use Case Selects & validates components Sells server & switch Prof Services included Provides L1 & L2 support VCE Vision & Onrack for mgmt. Provides L3 support for ScaleIO BUILD BUY CONSUME MANTAIN

Sds best practices Determine cloud workloads first (your mission), then architect SDS. Assess the performance requirements of the above workloads for your mission (write performance/replication factors/location). Create separate front and backend storage networks if required. Forecast initial capacity and growth. Prepare for cultural shift in storage operations. Create new ongoing capacity planning strategy. Business Requirement Budget ? Do you need Ceph cluster for day to day operation or SPECIAL  Technical Requirement What applications will be running on your storage What type of data will be stored on your storage? Should the ceph cluster be optimized for capacity and performance ? What should be usable storage capacity ? What is expected growth rate ? How many IOPS should the cluster support ? How much throughput should the cluster support How much data replication ( reliability level ) you need ? • What to optimize for? – Cost – Performance

Automation leads to optimization Mirantis Fuel Fuel is an open source deployment and management tool for OpenStack. Mirantis Fuel Plugin for EMC ScaleIO Enables deployment and configuration of Mirantis OpenStack, along with deployment of a ScaleIO cluster as a storage backend. Developed as an OpenStack community effort and approved as an OpenStack project under the Big Tent governance model, it provides an intuitive, GUI-driven experience for deployment and management of a variety of OpenStack distributions and plug-ins. GUI driven Scale IO configuration, carries throughout all control plane and compute nodes deployed initially as well as future deployments.

What about ceph? Multi-purpose (Ceph) vs. purpose-built (ScaleIO) Object store (Ceph) vs. native block (ScaleIO) Tradeoffs = Overhead Performance, performance, performance Go here for more: http://www.emc.com/scaleiocephbattle

Sds & Server san: the time is now Server SAN market is projected to GROW $50B by 20262 Server SAN is projected to have a 23% CAGR from 2012 to 2026, with faster growth from 2014 to 2020 of 38% CAGR Traditional enterprise storage market is projected to decline by Wikibon strongly recommends that CTOs & CIOs initiate Server SAN pilot projects in 2015, LOW COST or HIGH PERFORMANCE particularly for applications where either is required.2 16% CAGR 1Gartner, How to Determine Whether Software-Defined Storage Is Right for Your Organization, Julia Palmer, 13 July 2015 2Wikibon, Wikibon Premium Report: Server SAN 2012-2026, David Floyer, 15 July 2015 Server SAN is projected to have a 23% CAGR from 2012 to 2026, with faster growth from 2014 to 2020 of 38% CAGR Traditional enterprise storage market is projected to decline by 16% CAGR  “In 2017, more than 40% of Global 2000 enterprises will be involved in POC studies for SDS solutions compared with 17% today.”1

Next Steps Visit EMC.com/ScaleIO AND VCE.com/products/hyper-converged/VxRack Watch the ScaleIO / Ceph battle!  where you’ll have access to whitepapers, videos, demos etc.  Download Free & Frictionless version of ScaleIO 1.  Visit EMC.com/ScaleIO where you’ll have access to whitepapers, videos, demo’s etc.  (www.emc.com/scaleIO) 2.  Join the ScaleIO product Community https://community.emc.com/community/products/scaleio 3.  Download the Free & Frictionless version of ScaleIO http://emc.com/products-solutions/trial-software- download/scaleio.htm 4.  Reach out to local sales team.  Join the ECN ScaleIO Product Community Follow Us on Twitter @EMCScaleIO