Module 2: DriveScale architecture and components DriveScale Proprietary Information © 2017

DriveScale Confidential Information © 2017 List of acronyms Acronyms Meaning DSC DriveScale Management Server DMS DSA DriveScale Adapter LDAP Lightweight Directory Access Protocol iSCSI Internet Small Computer Systems Interface MLAG Multichassis Link Aggregation JBOD Just a Bunch Of Disks HA High Availibilty DS DriveScale SAS Serial Attached SCSI SATA Serial Advanced Technology Attachment Gbps Gigabits per second SFP Small Form Factor DriveScale Confidential Information © 2017

DriveScale Confidential Information © 2017 The DriveScale System DriveScale Adapter DriveScale Management System Cloud Central Highly Automated Infrastructure Provisioning and Management DriveScale Confidential Information © 2017

DriveScale Adapter: Interfaces 1U appliance with adapters that connect to servers via Ethernet, and to JBOD’s via SAS 4 DriveScale Ethernet to SAS Adapters in 1u Chassis Dual Redundant Power Supplies With 80 Gb throughput, a single chassis can comfortably support simultaneous access to 80 drives w/ equivalent performance to Direct Attached Storage 2x 10GbE Interfaces per Adapter 2x 12Gb 4 Lane SAS Interfaces per Adapter DriveScale Confidential Information © 2017

DriveScale Adapter: Front Panel NVMe Drives DriveScale Confidential Information © 2017

DriveScale Confidential Information © 2017 Chassis Block Diagram NVMe Slot_1 Controller_1 12Gb 4 Lane SAS: MiniSAS_HD 12Gb 4 Lane SAS: MiniSAS_HD 10GbE: SFP+ 10GbE: SFP+ 1GbE RJ45 Controller_2 12Gb 4 Lane SAS: MiniSAS_HD 12Gb 4 Lane SAS: MiniSAS_HD 10GbE: SFP+ NVMe Slot_5 10GbE: SFP+ 1GbE RJ45 Power Supply_1 Showing Two of the Four Controllers in the Chassis Power Supply_2 DriveScale Confidential Information © 2017

DriveScale Adapter Controller Block Diagram SAS Controller 12G, 4 Lane SAS PCIe Interfaces to NVMe slots in front 12G, 4 Lane SAS PCIe Switch Network Processor 10GbE SFP+ 10GbE SFP+ Chassis NW 1GbE RJ45 DriveScale Confidential Information © 2017

Deployment Model Adapter 4 Adapter 3 Adapter 2 Adapter 1 DSA Management Plane Switch Switch 1 Switch 2 MLAG DMS & Cloudera VM Server Data Node 4  Controller 2 Controller 1 Data Node 3 Data Node 2 1GE (mgmt) Data Node 1 10GE SAS Name Node 8 JBOD

Disaggregation is accomplished here Compute pool: Processor + Memory Servers 1u DriveScale Adapter (DA) -Ethernet to SAS This is where we cut the lady in half. So, a fully loaded rack might look something like this. In the top half of the rack we have diskless or disk-lite servers. In the bottom of the rack as JBOD’s with several drives in each. In the middle are two or more DriveScale Adapters (DA’s). One thing to point out here is that the DriveScale system is designed to be a DataCenter wide system, so our management system scales to hundreds of racks. Storage pool: Disks in JBODs, connected via SAS to the DA’s DriveScale Proprietary Information © 2017 DriveScale Confidential Information © 2017

DriveScale Software Components There are four principal components of the DriveScale software: DriveScale Management Server (DMS) DriveScale Server Agent DriveScale Central (DSC) DriveScale Adapter firmware DriveScale Proprietary Information © 2017

DriveScale Software Components Cont.. DriveScale Management Server (DMS) Whichever machine runs the DMS software bundle is called the DMS node Typical deployment consists of 3 DMS Systems in a clustered fashion for HA Manages and configure resources and contains inventory/configuration repository of: Inventory (DMS’s, DS Adapters, Switches, JBOD Chassis, Disks, Server Nodes) Configuration (Node Templates, Cluster Templates, Configured Clusters) DMS Database is used as a message bus to communicate with the end points DriveScale Server Agent DriveScale Server Agent Discovery provides inventory for hardware and servers Creates mappings for Server Nodes to consume disks DriveScale Confidential Information © 2017

DriveScale Software Components Cont.. DriveScale Central (DSC) Cloud-based software management portal where DriveScale repos are stored for software distribution to subscribers. Keys repository Centralized log file repository. Documentation repository License management DriveScale Adapter Firmware Heart of the cluster where the code is running on the processor and enables the JBODs to be presented to the servers to be used as local drives DriveScale Confidential Information © 2017

DriveScale Confidential Information © 2017 Central Kerberos/LDAP Integration HTTPS HTTPS (80) SSH (22) HTTPS HTTPS (443) Zookeeper (2281 TCP) HTTPS (8444,443) Zookeeper (2281 TCP) HTTPS (8443) Zookeeper (2888, 3888 TCP) MongoDB (27017) HTTPS HTTPS/SSH iSCSI (wide port range) 13 DriveScale Confidential Information © 2017 HTTP (38202)

DriveScale Cluster Minimum Hardware Requirements Two 10G SFP+ switches One1G switch One JBOD One DSA chassis DriveScale Confidential Information © 2017

DriveScale OS Support Matrix DriveScale now supports server nodes of type CentOS 6, CentOS 7, and Ubuntu 14.04. The DriveScale Management Servers (DMS) can be installed on CentOS 6, CentOS7, and Ubuntu 14.04   DMS Server Nodes CentOS/RHEL 6.x X CentOS/RHEL 7.x Ubuntu 14.04 DriveScale Confidential Information © 2017

DriveScale Proprietary Information © 2017 Communication Flow User -> DMS - Management interface access (HTTPS , HTTP redirect to HTTPS on 80) if using haproxy for HA, then HTTPS of individual server (not haproxy) is on 8443 User -> Adapter - Network configuration - HTTPS Adapter -> DMS - software updates (HTTPS on 8444) DMS -> DriveScale Central - software updates (HTTPS) DMS -> DriveScale Central - statistics / logs upload (HTTPS) DMS -> DMS - haproxy health check (HTTPS on 8443) DMS -> DMS - VRRP for HA setup DMS -> DMS - Zookeeper replication (2888, 3888 TCP) DMS -> DMS - MongoDB replication + access (27017 TCP) Server/Adapter/DMS -> DMS - Zookeeper access (2181 TCP) Server -> Adapter - iSCSI (wide port range, one iSCSI portal per drive used) Server -> Adapter, HTTP on alternate port 38202 for balancing (Live Data load Monitoring Reported from Adapter). Server -> DriveScale Central - software install (HTTPS) Server/Adapter -> DMS Log Report (HTTPS) DriveScale Proprietary Information © 2017

HDFS Cluster Minimum Hardware Requirements 1x DSA chassis (includes 4x DS Adapters) 1x JBOD to be loaded with the 60 drives 3 (min) x Servers for Data Nodes with 1 direct attached drive each for OS install (4-12 drives will be remotely attached via DSA) 1x Server for Name Node with 1 direct attached drive for OS install and Name node service 1x Server or a VM for DMS and Cloudera/Hortonworks 2x 10GbE switches for Data Flow 1x Management Switch (1GbE) Cables DriveScale Confidential Information © 2017