Use case of RDMA in Symantec storage software stack Om Prakash Agarwal Symantec

Agenda About Symantec Storage Software Stack Need for the faster interconnects Write operation without and with RDMA Implementation details: Write operation with RDMA Perf comparison (without and with RDMA) 2Symantec Proprietary: Use case of RDMA in Symantec storage stack

About Symantec Storage Software Stack Symantec Proprietary: Use case of RDMA in Symantec storage stack3 CVM/CFS Kernel Hardware CVM/CFS LLT NIC LLT NIC Applications User HBA Shared storage

Need for the faster interconnects Symantec Proprietary: Use case of RDMA in Symantec storage stack4 CVM/CFS Kernel Hardware CVM/CFS LLT NIC LLT NIC Applications User Local storage Shared Nothing Architecture

RDMA over InfiniBand or Ethernet Write operation without and with RDMA Symantec Proprietary: Use case of RDMA in Symantec storage stack5 CVM/CFS Kernel Hardware CVM/CFS LLT NIC LLT Buffer NIC RNIC Buffer Bufptr

Write operation with RDMA 6 Symantec Proprietary: Use case of RDMA in Symantec storage stack CVM/CFS LLT sender receiver Buffer advertisement: Allocate buffers and send Meta data to sender node. 4k RX map Actual allocation 4k TX map Destination buffer info 4k4k4k1k 8k8k Message 4k RX map Actual Allocation 4k4k4k2k2k 4k4k Message 4k TX map Destination buffer info 4k TX map Destination buffer info 4k RX map Actual Allocation 4k RX map Actual allocation 4k TX map Destination buffer info

Perf comparison (without and with RDMA) 7Symantec Proprietary: Use case of RDMA in Symantec storage stack 1)Throughput 2)Latency Setup configuration  Two node Linux (RHEL6.3) cluster  ConnectX3 VPI NIC card from Mellanox IB -56 Gbps RoCE-40 Gbps Eth-40 Gbps  3.3GHz Processor

LLT perf comparison : Throughput 8Symantec Proprietary: Use case of RDMA in Symantec storage stack 193% 125% Higher is better

LLT perf comparison : Latency 9Symantec Proprietary: Use case of RDMA in Symantec storage stack 62% Lower is better

#OFADevWorkshop Thank You