1. 1 InfiniBand HW Architecture InfiniBand Unified Fabric InfiniBand Architecture Router xCA Link Topology Switched Fabric (vs shared bus) 64K nodes per sub-net Multiple subnets bridged w/routers IPv6 addressing x-subnet Fabric Transactions Unified fabric for IPC, Networking, and Storage Channel based interconnect Closely integrated with Mem Ctrlr QoS (Service Levels, Virtual Lanes) Reliability Automatic fail-over in switch Support for redundant fabrics Physical Layer Cost Effective Four wire link (2 pairs) Enables volume deployments 2.5Gb/sec signaling rate Copper & Fiber support Multiple link widths 1x -2.5 Gbits/sec 4x - 10 Gb/sec 12x - 30 Gb/sec Hosts InfiniBand Switch Network Router Storage 1 2 3 n.. CPU Mem Cntlr HCA CPU Mem Cntlr HCA CPU Mem Cntlr HCA Link CPU Mem Cntlr HCA Switch Link TCA N/W Target TCA Storage Target Link 1 2 3 n

2. 2

3. 3

4. 4 Virtual Lane (VL) z Multiplex multiple independent data streams onto a single physical link which provides: y Differentiated services on a packet-boundary basis y Increase fabric utilization in the face of head-of-line blocking on a given VL and via VL-based routing across multiple paths y Support for up to 16 VLs with 1 VL reserved for fabric management y Implementations shall support a minimum of 1 VL application usage and 1 VL for fabric management De- Mux Mux Packets

5. 5 Messages & Packets z Applications, drivers, devices, adapters, etc. execute transactions via logical units of work termed messages. z H/W-based memory / resource protection to prevent unauthorized access to messages z Message semantics supported are: y Memory - RDMA Read / Write y Channel - Send / Receive y Atomics (optional functionality) y Multicast (optional functionality) z InfiniBand technology H/W provides automatic message segmentation and re-assembly via packets y End-to-end fabric unit of transfer Transaction Message Packet Message

6. 6

7. 7