Voltaire The Grid Backbone™ InfiniBand CERN Seminar Asaf Somekh VP Strategic Alliances June 2006

© 2006 Voltaire, All Rights Reserved. 2 Agenda About Voltaire Products Update InfiniBand – Ethernet connectivity

© 2006 Voltaire, All Rights Reserved. 3 Voltaire: The Company 2005 Sales: 4x over 2004, 15x over Over 50,000 Ports in 2005 Solid Financing - Recent Round: $17M, Summer Sufficient funds to breakeven Global Locations - Business HQ: Boston - R&D Center: Hertzliya, Israel - Sales Offices: San Francisco, Philadelphia, New York, Frankfurt, London, Tokyo - Headcount : 120

© 2006 Voltaire, All Rights Reserved. 4 Deploying Grids Globally Across Industries Government Education & Research Manufacturing Financial Srv.EntertainmentOil & Gas

© 2006 Voltaire, All Rights Reserved. 5 Expanding ISV And Solution Partnerships Infrastructure Application and Middleware Storage Software Management and Scheduling Server OEMs

© 2006 Voltaire, All Rights Reserved. 6 Voltaire Products Summary Grid Directors ISR X (DDR or SDR) or 32 12X ports ISR 9288 – 288 4X (DDR or SDR) or 96 12X ports Copper and optical support Integrated GbE and/or FC ports (up to 144) Full redundancy (PS, FAN, Fabric, Management,..) Blade Solutions High performance blade solutions for IBM BladeCenterH Blade Server Connectivity Solutions Voltaire ISR 9096 Voltaire ISR 9288

© 2006 Voltaire, All Rights Reserved. 7 Voltaire Products Summary Grid switches - ISR port IB (SDR and DDR) - ISR Multi-Protocol (IP / FC / IB) Management & Virtualization - Embedded in switches - Highly scalable Grid management Host software - Unique High-Performance offerings for HPC, Financials, and Storage ISR 9024 ISR 6000 GridVision™ Management Suite

© 2006 Voltaire, All Rights Reserved. 8 Voltaire Top500 Leadership Largest number of Top500 InfiniBand sites Broadest and Strongest Channels - Joint Installations with 7 OEMs and Resellers Top InfiniBand Site: NASA Ames #4 Most network-efficient InfiniBand site Number of InfiniBand sites doubled from previous list, tripled in a year Proprietary interconnects keep going down GbE pushed lower on the list Interconnect Change from Nov 2004 InfiniBand+200% GbE+38% Quadrics-19% Myrinet-23%

© 2006 Voltaire, All Rights Reserved. 9 Voltaire InfiniBand = Network Efficiency = $$$ Assumptions: - Cluster Size: 256 Nodes - 2P Opteron Server Price: $3,000 - InfiniBand Price/Node:$90080% Network Efficiency - Myrinet Price/Node$80065% Network Efficiency - GbE Price/Node: $10055% Network Efficiency Actual Performance Myr GbE TFlops Cost Per TFlop Myr GbE $500K $600K $400K Example:

© 2006 Voltaire, All Rights Reserved. 10 Multi-Protocol Switching Same Switch, Multiple Protocol and I/F Combinations

© 2006 Voltaire, All Rights Reserved. 11 Voltaire IP Router Unique Capabilities Hardware Configuration and Chassis Management ISR 9096/9288, as well as ISR 6000 chassis are supported - sRBD is required for holding up to 3 routers (any mix) - sRBD-D is required for DDR configurations, although the IPR is an SDR device Copper as well as optic-fiber SFPs are supported - IPRs are provided with 4 copper SFPs by default (included in price) Cluster mode is supported (multiple devices per chassis, any mix) Voltaire unique InfiniBand-Ethernet Silicon Link aggregation

© 2006 Voltaire, All Rights Reserved. 12 Voltaire IP Router Unique Capabilities Networking Management Centralized management – single point representation - Feedback from the field leads to an improved mechanism - in development CLI and GUI based management support - Including full TFM (Traffic Flow Management) and partitioning support - Click on Routers launches their VDM Automated configuration and application transparency by cluster learning and ARP Proxy Monitoring - management access to programmable hardware classification counters (CLI)

© 2006 Voltaire, All Rights Reserved. 13 Healthcare Grid Voltaire Grid Director ISR 9096 Native InfiniBand Storage with FalconStor IPStor Local Users InfiniBand VTL Application Servers Oracle 10g RAC Cluster Data from Hospitals WAN Router IPoIB RDS IPoIB SDP iSER TCP/IP

© 2006 Voltaire, All Rights Reserved Gb Ethernet Connectivity with InfiniBand ISR 9288 … … … … … … 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 194 4X links to 55 compute nodes X links to 90 storage nodes 48 4X links to each lower tier ISR 9288 Upper tier blocking (over-subscription) factor = 5:1 Node to node hops (worst case) = 9 ISR 9288 IP Router Multiple trunks of 4 x 1 GbE 16 GbE Links

© 2006 Voltaire, All Rights Reserved. 15 TITECH Grid - Protocols Core Nodes Each with 2 HCAs Stretching over 3 floors 1PB InfiniBand Storage with Lustre Legacy NAS Storage MPI (MVAPICH) Lustre NFS 300 Optical links iSER

© 2006 Voltaire, All Rights Reserved. 16 Enabling High Performance Commodity Storage with iSCSI RDMA (iSER) and InfiniBand iSER Target BOMQtyCostSum Target platform (PC) 1$1-2K SATA drives 16$0.7 * GB16*300GB*.7 = $3.4K SATA RAID Adapter 1-2$300$ InfiniBand Adapter 1$500 FC Performance 400 MB/s 900 MB/s iSER Delivering unprecedented cost/performance, leveraging on industry standard components Commercial grade target 1$2K -5K$2K-5K (config dependent) Total (4.8 TB) ~$2-3/GB

Thank You

© 2006 Voltaire, All Rights Reserved. 18 1,024 Compute Nodes on A Single Global File System with Voltaire Grid Backbone™ and HP SFS ™ 87 Voltaire ISR 9024 Grid Switches 4 Voltaire ISR 9288 Grid Directors 1,024 Compute Nodes 4 Login Nodes 2 Admin Nodes 12 HP SFS OSS Nodes (Lustre Servers) with 132 TB OSS Throughput 900 MB/s 1 SFS Admin Node 1 MDS Node Client Throughput: 350 MB/s Customer: D.O.D US Air Force Project TI-05 Fully Non-blocking 10 Gbps InfiniBand Fabric