OFA-IWG Interop Event March 2008 Rupert Dance, Arkady Kanevsky, Tuan Phamdo, Mikkel Hagen Sonoma Workshop Presentation

2 OFA-IWG Charter and Mission  The OpenFabrics Alliance Interoperability Working Group (OFA-IWG) is responsible for defining and developing a comprehensive suite of tests for evaluating product interoperability within the OpenFabrics environment. Each year, the OFA-IWG hosts interoperability test events in conjunction with the University of New Hampshire’s InterOperability Lab (UNH IOL). At these events, Alliance members have an opportunity to validate the interoperability of their products using the OpenFabrics software stack.UNH IOL  The OFA-IWG is responsible for defining and maintaining the OFA Logo Program.  At the end of each event, the OFA Interoperability Logo is granted to those companies who pass all of the mandatory tests.OFA Interoperability Logo

3 Event Overview  OFA IWG Interop Event 3/17  3/21/08  10 vendors and 23 devices  This is the 3 rd official OFA-IWG Interop event  Preceded by IBTA and iWARP compliance testing events  Hosted by University of NH Interoperability Lab (UNH-IOL)  Overall results very successful  Next event scheduled for September 2008

4 Program Details  OFA Interoperability Logo Program  Enable vendors to claim and market interoperability by using the Logo on their products or in their product marketing collateral.  Details available at  Current List of Logo Grants available at: nteroplist.php nteroplist.php  Updated List of Logo Grants will be available end of April 2008

5 Vendor Participation - IB  InfiniBand Vendors  Cisco, Data Direct Networks, Flextronics, LSI Logic, Mellanox, QLogic, Voltaire  InfiniBand Devices – using OFED 1.3 GA  14 HCAs  5 Switches  1 iSER Target  3 SRP Targets  5 SMs  Host Based SMs: OpenSM, Cisco  Switch Based SMs: Cisco, QLogic, Voltaire

6 Vendor Participation - iWARP  iWARP Vendors  Cisco, Chelsio, Fujitsu and NetEffect  iWARP Devices - using OFED 1.3 GA  Cisco  10 GbE Switches  Chelsio  3 RNICs – 2 CX4 and one SR  NetEffect  2 RNICs  Fujitsu  10 GbE Switches

7 Test Setup & Environment  Host Systems  17 servers provided by Intel  Cables Donations  Amphenol  C&M  Intel  Meritec  Panduit  W.L. Gore  Zarlink  RHEL 5  OFED 1.3 GA

8 Test Category for March 2008 Interop Event

9 New Tests for March 2008  IB IPoIB Connected Mode  Ethernet Link Initialize  Ethernet Fabric Initialize  Ethernet Fabric Reconvergence  Ethernet Fabric Failover  TI Reliable Datagram Sockets (RDS)  TI MPI – HP  TI Basic RDMA Interop  TI RDMA Operations over Interconnect Components

10 Testing Covered  InfiniBand  Link Init  Fabric Init  IPoIB  SRP  SDP  iSER  HP MPI  RDMA interop  iWARP:  iWARP Interop testing  uDAPL  HP MPI  RDMA interop  Ethernet switch testing (limited participation limited execution ability)

11 IB Cluster Topology

12 Problems Noted  No issues with OFED 1.3 GA seen.  Vendor specific SM stops when attempting to discover improperly identified device in the fabric.  Vendor device had duplicate GUIDs.  Vendors had a link problem because physical link was not achieved (this was remedied later).  Vendors continue to have uDAPL problems (especially in iWARP).  HP MPI didn't work (in iWARP) due to uDAPL problems.  Insufficient time to run all of the Interop Test Suite:  This was partly because vendors were debugging Interop problems.  Suggestion: The week prior to the OFA Interop event should be reserved for debugging and resolving interop problems. OFA Interop week should be for Logo Validation only.  This would require vendors to bring some additional equipment for the IBTA and iWARP compliance Plugfest.

13 Notes & Suggestions  A new Logo Name has been adopted  OFA Interoperability Logo  When a new feature is added to OFED or there is a major upgrade to a feature, a test should be created for OFA Interop Plan.  Cluster Availability  VPN access is granted to all OFILG Members.  Week long testing slots are available.  Next Event Dates  September 22 nd – 26 th - IBTA Plugfest  September 22 nd – 26 th - iWARP Test Period  September 29 th - October 3 rd - OFA Interop Event  Consider an End User event at UNH IOL

14 Open Invitation for Interop #4  Distros  Novell and Red Hat  Ethernet Switch Vendors  Arastra, Force 10, Fujitsu, Fulcrum, Woven  IB Vendors  HP, IBM, Obsidian, SGI, Sun, Xsigo  iWARP Vendors  NetXen  System Vendors  Appro, Dell, SuperMicro

15 Summary  Best OFA Interoperability Event to date  Many new tests added to the Interop Plan  Test Scripts improved  Test execution went smoothly  UNH-IOL staff performed very well  Mandatory testing was very successful  Beta testing  Need device participation in some categories such as FC and Ethernet Gateway devices  Need more participation from Ethernet Switch Vendors  Need more time to complete all of the testing

16 Backup

17 IBTA Event Overview  IBTA IL Compliance Testing 3/10  3/14/08  17 vendors versus 11 at the last event  18 devices versus 16 at last event  83 cables tested – versus 27 at the last event  This was the 13th IBTA Plugfest  IBTA integrators List  This list includes all products that have successfully completed the rigorous testing procedures at IBTA sponsored Plugfests.  Current List of devices is available at  Updated List will be available end of April 2008  Hosted by Lamprey Networks and University of NH Interoperability Lab (UNH-IOL)  Next event scheduled for September 2008

18 IBTA Vendor Participation  InfiniBand Devices  Cisco, Flextronics, Mellanox, QLogic, Voltaire  Cable Vendors  Amphenol, C&M, Cinch, Fujikura, Intel, Luxtera, Mellanox, Meritec, Molex, Panduit, Tyco, W.L. Gore, Zarlink