High Speed Optical Interconnect Project May08-06

Client: Lockheed Martin Team Information Client: Lockheed Martin Team Members Team Leader: Adam Jackson Communication Coordinator: Nick Ryan Bader Al-Sabah David Feely Richard Jones Faculty Advisor Dr. Ahmed Kamal Client Contacts Aaron Cordes Rick Stevens

Problem Statement At this time, the maximum real-world throughput of 10 Gbps network configurations is unknown.

Functional The network shall be implemented with10 Gbps components. The team shall test the network to determine real throughput.

Non-Functional The solution must be implemented before the Senior Design class completes in May 2008. The solution must determine whether or not fiber optic components can be used within budgetary constraints.

Environmental The solution is assumed to be implemented in an environment where the following will affect the final design: Weight Temperature shock sensitivity

Host System: Dell Optiplex 745 Capable of PCI-E x1/x4/x8/x16 Linux Operating System (Red Hat 5) Separate system needed for each node

Myricom 10G-PCIE-8A-R+E® Pluggable XFP optical interface 10GBASE-SR and –LR support x1/x4/x8 compatible 32 Gbps throughput Linux and Windows OS supported Source: Myricom website http://www.myricom.com/Myri-10G/NIC/10G-PCIE-8A-R.html

TigerSwitch™ 10G Standalone 8-port XFP 10G Managed Layer 2 switch Model Number: SMC8708L2 Supports up to 8 XFP ports Delivers 10-Gigabit Ethernet Switching fabric – 160Gbps AC Input – 100 to 240 V, 50 – 60 Hz, 2 A http://www.pcworld.com/product/pricing/prtprdid,9311286-sortby,retailer/pricing.html

XFP – 10 Gigabit Small Form Factor Pluggable Myricom 10G-XFP-SR 1-Port 10GBASE-SR (LC) XFP Transceiver Used for 10 Gbps connections http://ecx.images-amazon.com/images/I/11jHA98YEEL._AA160_.jpg

PCI-E Node-to-Node Configuration Testing will be completed with two systems directly connected Used for testing bandwidth and bandwidth efficiency Graphic inspired by previous HSOI team

PCI-E Switched Configuration Composed of three nodes and a Ethernet switch Used for testing switching time, latency, and quality of service Graphic inspired by previous HSOI team

Presented Hardware Setup (As recommended by Lockheed Martin.) NXB-10GXxR Intelligent NIC® 10 Gigabit Ethernet PCIe Adapter with pluggable XFP optical interface (http://www.netxen.com/products/boardsolutions/NXB-10GXxR.html) Node 1 Node 2 Node 3 TigerSwitch 10G 8-Port Standalone XFP 10Gigabit Ethernet Managed Layer 2 Switch SMC Networks, Inc.

Myricom 10G-PCIE-8A-R+E® Actual Hardware Setup Myricom 10G-PCIE-8A-R+E® 10 Gigabit Ethernet PCIe Adapter with pluggable XFP optical interface (http://www.myri.com/Myri-10G/10gbe_solutions.html) Node 1 Node 2 Node 3 TigerSwitch 10G 8-Port Standalone XFP 10Gigabit Ethernet Managed Layer 2 Switch SMC Networks, Inc.

Estimated Resource Costs Quantity Unit Cost Total Cost Optical NICs 3 $795 $2385 XFP Switch 1 $6500 XFP Transceiver 6 $450 $2700 Fiber optic cables $29 $87 Total $11672

Network Testing Software Network Traffic Generator Packet generation program Wireshark Packet capture/analysis program ping Used as a latency measurement tool netperf/netserver Bandwidth measurement tool tcpdump Packet capture program

Performance Metrics Bandwidth Measurement Switching Time Measurement Channel Capacity Bandwidth Efficiency (Throughput) Switching Time Measurement Latency Measurement Quality of Service Measurement

General Test Plans Execute each batch test 5 times to ensure precise results Establish a 95% confidence interval Use both UDP and TCP protocols when possible

Presenting Test Results Bandwidth Compare link usage for each node under varying workload types Bandwidth Efficiency Show a comparison of the amount of OSI Layer 1 data sent for different OSI Layer 7 data block sizes Switching Time Compare switching time and link load for cases when 2 and 3 nodes are connected to the network

Presenting Test Results Latency Compare the latency between nodes under different network loads Quality of Service Show the amount data received from each sending node for each endpoint node over time

Implementation Report Budget Resolved CSG delivering systems Test software chosen Exploring software capabilities

Implementation Report (2/26) NICs Ordered & Received Fiber Optic Cables Received NIC Drivers installed Test Plans Written Test Utility Experimentation

Questions? ?