Trojan Express Network II Goal: Develop Next Generation research network in parallel to production network to address increasing research data transfer demands Leverage existing 100G Science DMZ Instead of expensive routers, use cheaper high-end network switches Use OpenFlow running on a server to control the switch PerfSONSAR systems for metrics and monitoring

Trojan Express Network Buildout

Collaborative Bandwidth Tests 72.5ms round trip between USC and Clemson 100Gbps Shared Link 12 machine OrangeFS cluster at USC –Directly connected to Brocade Switch at 10Gbps Each 12 clients at Clemson USC ran nuttcp sessions between pairs of USC and Clemson hosts Clemson ran file copies to the USC OrangeFS cluster

Linux Network Configuration Bandwidth Delay Product 72.5ms x 10Gbits/second = bytes (90Mbytes) net.core.rmem_max = net.core.wmem_max = net.ipv4.tcp_rmem = net.ipv4.tcp_wmem = net.ipv4.tcp_congestion_control = yeah jumbo frames enabled (mtu 9000)

Nuttcp Bandwidth Test Peak Transfer of 72Gb/s with 9 nodes