1. Trojan Express Network II Goal: Develop Next Generation research network in parallel to production network to address increasing research data transfer demands Leverage existing 100G Science DMZ Instead of expensive routers, use cheaper high-end network switches Use OpenFlow running on a server to control the switch PerfSONSAR systems for metrics and monitoring

2. Trojan Express Network Buildout

3. Collaborative Bandwidth Tests 72.5ms round trip between USC and Clemson 100Gbps Shared Link 12 machine OrangeFS cluster at USC –Directly connected to Brocade Switch at 10Gbps Each 12 clients at Clemson USC ran nuttcp sessions between pairs of USC and Clemson hosts Clemson ran file copies to the USC OrangeFS cluster

4. Linux Network Configuration Bandwidth Delay Product 72.5ms x 10Gbits/second = 90625000 bytes (90Mbytes) net.core.rmem_max = 96468992 net.core.wmem_max = 96468992 net.ipv4.tcp_rmem = 4096 87380 96468992 net.ipv4.tcp_wmem = 4096 65536 96468992 net.ipv4.tcp_congestion_control = yeah jumbo frames enabled (mtu 9000)

5. Nuttcp Bandwidth Test Peak Transfer of 72Gb/s with 9 nodes