1. Bifrost och 10Gbit routing Software Freedom Day 2010-09-18/Stockholm Robert Olsson Uppsala Universitet och KTH

2. What is bifrost? Small Linux suited for USB For infrastructure For research & education Name of human network and collaboration Why a new Linux distro? We've been around For 15 years soon. What about Red Hat/Debian Ubuntu etc?

3. For who? Networking people Unix/Linux Needing a small flexible distro Research & Education

4. Objectives infrastucture? Hardware selection – Crucial Software selection - Crucial Testing - Crucial Bug Fixes/Support Crucial Development - Crucial

5. Basic functions? Routing Firewalling Login services Traffic logging Gateways etc Virtualization and/or Namespaces (New) Ipv4, ipv6 Network testing pktgen/netperf etc

6. Routing deamons Packet forwarding is done in Linux kernel But routing protocols is run by userpace Deamons Currently tested versions of quagga Bgp, OSPF both Ipv4, ipv6 Cisco API Of course other software can be used Bird?

7. More than 10 year in production at Uppsala University Stockholm 2 * XEON 5630 TYAN 7025 4 *10g ixgbe sfp+ LR/SR Full Internet routing via EBGP/IBGP DMZ AS 2834 UU- 1UU- 2 Internera l UU-Net L- green L- red ISP/SUNET AS1653 Local peering In Uppsala ipv4/ipv6 OSPF

8. Hi-End Hardware XEON 2 x E5630 TYAN S7025 Motherboard Intel 82599

9. Block hw structure

10. Hardware - NIC Intel 10g board Chipset 82599 with SFP+ Open chip specs. Thanks Intel!

11. R & D related to bifrost Close collaboration with Linux networking Developers and industry NAPI (3 years) now in most network drivers Pktgen testing in linux, fib_trie, (routing algo) routing stats to monitor and understand network Etc, etc

12. NAPI Effect Inelegant handling of heavy net loads System collapse Scalabiity affected System and number of NICS A single hogger netdev can bring the system to its knees and deny service to others March 15 report on lkml Thread: "How to optimize routing perfomance" reported by Marten.Wikstron@framsfab.seMarten.Wikstron@framsfab.se - Linux 2.4 peaks at 27Kpps - Pentium Pro 200, 64MB RAM

13. Cache effect/Performance using lmbench

14. Lab testing HW and SW

15. Not all were selected...

16. Recent project IIS DMA 93 Gbit/s TX Separation based HW classifier. BGP and ssh In control plane (CPU0)

17. TX w. 10 * 10g ports 93Gb/s “Optimal”

18. TX w. 10 * 10g ports 93Gb/s “unoptimal”

19. Network flow separation for bgp, ssh

20. KTH/CSD Current focus Optical to Open Source Router Low-Power & Renewable Energy Virtualization/Namespaces Performance Cost

21. Rwanda example

22. Lagos next

23. Low-Power Development Number of packet per second per Watt but Still addressing infrastructure. So need for SFP fiber modules, multiqueue etc

24. Low-Power Development Some ideas Power consumption SuperMicro X7SPA @ 16.5 Volt with picoPSU Watt Test ------------------- 1.98 Power-Off 13.53 Idle 14.35 1 core 15.51 2 Core 15.84 3 Core 16.50 4 Core Routing Performance about 500.000 packet/sec in optimal setup.

25. Low Power NIC Remember we talk server chips We're waiting for Intel 82580 for GE

26. Example herjulf.se 14 Watt by 55Ah battery bifrost/USB + lowpower disk

27. Power Control API Integrated charge controller Sensors USB to server Server actions on power & environment Proper shutdown Re-route Logging, mail, SMS etc

28. Power Control API http://www.herjulf.se/cgi-bin/pwr Battery Voltage = 13.45 Charge Goal Voltage = 13.47 In Voltage = 14.90 In Current = 0.68 Battery Temp = 21.31 Voltage Disconnect = 12.00 Load Manually Disconnect = 0 Load Voltage Disconnect = 0 Load Voltage = 13.69 Load Current = 1.16 Temperatures. Room 100914 13:15 1 284ab28302000076 21.75 Data is updated every 5:th minute

29. Running on battery

30. SuperCapacitors

31. Ulibc static binaries Total version control Static, no sharable objects etc Small (yes) Gentoo/Source Mage Linux style http://github.com/jelaas/bifrost-build Useful more than Bifrost...

32. Optical modules Optical sender and receiver in one module SFP 1G XFP 10G SFP+ 10G

33. DOM - Optical Monitoring Optical modules can support optical link monitoring RX, TX power, temperatuers, alarms etc Newly added support to Bifrost/Linux

34. DOM ethtool -D eth3 Int-Calbr: Avr RX-Power: RATE_SELECT: Wavelength: 1310 nm Temp: 25.5 C Vcc: 3.28 V Tx-Bias: 20.5 mA TX-pwr: -3.4 dBm ( 0.46 mW) RX-pwr: -15.9 dBm ( 0.03 mW)

35. CWDM MUX/DEMUX 4 Ports Price idea 600 Euro

36. CWDM MUX/DEMUX 16 Ports

37. That's all Questions?

38. Project's ideas DOM 4-port GIGE card/Linux igb driver GateWay Optical/WiFi Energy – Router Power Reduction/Linux Energy – Ultracaps/Solar or UPS

39. Usage

40. No guru, no method, no teacher

41. A younger colleague Jamal