1. Engineering Patrick Crowley, John DeHart, Mart Haitjema, Fred Kuhns, Jyoti Parwatikar, Ritun Patney, Jon Turner, Charlie Wiseman, Mike Wilson, Ken Wong, Dave Zar Applied Research Lab, Washington University www.arl.wustl.edu/~jst Internet-Scale Overlay Hosting DEPLOYED Demonstration

2. 2 Engineering WASH Node

3. 3 Engineering SPP Components Chassis Switch 10x1 GbE CP External Switch net FPGA GPE NPE Line Card

4. 4 Engineering SPP Deployment 2 2 2

5. 5 Engineering Hosting Platform Details Chassis Switch 10x1 GbE CP External Switch net FPGA GPE NPE Line Card PLOS VM... General Purpose Processing Engine filter... filter Line Card lookupparseheader format... queues... Network Processing Engine

6. 6 Engineering GEC-6 Demonstrations GPE: »Forest prototype implemented in GPE »Use as many PlanetLab nodes as needed as data srcs »Data pkts contain PlanetLab hosts performance stats »Laptop at conference site also receives data pkts Dumps stats into a set of files that can be monitored at demo site. NPE: »IP demonstration showing off performance aspects of SPP »Use as many PlanetLab nodes as possible/needed as data srcs »Use multiple slices? »Use sp++/serv to generate data packets in tunnels »Monitor NPE stats via SPPMon (modified ONL RLI GUI) Run both demos Simultaneously!!! Use Gush (extends Plush) for pushing out code to end nodes.

7. 7 Engineering Forest Demo Configuration SALT KANS WASH Univ. of Utah PlanetLab hosts Kansas Univ. and Washington U. PlanetLab hosts Princeton Univ. PlanetLab hosts... Laptop at Conference in Salt Lake City MAX host(s)

8. 8 Engineering Forest Demo SALT Configuration SALT Univ. of Utah PlanetLab hosts planetlab4.flux.utah.edu planetlab7.flux.utah.edu planetlab5.flux.utah.edu planetlab6.flux.utah.edu planetlab2.flux.utah.edu (down) planetlab3.flux.utah.edu (down) Internet2 64.57.23.210 64.57.23.214 64.57.23.218 WASH KANS 10.1.1.1 10.1.2.1 10.1.1.2 10.1.2.2 10.1.7.1 10.1.8.1 10.1.7.2 10.1.8.2

9. 9 Engineering Forest Demo KANS Configuration KANS Kansas Univ. PlanetLab hosts kupl1.ittc.ku.edu vn3.cs.wustl.edu kupl2.ittc.ku.edu vn2.cs.wustl.edu Washington Univ. PlanetLab hosts Internet2 64.57.23.178 64.57.23.182 64.57.23.186 WASH SALT 10.1.1.1 10.1.2.1 10.1.3.1 10.1.4.1 10.1.1.2 10.1.2.2 10.1.3.2 10.1.4.2

10. 10 Engineering Forest Demo WASH Configuration WASH Princeton Univ. PlanetLab hosts planetlab-02.cs.princeton.edu planetlab-05.cs.princeton.edu planetlab-03.cs.princeton.edu planetlab-04.cs.princeton.edu planetlab-03.cs.princeton.edu down Internet2 64.57.23.194 64.57.23.198 64.57.23.202 KANS SALT 10.1.3.1 10.1.4.1 10.1.3.2 10.1.4.2 10.1.7.1 10.1.8.1 10.1.7.2 10.1.8.2

11. 11 Engineering Forest Demo SALT Configuration SALT Univ. of Utah PlanetLab hosts planetlab4.flux.utah.edu planetlab7.flux.utah.edu planetlab5.flux.utah.edu planetlab6.flux.utah.edu planetlab2.flux.utah.edu (down) planetlab3.flux.utah.edu (down)

12. 12 Engineering Forest Demo KANS Configuration KANS Kansas Univ. PlanetLab hosts kupl1.ittc.ku.edu vn3.cs.wustl.edu kupl2.ittc.ku.edu vn2.cs.wustl.edu Washington Univ. PlanetLab hosts

13. 13 Engineering Forest Demo WASH Configuration WASH Princeton Univ. PlanetLab hosts planetlab-02.cs.princeton.edu planetlab-05.cs.princeton.edu planetlab-03.cs.princeton.edu planetlab-04.cs.princeton.edu planetlab-03.cs.princeton.edu down

14. 14 Engineering Demo Configuration R1 R2 R3 300Mb/s 150Mb/s H1 H2 H3 H4 H5 H6 10.1.1.2 10.1.2.2 10.1.3.2 10.1.4.2 10.1.5.2 10.1.6.2

15. 15 Engineering Demo Configuration R1 R2 R3 Logical View CPGPE LC NPE System View CPGPE LC NPE C1 C3 R2 C2 R1 R3 PLC 150M 300M 10.1.x.2 1 2 3 4 5 6

16. 16 Engineering Defining a Slice R1 R2 R3 CPGPE LC NPE CPGPE LC NPE PLC C1 150M 300M 10.1.x.2 1 2 3 4 5 6

17. 17 Engineering Logging into Slice R1 R2 R3 CPGPE LC NPE CPGPE LC NPE PLC C1 150M 300M 10.1.x.2 1 2 3 4 5 6

18. 18 Engineering Downloading Files to Slice R1 R2 R3 CPGPE LC NPE CPGPE LC NPE PLC C1 NAT 150M 300M 10.1.x.2 1 2 3 4 5 6

19. 19 Engineering Configuring Fastpath and Interfaces R1 R2 R3 CPGPE LC NPE CPGPE LC NPE PLC C1 D1 150M 300M 10.1.x.2 1 2 3 4 5 6

20. 20 Engineering CPGPE LC NPE CPGPE LC NPE PLC C1 D1 Configuring Router Filters, Queues R1 R2 R3 150M 300M 10.1.x.2 1 2 3 4 5 6

21. 21 Engineering Sending Traffic Through Network Logical View CPGPE LC NPE System View CPGPE LC NPE C1 C3 D2 C2 D1 D3 PLC R1 R2 R3 150M 300M 10.1.x.2 1 2 3 4 5 6

22. 22 Engineering NP Blade SPI Switch xScale input... ME Mem Int SRAM SDRAM ME output External Interfaces RTM FIC Switch Interface TCAM TCAM Int NP A NP B Loc. Mem. TC... TC ALU thread contexts

23. 23 Engineering Line Card Datapath Lookup (2 ME) RxIn (2 ME) TxIn (2 ME) Queue Manager (4 ME) Key Extract (2 ME) Hdr Format (1 ME) TCAM DRAM SRAM external interfaces switch interface ingress side Lookup (2 ME) Key Extract (1 ME) RxEg (2 ME) TxEg (2 ME) Queue Manager (4 ME) Hdr Format (1 ME) DRAM SRAM egress side Flow Stats (2 ME) SRAM Filter/route and rate-control traffic Network Address Translation for outgoing flows Record traffic statistics for all outgoing flows

24. 24 Engineering NPE Datapath (version 1) Parse and Header Format include slice-specific code »parse extracts header fields to form lookup key »Hdr Format does any required post-lookup processing Lookup uses opaque key for TCAM lookup Multiple static code options can be supported »multiple slices per code option »each has own interfaces, filters, queues and private memory SRAM Lookup (1 ME) Rx (2 ME) Tx (2 ME) Queue Manager (4 ME) Parse (1 ME) Hdr Format (1 ME) TCAM DRAM SRAM Substr. Decap (1 ME) SRAM

25. 25 Engineering NPE Datapath (Version 2) Use both NPs, enabling 10 Gb/s throughput Integrated Decap,Parse,Lookup uses MEs more efficiently Multicast supported by substrate SRAM Tx (2 ME) TCAM Decap, Parse, Lookup, AddShim (8 MEs) SRAM from switch Rx (2 ME) SRAM to switch SRAM Queue Manager (4 MEs) Rx (2 ME) Tx (2 ME) Lookup & Copy (2 ME) HdrFmt (4 MEs) SPI Switch SRAM