1 Liquid Software Larry Peterson Princeton University John Hartman University of Arizona

2 Goals Build a High-Performance Active Router –no penalty for passive packets –pay only for the extensibility you need Demonstrate “Active Search” Application –Universal Search Interface (USI) –programmable query + aggregation in network

3 Project Roadmap Scout NetTV/NetCAM IP Router Web Server Firewall Joust NodeOS Active Search Next Generation Router TimeQ1/99

4 Scout OS Targeted at Network Appliances –network-attached devices, proxies, … Configurable –specialized for a particular appliance Path Abstraction –encapsulates I/O flow through the system Status –runs on Alpha and Pentium processors –currently distributing version 2.0

5 NetTV VGA WIMP MPEG RTPUDP IP ETH 3COMKBD NetTV End-to-End Paths - best effort - realtime Cycle Scheduler - based on WFQ - steal to meet deadlines

6 IP Router Best-effort Controlled-load RSVP Device Driver0 IPIP Eth Device Driver1 Link Schedulers - RED - RIO (DiffServ) - WFQ

7 Web Server Resource Accounting –all cycles & memory –minimal overhead Protection Domains –isolate untrusted code –at any module boundary Policy –protect against denial of service –limit resource usage SCSI FS HTTP TCP IP ETH

8 Proxy Firewall TCPIPTCPIP Net1 Net2 HTTP Proxy

9 Splicing Optimization Net1 Net2 IP++

10 Firewall Performance Throughput (pps)

11 Firewall Performance (cont) Throughput (pps)

12 Joust NFS RPC UDP TCP DNSWIMP VGAKBD IP ARP ETH JVM Status - supports JDK 1.1.x - runs on Scout, Linux, Solaris, Irix Toba Compiler - WAT: Java-to-C - JIT: on x86

13 Joust Performance Round Trip Latency (Microseconds)

14 NodeOS Multiplex Node Resources Features –optimized to forward packets –fine-grained (per-flow) multiplexing –permit cut-through flows –access to OS/HW-specific features Status –draft interface spec –prototype implementation Scout Joust NodeOS API ANTSPLANJANE... Execution Environments NodeOS

15 Next Generation Router Extensible Scalable Open Commodity Components Performance Robust

16 Rest of the Internet My Network Edge Routers R R Assumption Boundary Untrusted Reliable High Latency High BW High Power DiffServ Trusted Flaky Low Latency Low BW Low Power IntServ

17 Scalable Servers R Client (s) Server Nodes Balance Load Cache Data Protocol Translation Partition Data Stream

18 Router as LAN R R Authenticate Users Filter Packets Intrusion Detection

19 Active Networks

20 Traditional Routers + extensible + open – low throughput – not scalable + high throughput – not extensible – limited scalability – closed Line card (forwarding buffering) Line card (forwarding buffering) Line card (forwarding buffering) Line card (forwarding buffering) CPU Buffer memory Routing software w/ COTS OS Routing software w/ COTS OS NI as line card NI as line card NI as line card... Routing CPU Buffer memory Routing software w/ router OS Routing software w/ router OS

21 Key Ideas Closer integration of... –processing cycles –switching bandwidth Implement hierarchy of… –classification mechanisms –processing paths

22 Hardware Architecture 200Gbps Crossbar Switch Katmai CPU MEM NI with uP NI with uP Katmai CPU MEM NI with uP NI with uP Katmai CPU MEM NI with uP NI with uP Katmai CPU MEM NI with uP NI with uP Katmai CPU MEM NI with uP NI with uP Katmai CPU MEM NI with uP NI with uP

23 Scalable Router 200Gbps crossbar switch Katmai CPUMEM NI with uP NI with uP Katmai CPUMEM NI with uP NI with uP 200Gbps crossbar switch Katmai CPUMEM NI with uP NI with uP Katmai CPUMEM NI with uP NI with uP... Katmai CPUMEM NI with uP NI with uP Katmai CPUMEM NI with uP NI with uP 200Gbps crossbar switch... Katmai CPUMEM NI with uP NI with uP Katmai CPUMEM NI with uP NI with uP 200Gbps crossbar switch...

24 Hierarchy of Paths Output Port Slow/Programmable Fast/Fixed Hardware JIT Input Port Hardware Hardware +  JIT EE (user space) Kernel Line Card

25 Challenges Refine Architecture –balance hardware configuration –partition functionality Interfaces –hardware/OS –EE/OS (NodeOS Interface) Scheduling and Resource Allocation –cycle and link bandwidth –multi-switch channels –protect against denial-of-service attacks