On-the-Fly TCP Acceleration with Miniproxy Giuseppe Siracusano 12, Roberto Bifulco 1, Simon Kuenzer 1, Stefano Salsano 2, Nicola Blefari Melazzi 2, Felipe Huici 1 1 NEC Labs Europe 2 Univ. of Rome Tor Vergata/CNIT This work was partly funded by the EU in the context of the SUPERFLUIDITY project

2© NEC Corporation 2016 Studies say… ▌ Amazon estimates that 100ms increase of delay cuts revenue by 1% [1] ▌ +400ms reduced Google searches by 0.74% [2] In 2010, Google revenue from searches was 188’000’000 $ ▌ +500ms reduced bing revenue-per user by 1.2% [3] [1] Reducing Web Latency: the Virtue of Gentle Aggression, SIGCOMM ’13 [2] ASAP: A Low-Latency Transport Layer, CoNEXT ’11 [3] Halfback: Running Short Flows Quickly and Safely, CoNEXT ’15

3© NEC Corporation 2016 Employed (network) solutions ▌ Content Delivery Networks for static content E.g., Akamai ▌ Network transfer Optimization mobile operators deploy optimizations (proxies) of some sort [4] E.g., transcoding ▌ But, not always applicable E.g, ubiquitous encryption makes optimization harder [5] [4] Investigating Transparent Web Proxies in Cellular Networks, PAM ’15 [5] The Cost of the "S" in HTTPS, CoNEXT ‘14

4© NEC Corporation 2016 ▌ Can we accelerate the delivery for non- cachable (and potentially encrypted) content? ▌ Can we do it without building a dedicated infrastructure?

5© NEC Corporation 2016 TCP acceleration using a proxy ClientServer ClientServer Proxy ▌ The majority of web data transfers ends during the slow start phase [6] ▌ TCP’s conn. establ. and slow start depend on RTT ▌ Use proxies to cut the RTT: a known technique, please check the related work mentioned in the paper [6] Overclocking the Yahoo! CDN for Faster Web Page Loads, IMC ’11

6© NEC Corporation 2016 TCP acceleration using proxies ▌ Controller to manage the proxies network: Where to deploy proxies Which proxies to use for a given data transfer When to scale-up, scale-down the system ▌ High-performance and resource efficient proxy Supports many data transfers Reduces deployment costs Deployable in, e.g., cloud datacenters Miniproxy

7© NEC Corporation 2016 Miniproxy Proxy APP lwIP MiniOS Xen Hardware Optimized boot times from Manco et al. “The Case for the Superfluid Cloud” USENIX HotCloud ‘15 ▌ New bind() function to create pairs of “sockets” ▌ New callback called after SYN reception ▌ Definition of a new TCP option for chaining proxies ▌ TCP initial congestion window increased ▌ Tuning of receive and sending buffers Allocates resources, selects next-hop, copies data, supports extended functions lwIP = lightweightIP -

8© NEC Corporation 2016 Chaining proxies ▌ Proxies are explicitly addressed Easy to deploy What is the actual connection’s destination? ▌ New TCP Option stores the connection destination (optionally) stores the proxies to use ▌ The first proxy is more likely to be deployable on path as transparent proxy C P1P2P3 S Connection establishment TCP SYN + Option TCP SYN + Option TCP SYN Reads the destination from packet’s payload

9© NEC Corporation 2016 Miniproxy numbers ▌ 600 lines of C code ▌ No block device required ▌ 6MB of RAM to boot ▌ Boots in Xen-based clouds (e.g., Amazon EC2) ▌ As fast as state-of-the-art Linux proxies (e.g., Varnish)

10© NEC Corporation 2016 ▌ 100ms RTT, 100Mbps link, proxies evenly split the delay TCP acceleration with Miniproxy 30% 60%

11© NEC Corporation 2016 Conclusion and future work ▌ Miniproxy High throughput Minimal footprint Fast boot Extensible ▌ How can we use it? Massive consolidation Flexible scale-out, scale-in On the fly creation TCP acceleration ▌ Future work Use Miniproxy to implement wide-area TCP acceleration Extend Miniproxy to support other functions, e.g., compression Run Miniproxy on different devices, e.g., home gateways and embedded systems New use cases Virtualized Congestion Control / AC/DC TCP presented on Thursday A First Look into Transnational Routing Detours

12© NEC Corporation 2016 Related work in this (!) SIGCOMM ▌ Via: Improving Internet Telephony Call Quality Using Predictive Relay Selection [Presented in Networked Applications] ▌ Virtualized Congestion Control [Presented in Datacenters II] ▌ AC/DC TCP: Virtual Congestion Control Enforcement for Datacenter Networks [Presented in Datacenters II] ▌ A First Look into Transnational Routing Detours [Poster]