Low-Latency Software Rate Limiters for Cloud Networks

Slides:



Advertisements
Similar presentations
Quality of Service CS 457 Presentation Xue Gu Nov 15, 2001.
Advertisements

WHITE – Achieving Fair Bandwidth Allocation with Priority Dropping Based on Round Trip Time Name : Choong-Soo Lee Advisors : Mark Claypool, Robert Kinicki.
Mohammad Alizadeh, Albert Greenberg, David A. Maltz, Jitendra Padhye Parveen Patel, Balaji Prabhakar, Sudipta Sengupta, Murari Sridharan Modified by Feng.
Playback-buffer Equalization For Streaming Media Using Stateless Transport Prioritization By Wai-tian Tan, Weidong Cui and John G. Apostolopoulos Presented.
Congestion Control: TCP & DC-TCP Swarun Kumar With Slides From: Prof. Katabi, Alizadeh et al.
T. S. Eugene Ngeugeneng at cs.rice.edu Rice University1 COMP/ELEC 429 Introduction to Computer Networks Lecture 16: Congestion control II Slides used with.
IETF87 Berlin DCTCP implementation in FreeBSD
Congestion control in data centers
The Power of Explicit Congestion Notification Aleksandar Kuzmanovic Northwestern University
Explicit Congestion Notification ECN Tilo Hamann Technical University Hamburg-Harburg, Germany.
Defense: Christopher Francis, Rumou duan Data Center TCP (DCTCP) 1.
Congestion Control and Resource Allocation
1 Minseok Kwon and Sonia Fahmy Department of Computer Sciences Purdue University {kwonm, TCP Increase/Decrease.
ACN: Congestion Control1 Congestion Control and Resource Allocation.
1 Spring Semester 2007, Dept. of Computer Science, Technion Internet Networking recitation #8 Explicit Congestion Notification (RFC 3168) Limited Transmit.
Mohammad Alizadeh, Abdul Kabbani, Tom Edsall,
ICTCP: Incast Congestion Control for TCP in Data Center Networks∗
Curbing Delays in Datacenters: Need Time to Save Time? Mohammad Alizadeh Sachin Katti, Balaji Prabhakar Insieme Networks Stanford University 1.
3: Transport Layer3b-1 Principles of Congestion Control Congestion: r informally: “too many sources sending too much data too fast for network to handle”
TCP Enhancement for Random Loss Jiang Wu Computer Science Lakehead University.
CS640: Introduction to Computer Networks Aditya Akella Lecture 20 - Queuing and Basics of QoS.
Understanding the Performance of TCP Pacing Amit Aggarwal, Stefan Savage, Thomas Anderson Department of Computer Science and Engineering University of.
B 李奕德.  Abstract  Intro  ECN in DCTCP  TDCTCP  Performance evaluation  conclusion.
Distance-Dependent RED Policy (DDRED)‏ Sébastien LINCK, Eugen Dedu and François Spies LIFC Montbéliard - France ICN07.
Parameswaran, Subramanian
Congestion Control - Supplementary Slides are adapted on Jean Walrand’s Slides.
Fairness Attacks in the eXplicit Control Protocol Christo Wilson Christopher Coakley Ben Y. Zhao University of California Santa Barbara.
Chapter 12 Transmission Control Protocol (TCP)
Congestion Control for High Bandwidth-Delay Product Networks D. Katabi (MIT), M. Handley (UCL), C. Rohrs (MIT) – SIGCOMM’02 Presented by Cheng.
Queueing and Active Queue Management Aditya Akella 02/26/2007.
1 Sheer volume and dynamic nature of video stresses network resources PIE: A lightweight latency control to address the buffer problem issue Rong Pan,
1 Three ways to (ab)use Multipath Congestion Control Costin Raiciu University Politehnica of Bucharest.
Shuihai Hu, Wei Bai, Kai Chen, Chen Tian (NJU), Ying Zhang (HP Labs), Haitao Wu (Microsoft) Sing Hong Kong University of Science and Technology.
T3: TCP-based High-Performance and Congestion-aware Tunneling Protocol for Cloud Networking Satoshi Ogawa† Kazuki Yamazaki† Ryota Kawashima† Hiroshi Matsuo†
Streaming Video over TCP with Receiver-based Delay Control
Dzmitry Kliazovich, Fabrizio Granelli, University of Trento, Italy
Data Center TCP (DCTCP)
draft-briscoe-tsvwg-l4s-arch-00 B. Briscoe, K. De Schepper, M. Bagnulo
Incast-Aware Switch-Assisted TCP Congestion Control for Data Centers
Dzmitry Kliazovich, Fabrizio Granelli, University of Trento, Italy
Internet Networking recitation #9
On Queuing, Marking, and Dropping
Topics discussed in this section:
Approaches towards congestion control
Protocols for Low Power
Congestion Control: The Role of the Routers
Router-Assisted Congestion Control
Bob Briscoe, BT Murari Sridharan, Microsoft IETF-84 ConEx Jul 2012
Net 221D : Computer Networks Fundamentals
Congestion Control and Resource Allocation
TCP, XCP and Fair Queueing
Lecture 19 – TCP Performance
Queuing and Queue Management
So far, On the networking side, we looked at mechanisms to links hosts using direct linked networks and then forming a network of these networks. We introduced.
PUSH Flag A notification from the sender to the receiver to pass all the data the receiver has to the receiving application. Some implementations of TCP.
FAST TCP : From Theory to Experiments
AMP: A Better Multipath TCP for Data Center Networks
Advanced Computer Networks
COS 461: Computer Networks
Internet Networking recitation #10
Advanced Computer Networks
If both sources send full windows, we may get congestion collapse
Project-2 (20%) – DiffServ and TCP Congestion Control
Lecture 16, Computer Networks (198:552)
Congestion Control Reasons:
Transport Layer: Congestion Control
Congestion Control and Resource Allocation
Review of Internet Protocols Transport Layer
DDT: Mitigating the Competitiveness Difference of Data Center TCPs
When to use and when not to use BBR:
Presentation transcript:

Low-Latency Software Rate Limiters for Cloud Networks Keqiang He, Weite Qin, Qiwei Zhang, Wenfei Wu, Junjie Yang, Tian Pan, Chengchen Hu, Jiao Zhang, Brent Stephens, Aditya Akella, Ying Zhang

Bandwidth Allocation in Clouds Provide performance isolation Allocate bandwidth for tenants Prioritize applications Implemented by Software Rate Limiters Configured on NICs E.g., Linux Hierarchical Token Buffer filter (HTB) 10G server VM1 VM2 VM3 RL1 RL2 RL3 4Gbps 2Gbps RL: Rate Limiter

Software Rate Limiters Maintain a queue to absorb packets Assigned tokens Dequeue packets according to tokens Refresh tokens periodically according to bandwidth allocation

However, queuing delay is introduced Motivating Experiment Rate limiting number of flows

Software Rate Limiters introduce queuing latency TCP RTT is increased by 10X or even more Goal: To build a low-latency software rate limiter

Contents Background & Problem Statement Design Evaluation Conclusion & Future Work

Strawman Solution: Extending ECN into Rate Limiters VM DCTCP VM DCTCP VM DCTCP Rate Limiter Queues Marking Threshold Extending ECN into Rate Limiters: set ECN bits in IP header based on queue length

ECN+DCTCP: Lead to Throughput Oscillation Network Latency is reduced, but throughput oscillates

Reasons of Oscillation Control loop latency One RTT Inflated by in-network latency Coarse-grained ECN marking Marking segments, not packets 64KB segment ≈ 43 packets (1500B) Aggressive CWND Computation

Direct ECE Marking (DEM) 1. Control loop latency is almost ZERO Outgoing data packets sender receiver 2. Fine-grained congestion feedback Incoming TCP ACK Rate limiter queue

Further Improvement: get rid of ECN? ECN may not be enabled Tenant VM, Internet end hosts Solution: SPRING Replay congestion control algorithm at rate limiter Enforce computed CWND to RWND field in ACK packets

Contents Background & Problem Statement Design Evaluation Conclusion & Future Work

Performance of DEM Both low latency and high throughput are achieved using DEM DEM works ECN-enabled flows only

Performance of SPRING Both low latency and high throughput are achieved using SPRING SPRING works for both ECN and non-ECN flows

Conclusions Software rate limiters introduce network latency DCTCP+ECN causes throughput oscillation One-RTT control loop latency Segment-level marking Direct ECE Marking high bandwidth saturation, low latency, low oscillation SPRING gets rid of ECN Future work Fairness, overhead, compatibility

End Thanks! Q&A wenfeiwu@tsinghua.edu.cn