1. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 An Analysis of TCP Startup over an Experimental DVB-RCS Platform Alberto Gotta, Francesco Potortì, Raffaello Secchi Italian National Research Council (CNR) Istituto di Scienza e Tecnologie dellInformazione A. Faedo (ISTI)

2. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Outline The Skyplex satellite platform TCP measurement over Skyplex Focusing on the TCP startup phase –The congestion window model –Transfer time during startup Consideration on parameters choice Conclusions

3. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Assumptions High performance in satellite mesh networks –Powerful error-correcting scheme and adaptive modulation and coding (DVB-S2) –High link availability: transmission virtually immune from packet losses for most of time Share of satellite bandwidth (DVB-RCS) –Demand Assigned Multiple Access (DAMA) schemes used to share uplink channel (CRA, RBDC, VBDC, FCA)

4. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Research topics (Motivations) TCP issues –TCP universally used for reliable data delivery across the Internet –TCP startup phase is critical The short flows (web, interactive applications, etc.) are concluded within the Slow- Start phase Current DAMA Implementations –Satellite bandwidth allocation schemes do not consider the efficiency of short connection transfers –The long loop delay of satellite links slows down the Slow-Start phase Bandwidth assigned on the basis of stations requests, which in turn depend on the current transmission rate (transmission backlog respectively) Demand-assignment delay is at least 500 ms on satellite links Since the throughput of TCP increases at each RTT, the allocated bandwidth is always less than the offered traffic

5. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Skyplex TM platform overview Skyplex Data from Eutelsat –Enables low-cost meshed networks –Support a range of data, television and audio applications Eutelsat will offer its Skyplex Data service –Ka band transponders on its Hot Bird 6 satellite located at 13° E. –Wide bandwidth the downlink stream is up to 36 Mb/s from 6 carriers User Terminal –User terminals can employ small antennas 90 cm –Low-power consumption (2 W SSPAs) –The terminal is a compact unit (30 cm wide by 4.5 cm high) –Low-cost equipment Skyplex Data bandwidth access –Permanent bandwidth assignment –Multiple access mode (Demand Assignment Multiple Access)

6. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Test-bed platform DVB-RCS DVB-S channel capacity2.1 Mb/s active stations18 available bandwidth~1.2 Mb/s slots per frame48 frame duration273 ms bandwidth granularity44 kb/s guaranteed bandwidth44 kb/s mean RTT840 ms testbed specifications LAN Ethernet LAN Ethernet Medium Access Control TDMA/TDM The bandwidth allocation uses a DAMA scheme It implements a variant of Rate Based Dynamic Capacity (RBDC)

7. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Experiment Setup Linux 2.6 TCP/IP stack –Windows scale option enable net.ipv4.tcp_window_scaling –Sack option was enabled/disabled net.ipv4.tcp_sack –Transmitting and receiving buffer are sized big enough not to limit TCP throughput FreeBSD 5.4 TCP/IP stack –Uses standard settings

8. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Linux 2.6 without SACK The bottleneck buffer fills up at the end of the Slow Start phase –many packet losses when the buffer overflows The subsequent Fast Recovery phase is not fast enough to avoid a timeout TCP retransmits a high number of already transmitted packets, whose duplicate ACKs do not contribute to increasing the congestion window

9. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 TCP Newreno on DAMA

10. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Linux 2.6 with SACK Linux with SACK behaves much better –The loss recovery is fast thanks to SACKs The resulting throughput is, on average, as fast as the channel permits The flow of packets is very irregular

11. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 FreeBSD 5.4 stack FreeBSD estimates available bandwidth using ACK interarrival times –the estimate is used to cap the rate of packet transmission A single connection occupies almost all the channel capacity The packet rate is extremely regular without even a loss The RTT is only slightly greater than the minimum.

12. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Focusing on TCP Startup Relevant parameters observed during TCP startup –Initial Window (IW) Linux 2.6 sets the Initial Window to three packets according to the specification of RFC 3390 FreeBSD 5.4 conservatively sets the IW to one packet –Round Trip Time (RTT) –Allocation Delay the delay between making a request and receiving the respective allocation –Delayed ACK

13. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 TCP Startup Comparison We analyze the first 20 sec of transmission –about 1.5MB are transmitted during this phase, which is enough for most interactive applications The only significant difference between TCP flavors during startup is the Initial Window FreeBSD TCP Linux TCP bandwidth limited increasing phase

14. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Basic DAMA scheme Each station periodically submits to a master station an allocation request based on the incoming traffic rate or traffic backlog at the terminal –The time interval between subsequent allocation requests is called request period (T r ) The master station collects the request of all the active stations, computes a burst time plan and broadcasts it back to the terminals –The allocation period (T a ) is the time interval between subsequent allocation assignments When the stations receive the burst time plan, they get to know their allocation –The allocation delay is the overall time between making a request and receiving the corresponding allocation

15. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Timeline for DAMA scheme the terminal issues the request master terminal the request is delivered mean request period (T r /2) half RTT ( ) the request is received the allocation t is delivered mean allocation period (T a /2) the allocation is received Average allocation delay half RTT ( )

16. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Interaction of DAMA with TCP During the Slow Start phase the growth of the segment transmit rate depends on the ACK reception rate The ACK reception rate depends on the rate the other TCP end receives the segments, that is, on the bandwidth allocation When using DAMA, the bandwidth allocation received by the earth station has been computed based on the segment transmit rate that the TCP connection had an allocation delay before (at least 500 ms) Thus, the larger the allocation delay, the slower the growth of the congestion window –DAMA delays the time the bandwidth is available to TCP connections, which in turns delay congestion window growth

17. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Modeling TCP startup on DAMA We model the performance of TCP during startup on a rate-based DAMA We derive the expression of the congestion window evolution as a function of the initial window, RTT and allocation delay We show that the congestion window evolution is similar to the one without DAMA, but with an increased RTT Using the expression for the congestion window, we estimate the connection completion time for short flows

18. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Model Assumptions Single greedy connection No losses due to corruption –ideal channel conditions (e.g. clear sky) No throughput limitations –receiving and transmitting buffer sufficiently large Satellite link idle before connection starts Slow Start threshold big enough that the Slow Start phase does not end before the channel is saturated No delayed ACK –Modern TCP implementations disable DelACK during startup –Even if DelACK is enabled, the ACK inter-arrival time is larger that DelACK retransmission timeout

19. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Congestion Window Equation During Slow-Start phase the congestion window growth is equal to the ACK reception rate If enough space is available on the channel, the resource scheduler assign the requested bandwidth w(t) congestion window in segments a(t) number of ACK in [0:t] ACK rate Requested/Assigned bandwidth

20. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Model Analysis We solve this equation using a second order approximation of its Laplace transform and we obtain a closed form representation of congestion window The expression is valid for 0 < t < t s, where t s is the time when the TCP rate equals the available capacity For t > t s the ACK rate is capped by and the growth of the congestion window depends on the exact implementation tsts time SN

21. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Equivalent RTT for rate-based DAMA –The equivalent RTT is an increasing function of ρ, that is, of allocation delay –Rate-based DAMA slows down the Slow Start phase of TCP connections –This effect can be partially compensated by requesting more bandwidth for starting connections This expression of w(t) just derived is equivalent to having a fixed allocation policy but with increased RTT: Equivalent RTT

22. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Transfer Time During Startup From the expression for w(t), we can estimate the amount of data N(t) transferred in the time interval [0:t] By integrating the TCP throughput (w(t)/, we obtain the time D required to transmit N packets as a function of the initial window W 0, the round trip time and the value of T

23. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Transfer Time Comparison actual values constant allocation max DAMA performance

24. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Consideration on Parameter Choice The harmful effect of DAMA on TCP startup could be compensated by assigning more bandwidth to a starting TCP connection –Ideally, a DAMA scheduler should provide enough bandwidth to double the congestion window every RTT The terminal requests k times the measured incoming traffic rate when detects a new connections is initiated from that station Using our model, we determine the condition over k allowing to exploit the assigned bandwidth share without buffering and without wasting channel resources –In the case of Skyplex, we estimate k=4.8

25. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Connection Duration The completion time improves with increasing k (down to a value of k near to 4.8) Improvements are most significant for bigger data volume

26. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Assigned Slot Utilization The channel utilization worsens with increasing k Worsening is most significant for smaller volume of data

27. Istituto di Scienza e Tecnologie dellInformazione A Faedo Madrid –September 15th 2006 Raffaello Secchi – IWSSC06 Conclusions Experimental and simulative studies on Skyplex Data highlights how rate-based DAMA can significantly slow down the transmission of small volume of data using TCP We presented an analytical modeling of this phenomenon –we show it is similar to what would happen on a traditional fixed-allocation satellite system if the RTT was increased A small change in allocation policy can bring significant benefits to short TCP connections in terms of channel utilization Further studies required in order to modify the allocation algorithm to make it more responsive to starting TCP connections