Data Transport Challenges for e-VLBI Julianne S.O. Sansa* * With Arpad Szomoru, Thijs van der Hulst & Mike Garret.

Slides:



Advertisements
Similar presentations
Appropriateness of Transport Mechanisms in Data Grid Middleware Rajkumar Kettimuthu 1,3, Sanjay Hegde 1,2, William Allcock 1, John Bresnahan 1 1 Mathematics.
Advertisements

TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot
FAST TCP Anwis Das Ajay Gulati Slides adapted from : IETF presentation slides Link:
August 10, Circuit TCP (CTCP) Helali Bhuiyan
1 TCP Vegas: New Techniques for Congestion Detection and Avoidance Lawrence S. Brakmo Sean W. O’Malley Larry L. Peterson Department of Computer Science.
TCP Vegas LAWRENCE S. BRAKMO SEAN W. O’MALLEY LARRY L. PETERSON PRESENTED TCP VEGAS IN 1994 PRESENTED BY CHUNG TRAN.
Improving TCP Performance over Mobile Ad Hoc Networks by Exploiting Cross- Layer Information Awareness Xin Yu Department Of Computer Science New York University,
1 End to End Bandwidth Estimation in TCP to improve Wireless Link Utilization S. Mascolo, A.Grieco, G.Pau, M.Gerla, C.Casetti Presented by Abhijit Pandey.
Restricted Slow-Start for TCP William Allcock 1,2, Sanjay Hegde 3 and Rajkumar Kettimuthu 1,2 1 Argonne National Laboratory 2 The University of Chicago.
Ahmed El-Hassany CISC856: CISC 856 TCP/IP and Upper Layer Protocols Slides adopted from: Injong Rhee, Lisong Xu.
Presentation by Joe Szymanski For Upper Layer Protocols May 18, 2015.
CUBIC : A New TCP-Friendly High-Speed TCP Variant Injong Rhee, Lisong Xu Member, IEEE v 0.2.
CUBIC Qian HE (Steve) CS 577 – Prof. Bob Kinicki.
Texas A&M University Improving TCP Performance in High Bandwidth High RTT Links Using Layered Congestion Control Sumitha.
Congestion Control Tanenbaum 5.3, /12/2015Congestion Control (A Loss Based Technique: TCP)2 What? Why? Congestion occurs when –there is no reservation.
Diagnosing Wireless TCP Performance Problems: A Case Study Tianbo Kuang, Fang Xiao, and Carey Williamson University of Calgary.
High-performance bulk data transfers with TCP Matei Ripeanu University of Chicago.
1 Minseok Kwon and Sonia Fahmy Department of Computer Sciences Purdue University {kwonm, TCP Increase/Decrease.
1 Chapter 3 Transport Layer. 2 Chapter 3 outline 3.1 Transport-layer services 3.2 Multiplexing and demultiplexing 3.3 Connectionless transport: UDP 3.4.
Introduction 1 Lecture 14 Transport Layer (Congestion Control) slides are modified from J. Kurose & K. Ross University of Nevada – Reno Computer Science.
Advanced Network Architecture Research Group 2001/11/149 th International Conference on Network Protocols Scalable Socket Buffer Tuning for High-Performance.
Transport Layer3-1 Chapter 3 outline r 3.1 Transport-layer services r 3.2 Multiplexing and demultiplexing r 3.3 Connectionless transport: UDP r 3.4 Principles.
Transport Layer3-1 Chapter 3 outline r 3.1 Transport-layer services r 3.2 Multiplexing and demultiplexing r 3.3 Connectionless transport: UDP r 3.4 Principles.
Transport Layer3-1 Chapter 3 outline 3.1 Transport-layer services 3.2 Multiplexing and demultiplexing 3.3 Connectionless transport: UDP 3.4 Principles.
Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.
1 Robust Transport Protocol for Dynamic High-Speed Networks: enhancing XCP approach Dino M. Lopez Pacheco INRIA RESO/LIP, ENS of Lyon, France Congduc Pham.
5th e-VLBI Workshop, September 2006, Haystack Observatory 1 A Simulation model for e-VLBI traffic on network links in the Netherlands Julianne Sansa*
Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 26, 2001.
TFRC: TCP Friendly Rate Control using TCP Equation Based Congestion Model CS 218 W 2003 Oct 29, 2003.
Implementing High Speed TCP (aka Sally Floyd’s) Yee-Ting Li & Gareth Fairey 1 st October 2002 DataTAG CERN (Kinda!)
UDT: UDP based Data Transfer Yunhong Gu & Robert Grossman Laboratory for Advanced Computing University of Illinois at Chicago.
UDT: UDP based Data Transfer Protocol, Results, and Implementation Experiences Yunhong Gu & Robert Grossman Laboratory for Advanced Computing / Univ. of.
Experience with Loss-Based Congestion Controlled TCP Stacks Yee-Ting Li University College London.
27th, Nov 2001 GLOBECOM /16 Analysis of Dynamic Behaviors of Many TCP Connections Sharing Tail-Drop / RED Routers Go Hasegawa Osaka University, Japan.
High TCP performance over wide area networks Arlington, VA May 8, 2002 Sylvain Ravot CalTech HENP Working Group.
High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.
Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.
HighSpeed TCP for High Bandwidth-Delay Product Networks Raj Kettimuthu.
Rate Control Rate control tunes the packet sending rate. No more than one packet can be sent during each packet sending period. Additive Increase: Every.
Udt.sourceforge.net 1 :: 23 Supporting Configurable Congestion Control in Data Transport Services Yunhong Gu and Robert L. Grossman Laboratory for Advanced.
Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.
Transport Layer3-1 TCP throughput r What’s the average throughout of TCP as a function of window size and RTT? m Ignore slow start r Let W be the window.
Murari Sridharan and Kun Tan (Collaborators: Jingmin Song, MSRA & Qian Zhang, HKUST.
Recent Congestion Control Research at UCLA Presenter: Cesar Marcondes PhD Candidate CS/UCLA Chicago, July IRTF/ICCRG Meeting Presenter: Cesar Marcondes.
Transport Layer 3-1 Chapter 3 Transport Layer Computer Networking: A Top Down Approach 6 th edition Jim Kurose, Keith Ross Addison-Wesley March
Compound TCP in NS-3 Keith Craig 1. Worcester Polytechnic Institute What is Compound TCP? As internet speeds increased, the long ‘ramp’ time of TCP Reno.
VLBI_UDP An application for transferring VLBI data via UDP protocol Simon Casey e-VLBI meeting, Haystack 20 Sep 2006.
Data Transport Challenges for e-VLBI Julianne S.O. Sansa* * With Arpad Szomoru, Thijs van der Hulst & Mike Garret.
Murari Sridharan Windows TCP/IP Networking, Microsoft Corp. (Collaborators: Kun Tan, Jingmin Song, MSRA & Qian Zhang, HKUST)
Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.
Fast TCP Cheng JinDavid WeiSteven Low Caltech Infocom, March 2004 Offense Team: Santa & Animesh.
Peer-to-Peer Networks 13 Internet – The Underlay Network
Increasing TCP's CWND based on Throughput draft-you-iccrg-throughput-based-cwnd-increasing-00 Jianjie You IETF92 Dallas.
Masaki Hirabaru (NICT) and Jin Tanaka (KDDI) Impact of Bottleneck Queue on Long Distant TCP Transfer August 25, 2005 NOC-Network Engineering Session Advanced.
1 Three ways to (ab)use Multipath Congestion Control Costin Raiciu University Politehnica of Bucharest.
1 Stochastic Ordering for Internet Congestion Control Han Cai, Do Young Eun, Sangtae Ha, Injong Rhee, and Lisong Xu PFLDnet 2007 February 7, 2007.
ICTCP: Incast Congestion Control for TCP in Data Center Networks By: Hilfi Alkaff.
28/09/2016 Congestion Control Ian McDonald (with many other WAND members)
TCP Vegas Congestion Control Algorithm
Chapter 3 outline 3.1 transport-layer services
Receiver Assistant Congestion Control in High Speed and Lossy Networks
Chapter 3 outline 3.1 Transport-layer services
Transport Protocols over Circuits/VCs
Khiem Lam Jimmy Vuong Andrew Yang
TransPAC HPCC Engineer
TCP Cubic CS577 Brett Levasseur 10/1/2013.
Chapter 3 outline 3.1 Transport-layer services
TCP flow and congestion control
Anant Mudambi, U. Virginia
Review of Internet Protocols Transport Layer
Presentation transcript:

Data Transport Challenges for e-VLBI Julianne S.O. Sansa* * With Arpad Szomoru, Thijs van der Hulst & Mike Garret

27 October Outline Network performance tests Simulation results conclusion

27 October Network Performance Measurements Investigate critically several connections established. Wire speeds suggests much higher throughput than what application data realises. TCP Congestion Control algorithm (AIMD) –SSACK:Cwnd  Cwnd +1 –CAACK:Cwnd  Cwnd + 1/Cwnd DROP: Cwnd  Cwnd -1/2*Cwnd Cwnd = max. # packets that TCP injects into network before receiving ACK. Cwnd optimal ~ Throughput *RTT Cwnd average = 1.22*MSS/sqrt (p) [Floyd & Fall (1999), Padhya et.al (1998)]

27 October Specific Questions How much bandwidth is available to the these TCP connections? Is it what is seen by the app? If it is less than the theoretic available b/w, what is the bottleneck? How do we minimise this bottleneck? How do multiple TCP connections share available bandwidth? What is the stability of these TCP connection (repeatability /predectability)?

27 October Results with web100 File transfer of 10 GB & 1GB file Modified file transfer (app socket buffers) Memory-memory with iperf

27 October Cwnd, RwinRcvd & for a file transfer / memory-memory

27 October Achieved/Available throughput

27 October Summary Test results Memory –MemoryFile transferModified file transfer Disk2net-net2file (yet to be done) Cwnd (bytes) TCP (Mbps) UDP (Mbps) Cwnd (bytes) TCP (Mbps) Cwnd (bytes) TCP (Mbps) CwndTCPUDP Bench via Amste rdam

27 October NIC RTT/loss discrepancies

27 October The bottlenecks Application socket buffers Hardware (PCI bus limit, NICs) The OS (more or less tuned optimally) The transport protocol (TCP) –Window limits –Retransmissions –Interface stalls –Vendor specific implementations (Other Reductions)

27 October Transport Protocol Analysis Already many proposals to alter this behaviour: HighSpeed TCP, scalable TCP, Westwood TCP, HTCP, Vegas, FAST, BIC, C-TCP

27 October Loss-based, delay-based,or equation-based? Which way do we go? Consider getting the best out each world/Allow the application to dynamically detect network conditions & decide which algorithm to use.

27 October Preliminary Simulation results Simulated file transfer of bench via Amsterdam scenario TCP UDPHSTCPFAST Cwnd (bytes) 1, n/a4, T/put (bps) 61,600,000960,000,00061,600,000310,870,560

27 October Cwnd for the simulated protocols

27 October Achieved Throughput for the simulated protocols

27 October Conclusions & further work Hardware (PCI bus, NICs,) on end systems as well as the application (buffers) need to be optimised. Model TCP data flows & relate flow analysis with correlation. More simulation work on Transport Protocol analysis (response function)

27 October References Floyd & Fall (1999) “Promoting the use of end-to- end congestion control in the internet”, IEEE/ ACM Trans. on Networking, August Padhya et.al (1998) “Modeling TCP throughput: A Simple model and its empirical validation” in Proc ACM SigCOMM 1998 Antony et.al(2004) “Exploring Practical Limitations of TCP over Transatlantic Networks” submitted Elsevier Science(2004)