Grid simulation (AliEn) Network data transfer model Eugen Mudnić Technical university Split -FESB.

Slides:

Advertisements

Similar presentations

A Survey of Recent High Speed TCP Variants

Advertisements

TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot

TCP Vegas: New Techniques for Congestion Detection and Control.

Playback-buffer Equalization For Streaming Media Using Stateless Transport Prioritization By Wai-tian Tan, Weidong Cui and John G. Apostolopoulos Presented.

1 Communication Networks Kolja Eger, Prof. Dr. U. Killat 1 From Packet-level to Flow-level Simulations of P2P Networks Kolja Eger, Ulrich Killat Hamburg.

Grid simulation (AliEn) Eugen Mudnić Technical university Split -FESB.

CS640: Introduction to Computer Networks Mozafar Bag-Mohammadi Lecture 3 TCP Congestion Control.

Bilal Gonen University of Alaska Anchorage Murat Yuksel University of Nevada, Reno.

CUBIC Qian HE (Steve) CS 577 – Prof. Bob Kinicki.

Network Border Patrol: Preventing Congestion Collapse and Promoting Fairness in the Internet Celio Albuquerque, Brett J. Vickers, Tatsuya Suda 1.

Advanced Computer Networking Congestion Control for High Bandwidth-Delay Product Environments (XCP Algorithm) 1.

XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.

TCP Stability and Resource Allocation: Part II. Issues with TCP Round-trip bias Instability under large bandwidth-delay product Transient performance.

Fair queueing and congestion control Jim Roberts (France Telecom) Joint work with Jordan Augé Workshop on Congestion Control Hamilton Institute, Sept 2005.

Simulation of O2 offline processing - tools and models Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture Eugen Mudnić.

Modeling of Web/TCP Transfer Latency Yujian Peter Li January 22, 2004 M. Sc. Committee: Dr. Carey Williamson Dr. Wayne Eberly Dr. Elena Braverman Department.

Congestion Control Tanenbaum 5.3, /12/2015Congestion Control (A Loss Based Technique: TCP)2 What? Why? Congestion occurs when –there is no reservation.

Explicit Congestion Notification ECN Tilo Hamann Technical University Hamburg-Harburg, Germany.

End-to-End Analysis of Distributed Video-on-Demand Systems Padmavathi Mundur, Robert Simon, and Arun K. Sood IEEE Transactions on Multimedia, February.

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

ISCSI Performance in Integrated LAN/SAN Environment Li Yin U.C. Berkeley.

Video Streaming Over Wireless: Where TCP is Not Enough Xiaoqing Zhu, Jatinder Pal Singh and Bernd Girod Information Systems Laboratory Stanford University.

High-performance bulk data transfers with TCP Matei Ripeanu University of Chicago.

Multiple Sender Distributed Video Streaming Thinh Nguyen, Avideh Zakhor appears on “IEEE Transactions On Multimedia, vol. 6, no. 2, April, 2004”

1 Traffic Sensitive Quality of Service Controller Masters Thesis Submitted by :Abhishek Kumar Advisors: Prof Mark Claypool Prof Robert Kinicki Reader:

Traffic Sensitive Active Queue Management - Mark Claypool, Robert Kinicki, Abhishek Kumar Dept. of Computer Science Worcester Polytechnic Institute Presenter.

1 Probabilistic Packet Scheduling (PPS): Achieving Proportional Share Bandwidth Allocation for TCP Flows Ming Zhang, Randy Wang, Larry Peterson Department.

1 TCP-LP: A Distributed Algorithm for Low Priority Data Transfer Aleksandar Kuzmanovic, Edward W. Knightly Department of Electrical and Computer Engineering.

The Effect of Router Buffer Size on HighSpeed TCP Performance Dhiman Barman Joint work with Georgios Smaragdakis and Ibrahim Matta.

Reducing the Buffer Size in Backbone Routers Yashar Ganjali High Performance Networking Group Stanford University February 23, 2005

Anthony Trinh and Rich Zieminski Department of Computer Science, Columbia University { akt2105, rez2107

Medium Start in TCP-Friendly Rate Control Protocol CS 217 Class Project Spring 04 Peter Leong & Michael Welch.

Performance and Robustness Testing of Explicit-Rate ABR Flow Control Schemes Milan Zoranovic Carey Williamson October 26, 1999.

Transport Level Protocol Performance Evaluation for Bulk Data Transfers Matei Ripeanu The University of Chicago Abstract:

Enhancing TCP Fairness in Ad Hoc Wireless Networks Using Neighborhood RED Kaixin Xu, Mario Gerla University of California, Los Angeles {xkx,

Congestion Control for High Bandwidth-Delay Product Environments Dina Katabi Mark Handley Charlie Rohrs.

1 A State Feedback Control Approach to Stabilizing Queues for ECN- Enabled TCP Connections Yuan Gao and Jennifer Hou IEEE INFOCOM 2003, San Francisco,

Comparing the Accuracy of Network Simulators for Packet-Level Analysis using a Network Testbed Chaudhry Usman Ali UNB, Fredericton.

1 Performance Evaluation of Ring- based Peer-to-Peer Virtual Private Network (RING-P2P-VPN) Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.

The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.

A Hybrid Systems Modeling Framework for Fast and Accurate Simulation of Data Communication Networks João P. Hespanha University of Calif. Santa Barbara.

Transport Layer 4 2: Transport Layer 4.

Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.

Improving Capacity and Flexibility of Wireless Mesh Networks by Interface Switching Yunxia Feng, Minglu Li and Min-You Wu Presented by: Yunxia Feng Dept.

Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.

High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.

Congestion Control in CSMA-Based Networks with Inconsistent Channel State V. Gambiroza and E. Knightly Rice Networks Group

1 Modeling and Performance Evaluation of DRED (Dynamic Random Early Detection) using Fluid-Flow Approximation Hideyuki Yamamoto, Hiroyuki Ohsaki Graduate.

Requirements for Simulation and Modeling Tools Sally Floyd NSF Workshop August 2005.

1 On Scalable Edge-based Flow Control Mechanism for VPN Tunnels --- Part 2: Scalability and Implementation Issues Hiroyuki Ohsaki Graduate School of Information.

1 On Dynamic Parallelism Adjustment Mechanism for Data Transfer Protocol GridFTP Takeshi Itou, Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.

TCP with Variance Control for Multihop IEEE Wireless Networks Jiwei Chen, Mario Gerla, Yeng-zhong Lee.

Self-generated Self-similar Traffic Péter Hága Péter Pollner Gábor Simon István Csabai Gábor Vattay.

A Model-Driven Multi-Paradigm Integrated Simulation Framework For Analysis of Communication Networks Amogh Kavimandan 1, Marina Thottan 2, Wonsuck Lee.

TCP transfers over high latency/bandwidth networks Internet2 Member Meeting HENP working group session April 9-11, 2003, Arlington T. Kelly, University.

Performance Engineering E2EpiPEs and FastTCP Internet2 member meeting - Indianapolis World Telecom Geneva October 15, 2003

We used ns-2 network simulator [5] to evaluate RED-DT and compare its performance to RED [1], FRED [2], LQD [3], and CHOKe [4]. All simulation scenarios.

Chapter 11.4 END-TO-END ISSUES. Optical Internet Optical technology Protocol translates availability of gigabit bandwidth in user-perceived QoS.

Development of a QoE Model Himadeepa Karlapudi 03/07/03.

TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot

XCP: eXplicit Control Protocol Dina Katabi MIT Lab for Computer Science

An Analysis of AIMD Algorithm with Decreasing Increases Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data Mining.

Delay-based Congestion Control for Multipath TCP Yu Cao, Mingwei Xu, Xiaoming Fu Tsinghua University University of Goettingen.

Corelite Architecture: Achieving Rated Weight Fairness

Impact of New CC on Cross Traffic

CUBIC Marcos Vieira.

Queue Dynamics with Window Flow Control

Stability of Congestion Control Algorithms Using Control Theory with an application to XCP Ioannis Papadimitriou George Mavromatis.

Resource Pooling A system exhibits complete resource pooling if it behaves as if there was a single pooled resource. I propose ‘extent of resource pooling’

Presentation transcript:

Grid simulation (AliEn) Network data transfer model Eugen Mudnić Technical university Split -FESB

2 Outline  AliEn simulation - AliEnSim  Network data transfer model for the Grid simulation model description model accuracy & performance

3 AliEnSim GRID simulation  Discrete Event simulation (DES)  Simulates AliEn (like) grid data processing/storage  It can be used for:  planning of resource requirements (network, storage, CPU)  identifying system bottlenecks  testing system scalability ...

4 AliEnSim

5

6

7 low efficiency (large RTT & congestion)

8 Network data transfer model  Packet based (ns-2) – accurate, slow for grid simulation, many configuration parameters  Fluid based – faster but not satisfactory for the grid simulation, many configuration parameters  Approximate-coarse grained model ?  Requirements: fast (at least two orders of magnitude faster than ns-2) minimal number of parameters -> assumption of properly configured network satisfactory accurate for the grid simulator -> exhibits most important network limitations

9 Very simple model Network as a set of links shared by changeable number of data streams CE1 SE1 SE2 SE3 100 MB/s 30MB/s 50 MB/s 30 MB/s 1 GB/s 100 MB/s LAN1 LAN2 LAN3 links with capacity ( C1,..CL ) N streams, every stream has a predefined transfer route ri  {1,…,L} Every stream has equal priority Stream bandwidth allocation must conform to: Stream instantaneously allocate available capacity

time[s] MBit/s 0.6ms 1.4ms 2.8ms 4.0ms 5.4ms 16.4ms 60.4ms 200.4ms TCP stream cannot instantaneously allocate available capacity TCP bandwith allocation (BIC)

11 AGNS- approximate grid network simulation CE1 SE2 SE3 200MB/s RTT=50ms 200MB/s RTT=5ms 1 GB/s 100 MB/s LAN1 LAN2 LAN3 more complicated bandwith allocation alghoritm (not described here) includes TCP unfairness efect includes TCP bandwith allocation dynamic (startup phase) bottleneck

12 AGNS- slow start approximation  Startup phase will be simulated as: delayed start of file transfer limited bandwidth allocation for a small files  TCP fairness : data flow allocated bandwidth is a function of streams RTT at the time of data flow start

13 a) Complete transfer is finished during startup phase Data flow can reach only reduced bandwidth allocation Φsli. Di = file size

14 b) Partial transfer during startup phase where D’ i is number of bytes transferred until time t s

15 AGNS- approximative grid network simulation relative aggregate performance metrics will be maintained by data flow bandwidth allocation as a function of its RTT ratio to other concurrent data flows RTT  state of the simulator is calculated only 3-times for each transfer !!!  Results of AGNS are compared to Ns-2 simulation at aggregate level.

16 Network test topology & performance ns-2AGNS 400files/91GByte/1GBps1320 s0.37 s 3800files/853GByte/10G Bps 6180 s1.74 s

17 1GB bottleneck 5ms/10ms/20ms/30ms (fairness) aggregate throughput

18 CE1 RTT=5ms CE2 RTT=10ms CE3 RTT=20msCE4 RTT=30ms throughput

19 10GB bottleneck 5ms/10ms/20ms/30ms aggregate throughput

20 CE1 RTT=5ms CE2 RTT=10ms CE3 RTT=20msCE4 RTT=30ms throughput

21  simulation using AGNS model is fast  it looks enough accurate to exhibit realistic congestion effects of the network traffic  should be compared with real measurements Conclusion