1 On Dynamic Parallelism Adjustment Mechanism for Data Transfer Protocol GridFTP Takeshi Itou, Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.

Slides:

Advertisements

Similar presentations

Helping TCP Work at Gbps Cheng Jin the FAST project at Caltech

Advertisements

Appropriateness of Transport Mechanisms in Data Grid Middleware Rajkumar Kettimuthu 1,3, Sanjay Hegde 1,2, William Allcock 1, John Bresnahan 1 1 Mathematics.

1 The ns-2 Network Simulator H Plan: –Discuss discrete-event network simulation –Discuss ns-2 simulator in particular –Demonstration and examples: u Download,

Computer Networks Performance Metrics Computer Networks Term B10.

Web Server Benchmarking Using the Internet Protocol Traffic and Network Emulator Carey Williamson, Rob Simmonds, Martin Arlitt et al. University of Calgary.

Playback-buffer Equalization For Streaming Media Using Stateless Transport Prioritization By Wai-tian Tan, Weidong Cui and John G. Apostolopoulos Presented.

Playback-buffer Equalization for Streaming Media using Stateless Transport Prioritization Dan Tan, HPL, Palo Alto Weidong Cui, UC Berkeley John Apostolopoulos,

Copyright © 2005 Department of Computer Science CPSC 641 Winter PERFORMANCE EVALUATION Often in Computer Science you need to: – demonstrate that.

1 Updates on Backward Congestion Notification Davide Bergamasco Cisco Systems, Inc. IEEE 802 Plenary Meeting San Francisco, USA July.

XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.

Receiver-driven Layered Multicast S. McCanne, V. Jacobsen and M. Vetterli SIGCOMM 1996.

On Modeling Feedback Congestion Control Mechanism of TCP using Fluid Flow Approximation and Queuing Theory　 Hisamatu Hiroyuki Department of Infomatics.

60 GHz Flyways: Adding multi-Gbps wireless links to data centers

Computer Networks Performance Metrics Advanced Computer Networks.

Active Queue Management. Fundamental problem: Queues and TCP Queues –Queues are to absorb bursts of packets. –They are required for statistical multiplexing.

Internet Traffic Patterns Learning outcomes –Be aware of how information is transmitted on the Internet –Understand the concept of Internet traffic –Identify.

A simulation-based comparative evaluation of transport protocols for SIP Authors: M.Lulling*, J.Vaughan Department of Computer science, University college.

Computer Networks: Performance Measures1 Computer Network Performance Measures.

1 PERFORMANCE EVALUATION H Often in Computer Science you need to: – demonstrate that a new concept, technique, or algorithm is feasible –demonstrate that.

Performance and Robustness Testing of Explicit-Rate ABR Flow Control Schemes Milan Zoranovic Carey Williamson October 26, 1999.

Reduced TCP Window Size for Legacy LAN QoS Niko Färber July 26, 2000.

Practical TDMA for Datacenter Ethernet

1 Performance Evaluation of Ring- based Peer-to-Peer Virtual Private Network (RING-P2P-VPN) Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.

The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.

Grid simulation (AliEn) Network data transfer model Eugen Mudnić Technical university Split -FESB.

A Virtual Circuit Multicast Transport Protocol (VCMTP) for Scientific Data Distribution Jie Li and Malathi Veeraraghavan University of Virginia Steve Emmerson.

Advanced Network Architecture Research Group 2001/11/149 th International Conference on Network Protocols Scalable Socket Buffer Tuning for High-Performance.

1 Enabling Large Scale Network Simulation with 100 Million Nodes using Grid Infrastructure Hiroyuki Ohsaki Graduate School of Information Sci. & Tech.

© 2006 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.0 Identifying Application Impacts on Network Design Designing and Supporting Computer.

Modeling and Performance Evaluation of Network and Computer Systems Introduction (Chapters 1 and 2) 10/4/2015H.Malekinezhad1.

PPTTEST 10/6/ :29 1 IT Ron Williams Business Innovation Through Information Technology Networking.

On the Data Path Performance of Leaf-Spine Datacenter Fabrics Mohammad Alizadeh Joint with: Tom Edsall 1.

Computer Networks Performance Metrics. Performance Metrics Outline Generic Performance Metrics Network performance Measures Components of Hop and End-to-End.

© 2006 Cisco Systems, Inc. All rights reserved.Cisco PublicITE I Chapter 6 1 Identifying Application Impacts on Network Design Designing and Supporting.

The effect of router buffer size on the TCP performance K.E. Avrachenkov*, U.Ayesta**, E.Altman*, P.Nain*,C.Barakat* *INRIA - Sophia Antipolis, France.

Computer Networks Performance Metrics

Data Transfers in the Grid: Workload Analysis of Globus GridFTP Nicolas Kourtellis, Lydia Prieto, Gustavo Zarrate, Adriana Iamnitchi University of South.

ONLINE GAME NETWORK TRAFFIC OPTIMIZATION Jaewoo kim Youngho yi Minsik cho.

Understanding the Performance of Web Caching System with an Analysis Model and Simulation Xiaosong Hu Nur Zincir-Heywood Sep

27th, Nov 2001 GLOBECOM /16 Analysis of Dynamic Behaviors of Many TCP Connections Sharing Tail-Drop / RED Routers Go Hasegawa Osaka University, Japan.

High-speed TCP  FAST TCP: motivation, architecture, algorithms, performance (by Cheng Jin, David X. Wei and Steven H. Low)  Modifying TCP's Congestion.

1 Modeling and Performance Evaluation of DRED (Dynamic Random Early Detection) using Fluid-Flow Approximation Hideyuki Yamamoto, Hiroyuki Ohsaki Graduate.

Advanced Network Architecture Research Group 2001/11/74 th Asia-Pacific Symposium on Information and Telecommunication Technologies Design and Implementation.

ICOM 6115: Computer Systems Performance Measurement and Evaluation August 11, 2006.

1 Network Emulation Mihai Ivanovici Dr. Razvan Beuran Dr. Neil Davies.

1 Evaluation of Cooperative Web Caching with Web Polygraph Ping Du and Jaspal Subhlok Department of Computer Science University of Houston presented at.

1 On Scalable Edge-based Flow Control Mechanism for VPN Tunnels --- Part 2: Scalability and Implementation Issues Hiroyuki Ohsaki Graduate School of Information.

Analysis of QoS Arjuna Mithra Sreenivasan. Objectives Explain the different queuing techniques. Describe factors affecting network voice quality. Analyse.

Performance of Web Proxy Caching in Heterogeneous Bandwidth Environments IEEE Infocom, 1999 Anja Feldmann et.al. AT&T Research Lab 발표자 : 임 민 열, DB lab,

Measuring the Capacity of a Web Server USENIX Sympo. on Internet Tech. and Sys. ‘ Koo-Min Ahn.

1 Analysis of a window-based flow control mechanism based on TCP Vegas in heterogeneous network environment Hiroyuki Ohsaki Cybermedia Center, Osaka University,

August 23, 2001ITCom2001 Proxy Caching Mechanisms with Video Quality Adjustment Masahiro Sasabe Graduate School of Engineering Science Osaka University.

H. OhsakiITCom A control theoretical analysis of a window-based flow control mechanism for TCP connections with different propagation delays Hiroyuki.

Chapter 11.4 END-TO-END ISSUES. Optical Internet Optical technology Protocol translates availability of gigabit bandwidth in user-perceived QoS.

1 Evaluation of Cooperative Web Caching with Web Polygraph Ping Du and Jaspal Subhlok Department of Computer Science University of Houston presented at.

Ch 1: Simulation of Computer Networks. 1.1 Computer Networks and the Layering Concept Layering Concept Service Interface Protocol.

Tango1 Considering End-to-End QoS Constraints in IP Network Design and Planning M.Ajmone Marsan, M. Garetto, E. Leonardi. M. Mellia, E. Wille Dipartimento.

A special acknowledge goes to J.F Kurose and K.W. Ross Some of the slides used in this lecture are adapted from their original slides that accompany the.

1 Network Transport Layer: TCP Analysis and BW Allocation Framework Y. Richard Yang 3/30/2016.

1 Scalability and Accuracy in a Large-Scale Network Emulator Nov. 12, 2003 Byung-Gon Chun.

Accelerating Peer-to-Peer Networks for Video Streaming

Chapter 6 The Transport Layer The Transport Service & Elements of Transport Protocols.

Computer Systems Performance Evaluation

Performance Evaluation of Computer Networks

Computer Systems Performance Evaluation

Performance Evaluation of Computer Networks

The Transport Layer Chapter 6.

QoS routing Finding a path that can satisfy the QoS requirement of a connection. Achieving high resource utilization.

Requirements of Computing in Network

Presentation transcript:

1 On Dynamic Parallelism Adjustment Mechanism for Data Transfer Protocol GridFTP Takeshi Itou, Hiroyuki Ohsaki Graduate School of Information Sci. & Tech. Osaka University, Japan

2 1. State Goals and Define the System Goals Quantitatively evaluate performance of DPAM DPAM: Dynamic Parallelism Adjustment Mechanism Show pros/cons of four DPAM operations modes (MI, MI+, AIMD, GSS) Confirm feasibility of DPAM in realistic environment System Definition SUT (System Under Test) Grid computing environment including… Underlying IP network (routers and links) Grid middleware (GridFTP server and client) End hosts CUS (Component Under Study) DPAM for GridFTP client with four operation modes

3 2. List Services and Outcomes Services Provided Reliable data transfer between GridFTP server and client Outcomes High link bandwidth utilization? Low packet loss probability? Low packet transfer delay?

4 3. Select Metrics Speed (case of successful service case) Individual Goodput, latency, packet loss probability Global Queue occupancy, link utilization, packet loss probability Reliability (case of error) None Availability (case of unavailability) None

5 4. List Parameters System parameters Network related Topology Link bandwidth, latency, loss ratio Queue size, queue discipline Host related TCP socket buffer size MTU, TCP version DPAM related Operation mode (MI, MI+, AIMD, GSS) Control parameters: α, β, γ, η, N0, X, M Workload parameters # of GridFTP sessions, request arrival rate, file size distribution Background traffic pattern

6 5. Select Factors to Study System parameters Network related Topology Link bandwidth, latency, loss ratio Queue size, queue discipline Host related TCP socket buffer size MTU, TCP version DPAM related Operation mode (MI, MI+, AIMD, GSS) Control parameters: α, β, γ, η, N0, X, M Workload parameters # of GridFTP sessions, request arrival rate, file size distribution Background traffic pattern

7 6. Select Evaluation Technique Use analytical modeling? No Use simulation? Yes Use measurement of real system? No

8 7. Select Workload GridFTP # of GridFTP sessions: Request arrival rate: % of utilization File size distribution: random with avg. of 100MB – 1TB Background traffic % of the bottleneck link bandwidth

9 8. Design Experiments First Phase (many factors & few levels) System parameters Network related Topology (Butterfly) Link bandwidth (100M, 1Gbps), latency (10, 100ms), loss ratio Queue size (100, 1000packet), queue discipline (DropTail/RED) Host related TCP socket buffer size (64K,1MB) MTU, TCP version DPAM related Operation mode (MI, MI+, AIMD, GSS) Control parameters: α(.5, 1, 2), β(.25,.5,.75), γ(1.5, 2, 3), η(.7,.8,.9), N0(1, 2, 4), X(10, 100, 1000MB), M (1, 4, 8) Workload parameters # of GridFTP sessions (1, 10, 100), request arrival rate (50, 75%), file size distribution (100M, 10GB) Background traffic pattern (0%) Second Phase (few factors & many levels) not yet

10 9. Analyze and Interpret Data Quantitatively evaluate performance of DPAM When does DPAM work well/poorly? How does DPAM work well/poorly? Why does DPAM work well/poorly? Show pros/cons of four DPAM operation modes What are pros of each DPAM operation mode? What are cons of each DPAM operation mode? Which operation mode is most/least effective? Confirm feasibility of DPAM in realistic environment Is DPAM feasible in realistic environment?

Present Results link bandwidth latencyqueue size queue discipline TCP socket buffer size operation mode N0XM # of GridFTP sessions request arrival rate file size distribution background traffic pattern goodput latency packet loss probability (individual) queue occupancy link utilization packet loss probability (global)