The LAC/UIC experiences through JGN2/APAN during SC04 Katsushi Kouyama and Kazumi Kumazoe Kitakyushu JGN Research Center / NiCT Robert L. Grossman, Yunhong.

Slides:



Advertisements
Similar presentations
Resource Allocation Subcommittee Meeting On Jan in Bangkok.
Advertisements

Appropriateness of Transport Mechanisms in Data Grid Middleware Rajkumar Kettimuthu 1,3, Sanjay Hegde 1,2, William Allcock 1, John Bresnahan 1 1 Mathematics.
Advanced satellite infrastructures in future global Grid computing: network solutions to compensate delivery delay Blasco Bonito, Alberto Gotta and Raffaello.
Streaming Video over the Internet
November 2006 TECO-WIS, Seoul 1 Definition of the Internet Network of networks –millions of smaller domestic, academic, business, and government networks.
1 School of Computing Science Simon Fraser University CMPT 771/471: Internet Architecture & Protocols TCP-Friendly Transport Protocols.
1 Optiputer High Performance Transport Protocols & Implementation Plans Ryan X. Wu, Andrew A. Chien, Eric Weigle, Nut Taesombut CSAG, CSE, UCSD 01/25/2005.
TCP/IP MODEL Maninder Kaur
Middleware Support for RDMA-based Data Transfer in Cloud Computing Yufei Ren, Tan Li, Dantong Yu, Shudong Jin, Thomas Robertazzi Department of Electrical.
Introduction 1-1 Chapter 3 Transport Layer Intro and Multiplexing Computer Networking: A Top Down Approach 6 th edition Jim Kurose, Keith Ross Addison-Wesley.
Dr. Kalpakis CMSC 621, Advanced Operating Systems. Fall 2003 URL: Distributed System Architectures.
EEC-484/584 Computer Networks Lecture 12 Wenbing Zhao (Part of the slides are based on Drs. Kurose & Ross ’ s slides for their Computer.
TCP friendlyness: Progress report for task 3.1 Freek Dijkstra Antony Antony, Hans Blom, Cees de Laat University of Amsterdam CERN, Geneva 25 September.
EEC-484/584 Computer Networks Lecture 14 Wenbing Zhao (Part of the slides are based on Drs. Kurose & Ross ’ s slides for their Computer.
EEC-484/584 Computer Networks Lecture 12 Wenbing Zhao (Part of the slides are based on Drs. Kurose & Ross ’ s slides for their Computer.
EEC-484/584 Computer Networks Lecture 14 Wenbing Zhao (Part of the slides are based on Drs. Kurose & Ross ’ s slides for their Computer.
Transport Level Protocol Performance Evaluation for Bulk Data Transfers Matei Ripeanu The University of Chicago Abstract:
Advanced UDP Sockets© Dr. Ayman Abdel-Hamid, CS4254 Spring CS4254 Computer Network Architecture and Programming Dr. Ayman A. Abdel-Hamid Computer.
Introduction 1 Lecture 14 Transport Layer (Congestion Control) slides are modified from J. Kurose & K. Ross University of Nevada – Reno Computer Science.
Udt.sourceforge.net 1 :: 50 BREAKING THE DATA TRANSFER BOTTLENECK Yunhong GU National Center for Data Mining University of Illinois at Chicago.
Chapter Two Application Layer Prepared by: Dr. Bahjat Qazzaz CS Dept. Sept
Presentation on Osi & TCP/IP MODEL
Udt.sourceforge.net 1 :: 50 BREAKING THE DATA TRANSFER BOTTLENECK Yunhong GU Laboratory for Advanced Computing National Center for Data.
Transport Layer3-1 Chapter 3 outline r 3.1 Transport-layer services r 3.2 Multiplexing and demultiplexing r 3.3 Connectionless transport: UDP r 3.4 Principles.
Transport Layer3-1 Chapter 3 outline 3.1 Transport-layer services 3.2 Multiplexing and demultiplexing 3.3 Connectionless transport: UDP 3.4 Principles.
Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.
Chapter 1: Introduction to Web Applications. This chapter gives an overview of the Internet, and where the World Wide Web fits in. It then outlines the.
The Transport Layer  introduction  fundamental problems in networking  communicating reliably over an unreliable channel  congestion and flow control.
On the Varieties of Clouds for Data Intensive Computing 董耀文 Antslab Robert L. Grossman University of Illinois at Chicago And Open Data.
UDT: UDP based Data Transfer Yunhong Gu & Robert Grossman Laboratory for Advanced Computing University of Illinois at Chicago Németh Felicián, Tarján Péter.
1 Next Few Classes Networking basics Protection & Security.
Optimizing UDP-based Protocol Implementations Yunhong Gu and Robert L. Grossman Presenter: Michal Sabala National Center for Data Mining.
UDT: UDP based Data Transfer Yunhong Gu & Robert Grossman Laboratory for Advanced Computing University of Illinois at Chicago.
UDT: UDP based Data Transfer Protocol, Results, and Implementation Experiences Yunhong Gu & Robert Grossman Laboratory for Advanced Computing / Univ. of.
E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.
Spring 2006Computer Networks1 Chapter 2 Network Models.
The Transmission Control Protocol (TCP) Application Services (Telnet, FTP, , WWW) Reliable Stream Transport (TCP) Connectionless Packet Delivery.
Example: Sorting on Distributed Computing Environment Apr 20,
UDT as an Alternative Transport Protocol for GridFTP Raj Kettimuthu Argonne National Laboratory The University of Chicago.
UDT UDT Bo Liu 11/1/2012 Inspired by Yunhong GU. OUTLINE Goal of UDT Three conditions Congestion control of UDT UDT Format Composable UDT.
Transport Layer3-1 Announcements r Collect homework r New homework: m Ch3#3,4,7,10,12,16,18-20,25,26,31,33,37 m Due Wed Sep 24 r Reminder: m Project #1.
Masaki Hirabaru Tsukuba WAN Symposium 2005 March 8, 2005 e-VLBI and End-to-End Performance over Global Research Internet.
HighSpeed TCP for High Bandwidth-Delay Product Networks Raj Kettimuthu.
Rate Control Rate control tunes the packet sending rate. No more than one packet can be sent during each packet sending period. Additive Increase: Every.
Masaki Hirabaru Network Performance Measurement and Monitoring APAN Conference 2005 in Bangkok January 27, 2005 Advanced TCP Performance.
Spring 2006Computer Networks1 Chapter 2 Network Models.
Udt.sourceforge.net 1 :: 23 Supporting Configurable Congestion Control in Data Transport Services Yunhong Gu and Robert L. Grossman Laboratory for Advanced.
ECEN “Internet Protocols and Modeling”, Spring 2012 Course Materials: Papers, Reference Texts: Bertsekas/Gallager, Stuber, Stallings, etc Class.
An Introduction to UDT Internet2 Spring Meeting Yunhong Gu Robert L. Grossman (Advisor) National Center for Data Mining University.
Transport Layer3-1 TCP throughput r What’s the average throughout of TCP as a function of window size and RTT? m Ignore slow start r Let W be the window.
Network and the internet Part eight Introduction to computer, 2nd semester, 2009/2010 Mr.Nael Aburas Faculty of Information.
Improving TCP Performance over Wireless Networks
INTERNET AND PROTOCOLS For more notes and topics visit: eITnotes.com.
Renesas Electronics America Inc. © 2010 Renesas Electronics America Inc. All rights reserved. Overview of Ethernet Networking A Rev /31/2011.
1 Advanced Transport Protocol Design Nguyen Multimedia Communications Laboratory March 23, 2005.
Peer-to-Peer Networks 13 Internet – The Underlay Network
An Analysis of AIMD Algorithm with Decreasing Increases Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data Mining.
Etere Video Assist The last step for a complete tapeless workflow Presented by: Emanuele Porfiri.
Accelerating Peer-to-Peer Networks for Video Streaming
Protocols and networks in the TCP/IP model initially.
TransPAC HPCC Engineer
PRESENTATION ON Sky X TECH. SUBMETTED TO:- SUBMETTED BY:-
BREAKING THE DATA TRANSFER BOTTLENECK
File Transfer Issues with TCP Acceleration with FileCatalyst
An Integrated Congestion Management Architecture for Internet Hosts
TCP Congestion Control
Beyond FTP & hard drives: Accelerating LAN file transfers
The Transport Layer Chapter 6.
STATEL an easy way to transfer data
A Protocol Reconfiguration Framework with Autonomic Aspects
Presentation transcript:

The LAC/UIC experiences through JGN2/APAN during SC04 Katsushi Kouyama and Kazumi Kumazoe Kitakyushu JGN Research Center / NiCT Robert L. Grossman, Yunhong Gu, Xinwei Hong, Michal Sabala, and David Handley University of Illinois of Chicago

Outline Introduction of NCDM / LAC Introduction of UDT Demos of UDT in SC2004 Request and Comment for JGN2 / APAN on SC2004

Introduction to NCDM/LAC NCDM: National Center for Data Mining –UIC: University of Illinois of Chicago –Standard development, Data Mining and Predictive modeling –organized into laboratories LAC: Laboratory for Advanced Computing LAC/UIC activities –data intensive computing –distributed computing –high performance computing and networking : UDT

TCP and AIMD TCP has been very successful in the Internet –AIMD (Additive Increase Multiplicative Decrease) Fair: max-min fairness Stable: globally asynchronously stable But, inefficient and not scalable –over high-speed wide area network RTT bias

UDT – UDP-based Data Transfer Protocol Application level transport protocol built above UDP Reliable data delivery Congestion control mechanisms General transport API; not a (file transfer) tool. Open source

UDT - Objectives Goals –Easy to install and use –Efficient for bulk data transfer –Fair –Friendly to TCP Non-goals –TCP replacement –Messaging service

UDT Architecture DATA ACK ACK2 NAK Sender Receiver Sender Receiver Pkt. Scheduling Timer ACK Timer NAK Timer Retransmission Timer Rate Control Timer Sender DATA

Demos of UDT in SC2004 Tokyo SC04 StarLight JGN2/APANAbileneSURFnet Tokyo Amsterdam Pittsburgh (SC04) Amsterdam 10Gbps Network Configuration

Demos of UDT in SC2004 Tokyo SC04 –Disk-to-Disk Transmission (1.5 Terabytes) –Sloan Digital Sky Survey (SDSS) data –Two Pair of machines SC Amsterdam/Tokyo –Memory-to-Memory Transmission –Pseudo data –Parallel flows

Results of Demos in SC Gbps real data file transfer between Pittsburgh and Tokyo. 16Gbps memory data transfer in and out Pittsburgh from/to Tokyo and Amsterdam. Winner of one of the bandwidth challenge awards –Best replacement of FedEx / UDP fairness award JGN2 Link

Request and Comment for usage of network on SC2004 Introduction of the Reservation System via web (not via ) We appreciate for the strong support and cooperation during SC2004 and our on- going collaboration work.

UDT Project: NCDM: Kitakyushu JGNII Research Center: Thank you... Related URLs