Networking for grid Network capacity Network throughput

Slides:



Advertisements
Similar presentations
DataGRID France – 12 Feb WP 7 High-Throughput Transfers with GridFTP EU Demo : GridFTP between CERN and NIKHEF New TCP stack implementation –High-Speed.
Advertisements

1 Grid networking in EU DataGRID TERENA conference Limerick - 5 th of June 2002 Pascale PRIMET Manager of the workpackage Network of the DataGRID project.
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
TCP transfers over high latency/bandwidth network & Grid TCP Sylvain Ravot
ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.
EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.
February 12, 2002 DØRACE 1 Grid activities in NIKHEF Willem van Leeuwen.
GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 End-2-End Network Monitoring What do we do ? What do we use it for? Richard Hughes-Jones Many people.
Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.
CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.
Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the.
Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.
DataTAG - WP3 Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd.
DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.
EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.
Transport Level Protocol Performance Evaluation for Bulk Data Transfers Matei Ripeanu The University of Chicago Abstract:
CdL was here DataTAG CERN Sep 2002 R. Hughes-Jones Manchester 1 European Topology: NRNs & Geant SuperJANET4 CERN UvA Manc SURFnet RAL.
An Active Reliable Multicast Framework for the Grids M. Maimour & C. Pham ICCS 2002, Amsterdam Network Support and Services for Computational Grids Sunday,
MB - NG MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester 1 Discussion of Methodology for MPLS QoS & High Performance High throughput Investigations.
KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.
1 WP7 (Network) status &plans Paris 6 th of March 2002 Pascale PRIMET INRIA/ RESO - ENS Lyon
Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
D0RACE: Testbed Session Lee Lueking D0 Remote Analysis Workshop February 12, 2002.
Parallel TCP Bill Allcock Argonne National Laboratory.
GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring and GridPP Richard Hughes-Jones, University of Manchester 6 November.
Less than Best Effort -- Nicolas Simar Less than Best Effort QoS IP 2003, Milan (Italy), Nicolas Simar, Network Engineer.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester UDPmon and TCPstream Tools to understand Network Performance Richard.
DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.
30 June Wide Area Networking Performance Challenges Olivier Martin, CERN UK DTI visit.
A demonstrator for IST 2001 G. Romier UREC Lyon. What is IST2001? the IST projects Exhibition is dedicated to displaying the results of projects within.
Chapter 11.4 END-TO-END ISSUES. Optical Internet Optical technology Protocol translates availability of gigabit bandwidth in user-perceived QoS.
GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 Lessons Learned in Grid Networking or How do we get end-2-end performance to Real Users ? Richard.
TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot
DataGrid WP7 Network Monitoring Robin Tasker, Daresbury Laboratory, 8 March 2001 Network Monitoring Requirements document produced,
Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.
The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.
ESLEA Closing Conference, Edinburgh, March 2007, R. Hughes-Jones Manchester 1 The Uptake of High Speed Protocols or Are these protocols making their way.
Networking and the Grid Ahmed Abdelrahim NeSC NeSC PPARC e-Science Summer School 10 th May 2005.
A Sneak Peak of What’s New in Globus GridFTP John Bresnahan Michael Link Raj Kettimuthu (Presenting) Argonne National Laboratory and The University of.
MB MPLS MPLS Technical Meeting Sep 2001 R. Hughes-Jones Manchester SuperJANET Development Network Testbed – Cisco GSR SuperJANET4 C-PoP – Cisco GSR.
DART SI-8: Pilot long-distance high speed and secure data transfer between the Repositories DART Workshop on Infrastructure Chief Investigator: Dr. Asad.
Which network parameters are interesting
LHCOPN lambda and fibre routing Episode 4 (the path to resilience…)
Disks; Distributed Systems
Architecture and Algorithms for an IEEE 802
INFN-GRID Work Package 5 - NETWORK
R. Hughes-Jones Manchester
Networking between China and Europe
WP7 objectives, achievements and plans
WP2/WP7 Demonstration WP7 High Throughput Data transfers WP2/WP7 Replica Selection based on Network Cost Functions WP2 Replica Location Service.
CERN-USA connectivity update DataTAG project
The DataTAG Project Olivier H. Martin
DataTAG Project update
TCP Performance over a 2.5 Gbit/s Transatlantic Circuit
MB-NG Review High Performance Network Demonstration 21 April 2004
Wide Area Networking at SLAC, Feb ‘03
High Performance Active End-to-end Network Monitoring
Presented at the GGF3 conference 8th October Frascati, Italy
Disks; Distributed Systems
Presentation at University of Twente, The Netherlands
Grid Coordination by Using the Grid Coordination Protocol
MB – NG SuperJANET4 Development Network
Grid activities in NIKHEF
Presented at the 4th DataGrid Conference
High-Performance Data Transport for Grid Applications
Presentation transcript:

Networking for grid Network capacity Network throughput 13-12-2002 Network capacity Network throughput What you get Network monitoring Datagrid tutorial

Network capacity GEANT: European research network 13-12-2002 GEANT: European research network Backbone 10 Gbit/s (6 POP’s) National research networks from 34 Mbit/s up to 2.5 Gbit/s Across the Ocean 2.5 Gbit/s Research on Optical networks (lambda’s) Netherlight, Starlight, Datatag Links between CERN, Amsterdam, Chigaco Datagrid tutorial

GEANT backbone topology 13-12-2002 Datagrid tutorial

GEANT global access 13-12-2002 Datagrid tutorial

Network throughput TCP performance System performance 13-12-2002 TCP performance Window size > bandwidth * RTT With 1 Gbit/s and RTT =20ms >2.4 Mbyte Recovery of lost packets Different protocal stacks congestion avoidance (ECN) Measured with iperf, netperf System performance Adapter System bus Disk access Datagrid tutorial

Application throughput 13-12-2002 GridFTP Extension of FTP standard Security Multiple streams Multiple disk stripes Datagrid tutorial

Network monitoring Pinger for RTT’s 13-12-2002 Pinger for RTT’s RipeNCC TTM boxes for link latencies or delays Iperf for TCP network throughput RTPL for TCP network throughput (netperf) UDPmon for network throughput GridFTP logs for application throughput Datagrid tutorial

Network monitoring http://gridmon.sara.nl/ 13-12-2002 http://gridmon.sara.nl/ http://ccwp7.in2p3.fr/main.html Monitoring data used for Statistics Diagnostics Enable efficient data transport (network cost function) RIPENCC TTM: NIKHEF – RAL 01-08/12 Iperf: CERN production testbed  Lyon en INFN Datagrid tutorial

Network monitoring Mapcenter : Mapcenter 13-12-2002 Mapcenter : presentation layer for grid information MDS data, sensor data Mapcenter RIPENCC TTM: NIKHEF – RAL 01-08/12 Iperf: CERN production testbed  Lyon en INFN Datagrid tutorial

Network performance Not discussed: 13-12-2002 Not discussed: Other network protocols (replacement for TCP) QoS Interactive applications Communication of distributed applications RIPENCC TTM: NIKHEF – RAL 01-08/12 Iperf: CERN production testbed  Lyon en INFN Datagrid tutorial