DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.

Slides:



Advertisements
Similar presentations
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
Advertisements

ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.
MB - NG MB-NG Meeting UCL 1 Nov 02 R. Hughes-Jones Manchester 1 Status of Task 2 Traffic Generation and Measurement.
IGRID2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network.
MB - NG MB-NG Technical Meeting 03 May 02 R. Hughes-Jones Manchester 1 Task2 Traffic Generation and Measurement Definitions Pass-1.
DataTAG CERN Oct 2002 R. Hughes-Jones Manchester Initial Performance Measurements With DataTAG PCs Gigabit Ethernet NICs (Work in progress Oct 02)
EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.
Project Partners Project Collaborators The Council for the Central Laboratory of the Research Councils Funded by EPSRC GR/T04465/01
CALICE, Mar 2007, R. Hughes-Jones Manchester 1 Protocols Working with 10 Gigabit Ethernet Richard Hughes-Jones The University of Manchester
ER2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network.
JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.
GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 End-2-End Network Monitoring What do we do ? What do we use it for? Richard Hughes-Jones Many people.
Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.
Slide: 1 Richard Hughes-Jones T2UK, October 06 R. Hughes-Jones Manchester 1 Update on Remote Real-Time Computing Farms For ATLAS Trigger DAQ. Richard Hughes-Jones.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.
CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.
5 Annual e-VLBI Workshop, September 2006, Haystack Observatory R. Hughes-Jones Manchester 1 The Network Transport layer and the Application or TCP/IP.
Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the.
Mapping a Network by Latency (and other things) Client connecting to , UDP port.
DataTAG - WP3 Objectives, activities and progress by UvA: Wim Sjouw, Hans Blom, Jason Lee, Cees de Laat INRIA: Mathieu Goutelle CERN: tbd.
DataGrid WP7 Meeting CERN April 2002 R. Hughes-Jones Manchester Some Measurements on the SuperJANET 4 Production Network (UK Work in progress)
T2UK RAL 15 Mar 2006, R. Hughes-Jones Manchester 1 ATLAS Networking & T2UK Richard Hughes-Jones The University of Manchester then.
CALICE UCL, 20 Feb 2006, R. Hughes-Jones Manchester 1 10 Gigabit Ethernet Test Lab PCI-X Motherboards Related work & Initial tests Richard Hughes-Jones.
DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.
EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.
Internet Bandwidth Measurement Techniques Muhammad Ali Dec 17 th 2005.
PFLDNet Argonne Feb 2004 R. Hughes-Jones Manchester 1 UDP Performance and PCI-X Activity of the Intel 10 Gigabit Ethernet Adapter on: HP rx2600 Dual Itanium.
CdL was here DataTAG CERN Sep 2002 R. Hughes-Jones Manchester 1 European Topology: NRNs & Geant SuperJANET4 CERN UvA Manc SURFnet RAL.
GridPP Collaboration Meeting May 2002 R. Hughes-Jones Manchester 1 Networking in Under 30 Minutes ! Richard Hughes-Jones, University of Manchester.
July 2000 PPNCG Meeting R. Hughes-Jones Performance Measurements of LANs MANs and SuperJANET III This is PRELIMINARY uBaseline data for Grid development.
02 nd April 03Networkshop Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)
GGF4 Toronto Feb 2002 R. Hughes-Jones Manchester Initial Performance Measurements Gigabit Ethernet NICs 64 bit PCI Motherboards (Work in progress Mar 02)
KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.
R. Hughes-Jones ESnet Meeting Kyoto July 2000 Networking for HEP in the UK uIntroduction to the PPNCG uNetwork Topologies uMonitoring Activities uPeering.
Experiences in Design and Implementation of a High Performance Transport Protocol Yunhong Gu, Xinwei Hong, and Robert L. Grossman National Center for Data.
Installation Verification Last Update Copyright Kenneth M. Chipps Ph.D.
POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 4. Active Monitoring Techniques.
Integration of AMP & Tracenol By: Qasim Bilal Lone.
GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring and GridPP Richard Hughes-Jones, University of Manchester 6 November.
Scavenger performance Cern External Network Division - Caltech Datagrid WP January, 2002.
Network Performance for ATLAS Real-Time Remote Computing Farm Study Alberta, CERN Cracow, Manchester, NBI MOTIVATION Several experiments, including ATLAS.
Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI The iNetTest Unit Development of Real Time eVLBI at Jodrell Bank Observatory.
ESLEA Bits&Bytes, Manchester, 7-8 Dec 2006, R. Hughes-Jones Manchester 1 Protocols DCCP and dccpmon. Richard Hughes-Jones The University of Manchester.
Robin HJ & R. Hughes-Jones Manchester Sep 1999 Gigabit Ethernet in Ptolemy Status Sep 99 : Stars that exist : –GigEChipTranslate between GigEPacket and.
1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.
Online-Offsite Connectivity Experiments Catalin Meirosu *, Richard Hughes-Jones ** * CERN and Politehnica University of Bucuresti ** University of Manchester.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester UDPmon and TCPstream Tools to understand Network Performance Richard.
PFLDNet Workshop February 2003 R. Hughes-Jones Manchester Some Performance Measurements Gigabit Ethernet NICs & Server Quality Motherboards Richard Hughes-Jones.
High bit rate tests between Manchester and JIVE Looking at data rates attainable with UDP along with packet loss and reordering statistics Simon Casey,
VLBI_UDP An application for transferring VLBI data via UDP protocol Simon Casey e-VLBI meeting, Haystack 20 Sep 2006.
GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 Lessons Learned in Grid Networking or How do we get end-2-end performance to Real Users ? Richard.
WP7 Middleware Status and Plans Paul Mealor. Contents GridFTP monitoring Network monitoring information in RGMA UK network monitoring.
Development of a QoE Model Himadeepa Karlapudi 03/07/03.
DataGrid WP7 Network Monitoring Robin Tasker, Daresbury Laboratory, 8 March 2001 Network Monitoring Requirements document produced,
Networks ∙ Services ∙ People Richard-Hughes Jones eduPERT Training Session, Porto A Hands-On Session udpmon for Network Troubleshooting 18/06/2015.
Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.
Mark Leese Daresbury Laboratory GridMon EGEE JRA4 R-GMA workshop Thursday 22 nd July 2004 University College London Mark Leese.
Networking and the Grid Ahmed Abdelrahim NeSC NeSC PPARC e-Science Summer School 10 th May 2005.
Connect communicate collaborate Performance Metrics & Basic Tools Robert Stoy, DFN EGI TF, Madrid September 2013.
At the February meeting we agreed; - the requirements for Network Monitoring found at - 7 sites.
WTG – Wireless Traffic Generator Presented by: Lilach Givaty Supervised by: Dr. Yehuda Ben-Shimol, Shlomi Atias.
Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI Richard Hughes-Jones.
DataGrid WP7 Meeting Jan 2002 R. Hughes-Jones Manchester Initial Performance Measurements Gigabit Ethernet NICs 64 bit PCI Motherboards (Work in progress)
iperf a gnu tool for IP networks
R. Hughes-Jones Manchester
Networking for grid Network capacity Network throughput
WP2/WP7 Demonstration WP7 High Throughput Data transfers WP2/WP7 Replica Selection based on Network Cost Functions WP2 Replica Location Service.
MB-NG Review High Performance Network Demonstration 21 April 2004
NET 536 Network Security Lab 1: TCP IP Attacks
Presentation transcript:

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular intervals  Vary the frame size and the frame transmit spacing  Record  The time to send and the time to receive the frames  The number received, the number lost, number out of order  The received inter-packet spacing Zero stats OK done ●●● Get remote statistics Send statistics Send data frames at regular intervals ●●● Time to send Time to receive Inter-packet time

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 2 UDPmon – Status  Tool operational at Manchester  RAL UCL Bologna Lyon NBI CERN SARA  And CERN  MAN RAL Bologna Lyon SARA  Cgi script to generate web.gif display – based on Pinger  Web page rather primitive – will include Antony’s  Cgi script for LDAP access discussed – simple mod!  Cgi script for extraction of data for comparison half discussed!!

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 3 Ping & UDP throughput MAN-CERN From 20 Oct 01 PingER rtt (ms) dl – cern 1000 byte packet Forecast UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 4 iperf & UDP throughput MAN-CERN From 20 Oct 01 Iperf throughput ucl – cern byte buffer Forecast UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 5 UDP Loss & throughput MAN-Lyon From 20 Oct 01 UDPmon packet loss man – lyon 300 * 1400 byte frames UDPmon throughput Mbit/s man – lyon 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 6 Ping & UDP throughput MAN-Lyon From 20 Oct 01 PingER rtt (ms) dl – Lyon 1000 byte packet Forecast UDPmon throughput Mbit/s man – Lyon 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 7 Ping & UDP throughput MAN-RAL From 20 Oct 01 PingER rtt (ms) dl – RAL 1000 byte packet Forecast UDPmon Zero packet loss! UDPmon throughput Mbit/s man – RAL 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 8 UDP Loss & throughput MAN-SARA From 20 Oct 01 UDPmon packet loss man – SARA 300 * 1400 byte frames UDPmon throughput Mbit/s man – SARA 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 9 Ping & UDP throughput MAN-SARA From 20 Oct 01 PingER rtt (ms) dl – sara 1000 byte packet Forecast UDPmon throughput Mbit/s man – sara 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 10 iperf & UDP throughput MAN-SARA From 20 Oct 01 Iperf throughput ucl – sara byte buffer Forecast UDPmon throughput Mbit/s man – sara 300 * 1400 byte frames

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 11 Other comparisons

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 12 UDP Frame Jitter

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 13 iperf & Pinger UK-Bologna From 20 Oct 01 Iperf throughput ucl – Bologna byte buffer Forecast PingER rtt (ms) dl – Bologna 1000 byte packet Forecast

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 14 iperf & Pinger UK-Bologna From 20 Oct 01 Iperf throughput ucl – Bologna byte buffer Forecast PingER rtt (ms) dl – Bologna 100 byte packet Forecast

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 15 RIPE 1-way & TCP throughput UK-Bologna RIPE 1-way time ms Bologna  RAL 20 Oct 01 RIPE 1-way time ms RAL  Bologna TCP Iperf + prediction Mbit/s UCL  Bologna

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 16 RIPE 1-way & TCP throughput UK-SARA RIPE 1-way time ms Sara  RAL 20 Oct 01 RIPE 1-way time ms RAL  Sara TCP Iperf + prediction Mbit/s UCL  Sara