Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the.

Slides:

Advertisements

Similar presentations

1 QoS on Best-effort IP Networks Les Cottrell – SLAC Presented at the Joint SG13/SG16 Workshop Panel.

Advertisements

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.

MB - NG MB-NG Meeting UCL 1 Nov 02 R. Hughes-Jones Manchester 1 Status of Task 2 Traffic Generation and Measurement.

MB - NG MB-NG Technical Meeting 03 May 02 R. Hughes-Jones Manchester 1 Task2 Traffic Generation and Measurement Definitions Pass-1.

MB - NG MB-NG Jan 2002 R. Hughes-Jones Manchester Some Edge (Bbone) Router requirements Connect to the test systems in the IP domain. Accept marked packets.

EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.

March 2001 SuperJANET4 & International Connectivity Rina Samani UKERNA.

ER2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network.

JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.

GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 End-2-End Network Monitoring What do we do ? What do we use it for? Richard Hughes-Jones Many people.

Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.

Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.

DataGrid WP7 Meeting CERN April 2002 R. Hughes-Jones Manchester Some Measurements on the SuperJANET 4 Production Network (UK Work in progress)

DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.

EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.

CdL was here DataTAG CERN Sep 2002 R. Hughes-Jones Manchester 1 European Topology: NRNs & Geant SuperJANET4 CERN UvA Manc SURFnet RAL.

GridPP Collaboration Meeting May 2002 R. Hughes-Jones Manchester 1 Networking in Under 30 Minutes ! Richard Hughes-Jones, University of Manchester.

July 2000 PPNCG Meeting R. Hughes-Jones Performance Measurements of LANs MANs and SuperJANET III This is PRELIMINARY uBaseline data for Grid development.

1 ICFA/SCIC Network Monitoring Prepared by Les Cottrell, SLAC, for ICFA

MB - NG MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester 1 Discussion of Methodology for MPLS QoS & High Performance High throughput Investigations.

02 nd April 03Networkshop Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)

KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.

1 Monitoring Internet connectivity of Research and Educational Institutions Les Cottrell – SLAC/Stanford University Prepared for the workshop on “Developing.

R. Hughes-Jones Advanced Networks Workshop Montreal November 2000 Networking for the Particle Physics Community - a UK Perspective uIntroduction to the.

R. Hughes-Jones ESnet Meeting Kyoto July 2000 Networking for HEP in the UK uIntroduction to the PPNCG uNetwork Topologies uMonitoring Activities uPeering.

ICFA SCIC Meeting CERN 28 Sep 02 R. Hughes-Jones Manchester Networking from the UK Richard Hughes-Jones PPNCG.

1 ESnet/HENP Active Internet End-to-end Performance & ESnet/University performance Les Cottrell – SLAC Presented at the ESSC meeting Albuquerque, August.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

1 The PingER Project: Measuring the Digital Divide PingER Presented by Les Cottrell, SLAC At the SIS Show Palexpo/Geneva December 2003.

GridPP Collaboration Meeting Nov 2001 R. Hughes-Jones Manchester Network Monitoring and GridPP Richard Hughes-Jones, University of Manchester 6 November.

October 2000 © The JNT Association JISC / UKERNA Initiative Internet2 Collaborative Programme in the UK Rina Samani.

1 Measurements of Internet performance for NIIT, Pakistan Jan – Feb 2004 PingER From Les Cottrell, SLAC For presentation by Prof. Arshad Ali, NIIT.

1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.

MB - NG MB-NG Meeting Dec 2001 R. Hughes-Jones Manchester MB – NG SuperJANET4 Development Network SuperJANET4 Production Network Leeds RAL / UKERNA RAL.

1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.

Online-Offsite Connectivity Experiments Catalin Meirosu *, Richard Hughes-Jones ** * CERN and Politehnica University of Bucuresti ** University of Manchester.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester UDPmon and TCPstream Tools to understand Network Performance Richard.

GridPP 11 th Collaboration Meeting Networking: Current Status Robin Tasker 14 September 2004.

DataGrid WP7 Meeting Amsterdam Nov 01 R. Hughes-Jones Manchester 1 UDPmon Measuring Throughput with UDP  Send a burst of UDP frames spaced at regular.

MB - NG MB-NG Meeting UCL 17 Jan 02 R. Hughes-Jones Manchester 1 Discussion of Methodology for MPLS QoS & High Performance High throughput Investigations.

1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04

1 Internet Performance Monitoring for the HENP Community Les Cottrell & Warren Matthews – SLAC Presented.

GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 Lessons Learned in Grid Networking or How do we get end-2-end performance to Real Users ? Richard.

Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.

18/09/2002Presentation to Spirent1 Presentation to Spirent 18/09/2002.

Grid Network Performance Monitoring for e-Science.

DataGrid WP7 Network Monitoring Robin Tasker, Daresbury Laboratory, 8 March 2001 Network Monitoring Requirements document produced,

Final EU Review - 24/03/2004 DataTAG is a project funded by the European Commission under contract IST Richard Hughes-Jones The University of.

Mark Leese Daresbury Laboratory GridMon EGEE JRA4 R-GMA workshop Thursday 22 nd July 2004 University College London Mark Leese.

The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.

Networking and the Grid Ahmed Abdelrahim NeSC NeSC PPARC e-Science Summer School 10 th May 2005.

1 IEPM / PingER project & PPDG Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99 Partially funded by DOE/MICS Field Work Proposal on.

QoS Experience on European Backbone - TNC Nicolas Simar QoS Experience on European Backbone TNC 2003, Zabgreb (Croatia),

Connect. Communicate. Collaborate 4 Gigabit Onsala - Jodrell Lightpath for e-VLBI Richard Hughes-Jones.

June 2000 Globus UK Workshop R. Hughes-Jones Globus Current and Future Organizational / Management uHow do we keep informed of work in UK / HEP? èSimple.

Paola Grosso SLAC October

R. Hughes-Jones Manchester

Networking between China and Europe

Networking for grid Network capacity Network throughput

Wide Area Networking at SLAC, Feb ‘03

MB – NG SuperJANET4 Development Network

SLAC monitoring Web Services

Wide-Area Networking at SLAC

HEP System Managers Meeting, UCL.

Presentation transcript:

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the PPNCG  UK Network Topologies  External Connectivity – Europe & US  Astronomy & Astrophysics Sites  Grid Network Monitoring  PingER – World wide Monitoring  QoS – a micro Introduction

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 2 Introduction to the PPNCG  Membership includes HEP and Astronomy users  Dave Terrett, Bob Bentley, Ralph Spencer  Remit  Ensure the community has the required networking facilities  Monitor end-to-end performance  Investigate new network applications / technologies  Provide advice on kit / facilities  Active Network Monitoring  PPNCG ping, ftp and traceping  ICFA monitoring  Report problems to UKERNA  Regular meetings with UKERNA invited  Recognised as a subject group in JNUG and JISC  Links to several Grid Projects

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 3 SuperJANET4: Backbone and Access links  Worldcom supplied the transmission  UKERNA layer the IP service  Core PoP IP router at Worldcom  Backbone Access Router at MANs  Access Links:  Large MAN 2.5 Gbit -> Gbit  Medium MAN 622 Mbit -> 2.5 Gbit  4 node DWDM development net  Deployment Status:  Backbone Oct 00 Routers Nov 00  All sites Mar 01  Proved to be Stable  Constant growth of traffic  Upgrade Backbone to 10Gbit Jun 02

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 4 SuperJANET4: ping rtt Core routers Jun 01

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 5 SuperJANET4: ping rtt Site nodes Lancaster Glasgow MAN / LAN Issues Bristol Cambridge

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 6 London MAN Upgrade UDP Throughput Mbit/s UDP Packet loss % UDPmon Tests Manchester – London MAN was 155 Mbit ATM 1 st Oct Time interval in Weeks Richard HJ

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 7 Previous External Connectivity  Europe:  TEN-155  155Mbit Access link  US:  6 * 155 Mbit links  Peer in Hudson St.  622 Mbit to Esnet  622 Mbit to Abilene.

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 8 ICFAMON Plot from RAL to CERN for 19 th Oct to 1 st Nov 2001 Europe – Access links (1)  UK Access link 155 Mbit ATM  Sustained rate 130 Mbit  Contract to end of Nov 01  Bad news for users !

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 9 Traceping Oxford to CERN for 31 st October 2001 Europe – Access links (2) loss around ten155-gw.ja.net router J. Macallister

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 10 New External Connectivity  6 * 155 Mbit links  2.5Gbit line installed  IP commodity peer in London  Research traffic over 2.5G bit  Peer in Hudson St.  622 Mbit to Esnet  622 Mbit to Abilene.

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 11 Connectivity to Europe : Geant  Start mid November 2001  UKERNA switched off TEN Dec 2001

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 12 ICFAMON Plot from DL to CERN for 18 th Feb to 3 rd Mar 2002 Connectivity to Europe  UK Dante Access link 2.5 Gbit POS  Remember 19 th Oct to 1 st Nov 2001 Access link over loaded

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 13 Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 day periods 1 hour averages Weekend-Before Weekday-After Weekday-Before 14 Jan 2002 (800Mbit/s) peak 86% of total 930 Mbit 17 Jan 2002 Peering altered 22 Jan 22 Jan 2002 Weed day peak 175 Mbit/s

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 14 Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 Dec 2001 (900kbit/s) 29 Jan 2002 (175kbit/s) peak is 88% of total BW 930 Mbit 10 minute averages Last 7 days 1 hour averages

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 15 Astronomy & Astrophysics Sites

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 16 ICFAMON Plot from DL to Anglo-Australian Observatory for 11 th Apr to 24 th Apr 2002 Connectivity to Australia  Packet loss reasonable  rtt improves ~420 ms to ~300 ms  Variations ~100ms

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 17 ICFAMON Plots for 11 th Apr to 24 th Apr 2002 DL to NOAO, Arizona DL to Goddard GSFC NASA Connectivity to US

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 18 ICFAMON Plot from DL to The Joint Astronomy Centre for 11 th Apr to 24 th Apr 2002 Connectivity to Hawaii  Packet loss good  rtt ~210 ms  Variations – queuing  traceroute:  Cross SuperJANET4 to NY OK  Cross Abilene to Seattle OK  Enters uhnet  Stops after 2-3 routers  No connectivity to La Palma  traceroute ends in iac.es network Tenerife ?

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 19 Grid Network Monitoring  Several tools in test – plugged into a coherent structure:  PingER, RIPE one way times, iperf, UDPmon, rTPL, GridFTP, and NWS prediction engine  continuous tests for last few months to selected sites:  DL Man RL UCL CERN Lyon Bologna SARA NBI SLAC …  The aims of monitoring for the Grid:  to inform Grid applications, via the middleware, of the current status of the network – input for resource broker and scheduling  to identify fault conditions in the operation of the Grid  to understand the instantaneous, day-to-day, and month-by-month behaviour of the network – provide advice on configuration etc.  Network information published in LDAP schema  Will be used by UK GridPP and e-science centres  AstroGrid ?

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 20 Local Network Monitoring Store & Analysis of Data (Access) Access to current and historic data and metrics via the Web, i.e. WP7 NM Pages, access to metric forecasts Backend LDAP script to fetch metrics Monitor process to push metrics local LDAP Server Grid Application access via LDAP Schema to - monitoring metrics; - location of monitoring data. PingER (RIPE TTB) IperfER UDPmon rTPL NWS etc LDAP Schema Grid Apps GridFTP Network Monitoring Architecture Robin Tasker

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 21 Network Monitoring Components PingNetmonUDPmoniPerfRipe Cron script plot Table LDAP raw control Cron script control Cron script plot Table LDAP rawplot Table LDAP raw WEB DisplayAnalysisGrid BrokerPredictions Web I/f Scheduler Tool Clients LDAP raw LDAP raw

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 22 Ping & UDP throughput MAN-RAL From 20 Oct 01 PingER rtt (ms) dl – RAL 1000 byte packet Forecast UDPmon Zero packet loss! UDPmon throughput Mbit/s man – RAL 300 * 1400 byte frames

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 23 Ping & UDP throughput MAN-CERN From 20 Oct 01 PingER rtt (ms) dl – cern 1000 byte packet Forecast UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 24 iperf TCP & UDP throughput MAN-SARA From 20 Oct 01 Iperf TCP throughput Mbit/s ucl – sara byte buffer Forecast UDPmon throughput Mbit/s man – sara 300 * 1400 byte frames

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 25 iperf & Pinger UK-Bologna From 20 Oct 01 Iperf throughput ucl – Bologna byte buffer Forecast in green PingER rtt (ms) dl – Bologna 1000 byte packet Forecast

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 26 Geant Enabled Routing Stable Iperf Throughput Mbit/s UCL – SARA byte buffer UDPmon Loss Throughput Mbit/s MAN – SARA iperf throughput UCL-SARA From 1 Nov 01 – Geant Operational

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 27 PingER deployment Les Cottrell  Measurements from  34 monitors in 14 countries  Over 600 remote hosts  Over 72 countries  Over 3300 monitor-remote site pairs  Measurements go back to Jan-95  Reports on RTT, loss, reachability, jitter, reorders, duplicates …  Countries monitored  Contain 78% of world population  99% of online users of Internet  Lightweight (100bps/host pair)  Very useful for inter-regional and poor links, need more intensive for high performance & Grid sites

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 28 Losses: World by region, Jan ‘02  Packet loss 5%=bad  Russia, S America bad  Balkans, M East, Africa, S Asia, Caucasus poor

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 29 Quality improvement seen from SLAC & NASA  NASA results courtesy of Andy Germain, NASA, GSFC

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 30 Iperf mem-mem vs file copy disk to disk Iperf TCP Mbits/s File copy disk-to-disk Fast Ethernet OC3 Disk limited Over 60Mbits/s iperf >> file copy

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 31 QoS: Terms and Concepts  Identifying frames – marking / setting IP precedence bits  Sorting frames into queues  Selecting which frame to send  Action taken when a queue is full Sort Fail Discard Test Identify & Classify Police Dequeue Configurable Queues

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 32 QoS: What Next?  Dante propose the following services:  IP Premium (EF) (AF) difficult to define in a way that suits most NRNs  Best Efforts  Scavenger “Less than best efforts”  UKERNA ran a Think Tank to Study QoS requirements in the UK  MB-NG Network development project to test MPLS and QoS  SuperJANET is expected to offer similar services to Dante  Applications need end to end QoS – so we need to cross:  LAN  SuperJANET4  Dante  Remote NRN  Remote LAN

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 33 More Information Some URLs  PPNCG Home page with Stop Press:  PPNCG Page for monitoring Astronomy & Astrophysics Sites  and  DataGrid WP7 Networking:  IEPM PingER home site:  IEPM-BW site: