Presentation is loading. Please wait.

Presentation is loading. Please wait.

Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the.

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the."— Presentation transcript:

1 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the PPNCG  UK Network Topologies  External Connectivity – Europe & US  Astronomy & Astrophysics Sites  Grid Network Monitoring  PingER – World wide Monitoring  QoS – a micro Introduction

2 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 2 Introduction to the PPNCG  Membership includes HEP and Astronomy users  Dave Terrett, Bob Bentley, Ralph Spencer  Remit  Ensure the community has the required networking facilities  Monitor end-to-end performance  Investigate new network applications / technologies  Provide advice on kit / facilities  Active Network Monitoring  PPNCG ping, ftp and traceping  ICFA monitoring  Report problems to UKERNA  Regular meetings with UKERNA invited  Recognised as a subject group in JNUG and JISC  Links to several Grid Projects

3 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 3 SuperJANET4: Backbone and Access links  Worldcom supplied the transmission  UKERNA layer the IP service  Core PoP IP router at Worldcom  Backbone Access Router at MANs  Access Links:  Large MAN 2.5 Gbit -> 10-20 Gbit  Medium MAN 622 Mbit -> 2.5 Gbit  4 node DWDM development net  Deployment Status:  Backbone Oct 00 Routers Nov 00  All sites Mar 01  Proved to be Stable  Constant growth of traffic  Upgrade Backbone to 10Gbit Jun 02

4 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 4 SuperJANET4: ping rtt Core routers Jun 01

5 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 5 SuperJANET4: ping rtt Site nodes Lancaster Glasgow MAN / LAN Issues Bristol Cambridge

6 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 6 London MAN Upgrade UDP Throughput Mbit/s UDP Packet loss % UDPmon Tests Manchester – London MAN was 155 Mbit ATM 1 st Oct Time interval in Weeks Richard HJ

7 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 7 Previous External Connectivity  Europe:  TEN-155  155Mbit Access link  US:  6 * 155 Mbit links  Peer in Hudson St.  622 Mbit to Esnet  622 Mbit to Abilene.

8 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 8 ICFAMON Plot from RAL to CERN for 19 th Oct to 1 st Nov 2001 Europe – Access links (1)  UK Access link 155 Mbit ATM  Sustained rate 130 Mbit  Contract to end of Nov 01  Bad news for users !

9 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 9 Traceping Oxford to CERN for 31 st October 2001 Europe – Access links (2) loss around ten155-gw.ja.net router J. Macallister

10 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 10 New External Connectivity  6 * 155 Mbit links  2.5Gbit line installed  IP commodity peer in London  Research traffic over 2.5G bit  Peer in Hudson St.  622 Mbit to Esnet  622 Mbit to Abilene.

11 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 11 Connectivity to Europe : Geant  Start mid November 2001  UKERNA switched off TEN-155 3 Dec 2001

12 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 12 ICFAMON Plot from DL to CERN for 18 th Feb to 3 rd Mar 2002 Connectivity to Europe  UK Dante Access link 2.5 Gbit POS  Remember 19 th Oct to 1 st Nov 2001 Access link over loaded

13 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 13 Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 day periods 1 hour averages Weekend-Before Weekday-After Weekday-Before 14 Jan 2002 (800Mbit/s) peak 86% of total 930 Mbit 17 Jan 2002 Peering altered 22 Jan 22 Jan 2002 Weed day peak 175 Mbit/s

14 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 14 Monitoring: US Traffic UKERNA Traffic data Kbit/s. Blue Traffic from US; Maroon Traffic to US 7 Dec 2001 (900kbit/s) 29 Jan 2002 (175kbit/s) peak is 88% of total BW 930 Mbit 10 minute averages Last 7 days 1 hour averages

15 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 15 Astronomy & Astrophysics Sites

16 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 16 ICFAMON Plot from DL to Anglo-Australian Observatory for 11 th Apr to 24 th Apr 2002 Connectivity to Australia  Packet loss reasonable  rtt improves ~420 ms to ~300 ms  Variations ~100ms

17 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 17 ICFAMON Plots for 11 th Apr to 24 th Apr 2002 DL to NOAO, Arizona DL to Goddard GSFC NASA Connectivity to US

18 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 18 ICFAMON Plot from DL to The Joint Astronomy Centre for 11 th Apr to 24 th Apr 2002 Connectivity to Hawaii  Packet loss good  rtt ~210 ms  Variations – queuing  traceroute:  Cross SuperJANET4 to NY OK  Cross Abilene to Seattle OK  Enters uhnet  Stops after 2-3 routers  No connectivity to La Palma  traceroute ends in iac.es network Tenerife ?

19 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 19 Grid Network Monitoring  Several tools in test – plugged into a coherent structure:  PingER, RIPE one way times, iperf, UDPmon, rTPL, GridFTP, and NWS prediction engine  continuous tests for last few months to selected sites:  DL Man RL UCL CERN Lyon Bologna SARA NBI SLAC …  The aims of monitoring for the Grid:  to inform Grid applications, via the middleware, of the current status of the network – input for resource broker and scheduling  to identify fault conditions in the operation of the Grid  to understand the instantaneous, day-to-day, and month-by-month behaviour of the network – provide advice on configuration etc.  Network information published in LDAP schema  Will be used by UK GridPP and e-science centres  AstroGrid ?

20 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 20 Local Network Monitoring Store & Analysis of Data (Access) Access to current and historic data and metrics via the Web, i.e. WP7 NM Pages, access to metric forecasts Backend LDAP script to fetch metrics Monitor process to push metrics local LDAP Server Grid Application access via LDAP Schema to - monitoring metrics; - location of monitoring data. PingER (RIPE TTB) IperfER UDPmon rTPL NWS etc LDAP Schema Grid Apps GridFTP Network Monitoring Architecture Robin Tasker

21 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 21 Network Monitoring Components PingNetmonUDPmoniPerfRipe Cron script plot Table LDAP raw control Cron script control Cron script plot Table LDAP rawplot Table LDAP raw WEB DisplayAnalysisGrid BrokerPredictions Web I/f Scheduler Tool Clients LDAP raw LDAP raw

22 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 22 Ping & UDP throughput MAN-RAL From 20 Oct 01 PingER rtt (ms) dl – RAL 1000 byte packet Forecast UDPmon Zero packet loss! UDPmon throughput Mbit/s man – RAL 300 * 1400 byte frames

23 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 23 Ping & UDP throughput MAN-CERN From 20 Oct 01 PingER rtt (ms) dl – cern 1000 byte packet Forecast UDPmon throughput Mbit/s man – cern 300 * 1400 byte frames

24 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 24 iperf TCP & UDP throughput MAN-SARA From 20 Oct 01 Iperf TCP throughput Mbit/s ucl – sara 262144 byte buffer Forecast UDPmon throughput Mbit/s man – sara 300 * 1400 byte frames

25 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 25 iperf & Pinger UK-Bologna From 20 Oct 01 Iperf throughput ucl – Bologna 262144 byte buffer Forecast in green PingER rtt (ms) dl – Bologna 1000 byte packet Forecast

26 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 26 Geant Enabled Routing Stable Iperf Throughput Mbit/s UCL – SARA 262144 byte buffer UDPmon Loss Throughput Mbit/s MAN – SARA iperf throughput UCL-SARA From 1 Nov 01 – Geant Operational

27 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 27 PingER deployment Les Cottrell  Measurements from  34 monitors in 14 countries  Over 600 remote hosts  Over 72 countries  Over 3300 monitor-remote site pairs  Measurements go back to Jan-95  Reports on RTT, loss, reachability, jitter, reorders, duplicates …  Countries monitored  Contain 78% of world population  99% of online users of Internet  Lightweight (100bps/host pair)  Very useful for inter-regional and poor links, need more intensive for high performance & Grid sites

28 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 28 Losses: World by region, Jan ‘02  Packet loss 5%=bad  Russia, S America bad  Balkans, M East, Africa, S Asia, Caucasus poor

29 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 29 Quality improvement seen from SLAC & NASA  NASA results courtesy of Andy Germain, NASA, GSFC

30 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 30 Iperf mem-mem vs file copy disk to disk 0 400 100 Iperf TCP Mbits/s File copy disk-to-disk Fast Ethernet OC3 Disk limited Over 60Mbits/s iperf >> file copy

31 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 31 QoS: Terms and Concepts  Identifying frames – marking / setting IP precedence bits  Sorting frames into queues  Selecting which frame to send  Action taken when a queue is full Sort Fail Discard Test Identify & Classify Police Dequeue Configurable Queues

32 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 32 QoS: What Next?  Dante propose the following services:  IP Premium (EF) (AF) difficult to define in a way that suits most NRNs  Best Efforts  Scavenger “Less than best efforts”  UKERNA ran a Think Tank to Study QoS requirements in the UK  MB-NG Network development project to test MPLS and QoS  SuperJANET is expected to offer similar services to Dante  Applications need end to end QoS – so we need to cross:  LAN  SuperJANET4  Dante  Remote NRN  Remote LAN

33 Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 33 More Information Some URLs  PPNCG Home page with Stop Press: http://ppncg.rl.ac.uk/  PPNCG Page for monitoring Astronomy & Astrophysics Sites http://icfamon.dl.ac.uk/ppncg/astronomy.html  and e-mail: hepgripe@rl.ac.uk  DataGrid WP7 Networking: http://www.gridpp.ac.uk/wp7/index.html  IEPM PingER home site: http://www-iepm.slac.stanford.edu/  IEPM-BW site: http://www-iepm.slac.stanford.edu/bw

Download ppt "Astronomy Sysman Meeting 29/30 April 02 R. Hughes-Jones Manchester 1 Introduction to the PPNCG Networking for the PPARC Community  Introduction to the."

Similar presentations

1 QoS on Best-effort IP Networks Les Cottrell – SLAC www.slac.stanford.edu/grp/scs/net/talk/qos-itu-apr01/ Presented at the Joint SG13/SG16 Workshop Panel.

1 QoS on Best-effort IP Networks Les Cottrell – SLAC Presented at the Joint SG13/SG16 Workshop Panel.
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.

ICFA SCIC Meeting CERN Dec 01 R. Hughes-Jones Manchester Network Connectivity and Projects – a Perspective from the UK Richard Hughes-Jones PPNCG SuperJANET4.
MB - NG MB-NG Meeting UCL 1 Nov 02 R. Hughes-Jones Manchester 1 Status of Task 2 Traffic Generation and Measurement.

MB - NG MB-NG Meeting UCL 1 Nov 02 R. Hughes-Jones Manchester 1 Status of Task 2 Traffic Generation and Measurement.
MB - NG MB-NG Technical Meeting 03 May 02 R. Hughes-Jones Manchester 1 Task2 Traffic Generation and Measurement Definitions Pass-1.

MB - NG MB-NG Technical Meeting 03 May 02 R. Hughes-Jones Manchester 1 Task2 Traffic Generation and Measurement Definitions Pass-1.
MB - NG MB-NG Jan 2002 R. Hughes-Jones Manchester Some Edge (Bbone) Router requirements Connect to the test systems in the IP domain. Accept marked packets.

MB - NG MB-NG Jan 2002 R. Hughes-Jones Manchester Some Edge (Bbone) Router requirements Connect to the test systems in the IP domain. Accept marked packets.
EU 2nd Year Review – 04-05 Feb. 2003 – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.

EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.
March 2001 SuperJANET4 & International Connectivity Rina Samani UKERNA.

March 2001 SuperJANET4 & International Connectivity Rina Samani UKERNA.
ER2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets 256-500 Mbit/s on the production network.

ER2002 Radio Astronomy VLBI Demo. uWeb based demonstration sending VLBI data A controlled stream of UDP packets Mbit/s on the production network.
JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.

JIVE VLBI Network Meeting 15 Jan 2003 R. Hughes-Jones Manchester The EVN-NREN Project Richard Hughes-Jones The University of Manchester.
GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 End-2-End Network Monitoring What do we do ? What do we use it for? Richard Hughes-Jones Many people.

GNEW2004 CERN March 2004 R. Hughes-Jones Manchester 1 End-2-End Network Monitoring What do we do ? What do we use it for? Richard Hughes-Jones Many people.
Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.

Meeting on ATLAS Remote Farms. Copenhagen 11 May 2004 R. Hughes-Jones Manchester Networking for ATLAS Remote Farms Richard Hughes-Jones The University.
1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June, 2004 www.slac.stanford.edu/grp/scs/net/talk03/isma-jun04.ppt.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.
CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.

CdL was here DataTAG/WP7 Amsterdam June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of Manchester.
MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.
Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.

Optical Networking Status of Discussion in the UK Richard Hughes-Jones The University of Manchester Particle Physics Network Coordination Group TERENA.
DataGrid WP7 Meeting CERN April 2002 R. Hughes-Jones Manchester Some Measurements on the SuperJANET 4 Production Network (UK Work in progress)

DataGrid WP7 Meeting CERN April 2002 R. Hughes-Jones Manchester Some Measurements on the SuperJANET 4 Production Network (UK Work in progress)
DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.

DataTAG Meeting CERN 7-8 May 03 R. Hughes-Jones Manchester 1 High Throughput: Progress and Current Results Lots of people helped: MB-NG team at UCL MB-NG.

Similar presentations

Ads by Google