GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL DataGrid WP7 Meetings: –Amsterdam, November –Bologna, Jan Deliverables, reports –D7.2 –QoS

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Deliverable 7.2 Demonstration of enhanced monitoring tools Delivered PingER, RTPL, IperfER, UDPmon, MapCenter, RIPE NCC Test Traffic Measurements LDAP Publication Future: Prediction and forecasting; NetSaint

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - EDG- PingER Available in TB1 v1 Modification of PingER –PingER used extensively in HEP community Measures RTT, Loss (and therefore connectivity) Centrally configured

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - EDG- PingER Configuration system –On install: sends Franck Bonnassieux an –Every night, cron job gets an individual configuration file from ccwp7.in2p3.fr –Consultation between WP7 and local sysadmin –Easy way to set up all network monitoring hosts

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - EDG- PingER Apache cgi-bin scripts log files ping scripts cron

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools EDG-IperfER –Based on PingER –Measures TCP throughput UDPmon –Based on PingER –Measures UDP Ping and 1-way loss; calculates throughput

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - UDPmon Zero stats OK done Get remote statistics Send statistics Send data frames at regular intervals Time to send Time to receive Inter-packet time

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - RTPL Remote throughput, ping, load Tests are made between pairs of machines Centrally controlled Results presented using Java applets

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - MapCenter Provides various views showing the connectivity of various nodes on the Grid

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - website Links to other monitoring tools (MapCenter, RIPE NCC, NetSaint, RTPL) Links to sites with WP7s monitoring tools installed - 9 with PingER so far

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - NetSaint A thing to do in D7.2

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Monitoring tools - others Other systems under consideration are –RIPE NCC Test Traffic Measurements –Surveyor –NIMI –MRTG –Traceping –Netflow and cflowd –NWS

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Publication of monitoring data - LDAP LDAP backend script to publish data from PingER –Available with TB1 –Part of the standard WP3 information system –Script is installed using an extra RPM –Slow-burning update cycle Extra information providers for RTPL and NWS on their way

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Publication of monitoring data - LDAP How it looks Mds-Vo-Name=ucl,Mds-Vo-Name=uk,Mds-Vo-Name=datagrid,o=grid in=netmon netmonrou=netmon.rl.ac.ukrou=netmon.dl.ac.uk netmontool=pinger netmonpacketsize=256netmonpacketsize=512

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Publication of monitoring data - R-GMA Relational implementation of the grid monitoring architecture Under development WP7 is the first real user of it Seems to be far better suited to publishing network monitoring data than the LDAP tree structure

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Publication of monitoring data - R-GMA Much to decide –schemas, what to publish, where, how CE SE NM GridFTP logging Monitoring GridFTP logging SE/CE/NM associations Archiver SELECT nm1.rtt, cenm.ceid, cenm.ceid FROM nm nm1, nm nm2, cenm, senm WHERE cenm.nmid=nm1.nmid AND senm.nmid=nm2.nmid AND nm1.othernm=nm2.nmid AND mm1.rtt<100

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Other Stuff Gigabit ethernet performance measurements –characterisation of NICs, Richard Hughes- Jones

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Other stuff Tests of scavenger mode (DiffServ / QoS) –Cern External Network Division Tests of TCP in high-bandwidth situations –Antony Antony Tests of various other hardware –Routers and switches and things Security (will be D7.5)

GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL END