IEPM. Warren Matthews (SLAC)

Slides:

Advertisements

Similar presentations

Web100 at SLAC Presented at the Web100 Workshop, Boulder, CO, August 2002.

Advertisements

1 High Performance Active End-to- end Network Monitoring Les Cottrell, Connie Logg, Warren Matthews, Jiri Navratil, Ajay Tirumala – SLAC Prepared for the.

1 IEPM-BWIEPM-BW Warren Matthews (SLAC) Presented at the UCL Monitoring Infrastructure Workshop, London, May 15-16, 2003.

MAGGIE Monitoring and Analysis for the Global Grid and Internet End-to-end performance Warren Matthews (SLAC) Presented at the Measurement SIG ESCC/Internet2.

1 End-to-end Monitoring of High Performance Network Paths Les Cottrell, Connie Logg, Jerrod Williams SLAC, for the ESCC meeting, Columbus Ohio, July 2004.

1 IP Address Management Survey of Esnet sites – December 2011 Prepared by: Les Cottrell SLAC, ESCC meeting Clemson University February 3 rd 2011.

1 Traceanal: a tool for analyzing and representing traceroutes Les Cottrell, Connie Logg, Ruchi Gupta, Jiri Navratil SLAC, for the E2Epi BOF, Columbus.

1 Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.

1 Terapaths: Datagrid WAN Network Monitoring Infrastructure Les Cottrell, Connie Logg, Jerrod Williams SLAC, for the DoE 2004 PI Network Research Meeting,

1 IEPM-BW a new network/application throughput performance measurement infrastructure Les Cottrell – SLAC Presented at the GGF4 meeting, Toronto Feb 20-21,

Measurement and Fault-Finding Using MAGGIE and PIPES. Presented at the HENP SIG Internet2 Members Meeting, Indianapolis, October Paola Grosso (SLAC)

1 ICFA/SCIC Network Monitoring Prepared by Les Cottrell, SLAC, for ICFA

Network Monitoring grid network performance measurement, simulation & analysis Presented by Warren Matthews at the Performance.

What we have learned from developing and running ABwE Jiri Navratil, Les R.Cottrell (SLAC)

1 End-to-end Monitoring of High Performance Network Paths Les Cottrell, Connie Logg, Jerrod Williams, Jiri Navratil, SLAC, for the ESCC meeting, Columbus.

LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.

1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February

DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.

DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.

1 Status Report on US networks at the Turn of the Century Les Cottrell – SLAC & Stanford U.

Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

Office of Science U.S. Department of Energy ESCC Meeting July 21-23, 2004 Network Research Program Update Thomas D. Ndousse Program Manager Mathematical,

1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.

1 SLAC IEPM PingER and BW monitoring & tools PingER Presented by Les Cottrell, SLAC At LBNL, Jan 21,

IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.

Tiziana FerrariThe DataTAG Projct, Roma Nov DataTAG Project.

Introduction Jiří Navrátil SLAC. Rice University Richard Baraniuk, Edward Knightly, Robert Nowak, Rudolf Riedi Xin Wang, Yolanda Tsang, Shriram Sarvotham,

1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04

ICFA/SCIC Aug '05 SLAC Site Report 1 SLAC Site Report Les Cottrell, Gary Buhrmaster, Richard Mount, SLAC For ICFA/SCIC meeting 8/22/05

DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.

1 MAGGIE Monitoring and Analysis for the Global Grid and Internet End-to-end performance Warren Matthews Stanford Linear Accelerator Center (SLAC)

Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.

1 PingER performance to Bangladesh Prepared by Les Cottrell, SLAC for Prof. Hilda Cerdeira May 27, 2004 Partially funded by DOE/MICS Field Work Proposal.

The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.

1 WAN Monitoring Prepared by Les Cottrell, SLAC, for the Joint Engineering Taskforce Roadmap Workshop JLab April 13-15,

1 FAST TCP for Multi-Gbps WAN: Experiments and Applications Les Cottrell & Fabrizio Coccetti– SLAC Prepared for the Internet2, Washington, April 2003

1 Particle Physics Data Grid (PPDG) project Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99.

Toward a Measurement Infrastructure. Warren Matthews (SLAC) Presented at the e2e Workshop Miami, FL, February 2003.

Bob Jones EGEE Technical Director

IEPM-BW (or PingER on steroids) and the PPDG

Networking for grid Network capacity Network throughput

Milestones/Dates/Status Impact and Connections

High Speed File Replication

Warren Matthews and Les Cottrell (SLAC)

Using Netflow data for forecasting

Prepared by Les Cottrell & Hadrien Bullot, SLAC & EPFL, for the

The PingER Project: Measuring the Digital Divide

Wide Area Networking at SLAC, Feb ‘03

Digital Divide and PingER

High Performance Active End-to-end Network Monitoring

Connie Logg February 13 and 17, 2005

My Experiences, results and remarks to TCP BW and CT Measurements Tools Jiří Navrátil SLAC.

Experiences in Traceroute and Available Bandwidth Change Analysis

Experiences in Traceroute and Available Bandwidth Change Analysis

SLAC monitoring Web Services

Advanced Networking Collaborations at SLAC

Wide-Area Networking at SLAC

Correlating Internet Performance & Route Changes to Assist in Trouble-shooting from an End-user Perspective Les Cottrell, Connie Logg, Jiri Navratil SLAC.

MAGGIE NIIT- SLAC On Going Projects

PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.

Interoperable Measurement Frameworks: Internet2 E2E piPEs and NLANR Advisor Eric L. Boyd Internet2 17 April 2019.

Net Rat Network Reliability and Troubleshooting.

Quantifying the Global Digital Divide

Warren Matthews (SLAC) Presented at the PIPEfitters Breakfast,

The PingER Project: Measuring the Digital Divide

AMP Update and OC192 Monitor

Presentation transcript:

IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.

Overview Internet End-to-end Performance Monitoring (IEPM) Web Site PingER IEPM-BW MAGGIE Web Site http://www-iepm.slac.stanford.edu http://www-iepm.slac.stanford.edu

PingER Ping End-to-end Reporting 10x100 Byte pkts, 10x1000 Byte pkts Started in 1995 Currently 36 monitoring sites in 14 countries Long term trends and short term glitches Continues to prove useful Project with ICTP/eJDS on Digital Divide

Transatlantic link was 2Mbps in 1995. Now Multiple OC12. Vacation Traffic on ESnet doubles every year

IEPM-BW Direct Monitoring Currently 10 monitoring sites North America, Europe and Asia 1-6 target sites each (40 at SLAC) Iperf, bbftp, bbcp, gridftp, udpmon … Network and applications

LANL KEK FNAL EDG ANL NIKHEF CERN TRIUMF NERSC IN2P3 PPDG/GriPhyN CHI CERN SNV ESnet ORNL RAL JLAB NY SLAC UCL UManc SLAC JAnet DL BNL NNW APAN RIKEN Stanford INFN-Roma APAN Geant INFN-Milan CalREN Abilene SEA CESnet NY ATL SNV HSTN CLV SOX IPLS SDSC CALTECH I2 UFL UTDallas Rice UMich NCSA Monitoring Site

Network Host

Available B/width Estimator Tests impact the network Can cause problems for “real” traffic Can trip over each other Prefer low-impact tools Can also be run more often ABwE INCITE (SLAC/RICE/LANL) Results comparable to high impact tools

Sat Sun Mon Tues Weds Thurs

MAGGIE Measurement and Analysis for the Global Grid and Internet End-to-end Performance A secure, scalable measurement infrastructure providing measurement, analysis and access to data.

Features IEPM-BW + SCIDAC + Other tools Security Access to Data Akenti/Shibboleth Access to Data MDS, Web Services Troubleshooting tools survey other sources Deploy in DoE Science Community Work closely with PIPES (Internet2)

The Need A need for a ubiquitous monitoring infrastructure ? DOE Science Community SCIDAC testbed Large Scale Networking Grid (especially resource brokers) Troubleshooting / E2Epi

Toward a Monitoring Infrastructure The pieces are coming together Many monitoring projects Internet2 NG with built-in monitoring E2e PIPES Join in !

End SLAC team led by Les Cottrell Warren Matthews Connie Logg Jiri Navratil Jerrod Williams Fabrizio Coccelletti (INFN) Frank Nagy, Maxim Grigoriev (FNAL) And all the local administrators/supporters. Funding by DoE MICS / SCIDAC