IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.

Slides:

Advertisements

Similar presentations

Web100 at SLAC Presented at the Web100 Workshop, Boulder, CO, August 2002.

Advertisements

1 High Performance Active End-to- end Network Monitoring Les Cottrell, Connie Logg, Warren Matthews, Jiri Navratil, Ajay Tirumala – SLAC Prepared for the.

1 IEPM-BWIEPM-BW Warren Matthews (SLAC) Presented at the UCL Monitoring Infrastructure Workshop, London, May 15-16, 2003.

MAGGIE Monitoring and Analysis for the Global Grid and Internet End-to-end performance Warren Matthews (SLAC) Presented at the Measurement SIG ESCC/Internet2.

1 End-to-end Monitoring of High Performance Network Paths Les Cottrell, Connie Logg, Jerrod Williams SLAC, for the ESCC meeting, Columbus Ohio, July 2004.

1 IP Address Management Survey of Esnet sites – December 2011 Prepared by: Les Cottrell SLAC, ESCC meeting Clemson University February 3 rd 2011.

1 Traceanal: a tool for analyzing and representing traceroutes Les Cottrell, Connie Logg, Ruchi Gupta, Jiri Navratil SLAC, for the E2Epi BOF, Columbus.

1 Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers.

1 Correlating Internet Performance & Route Changes to Assist in Trouble- shooting from an End-user Perspective Les Cottrell, Connie Logg, Jiri Navratil.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.

PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.

1 Terapaths: Datagrid WAN Network Monitoring Infrastructure Les Cottrell, Connie Logg, Jerrod Williams SLAC, for the DoE 2004 PI Network Research Meeting,

1 IEPM-BW a new network/application throughput performance measurement infrastructure Les Cottrell – SLAC Presented at the GGF4 meeting, Toronto Feb 20-21,

Measurement and Fault-Finding Using MAGGIE and PIPES. Presented at the HENP SIG Internet2 Members Meeting, Indianapolis, October Paola Grosso (SLAC)

Network Monitoring grid network performance measurement, simulation & analysis Presented by Warren Matthews at the Performance.

What we have learned from developing and running ABwE Jiri Navratil, Les R.Cottrell (SLAC)

1 End-to-end Monitoring of High Performance Network Paths Les Cottrell, Connie Logg, Jerrod Williams, Jiri Navratil, SLAC, for the ESCC meeting, Columbus.

LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.

1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February

PPDG and ATLAS Particle Physics Data Grid Ed May - ANL ATLAS Software Week LBNL May 12, 2000.

DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.

DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.

1 Status Report on US networks at the Turn of the Century Les Cottrell – SLAC & Stanford U.

DataGrid Wide Area Network Monitoring Infrastructure (DWMI) Connie Logg February 13-17, 2005.

ESnet PKI Developed for the DOE Science Grid and SciDAC.

Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

1 The PingER Project: Measuring the Digital Divide PingER Presented by Les Cottrell, SLAC At the SIS Show Palexpo/Geneva December 2003.

1 Quantifying the Digital Divide Les Cottrell – SLAC Prepared for the ICFA-SCIC video meeting, May 2003

Office of Science U.S. Department of Energy ESCC Meeting July 21-23, 2004 Network Research Program Update Thomas D. Ndousse Program Manager Mathematical,

1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.

1 SLAC IEPM PingER and BW monitoring & tools PingER Presented by Les Cottrell, SLAC At LBNL, Jan 21,

Introduction Jiří Navrátil SLAC. Rice University Richard Baraniuk, Edward Knightly, Robert Nowak, Rudolf Riedi Xin Wang, Yolanda Tsang, Shriram Sarvotham,

1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04

ICFA/SCIC Aug '05 SLAC Site Report 1 SLAC Site Report Les Cottrell, Gary Buhrmaster, Richard Mount, SLAC For ICFA/SCIC meeting 8/22/05

DoE SciDAC high-performance networking research project: INCITE INCITE.rice.edu 2004 Technical Challenges INCITE R. Baraniuk, E. Knightly, R. Nowak, R.

1 MAGGIE Monitoring and Analysis for the Global Grid and Internet End-to-end performance Warren Matthews Stanford Linear Accelerator Center (SLAC)

Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.

1 PingER performance to Bangladesh Prepared by Les Cottrell, SLAC for Prof. Hilda Cerdeira May 27, 2004 Partially funded by DOE/MICS Field Work Proposal.

The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.

Igniting Internet Innovation

1 WAN Monitoring Prepared by Les Cottrell, SLAC, for the Joint Engineering Taskforce Roadmap Workshop JLab April 13-15,

1 IEPM / PingER project & PPDG Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99 Partially funded by DOE/MICS Field Work Proposal on.

1 FAST TCP for Multi-Gbps WAN: Experiments and Applications Les Cottrell & Fabrizio Coccetti– SLAC Prepared for the Internet2, Washington, April 2003

1 PingER6 Preliminary PingER Monitoring Results from the 6Bone/6REN. Warren Matthews Les Cottrell.

1 Particle Physics Data Grid (PPDG) project Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99.

Toward a Measurement Infrastructure. Warren Matthews (SLAC) Presented at the e2e Workshop Miami, FL, February 2003.

IEPM-BW (or PingER on steroids) and the PPDG

Networking for grid Network capacity Network throughput

Milestones/Dates/Status Impact and Connections

High Speed File Replication

Warren Matthews and Les Cottrell (SLAC)

Using Netflow data for forecasting

Wide Area Networking at SLAC, Feb ‘03

Digital Divide and PingER

High Performance Active End-to-end Network Monitoring

Connie Logg February 13 and 17, 2005

My Experiences, results and remarks to TCP BW and CT Measurements Tools Jiří Navrátil SLAC.

Experiences in Traceroute and Available Bandwidth Change Analysis

SLAC monitoring Web Services

Advanced Networking Collaborations at SLAC

IEPM. Warren Matthews (SLAC)

Wide-Area Networking at SLAC

PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.

Net Rat Network Reliability and Troubleshooting.

Quantifying the Global Digital Divide

Warren Matthews (SLAC) Presented at the PIPEfitters Breakfast,

The PingER Project: Measuring the Digital Divide

Presentation transcript:

IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.

Overview Internet End-to-end Performance Monitoring (IEPM) –PingER –IEPM-BW –MAGGIE Web Site –

PingER Ping End-to-end Reporting 10x100 Byte pkts, 10x1000 Byte pkts Started in 1995 Currently 36 monitoring sites in 14 countries Long term trends and short term glitches Continues to prove useful –Project with ICTP/eJDS on Digital Divide

Traffic on ESnet doubles every year Transatlantic link was 2Mbps in Now Multiple OC12. Vacation

IEPM-BW Direct Monitoring Currently 10 monitoring sites –North America, Europe and Asia 1-6 target sites each (40 at SLAC) Iperf, bbftp, bbcp, gridftp, udpmon … –Network and applications

SNV SLAC CHI ESnet NY Stanford CalREN NERSC LANL JLAB TRIUMF KEK Abilene SLAC SNV FNAL ANL NIKHEF CERN IN2P3 CERN CALTECH SDSC BNL JAnet HSTN SEA ATL CLV IPLS RAL UCL UManc DL NNW NY Rice UTDallas NCSA UMich I2 SOX UFL APAN RIKEN INFN-Roma INFN-Milan CESnet APAN Geant EDG PPDG/GriPhyN Monitoring Site ORNL

Network Host

Available B/width Estimator Tests impact the network –Can cause problems for “real” traffic –Can trip over each other Prefer low-impact tools –Can also be run more often ABwE –INCITE (SLAC/RICE/NLANR) –Results comparable to high impact tools

SatSunMonTuesWedsThurs

MAGGIEMAGGIE Measurement and Analysis for the Global Grid and Internet End-to-end Performance –A secure, scalable measurement infrastructure providing measurement, analysis and access to data.

FeaturesFeatures IEPM-BW + SCIDAC + Other tools Security –Akenti/Shibboleth Access to Data –MDS, Web Services –Troubleshooting tools survey other sources Deploy in DoE Science Community Work closely with PIPES (Internet2)

The Need A need for a ubiquitous monitoring infrastructure ? –DOE Science Community –SCIDAC testbed –Large Scale Networking –Grid (especially resource brokers) –Troubleshooting / E2Epi

Toward a Monitoring Infrastructure The pieces are coming together –Many monitoring projects –Internet2 NG with built-in monitoring –E2e PIPES Join in !

EndEnd SLAC team led by Les Cottrell Warren Matthews Connie Logg Jiri Navratil Jerrod Williams Fabrizio Coccelletti (INFN) Frank Nagy, Maxim Grigoriev (FNAL) And all the local administrators/supporters. Funding by DoE MICS / SCIDAC