Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.

Slides:



Advertisements
Similar presentations
© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 8: Monitoring the Network Connecting Networks.
Advertisements

Overview of network monitoring development at AMRES Slavko Gajin.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Connect. Communicate. Collaborate WI5 – tools implementation Stephan Kraft October 2007, Sevilla.
Geolocation Les Cottrell – SLAC University of Helwan / Egypt, Sept 18 – Oct 3, 2010 Partially funded by DOE/MICS Field Work Proposal on Internet End-to-end.
1 Traceanal: a tool for analyzing and representing traceroutes Les Cottrell, Connie Logg, Ruchi Gupta, Jiri Navratil SLAC, for the E2Epi BOF, Columbus.
1 Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers.
PingER Management1 Error Reporting Model for Ping End-to-End Reporting (PingER Management)
1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,
1 Evaluation of Techniques to Detect Significant Performance Problems using End-to-end Active Network Measurements Les Cottrell, SLAC 2006 IEEE/IFIP Network.
MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.
1 Network Monitoring for SCIC Les Cottrell, SLAC For ICFA meeting September, 2005 Initially funded by DoE Field Work proposal. Currently partially funded.
1 AMTv6: Active Measurement Tool in IPv6 Network Jaehoon Jeong, ETRI
Next Generation Network Monitoring for Pakistan: Proposal Prepared by: Les Cottrell SLAC, Arshad Ali NIIT For Prof. Dr. Atta-ur-Rehman, Chairman of HEC.
Internet Bandwidth Measurement Techniques Muhammad Ali Dec 17 th 2005.
Stanford University, SLAC, NIIT, the Digital Divide & Projects Prepared by Les Cottrell, SLAC for the NIIT Under Graduate Students, March 15, 2007.
LOGO 1 MAGGIE Measurement & Analysis of the Global Grid & Internet End-to-End Performance Monitoring A Research Collaboration by National University of.
Federation – Smokeping, PingER Integration Asma Shamshad Bit-4A.
A Step Towards Automated Event Diagnosis Stanford Linear Accelerator Center Adnan Iqbal, Yee-Ting Li, Les Cottrell Connie A. Log. Williams Jerrod.
1 ICFA/SCIC Network Monitoring Prepared by Les Cottrell, SLAC, for ICFA
Network Monitoring grid network performance measurement, simulation & analysis Presented by Warren Matthews at the Performance.
Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger
Performance Measurement Tools August 9 th 2011, OSG Site Admin Workshop Jason Zurawski – Internet2 Research Liaison.
Reading Report 14 Yin Chen 14 Apr 2004 Reference: Internet Service Performance: Data Analysis and Visualization, Cross-Industry Working Team, July, 2000.
1 Monitoring Internet connectivity of Research and Educational Institutions Les Cottrell – SLAC/Stanford University Prepared for the workshop on “Developing.
PingER: Research Opportunities and Trends R. Les Cottrell, SLAC University of Malaya.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.
1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February
Use cases Navigation Problem notification Problem analysis.
DataGrid Wide Area Network Monitoring Infrastructure (DWMI) Connie Logg February 13-17, 2005.
1 ESnet/HENP Active Internet End-to-end Performance & ESnet/University performance Les Cottrell – SLAC Presented at the ESSC meeting Albuquerque, August.
1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.
1 The PingER Project: Measuring the Digital Divide PingER Presented by Les Cottrell, SLAC At the SIS Show Palexpo/Geneva December 2003.
1 Implementing Monitoring and Reporting. 2 Why Should Implement Monitoring? One of the biggest complaints we hear about firewall products from almost.
1 Network Monitoring for SCIC Les Cottrell, SLAC ICFA/SCIC meeting August 24, aug05.ppt Initially.
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts) Prepared by: Les Cottrell SLAC, Faran Javed NIIT, Shahryar Khan NIIT,Umar Kalim NIIT.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
1 Measuring The Digital Divide Prepared by: Les Cottrell SLAC, Shahryar Khan NIIT/SLAC, Jared Greeno SLAC, Qasim Lone NIIT/SLAC Presentation to Princess.
1 Internet End-to-end Monitoring Project - Overview Les Cottrell – SLAC/Stanford University Partially funded by DOE/MICS Field Work Proposal on Internet.
1 SLAC IEPM PingER and BW monitoring & tools PingER Presented by Les Cottrell, SLAC At LBNL, Jan 21,
IEPM. Warren Matthews (SLAC) Presented at the ESCC Meeting Miami, FL, February 2003.
Quantifying the need for Improved Network Performance for S. Asia Prepared by: Les Cottrell SLAC & Shahryar Khan NIIT For the Internet2 Special Interest.
Internet2’s Dynamic Circuit Infrastructure Ciena CoreDirectors OSCARS + DRAGON for dynamic circuit allocation ION.
Xrootd Monitoring and Control Harsh Arora CERN. Setting Up Service  Monalisa Service  Monalisa Repository  Test Xrootd Server  ApMon Module.
1 IEPM/PingER Project Les Cottrell, SLAC DoE 2004 PI Network Research Meeting, FNAL Sep ‘04
TeraPaths: A QoS Enabled Collaborative Data Sharing Infrastructure for Petascale Computing Research The TeraPaths Project Team Usatlas Tier 2 workshop.
EGEE-II INFSO-RI Enabling Grids for E-sciencE End-to-End Service Level Agreement Provisioning and Monitoring for End-to-End QoS.
US LHC Tier-2 Network Performance BCP Mar-3-08 LHC Community Network Performance Recommended BCP Eric Boyd Deputy Technology Officer Internet2.
Navigating PingER Les Cottrell – SLAC Presented at the Optimization Technologies for Low-Bandwidth Networks, ICTP Workshop,
1 PingER performance to Bangladesh Prepared by Les Cottrell, SLAC for Prof. Hilda Cerdeira May 27, 2004 Partially funded by DOE/MICS Field Work Proposal.
BOF Discussion: Uploading IEPM-BW data to MonALISA Connie Logg SLAC Winter 2006 ESCC/Internet2 Joint Techs Workshop ESCCInternet2ESCCInternet2 February.
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Which network parameters are interesting
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Networking for the Future of Science
Using Netflow data for forecasting
The PingER Project: Measuring the Digital Divide
Wide Area Networking at SLAC, Feb ‘03
Connie Logg February 13 and 17, 2005
Chapter 8: Monitoring the Network
PingER: An Effort to Quantify the Digital Divide
Network Performance Measurement
SLAC monitoring Web Services
MAGGIE NIIT- SLAC On Going Projects
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts)
Net Rat Network Reliability and Troubleshooting.
The PingER Project: Measuring the Digital Divide
Presentation transcript:

Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement

SLAC Dr. Les Cottrell Dr. Yee-Ting Li Mr. Asif Khan Mr. Shahryar Khan Mr. Akbar Mehdi NIIT Dr. Arshad Ali Mr. Umar Kalim Mr. Azher Amin Mr. Adnan Iqbal Mr. Qasim Bilal Mr. Ahmad Hassan Mr. Faran Javed Mr. Fahad Ahmed Mr. Nauman Shah Team Members

Alumni SLAC Mr. Jerrod Williams Ms. Connie Logg NIIT Dr. Waqar Mehmood Mr. Ahsan Chaudry Mr. Ejaz Ahmed Mr. Fawad Nazir Mr. Aziz Allaudin Ms. Fareena Saqib Ms. Asma Shamshad Mr. Raja Asher Mr. Waqar Ali Ms. Rabail Javed

Ongoing Projects PingER IEPM Trilateration Utility for Locating IP Addresses Event Detection Event Diagnosis Topology Service for PerfSONAR Network Weather Forecasting DataGrid WAN Monitoring Infrastructure (DWMI) Terapaths Monitoring Project

PingER Methodology Internet 10 ping request packets each 30 mins Remote Host (typically a server) Monitoring host Ping response packets Measure Round Trip Time & Loss Data SLAC Once a Day Uses ubiquitous ping > ping remhost

Coverage

PingER (Sub Projects) Most of South Asia has good connectivity Greater Coverage Area Min RTTs are decreasing globally For S.Asia Loss decreasing, still far behind others SmokePing PingER Integration ViPER - Visualization for PingER AMP PingER Integration PingER Executive Plots PingER Management ICFA/SCIC Report

Topology Service for PerfSONAR To archive network topology information needed for the operation of perfSONAR and Visualization tools. Each AS has to maintain its own topology database and publish it to the perfSONAR framework. The ToS will define a topology information data format to allow for an easy processing of topology information. Beside of the current topology, it should contain past and planned network configuration. Each AS should register its ToS with the Lookup Service, so that the topology becomes available to every interested user.

Trilateration Utility for Locating IP Addresses (TULIP) Java applet (needs Java Webstart) Friendly client, easy vizualization Need landmarks around world Landmarks Target Enter target Pings min/avg/max from landmarks to targets Traceroutes from landmarks to targets

Automated Event Detection Based on IEPM-BW Different Network Monitoring tools (Ping, IPerf, Thrulay, Pathchirp etc) Variety of Metrics (Throughput, RTT, available bandwidth, Traceroutes) Topology (5 Monitoring Hosts, Over 25 Monitored nodes) Different Mechanisms (Holt-winters, Plateau etc) Alerts are Detected Reported through Stored in database Made available on web

Event Diagnosis End-to-end analysis; assume that the problem may not just be from the network Initiate analysis of all available results when an event is detected Search Event DB for each metric checked on each host and used to cross correlate results between Monitoring Hosts or Monitored Nodes Use heuristics defined with a simple summation algorithm to narrow down the location of a fault. Tiered system used to pin-point exact cause of problem. Start from high level to very low level to help locate, identify and verify cause of alert Heuristics based approach

DataGrid WAN Monitoring Infrastructure (DWMI) Terapaths Monitoring Project Terapath fully configurable passive monitoring infrastructure based on netflow records exported from routers data collection and aggregation schemes Flexible reporting infrastructure Traffic In Traffic out

Topology Service for PerfSONAR PerfSONAR Measurement Point Service Measurement Archive Service Authentication Service Lookup Service Topology Service Transformation Service

Proposals (under process) To establish a perfSONAR based network monitoring infrastructure in Pakistan Next Generation Network Monitoring for Pakistan To join the International perfSONAR project (currently: Europe, US & Brazilian NRENs):

Visit