BOF Discussion: Uploading IEPM-BW data to MonALISA Connie Logg SLAC Winter 2006 ESCC/Internet2 Joint Techs Workshop ESCCInternet2ESCCInternet2 February.

Slides:

Advertisements

Similar presentations

Edge-based Network Modeling and Inference

Advertisements

pathChirp Efficient Available Bandwidth Estimation

RED-PD: RED with Preferential Dropping Ratul Mahajan Sally Floyd David Wetherall.

Bandwidth Estimation Workshop 2003 Evaluating pathrate and pathload with realistic cross-traffic Ravi Prasad Manish Jain Constantinos Dovrolis (ravi, jain,

RED Enhancement Algorithms By Alina Naimark. Presented Approaches Flow Random Early Drop - FRED By Dong Lin and Robert Morris Sabilized Random Early Drop.

Networks and TCP/IP Part 2. PORTS Ports – What and Why are They?  Typically: Computers usually have only one network access point to the internet 

Presentation by Joe Szymanski For Upper Layer Protocols May 18, 2015.

The Tension Between High Video Rate and No Rebuffering Te-Yuan (TY) Huang Stanford University IRTF Open 87 July 30th, 2013 Joint work Prof.

1 Traceanal: a tool for analyzing and representing traceroutes Les Cottrell, Connie Logg, Ruchi Gupta, Jiri Navratil SLAC, for the E2Epi BOF, Columbus.

1 Correlating Internet Performance & Route Changes to Assist in Trouble- shooting from an End-user Perspective Les Cottrell, Connie Logg, Jiri Navratil.

1 SLAC Internet Measurement Data Les Cottrell, Jerrod Williams, Connie Logg, Paola Grosso SLAC, for the ISMA Workshop, SDSC June,

1 Evaluation of Techniques to Detect Significant Performance Problems using End-to-end Active Network Measurements Les Cottrell, SLAC 2006 IEEE/IFIP Network.

EE689 Lecture 5 Review of last lecture More on HPF RED.

MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.

1 Random Early Detection Gateways for Congestion Avoidance Sally Floyd and Van Jacobson, IEEE Transactions on Networking, Vol.1, No. 4, (Aug 1993), pp

Available bandwidth measurement as simple as running wget D. Antoniades, M. Athanatos, A. Papadogiannakis, P. Markatos Institute of Computer Science (ICS),

Defending Against Low-rate TCP Attack: Dynamic Detection and Protection Haibin Sun John C.S.Lui CSE Dept. CUHK David K.Y.Yau CS Dept. Purdue U.

1 Emulating AQM from End Hosts Presenters: Syed Zaidi Ivor Rodrigues.

Internet Bandwidth Measurement Techniques Muhammad Ali Dec 17 th 2005.

Advanced Computer Networks : RED 1 Random Early Detection Gateways for Congestion Avoidance Sally Floyd and Van Jacobson, IEEE Transactions on Networking,

Lect3..ppt - 09/12/04 CIS 4100 Systems Performance and Evaluation Lecture 3 by Zornitza Genova Prodanoff.

POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 2. Network Monitoring Metrics.

POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 4. Active Monitoring Techniques.

LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.

Transport over Wireless Networks Myungchul Kim

IEPM-BW Deployment Experiences Connie Logg SLAC Joint Techs Workshop February 4-9, 2006.

27th, Nov 2001 GLOBECOM /16 Analysis of Dynamic Behaviors of Many TCP Connections Sharing Tail-Drop / RED Routers Go Hasegawa Osaka University, Japan.

Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

IEPM-BW: Bandwidth Change Detection and Traceroute Analysis and Visualization Connie Logg, Joint Techs Workshop February 4-9, 2006.

TCP Trunking: Design, Implementation and Performance H.T. Kung and S. Y. Wang.

Multiplicative Wavelet Traffic Model and pathChirp: Efficient Available Bandwidth Estimation Vinay Ribeiro.

Masaki Hirabaru NICT Koganei 3rd e-VLBI Workshop October 6, 2004 Makuhari, Japan Performance Measurement on Large Bandwidth-Delay Product.

Performance Engineering E2EpiPEs and FastTCP Internet2 member meeting - Indianapolis World Telecom Geneva October 15, 2003

Random Early Detection (RED) Router notifies source before congestion happens - just drop the packet (TCP will timeout and adjust its window) - could make.

Grid Computing slide to be used anywhere Harness global resources to improve performance.

TCP continued. Discussion – TCP Throughput TCP will most likely generate the saw tooth type of traffic. – A rough estimate is that the congestion window.

TCP transfers over high latency/bandwidth networks & Grid DT Measurements session PFLDnet February 3- 4, 2003 CERN, Geneva, Switzerland Sylvain Ravot

Peer-to-Peer Networks 13 Internet – The Underlay Network

CS492B Project #2 TCP Tutorial # Jin Hyun Ju.

Real-time Transport for Assured Forwarding: An Architecture for both Unicast and Multicast Applications By Ashraf Matrawy and Ioannis Lambadaris From Carleton.

1 IEPM / PingER project & PPDG Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99 Partially funded by DOE/MICS Field Work Proposal on.

Bandwidth Estimation of a Network Path ET-4285 Measuring & Simulating the internet Bandwidth Estimation of a Network Path Group 4: S. Ngabonziza Rugemintwaza.

IEPM-BW Deployment Experiences

Window Control Adjust transmission rate by changing Window Size

Master’s Project Presentation

The CALgorithm for Detecting Bandwidth Changes

IEPM-BW Deployment Experiences

BOF Discussion: Uploading IEPM-BW data to MonALISA

Generalizing The Network Performance Interference Problem

Using Netflow data for forecasting

Connie Logg, Joint Techs Workshop February 4-9, 2006

Wide Area Networking at SLAC, Feb ‘03

My Experiences, results and remarks to TCP BW and CT Measurements Tools Jiří Navrátil SLAC.

End-to-end Anomalous Event Detection in Production Networks

Experiences in Traceroute and Available Bandwidth Change Analysis

Evaluation of Techniques to Detect Significant Performance Problems using End-to-end Active Network Measurements Mahesh Chhaparia & Les Cottrell, SLAC.

“Promoting the Use of End-to-End Congestion Control in the Internet”

Experiences in Traceroute and Available Bandwidth Change Analysis

Forecasting Network Performance

TCP Throughput Modeling

TCP Congestion Control

Correlating Internet Performance & Route Changes to Assist in Trouble-shooting from an End-user Perspective Les Cottrell, Connie Logg, Jiri Navratil SLAC.

MAGGIE NIIT- SLAC On Going Projects

The CALgorithm for Detecting Bandwidth Changes

By Manish Jain and Constantinos Dovrolis 2003

Transport Layer: Congestion Control

pathChirp Efficient Available Bandwidth Estimation

pathChirp Efficient Available Bandwidth Estimation

Presentation transcript:

BOF Discussion: Uploading IEPM-BW data to MonALISA Connie Logg SLAC Winter 2006 ESCC/Internet2 Joint Techs Workshop ESCCInternet2ESCCInternet2 February 4-9, 2006

Overview Several discussions about uploading IEPM- BW data and alerts to MonALISA Consider: What parts of data (varies with probe type) Mechanism (every n minutes or as data is taken) What parts of ALERTS?

Data Fields Vary with type of probe PING – RTT (min, avg, max), Packets sent, Packets Received, Packet order (probably not) ? Traceroute – list of IP addresses in the traceroute

Data Fields - Continued IPERF - #streams - Window size, throughput achieved. With incremental reporting are the thruput min, max, avg and std dev of incremental values of interest ? (I do not think so)

Data Fields - Continued THRULAY TCP: total thruput; RTT min, max, and avg. With incremental reporting are the thruput min, max, avg and std dev of incremental values of interest? (I do not think so) PATHCHIRP: achievable bandwidth; min, avg, max of chirping steps - NO

Data Fields - Continued PATHLOAD – min and max of thruput range ? CAVEATS: Only upload data from relevant and quality probes – for example Pathchirp works well on some paths, and not so well on others.

ALERTS IEPM-BW has an algorithm for auto detection of bandwidth drops. Need to choose only alerts on relevant and quality probes Do not flood MonALISA with every alert that is detected.

ALERT Mechanism Baseline data – in ‘history’ buffer – has a mean and std dev Data less than (mean – 2 std dev) is put in ‘trigger’ buffer for examination Trigger buffer also has mean and std dev. When trigger buffer is full and (history_mean – trigger_mean)/history_mean meets or exceeds the drop threshold, an ALERT is generated.

ALERTS – Info to Upload Baseline mean and std dev of ‘history’ buffer before drop Date and time when drop is detected in ‘trigger’ buffer Percentage of drop from history mean to trigger mean Mean and std dev of ‘trigger’ buffer Values in Trigger buffer (probably not)

Guidance/Input Needed What probes, how frequent, and length of history and trigger buffers What probe data to upload to MonALISA What alert information to upload to MonALISA How to upload information to MonALISA Other thoughts, comments and suggestions