LOGO 1 MAGGIE Measurement & Analysis of the Global Grid & Internet End-to-End Performance Monitoring A Research Collaboration by National University of.

Slides:



Advertisements
Similar presentations
ABSTRACT Due to the Internets sheer size, complexity, and various routing policies, it is difficult if not impossible to locate the causes of large volumes.
Advertisements

Chapter 3: Planning a Network Upgrade
4.1.5 System Management Background What is in System Management Resource control and scheduling Booting, reconfiguration, defining limits for resource.
The Network Weather Service A Distributed Resource Performance Forecasting Service for Metacomputing Rich Wolski, Neil T. Spring and Jim Hayes Presented.
Geolocation Les Cottrell – SLAC University of Helwan / Egypt, Sept 18 – Oct 3, 2010 Partially funded by DOE/MICS Field Work Proposal on Internet End-to-end.
Discovering Computers Fundamentals, 2011 Edition Living in a Digital World.
PingER Management1 Error Reporting Model for Ping End-to-End Reporting (PingER Management)
MAGGIE NIIT- SLAC On Going Projects Measurement & Analysis of Global Grid & Internet End to end performance.
OCT1 Principles From Chapter One of “Distributed Systems Concepts and Design”
NUST Institute of Information Technology Progress Presentation By Faran Javed Chawla BIT - 5.
Brief History of Internet. Internet Impact Check weather Buy goods Play music Find the shortest route Give a lecture…
Path Protection in MPLS Networks Using Segment Based Approach.
Policy for Transforming Teaching & Learning through ICTs in South Africa Seugnet Blignaut Seugnet Blignaut
Winter Retreat Connecting the Dots: Using Runtime Paths for Macro Analysis Mike Chen, Emre Kıcıman, Anthony Accardi, Armando Fox, Eric Brewer
Scalable Server Load Balancing Inside Data Centers Dana Butnariu Princeton University Computer Science Department July – September 2010 Joint work with.
Internet Traffic Management Prafull Suryawanshi Roll No - 04IT6008.
Reading Report 14 Yin Chen 14 Apr 2004 Reference: Internet Service Performance: Data Analysis and Visualization, Cross-Industry Working Team, July, 2000.
On the Power of Off-line Data in Approximating Internet Distances Danny Raz Technion - Israel Institute.
PingER: Research Opportunities and Trends R. Les Cottrell, SLAC University of Malaya.
Coastal and Marine Spatial Planning Debra Hernandez, SECOORA Walter Johnson, BOEMRE Ru Morrison, NERACOOS Charly Alexander, IOOS Office.
A Delaunay Triangulation Architecture Supporting Churn and User Mobility in MMVEs Mohsen Ghaffari, Behnoosh Hariri and Shervin Shirmohammadi Advanced Communications.
Internet Traffic Management. Basic Concept of Traffic Need of Traffic Management Measuring Traffic Traffic Control and Management Quality and Pricing.
MARCH 27, Meeting Agenda  Prototype 1 Design Goals  Prototype 1 Demo  Framework Overview  Prototype 2 Design Goals  Timeline Moving Forward.
Information Technology and Database Global Theme Yulu Xia, Ron Stinner, Jim VanKirk, Jim Harper North Carolina State University April 4-8, 2006.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
Visualization, analysis and mining of geo- spatial information in educational data sets using web-based tools Aniruddha Desai |Winter 2013 Presentation.
LOGO 1 TULIP Trilateration Utility for Locating IP addresses Presented By Faran Javed BIT-5.
Computers in Urban Planning Computational aids – implementation of mathematical models, statistical analyses Data handling & intelligent maps – GIS (Geographic.
1 The Research on Analyzing Time- Series Data and Anomaly Detection in Internet Flow Yoshiaki HARADA Graduate School of Information Science and Electrical.
Department of Information Engineering The Chinese University of Hong Kong A Framework for Monitoring and Measuring a Large-Scale Distributed System in.
LAN and WAN Monitoring at SLAC Connie Logg September 21, 2005.
School of Electrical Engineering & Computer Science National University of Sciences & Technology (NUST), Pakistan Profile Mohammad Asif Khan.
A Web-based Distributed Simulation System Christopher Taewan Ryu Computer Science Department California State University, Fullerton.
Stanford University, SLAC, NIIT, the Digital Divide & Bandwidth Challenge Prepared by Les Cottrell, SLAC for the NIIT, March 9, 2007.
Russ Hobby Program Manager Internet2 Cyberinfrastructure Architect UC Davis.
Measurement & Analysis of Global Grid & Internet End to end performance (MAGGIE) Network Performance Measurement.
1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
Relay Placement Problem in Smart Grid Deployment Wei-Lun Wang and Quincy Wu Department of Computer Science and Information Engineering, National Chi Nan.
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts) Prepared by: Les Cottrell SLAC, Faran Javed NIIT, Shahryar Khan NIIT,Umar Kalim NIIT.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Soil and Water Conservation Modeling: MODELING SUMMIT SUMMARY COMMENTS Dennis Ojima Natural Resource Ecology Laboratory COLORADO STATE UNIVERSITY 31 MARCH.
The Globus Toolkit®: The Open Source Solution for Grid Computing
S. Shumilov – Zürich Analytical Visualization Framework - a visual data processing and knowledge discovery system Ivan Denisovich, Serge Shumilov Department.
Resilient Overlay Networks Robert Morris Frans Kaashoek and Hari Balakrishnan MIT LCS
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Jeremy Nowell EPCC, University of Edinburgh A Standards Based Alarms Service for Monitoring Federated Networks.
1 Version 3.1 Module 6 Routed & Routing Protocols.
PRINCIPLES OF COMMUNICATION NETWORKS Tel Aviv University March-2010.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Internet Connectivity and Performance for the HEP Community. Presented at HEPNT-HEPiX, October 6, 1999 by Warren Matthews Funded by DOE/MICS Internet End-to-end.
- GMA Athena (24mar03 - CHEP La Jolla, CA) GMA Instrumentation of the Athena Framework using NetLogger Dan Gunter, Wim Lavrijsen,
Monitoring Guy Warner NeSC Training.
David Foster, CERN GDB Meeting April 2008 GDB Meeting April 2008 LHCOPN Status and Plans A lot more detail at:
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
1 Particle Physics Data Grid (PPDG) project Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99.
Distributed Network Monitoring in the Wisconsin Advanced Internet Lab Paul Barford Computer Science Department University of Wisconsin – Madison Spring,
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
OPEN SOURCE NETWORK MANAGEMENT TOOLS
SDN challenges Deployment challenges
Discovering Computers 2010: Living in a Digital World Chapter 14
Improved Algorithms for Network Topology Discovery
Robert Szuman – Poznań Supercomputing and Networking Center, Poland
Chapter 5 The Network Layer.
Grid Computing B.Ramamurthy 9/22/2018 B.Ramamurthy.
Connie Logg February 13 and 17, 2005
2b. GSICS Coordination Centre (GCC)
Caio Coelho (Joint CBS/CCl IPET-OPSLS Co-chair) CPTEC/INPE, Brazil
MAGGIE NIIT- SLAC On Going Projects
Locating hosts by TULIP (Trilateration Utility for Locating IP hosts)
Presentation transcript:

LOGO 1 MAGGIE Measurement & Analysis of the Global Grid & Internet End-to-End Performance Monitoring A Research Collaboration by National University of Sciences and Technology (NUST) and Stanford Linear Accelerator Center (SLAC)

2 Agenda Motivation for MAGGIE 1 IEPM & SLAC 2 Contribution by NUST/NIIT 3

3 Motivation for MAGGIE The Development and Integration of network performance monitoring tools into a scalable infrastructure providing reliable statistics, analysis and access to data.

4 Motivation  The increasing amount of computing and networking power has created a need for better and more integrated Network Performance Measurement and Monitoring.  What is needed is to develop a ubiquitous monitoring infrastructure that would:  Develop means to collect statistics reliably and analyze them  Provide the measurements seen in multiple monitoring projects  Allow us to co-ordinate and integrate tools in a co- operative framework.

5 IEPM & PingER  IEPM  Monitoring network connectivity and End-to-end performance for sites involved in High Energy Nuclear and Particle Physics  PingER – Ping end-to-End Reporting  Used to monitor end-to-end performance of Internet links PingER historical graphs

6 The Digital Divide

7 Projects  2004 & 2005  Nearest Abroad Neighbor (NAN)  Nearest Joint Point (NJP)  Network Anomaly Detection Using PCA  TULIP – IP Geolocation  PingER Executive Plots  PingER Management  2006  Visualization for PingER (VIPER)  Topological Analysis and Visualization  Network Weather Forecasting (NWF) Regression techniques Holts-Winter’s Algorithm ARMA/ARIMA  Federation of Monitoring Infrastructures SmokePng-PingER Integration PingER-AMP Integration  Several other projects… Skip details

8 Nearest Abroad Neighbor – NAN  An analysis which is of special interest to the part of the world which does not have a dense communication infrastructure (South America, Africa, Asia).  NAN tell us the shortest path (in terms of smallest RTT) to another PingER site abroad from selected location Group members: Fawad Nazir Sufyan Masood Faran Javed

9 Nearest Joint Point NJP Related Projects: Nearest Abroad Neighbor Suggest to change routing policies for improved faster routing Purpose to reduce the path after NJP Group members: Fawad Nazir Faran Javed

10 VIPER – PingER Visualization  An Interactive visualization for PingER  Visualizes the Digital Divide Group members: Sheryar Khan sheryar/ du/comp/net/wan- mon/viper/

11 Network Weather Forecasting Group members: Azam Bukhari Adnan Iqbal Raja Ashar Fareena Saqib Noman Shah  Regression Techniques  Holts-Winter’s Algorithm  ARMA/ARIMA

12 Network Anomaly Detection & Diagnosis Group members: Adnan Iqbal  Anomaly Case Studies  Event Detection  Event Diagnosis  Using Principle Component Analysis

13 TULIP – IP Geo Location  Geolocation of an IP address  Uses the principle of Trilateration  Takes RTT measurements from various landmarks around the globe. Group members: Faran Javed

14 A measure of accuracy by region

15 Implementations  Fully functional prototype available at  Nearly all development challenges have been met & 90 % of the issues are resolved  A stripped down version of the API is available  Small issues keep up coming. Many parsers for results analysis & extraction have to be written  The code is well documented

16 Guthrie Vs TULIP Longitude

17 Guthrie Vs TULIP latitude

18 TULIP Vs NetGeo Latitude

19 TULIP Vs NetGeo Longitude

20 Guthrie Vs NetGeo Latitude

21 Guthrie Vs NetGeo Longitude

22 Topology Discovery & Analysis  LAN & WAN Topology discovery  SNMP  Single-ended probes & without SNMP  Gathering Performance Statistics

LOGO 23 Thank you You can visit us at: Back to projects