PerfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.

Slides:



Advertisements
Similar presentations
Circuit Monitoring July 16 th 2011, OGF 32: NMC-WG Jason Zurawski, Internet2 Research Liaison.
Advertisements

Distributed Data Processing
Nagios Integration January , perfSONAR-PS Developers Meeting Jason Zurawski, Internet2 Brian Tierney, ESnet.
1 NETE4631 Cloud deployment models and migration Lecture Notes #4.
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Connect. Communicate. Collaborate WI5 – tools implementation Stephan Kraft October 2007, Sevilla.
Red Hat Linux Network. Red Hat Network Red Hat Network is the environment for system- level support and management of Red Hat Linux networks. Red Hat.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
Notes to the presenter. I would like to thank Jim Waldo, Jon Bostrom, and Dennis Govoni. They helped me put this presentation together for the field.
© 2009 VMware Inc. All rights reserved VMware Updates Orlando VMware User Group – April 2011 Ryan Johnson VMware, Inc. Technical Account Manager Professional.
1 ITC242 – Introduction to Data Communications Week 12 Topic 18 Chapter 19 Network Management.
PerfSONAR Client Construction February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger
Performance Measurement Tools August 9 th 2011, OSG Site Admin Workshop Jason Zurawski – Internet2 Research Liaison.
Performance Measurement Tools March 10 th 2011, OSG All Hands Workshop - Network Performance Jason Zurawski, Internet2.
Software Engineering Muhammad Fahad Khan
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.
PerfSONAR Performance Monitoring Framework Matt Zekauskas, GENI Measurement Workshop June 26, 2009 Madison, Wisconsin.
1 ESnet Network Measurements ESCC Feb Joe Metzger
NASRULLAH KHAN.  Lecturer : Nasrullah   Website :
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
1 Apache. 2 Module - Apache ♦ Overview This module focuses on configuring and customizing Apache web server. Apache is a commonly used Hypertext Transfer.
Connect communicate collaborate perfSONAR MDM updates: New interface, new possibilities Domenico Vicinanza perfSONAR MDM Product Manager
PerfSONAR Information Services Update Jason Zurawski Feb 2, 2009 Winter Joint Techs 2009, College Station Texas.
Diagnostics vs Regular Monitoring March 10 th 2011, OSG All Hands Workshop - Network Performance Jason Zurawski, Internet2.
Connect communicate collaborate perfSONAR MDM updates: New interface, new weathermap, towards a complete interoperability Domenico Vicinanza perfSONAR.
The Network Performance Advisor J. W. Ferguson NLANR/DAST & NCSA.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks perfSONAR deployment over Spanish LHC Tier.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
Internet2 Performance Update Jeff W. Boote Senior Network Software Engineer Internet2.
PerfSONAR Information Discovery February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D.
1 Measuring Circuit Based Networks Joint Techs Feb Joe Metzger
Internet2 & perfSONAR-PS August 23 rd 2012, OSG & perfSONAR-PS Meeting Jason Zurawski – Senior Research Engineer.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Business Data Communications, Fourth Edition Chapter 11: Network Management.
Connect. Communicate. Collaborate Hades – Going Operational Roland Karch, RRZE FAU Erlangen-Nürnberg JRA1 Montpellier Meeting, October 2006.
1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.
February 6-8, 2006[Joint Techs] Albuquerque, NM Performance Tool Development: NLANR Network Performance Advisor J. W. Ferguson NCSA.
Microsoft Management Seminar Series SMS 2003 Change Management.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Internet2’s Dynamic Circuit Infrastructure Ciena CoreDirectors OSCARS + DRAGON for dynamic circuit allocation ION.
Master thesis Analysis and implementation of monitoring systems of active network equipment. Scientific advisor: Univ. Prof., Dr. Hab., Pavel TOPALA Master.
US LHC Tier-2 Network Performance BCP Mar-3-08 LHC Community Network Performance Recommended BCP Eric Boyd Deputy Technology Officer Internet2.
PerfSONAR-PS Working Group Aaron Brown/Jason Zurawski January 21, 2008 TIP 2008 – Honolulu, HI.
E2E piPEfitters Eric L. Boyd. 2 Agenda NLANR / DAST Advisor Jim Ferguson John Estabrook OWAMP Jeff Boote SONAR Prototype Deployment Eric Boyd.
DICE: Authorizing Dynamic Networks for VOs Jeff W. Boote Senior Network Software Engineer, Internet2 Cándido Rodríguez Montes RedIRIS TNC2009 Malaga, Spain.
GEMINI: Active Network Measurements Martin Swany, Indiana University.
Connect. Communicate. Collaborate JRA1 Status Update Stephan Kraft, RRZE FAU Erlangen-Nürnberg JRA1 Montpellier Meeting, October 2006.
LHCONE Monitoring Thoughts June 14 th, LHCOPN/LHCONE Meeting Jason Zurawski – Research Liaison.
Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –
Connect communicate collaborate perfSONAR MDM News Domenico Vicinanza DANTE (UK)
Advanced Network Diagnostic Tools Richard Carlson EVN-NREN workshop.
PerfSONAR Update Jason Zurawski October, 2007 OGF 21 – Seattle WA.
Campana (CERN-IT/SDC), McKee (Michigan) 16 October 2013 Deployment of a WLCG network monitoring infrastructure based on the perfSONAR-PS technology.
1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.
Scientific Linux Inventory Project (SLIP) Troy Dawson Connie Sieh.
PSPT 3.2 Development Update October 13 th 2010, USATLAS Distributed Facilities Workshop Jason Zurawski, Internet2.
Overview – SOE Net-SNMP v5.7.2
Overview – SOE Net-SNMP v
Overview – SOE Net-SNMP v5.7.3
By Sachin Kumar Korenga & Rochita Thakkallapally
System Center 2012 Configuration Manager
Path Monitoring Tools Deployment Planning for U.S. T123
Networking for the Future of Science
Robert Szuman – Poznań Supercomputing and Networking Center, Poland
Internet2 Performance Update
Deployment & Advanced Regular Testing Strategies
ESnet Network Measurements ESCC Feb Joe Metzger
Presentation transcript:

perfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D

perfSONAR-PS Availability – Where to Find – How to Install – More Information perfSONAR-PS Tools – Measurement Points and Archives – Information Services – Analysis and GUIs perfSONAR-PS Utility – Regular Monitoring Infrastructure – Diagnostic Toolkit 2 – 12/8/2015, © 2009 Internet2 Outline

perfSONAR-PS is an implementation of the perfSONAR measurement infrastructure and protocols written in the perl programming language All products are available as platform and architecture independent source code. All products are available as RPMs (e.g. RPM Package Manager). The perfSONAR-PS consortium directly supports the following operating systems: – Red Hat Enterprise Linux (versions 4 and 5) – CentOS (versions 4 and 5) – Scientific Linux (versions 4 and 5) RPMs are compiled for the x86 and x86 64 bit architectures. Functionality on other platforms and architectures is possible, but not supported. Attempts are done at the user’s own risk. 3 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

The pS Performance Toolkit (pSPT) is a Linux ISO image (e.g. a LiveCD) packed by Internet2 for both easy of installation and configuration of performance tools – Based on Knoppix Linux – Designed for x86 architecture – No explicit support for x86 64 bit but compatibility is expected Product also contains other relevant measurement tools and perfSONAR-PS dependencies. Support structure is limited to the following goals: – Updated versions of all software (operating system and performance) with each release – Monitoring and alerts regarding critical security vulnerabilities for all software. Critical patches and releases available for severe cases – Semi annual (4 times per year) minor releases 4 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

perfSONAR-PS and the pSPT are available from – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

To facilitate installation and updates on the supported platforms, installation is available through several package managers: – YUM – Up2date – APT-RPM Instructions to enable are available on Installing software becomes a simple one step operation – Dependencies are managed by the operating system – Software is identified by name, and can be searched for 6 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

Using YUM to search for packages: 7 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

Using YUM to install packages: 8 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

perfSONAR-PS is working to build a strong user community to support the use and development of the software. perfSONAR-PS Mailing Lists – Users List: – Announcement List: ps-announce ps-announce pSPT Mailing Lists – Users List: – Announcement List: – 12/8/2015, © 2009 Internet2 perfSONAR-PS Availability

perfSONAR-PS Tools can be broken into 3 categories: – Measurement Points and Archives – Information Services – Analysis tools and GUIs The following sections will explain the differences between the categories as well as describe the utility each offers. Development on perfSONAR-PS continues to be active and new services are added over time Contributions from the community with regards to ideas or development work are encouraged 10 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Tools

Measurement Archives store the results of measurements – Results can come from external sources (e.g. Cacti, MRTG, Cricket) – Results can come from a perfSONAR MP performing measurements Designed to run on any machine – Should be located in the same physical domain, but this is not a requirement Examples in perfSONAR-PS – SNMP MA: Results of SNMP collection (interface counters, etc.) – Status MA: Results of TL1 collection (optical devices) – perfSONAR-BUOY: OWAMP and BWCTL (one way latency and bandwidth testing) results – PingER: Ping (round trip latency) results. 11 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Tools - MAs

12 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Framework Deployment

13 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Framework Deployment

Measurement Points perform measurements and store the results locally, or in Measurement Archives – Perform on-demand testing – Perform test according to a schedule Designed to run on any machine Examples in perfSONAR-PS – Status MA Scripts: Gather TL1 or SNMP results. – perfSONAR-BUOY: OWAMP and BWCTL (one way latency and bandwidth testing) scheduled testing – PingER: Ping (round trip latency) scheduled testing. 14 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Tools - MPs

15 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Framework Deployment

Information services are the glue of the framework – Collect statistics and status of deployed services – Answer queries from clients and services – Allow for federation, e.g. the sharing of information across domains Designed to run on any machine – Must be located in the same physical domain Examples in perfSONAR-PS – Lookup Service: Manages service and data locality – Topology Service: Manages topological knowledge for a domain 16 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Tools - IS

17 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Framework Deployment

Analysis tools and GUIs plot data from perfSONAR services. – Utilize the IS infrastructure to locate specific data – Communicate with MAs to gather data – Communicate with MPs to perform live tests Designed to run on any machine Examples in perfSONAR-PS – perfAdmin: CGI scripts to locate and manage perfSONAR services and data – PingER GUI: Displays the results of PingER testing 18 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Tools - GUIs

19 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Framework Deployment

perfSONAR-PS appeals to both network users and operators: – Operators: Easy deployment Minimal maintenance Results relevant to common problems (e.g. connectivity loss, equipment failure, performance problems) – Users: Immediate access to network data Cross domain capabilities Adoption is spreading to networks of all sizes The perfSONAR-PS framework has two primary high level use cases: – Diagnostic (e.g. on-demand) use – Monitoring Infrastructure 20 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Utility

The pS Performance Toolkit was designed for one-off diagnostic use – All tools preconfigured – Minimal installation requirements – Can deploy multiple instances for short periods of time in a domain Enhancements to the original design also allow for use in regular monitoring. Other perfSONAR-PS and performance tools can function in the same role as the toolkit – Requires longer installation/configuration phase – Requires semi-permanent home for services 21 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Utility - Diagnostics

Regular monitoring is an important design consideration for perfSONAR-PS tools – perfSONAR-BUOY and PingER provide scheduling infrastructure to create regular latency and bandwidth tests – The SNMP MA integrates with COTS SNMP monitoring solutions The pSPT is capable of organizing and visualizing regular tests NAGIOS can be integrated with perfSONAR-PS tools to facilitate alerting to potential network performance degradation 22 – 12/8/2015, © 2009 Internet2 perfSONAR-PS Utility - Monitoring

perfSONAR-PS Tools – Widely available – Easy to install, configure, use – Addressing several key facets of network performance Designed for use in a diagnostic or regular monitoring role Automatic federation with other deployments GUIs gaining traction – Useful for network operators to diagnose and visual performance problems – Useful for users to understand end to end performance 23 – 12/8/2015, © 2009 Internet2 Conclusion

perfSONAR-PS Functionality February 11 th 2010, APAN 29 – perfSONAR Workshop Jeff Boote, Assistant Director R&D For more information, visit psps.perfsonar.net 24 – 12/8/2015, © 2009 Internet2