A new tool for network telemetry analytics.

Slides:



Advertisements
Similar presentations
Essential Software Architecture Chapter Two - Introducing the Case Study Ian Gorton CS590 – Winter 2008.
Advertisements

October 2003 Iosif Legrand Iosif Legrand California Institute of Technology.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
© eg solutions plc Global Workforce Optimisation for the Back Office eg operational intelligence ® Elizabeth Gooch | October 2014.
Polaris Financial Technologies Welcomes the members of Hyderabad chapter for the 2nd event on 4 th July 14 held by PACE (The Testing Practice)
Live dashboards for Progress built by anyone, available anywhere. Introducing DataPA OpenAnalytics Nick Finch CTO.
CERN IT Department CH-1211 Genève 23 Switzerland t Messaging System for the Grid as a core component of the monitoring infrastructure for.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 12 Slide 1 Distributed Systems Design 1.
FileSecure Implementation Training Patch Management Version 1.1.
Protocols and the TCP/IP Suite Chapter 4. Multilayer communication. A series of layers, each built upon the one below it. The purpose of each layer is.
A Seminar on Securities In Cloud Computing Presented by Sanjib Kumar Raul Mtech(ICT) Roll-10IT61B09 IIT Kharagpur Under the supervision of Prof. Indranil.
By N.Gopinath AP/CSE. Why a Data Warehouse Application – Business Perspectives  There are several reasons why organizations consider Data Warehousing.
McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc. All rights reserved. BUSINESS DRIVEN TECHNOLOGY Chapter Twelve: Integrating the Organization from.
BUSINESS DRIVEN TECHNOLOGY
Net Optics Confidential and Proprietary Net Optics appTap Intelligent Access and Monitoring Architecture Solutions.
CSD 2006 / TEAM 12 Final presentation 29 th May 2006.
Business Requirements Using Unified Modeling Language Eric H. Castain, SVP Internet Services Group, Architecture Wells Fargo March 2005.
1 Copyright © 2004, Oracle. All rights reserved. Introduction to Oracle Forms Developer and Oracle Forms Services.
Operating System Review September 10, 2012Introduction to Computer Security ©2004 Matt Bishop Slide #1-1.
Software Component Technology and Component Tracing CSC532 Presentation Developed & Presented by Feifei Xu.
IBM Corporation IDATE November 20, 2003 Investment in the Mobile Enterprise Scott Stainken General Manager, Global Pervasive/Wireless e-Business.
M.A.Doman Short video intro Model for enabling the delivery of computing as a SERVICE.
Software Defined Networks for Dynamic Datacenter and Cloud Environments.
Intelligent Performance Management Empowering Your Enterprise Duane E. Presti, CEO PARIS Technologies, Inc.
An Architecture and Prototype Implementation for TCP/IP Hardware Support Mirko Benz Dresden University of Technology, Germany TERENA 2001.
CERN IT Department CH-1211 Geneva 23 Switzerland t GDB CERN, 4 th March 2008 James Casey A Strategy for WLCG Monitoring.
The Intelligent Infrastructure John Pollard – 29 th April 2008
Network management Network management refers to the activities, methods, procedures, and tools that pertain to the operation, administration, maintenance,
CERN IT Department CH-1211 Genève 23 Switzerland t CERN IT Monitoring and Data Analytics Pedro Andrade (IT-GT) Openlab Workshop on Data Analytics.
CSC 480 Software Engineering Lecture 17 Nov 4, 2002.
1 Acquisition Automation – Challenges and Pitfalls Breakout Session # E11 Name: Jim Hargrove and Allen Edgar Date: Tuesday, July 31, 2012 Time: 2:30 pm-3:45.
ENGINEERING PRACTICES FOR CONTINUOUS DELIVERY: From Metrics and Deployment Pipelines to Integration and Microservices By Neal Ford with Tim Brown Deployment.
2016 Global Seminar 按一下以編輯母片標題樣式 Virtualization apps simplify your IoT development Alfred Li.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
PART1 Data collection methodology and NM paradigms 1.
Introduction to Oracle Forms Developer and Oracle Forms Services
Cisco CNS NetFlow Collection Engine Version 5.0
A Seminar on Securities In Cloud Computing
Why Sytel?.
CIM Modeling for E&U - (Short Version)
Blue Mixology.
PSS Plans for Improved Reliability and Availability
Introduction to Oracle Forms Developer and Oracle Forms Services
Overview of MDM Site Hub
CSPA Workshop Hackathon
Intelligent Agent Solution
Introduction to Oracle Forms Developer and Oracle Forms Services
How Smart Networks are Changing Corporate Networks
CSC 480 Software Engineering
EIN 6133 Enterprise Engineering
Introducing To Networking
BUSINESS DRIVEN TECHNOLOGY
ENTERPRISE BUSINESS SYSTEMS part II
Stratus Innovations Group Intelligent Factory™ Solution Offering
EA Modelling Guidelines
VOLTHA Lock-In January 10 & 11, 2018.
A Seminar on Securities In Cloud Computing
QNX Technology Overview
Example of usage in Micron Italy (MIT)
Introduction to Information Systems
Service Oriented Architecture (SOA)
REMOTE POWER MONITORING OF MARINE SITES
Enterprise Integration
SOA Strategies for Enterprise X
Enhancing enterprise architecture models using application monitoring data Christopher Janietz, 2018/10/12, Advanced Seminar (Advisor: Martin Kleehaus)
OpenSec:Policy-Based Security Using Software-Defined Networking
Pitch Deck.
Software Re-engineering and Reverse Engineering
The changing Development Organization
Leveraging PIDs for object management in data infrastructures RDA UK Node Workshop, July Tobias Weigel (DKRZ)
Presentation transcript:

A new tool for network telemetry analytics. Dominic Oyeniran Trondheim, Norway Tuesday June 12, 2018 In order to cope with the increasing complexities of managing existing network services, addressing the growing demand for new network services in addition to the ability to capture, and keep vital historical records of where a service have been physically connected and deployed overtime, avoid manual synchronisation upon service migration, and loss of data granularity.  

GÉANT currently uses Cacti for SNMP telemetry data collection and visualisation, but with some limitations… Telemetry, utilisation, analytics, persistence, network traffic, network services, business intelligence, message broker, enterprise service bus, microservices.

The Quandary GEANT is exploiting a new telemetry solution that reduces some of the above challenges and is capable of automatically identifying a service when it comes live, provide input for business intelligence, analytics and possible new opportunities.

Solution GEANT Poller Telemetry Solution; is a suite of applications consisting of loosely coupled components using an event-based architecture that leverages on a message broker middleware. But first step, a naming convention change..

SRV_GLOBAL CUSTOMER TEST SRF9965248 | ASN9999 | For demonstration only Naming Convention A new machine readable naming convention allows the software to gather required information about the relevant objects SRV_GLOBAL CUSTOMER TEST SRF9965248 | ASN9999 | For demonstration only This is a point of access to a service and the service accessed is the global R&E Internet. A customer is connected to this interface. The name of the connected customer is “Test”. A unique identifier is also assigned to the interface. Following the “|” character is a human readable field allowing for additional information to be entered. This is ignored by the system. e.g:- SRV_GLOBAL INFRASTRUCTURE BACKBONE LON SRF0000001 | ams-lon SRV_L2CIRCUIT CUSTOMER SWITCH AMSIX SRF9913005 | ams-gen_IX_SWITCH-AMSIX_13005

Application Architecture Technologies used for the project:- - event driven messaging with asynchronous listeners. - metric agents : a thread per router. - metadata agents : executors in both single threaded and multithreaded pool mode. - message broker activemq / considered kafka -

Appreciation & Future Work Visualisation Microservices architecture Separation of concerns Resource optimisation We’d now like to recognize and thank the people who worked on the project… Other benefits of the telemetry solution, includes separation of concerns and resource optimisation as memory, CPU and I/O requirements differ for each module within the application. Docker Product owner - Seb, Software Dev team, Service Assurance, Network Engineering & Implementation team.

dominic.oyeniran at geant.org