ODL based AI/ML for Networks Prem Sankar Gopannan, Ericsson

Slides:



Advertisements
Similar presentations
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Advertisements

OpenDaylight: An Open Source SDN for Your OpenStack Cloud Stephan Baucke, Ericsson Kyle Mestery, Cisco Anees Shaikh, IBM Chris Wright,
Hydrogen Helium Lithium
Spark: Cluster Computing with Working Sets
Matei Zaharia, Mosharaf Chowdhury, Tathagata Das, Ankur Dave, Justin Ma, Murphy McCauley, Michael Franklin, Scott Shenker, Ion Stoica Spark Fast, Interactive,
Time Series Data Repository (TSDR)
Oracle Enterprise Manager – Cloud Control 12c Simon Keys, The Small Ronnie Martin Lambert, The Large Ronnie.
Components and Architecture CS 543 – Data Warehousing.
Distribution Statement A. Approved for public release; distribution is unlimited. Test and Evaluation/Science and Technology Program Rapid Data Analyzer.
Jason Morrill NCOAUG Training Day February, 2008
Interoperability is Key to Accelerating SDN Adoption Neela Jacques Executive Director OpenDaylight Projectt.
SECURING NETWORKS USING SDN AND MACHINE LEARNING DRAGOS COMANECI –
SharePoint 2010 Business Intelligence Module 6: Analysis Services.
Tyson Condie.
Practical Machine Learning Pipelines with MLlib Joseph K. Bradley March 18, 2015 Spark Summit East 2015.
` tuplejump The data engineering platform. A startup with a vision to simplify data engineering and empower the next generation of data powered miracles!
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Cluster Reliability Project ISIS Vanderbilt University.
© 2008 IBM Corporation ® IBM Cognos Business Viewpoint Miguel Garcia - Solutions Architect.
Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering Nithya N. Vijayakumar, Beth Plale DDE Lab, Indiana University {nvijayak,
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
Client: The Boeing Company Contact: Mr. Nick Multari Adviser: Dr. Thomas Daniels Group 6 Steven BromleyJacob Gionet Jon McKeeBrandon Reher.
MURI: Integrated Fusion, Performance Prediction, and Sensor Management for Automatic Target Exploitation 1 Dynamic Sensor Resource Management for ATE MURI.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Vic Liu Liang Xia Zu Qiang Speaker: Vic Liu China Mobile Network as a Service Architecture draft-liu-nvo3-naas-arch-01.
Copyright © 2012, SAS Institute Inc. All rights reserved. ANALYTICS IN BIG DATA ERA ANALYTICS TECHNOLOGY AND ARCHITECTURE TO MANAGE VELOCITY AND VARIETY,
1 COPYRIGHT © 2015 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Cognitive Security: Security Analytics and Autonomics for Virtualized Networks Lalita Jagadeesan.
INNOV-10 Progress® Event Engine™ Technical Overview Prashant Thumma Principal Software Engineer.
S. Shumilov – Zürich Analytical Visualization Framework - a visual data processing and knowledge discovery system Ivan Denisovich, Serge Shumilov Department.
Matthew Winter and Ned Shawa
Tool Integration with Data and Computation Grid “Grid Wizard 2”
What’s New and Hot in OpenDaylight Beryllium Colin Dixon TSC Chair, OpenDaylight Distinguished Engineer, Brocade.
Internet of Things. Creating Our Future Together.
© Copyright IBM Corporation 2016 Diagram Template IBM Cloud Architecture Center Using the Diagram Template This template is for use in creating a visual.
Time Series Data Repository #ODSummit - The Generic, Extensible, and Elastic Data Repository in OpenDaylight for Advanced Analytics.
Data Summit 2016 H104: Building Hadoop Applications Abhik Roy Database Technologies - Experian LinkedIn Profile:
Mobilizing Your SAS® Business Analytic Reports Falko Schulz Sr. Systems Engineer SAS Australia & New Zealand.
Leverage Big Data With Hadoop Analytics Presentation by Ravi Namboori Visit
9/24/2017 7:27 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Orchestration and Controller Architecture Alignment Vimal Begwani AT&T
Image taken from: slideshare
Euro17 LSO Hackathon Open LSO Analytics
OpenDaylight Based Machine Learning for Networks
Connected Infrastructure
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Orchestration and Controller Alignment for ONAP Release 1
Use Case for Distributed Data Center in SUPA
Apache Spot (Incubating)
Connected Maintenance Solution
CMS High Level Trigger Configuration Management
OPEN-O Modeling Directions (DRAFT 0)
Spark Presentation.
Time Series Data Repository
Connected Maintenance Solution
Connected Infrastructure
EIN 6133 Enterprise Engineering
Sana Tariq Sr. Architect Service Orchestration March 26th, 2018
Exploring Azure Event Grid
Spark Software Stack Inf-2202 Concurrent and Data-Intensive Programming Fall 2016 Lars Ailo Bongo
MDM Enterprise.
CMPT 733, SPRING 2016 Jiannan Wang
Introduction to Apache
What's New in eCognition 9
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
CMPT 733, SPRING 2017 Jiannan Wang
The Student’s Guide to Apache Spark
What's New in eCognition 9
What's New in eCognition 9
ONAP Optimization Framework (OOF) POC for Physical CellID (PCI) Optimization July 30, 2018.
Presentation transcript:

ODL based AI/ML for Networks Prem Sankar Gopannan, Ericsson YuLing Chen, Cisco

ODL based AI/ML for Networks Agenda Role of AI/ML in networks and use cases ODL – Overview in 30 seconds ODL TSDR Algorithms

History is made

Opendaylight – Quick overview

Making ODL the Brain of Network GBP VPN service Topo AI/ML TSDR SFC OF/Netconf/BGP Base Image courtesy - http://www.shutterstock.com/gallery-776350p1.html

Advantages Opendaylight has the exposure to data that relates to both Infrastructure and Network with mutiprotocol support Helps build an unified model which is key for the following areas Cloud NFV IoT

Use Case Policy Management Cloud Resource Utilization Traffic Steering Policy composition Policy monitoring and optimization Cloud Resource Utilization Monitoring tenant provisioning Provide Resource planning Traffic Steering Anomaly Detection and DDOS

TSDR Architecture Framework

TSDR Capabilities

Current TSDR Architecture in OpenDaylight

High Level Architecture Proposal for ODL AI/ML framework Enable AI/ML on both historical and real-time data paths. Many use cases would require both offline and online ML on the time series data. External events could be additional input for accurate machine learning results. Feed back the results to SDN control path for automatic traffic steering and policy placement. Well-defined interface among the components towards future standardization of advanced analytics in SDN.

Offline ML Sequence flow Offline ML on persistence data path ODL AI/ML receives user requests to predict BWUtil on port1. ODL AI/ML maps user requests to proper ML algorithms, feature sets, parameters, and sends request to TSDR. TSDR processes the requests on historical data path with its ML library. Execution results from data stores being sent back to TSDR. Aggregated results being sent back to ODL AI/ML. Prescriptive actions being sent to other ODL services. When training an ML model, there could be multiple trips of the above flow.

Online ML Sequence flow Online ML on real-time data path ODL AI/ML receives user requests to detect DDoS attack. ODL AI/ML maps user requests to proper ML algorithms, feature sets, tuning parameters, and sends request to TSDR. TSDR processes the requests on real-time data path with its ML library. Execution results being sent back to TSDR Aggregated results being sent back to ODL AI/ML. Prescriptive actions being generated and sent to other ODL services. Use cases for Online ML: Apply offline machine learning results to real-time data. Apply ML algorithms that do not need training on historical data.

TSDR Roadmap in Boron Release Advanced Analytics Support Architecture PoC. IoTDM integration for IoT Sensor Data. New Data Store support(Elastic Search). Multiple data store support at runtime. JDBC driver and SQL parser on northbound for third party integration. Security Enhancement. ODL Cluster Support Enhancement. Performance and Scalability Testing and Benchmarking.

Tools evaluated SparkMlib – Would be the prefered tool H2O TensorFlow

Overall ML workflow

Simple ML workflow Load Data Extract Features Train Model Evaluate Data sources - TSDR Extract Features Transformer Train Model Logistic Regression Evaluate

SparkMLlib Spark MLlib is Machine Learning Library and part of Apache Spark Consists of common learning algorithms and utilities, including Classification (Supervised) Regression (Supervised) Clustering Collaborative filtering Decomposition Recommondation Optimization dimensionality reduction, as well as lower-level optimization primitives and higher-level pipeline APIs. RDD Actions (results in DAG of operations) and Transformations

ODL AI/ML Components Trainer Model store Interface Helps trying with various datasets and algorithms Provides small UI to define Input/Output and other parameters for algorithms (for eg., ANN would need # of levels needed based on requirement) Model store Trained models are persisted Apps/Users can pick from pre-trained models Interface Data Sources that would include event triggers, data, feedback

Next Steps Propose to Opendaylight TSC in Carbon release PoC in Boron release Create a new project with proposal in Carbon release Looking for contributors For both PoC and the project

Q&A