FlowSense: Monitoring Network Utilization with Zero Measurement Cost Curtis Yu 1, Cristian Lumezanu 2, Yueping Zhang 2, Vishal Singh 2, Guofei Jiang 2,

Slides:



Advertisements
Similar presentations
Advanced Technology Laboratories page 1 Network Performance Monitoring at Small Time Scales Dina Papagiannaki, Rene Cruz, Christophe Diot.
Advertisements

Interconnection Networks: Flow Control and Microarchitecture.
Transparent and Flexible Network Management for Big Data Processing in the Cloud Anupam Das Curtis Yu Cristian Lumezanu Yueping Zhang Vishal Singh Guofei.
CloudWatcher: Network Security Monitoring Using OpenFlow in Dynamic Cloud Networks or: How to Provide Security Monitoring as a Service in Clouds? Seungwon.
1 IK1500 Communication Systems IK1330 Lecture 3: Networking Anders Västberg
Efficient Constraint Monitoring Using Adaptive Thresholds Srinivas Kashyap, IBM T. J. Watson Research Center Jeyashankar Ramamirtham, Netcore Solutions.
Flowlet Switching Srikanth Kandula Shan Sinha & Dina Katabi.
ClosedFlow: OpenFlow-like Control over Proprietary Devices
An Analytics Approach to Traffic Analysis in Network Virtualization Hui Zhang, Junghwan Rhee, Nipun Arora, Qiang Xu, Cristian Lumezanu, Guofei Jiang
Enabling Flow-level Latency Measurements across Routers in Data Centers Parmjeet Singh, Myungjin Lee Sagar Kumar, Ramana Rao Kompella.
OpenFlow-Based Server Load Balancing GoneWild
FlowN: Software-Defined Network Virtualization
Managing Redundant Content in Bandwidth Constrained Wireless Networks Tuan Dao, Amit K. Roy- Chowdhury, Srikanth V. Krishnamurthy U.C. Riverside Harsha.
SKELETON BASED PERFORMANCE PREDICTION ON SHARED NETWORKS Sukhdeep Sodhi Microsoft Corp Jaspal Subhlok University of Houston.
Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.
Scalable Network Virtualization in Software-Defined Networks
Scalable Flow-Based Networking with DIFANE 1 Minlan Yu Princeton University Joint work with Mike Freedman, Jennifer Rexford and Jia Wang.
Flowspace revisited OpenFlow Basics Flow Table Entries Switch Port MAC src MAC dst Eth type VLAN ID IP Src IP Dst IP Prot L4 sport L4 dport Rule Action.
Traffic Management - OpenFlow Switch on the NetFPGA platform Chun-Jen Chung( ) SriramGopinath( )
Measuring Large Traffic Aggregates on Commodity Switches Lavanya Jose, Minlan Yu, Jennifer Rexford Princeton University, NJ 1.
Enabling Layer 2 Pathlet Tracing through Context Encoding in SDN Hui Zhang, Cristian Lumezanu, Junghwan Rhee, Nipun Arora, Qiang Xu, Guofei Jiang NEC Labs.
Data Center Traffic and Measurements: Available Bandwidth Estimation Hakim Weatherspoon Assistant Professor, Dept of Computer Science CS 5413: High Performance.
OpenFlow Switch Limitations. Background: Current Applications Traffic Engineering application (performance) – Fine grained rules and short time scales.
SECURING NETWORKS USING SDN AND MACHINE LEARNING DRAGOS COMANECI –
OpenFlow-Based Server Load Balancing GoneWild Author : Richard Wang, Dana Butnariu, Jennifer Rexford Publisher : Hot-ICE'11 Proceedings of the 11th USENIX.
Qian Zhang and Christopher LIM Department of Computer Science and Engineering, Hong Kong University of Science and Technology IEEE ICC 2009.
VeriFlow: Verifying Network-Wide Invariants in Real Time
Copyright © 2011, Programming Your Network at Run-time for Big Data Applications 張晏誌 指導老師:王國禎 教授.
Measuring Control Plane Latency in SDN-enabled Switches Keqiang He, Junaid Khalid, Aaron Gember-Jacobson, Sourav Das, Chaithan Prakash, Aditya Akella,
Connectivity Devices Hakim S. ADICHE, MSc
©NEC Laboratories America 1 Huadong Liu (U. of Tennessee) Hui Zhang, Rauf Izmailov, Guofei Jiang, Xiaoqiao Meng (NEC Labs America) Presented by: Hui Zhang.
Network Instruments VoIP Analysis. VoIP Basics  What is VoIP?  Packetized voice traffic sent over an IP network  Competes with other traffic on the.
11 Experimental and Analytical Evaluation of Available Bandwidth Estimation Tools Cesar D. Guerrero and Miguel A. Labrador Department of Computer Science.
1 RECONSTRUCTION OF APPLICATION LAYER MESSAGE SEQUENCES BY NETWORK MONITORING Jaspal SubhlokAmitoj Singh University of Houston Houston, TX Fermi National.
Time synchronization for UWSN. Outline Time synchronization knowledge Typical time sync protocol Time sync in UWSN Discussion.
Emir Halepovic, Jeffrey Pang, Oliver Spatscheck AT&T Labs - Research
INM 2008 Orlando, Florida A Hidden Markov Model Approach to Available Bandwidth Estimation and Monitoring Cesar D. Guerrero Miguel A. Labrador Department.
Multi-layer Network Virtualization with Resource Reservation based on SDN Nguyen Huu Thanh Tran Manh Nam Truong Thu Huong School of Electronics and Telecommunications.
Presented By: Mohammed Al-Mehdhar Presentation Outline Introduction Approaches Implementation Evaluation Conclusion Q & A.
Performance Limitations of ADSL Users: A Case Study Matti Siekkinen, University of Oslo Denis Collange, France Télécom R&D Guillaume Urvoy-Keller, Ernst.
Using Ant Agents to Combine Reactive and Proactive strategies for Routing in Mobile Ad Hoc Networks Fredrick Ducatelle, Gianni di caro, and Luca Maria.
Data Stashing: Energy-Efficient Information Delivery to Mobile Sinks through Trajectory Prediction (IPSN 2010) HyungJune Lee, Martin Wicke, Branislav Kusy,
2009/6/221 BotMiner: Clustering Analysis of Network Traffic for Protocol- and Structure- Independent Botnet Detection Reporter : Fong-Ruei, Li Machine.
POSITION PAPER Reactive Logic in Software-Defined Networking: Accounting for the Limitations of the Switches Roberto Bifulco, Maurizio Dusi
1 Scalability of a Mobile Cloud Management System Roberto Bifulco* Marcus Brunner** Roberto Canonico* Peer Hasselmeyer** Faisal Mir** * Università di Napoli.
Reactive Logic in Software-Defined Networking: Measuring Flow-Table Requirements Maurizio Dusi*, Roberto Bifulco*, Francesco Gringoli”, Fabian Schneider*
3.6 Software-Defined Networks and OpenFlow
Sven Ubik, Aleš Friedl CESNET TNC 2009, Malaga, Spain, 11 June 2009 Experience with passive monitoring deployment in GEANT2 network.
Coping with Link Failures in Centralized Control Plane Architecture Maulik Desai, Thyagarajan Nandagopal.
Programming Assignment 2 Zilong Ye. Traditional router Control plane and data plane embed in a blackbox designed by the vendor high-seed switching fabric.
SDN basics and OpenFlow. Review some related concepts SDN overview OpenFlow.
MOZART: Temporal Coordination of Measurement (SOSR’ 16)
Programming SDN 1 Problems with programming with POX.
SDN challenges Deployment challenges
SDN Network Updates Minimum updates within a single switch
Software defined networking: Experimental research on QoS
HybNET: Network Manager for a Hybrid Network Infrastructure
An Analytics Approach to Traffic Analysis in Network Virtualization
Programming Assignment
SDN Overview for UCAR IT meeting 19-March-2014
SDN basics and OpenFlow
DDoS Attack Detection under SDN Context
2018/11/19 Source Routing with Protocol-oblivious Forwarding to Enable Efficient e-Health Data Transfer Author: Shengru Li, Daoyun Hu, Wenjian Fang and.
SoftRing: Taming the Reactive Model for Software Defined Networks
SPEAKER: Yu-Shan Chou ADVISOR: DR. Kai-Wei Ke
Network hardening Chapter 14.
2019/5/2 Using Path Label Routing in Wide Area Software-Defined Networks with OpenFlow ICNP = International Conference on Network Protocols Presenter:Hung-Yen.
Autonomous Network Alerting Systems and Programmable Networks
Chapter 4: outline 4.1 Overview of Network layer data plane
Presentation transcript:

FlowSense: Monitoring Network Utilization with Zero Measurement Cost Curtis Yu 1, Cristian Lumezanu 2, Yueping Zhang 2, Vishal Singh 2, Guofei Jiang 2, Harsha V. Madhyastha 1 1 UC Riverside, 2 NEC Labs America

SDN enables centralized control 2

A B SDN enables reactive control of network 3 C

State-of-the-art measurement  Active measurements  Injection of probes  Passive measurements  Expensive instrumentation and infrastructure setup  SDN measurements  Additional control traffic 4

FlowSense: measuring with zero cost  Leverage existing control traffic to measure network  No additional traffic introduced  Network informs system of changes  As accurate as switch polling 5

OpenFlow overview Flow Arrival: 1) Packet of new flow arrives 2) PacketIn message sent 3) FlowMod message sent 4) New rule installed Flow Completion: 1) Rule expires 2) Remove rule 3) FlowRemoved message sent 6 RuleMatchOutput 1Greensw2 RuleMatchOutput sw1sw2

Messages have utilization info  PacketIn  Signals new flow on port (t 1 )  FlowRemoved  Duration of entry in flow table (10s)  Amount of traffic matched (400 MB)  Can infer utilization contributed by flow on link 7 t1t1 t s Flow: PacketIn FlowRemoved

t1t1 t2t2 t3t3 t4t4 t5t5 t6t6 Time Estimating utilization in FlowSense 8 f1f1 f2f2 f3f3 CheckpointFlows LeftTotal UtilizationCheckpointFlows LeftTotal Utilization t4t4 240 MB/s CheckpointFlows LeftTotal Utilization t4t4 150 MB/s t5t5 110 MB/s CheckpointFlows LeftTotal Utilization t4t4 070 MB/s t5t5 030 MB/s t6t6 020 MB/s

FlowSense system design  Parser  Captures and analyzes control traffic  Utilization Monitor  Runs FlowSense algorithm  Utilization Table  Database of checkpoints 9

Evaluating FlowSense  Goals  Accuracy  Timeliness  Dataset  Testbed of NEC OpenFlow switches  Real-world traffic trace from a campus network switch 10

Accuracy testbed 11  1 continuous flow  3 separate short flows

FlowSense is as accurate as polling 12

Revisiting utilization estimation 13 t1t1 f1f1 f2f2 f3f3 t2t2 t3t3 t4t4 t5t5 t6t6 Time CheckpointFlows LeftTotal Utilization t4t4 240 MB/s CheckpointFlows LeftTotal Utilization t4t4 070 MB/s t5t5 030 MB/s t6t6 020 MB/s

Perfect utilization information is typically delayed 14

Coarse-grained estimation can be obtained soon 15

Data refreshes in the order of seconds 16

Conclusion  FlowSense  Leverage control traffic to estimate utilization  Incurs no measurement cost  Estimates are accurate  Comparable to switch polling  Data is timely  Do not have to wait too long for new utilization information 17

Future work  Measuring long flows  Overhead of stopping the rule for measurement  Wildcard and proactive rules  Reasonable way to merge active measurements to keep overhead low  Link Latency  Similar method to enable zero cost measurement of latency 18

Questions? 19