DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung.

Slides:



Advertisements
Similar presentations
Ch. 12 Routing in Switched Networks
Advertisements

Rethinking Internet Traffic Management From Multiple Decompositions to a Practical Protocol Martin Suchara in collaboration with: J. He, M. Bresler, J.
1 Praveen K. Muthuswamy Electrical Computer and Systems Engineering Rensselaer Polytechnic Institute In collaboration with Koushik Kar, Aparna Gupta (RPI)
Optimal Capacity Sharing of Networks with Multiple Overlays Zheng Ma, Jiang Chen, Yang Richard Yang and Arvind Krishnamurthy Yale University University.
Simultaneous Routing and Resource Allocation in Wireless Networks Mikael Johansson Signals, Sensors and Systems, KTH Joint work with Lin Xiao and Stephen.
Ch. 12 Routing in Switched Networks Routing in Packet Switched Networks Routing Algorithm Requirements –Correctness –Simplicity –Robustness--the.
Internet Protocols Steven Low CS/EE netlab.CALTECH.edu October 2004 with J. Doyle, L. Li, A. Tang, J. Wang.
Jaringan Komputer Lanjut Packet Switching Network.
1 Traffic Engineering (TE). 2 Network Congestion Causes of congestion –Lack of network resources –Uneven distribution of traffic caused by current dynamic.
Data and Computer Communications Ninth Edition by William Stallings Chapter 12 – Routing in Switched Data Networks Data and Computer Communications, Ninth.
Hot Sticky Random Multipath or Energy Pooling Jon Crowcroft,
Mathematical models of the Internet Frank Kelly Hood Fellowship Public Lecture University of Auckland 3 April 2012.
1 EL736 Communications Networks II: Design and Algorithms Class8: Networks with Shortest-Path Routing Yong Liu 10/31/2007.
Decomposable Optimisation Methods LCA Reading Group, 12/04/2011 Dan-Cristian Tomozei.
XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.
Network Architecture for Joint Failure Recovery and Traffic Engineering Martin Suchara in collaboration with: D. Xu, R. Doverspike, D. Johnson and J. Rexford.
Can Congestion Control and Traffic Engineering be at Odds? Jiayue He, Mung Chiang, Jennifer Rexford Princeton University November 30 th, 2006.
Comparing flow-oblivious and flow-aware adaptive routing Sara Oueslati and Jim Roberts France Telecom R&D CISS 2006 Princeton March 2006.
Charge-Sensitive TCP and Rate Control Richard J. La Department of EECS UC Berkeley November 22, 1999.
Multiple constraints QoS Routing Given: - a (real time) connection request with specified QoS requirements (e.g., Bdw, Delay, Jitter, packet loss, path.
*Sponsored in part by the DARPA IT-MANET Program, NSF OCE Opportunistic Scheduling with Reliability Guarantees in Cognitive Radio Networks Rahul.
Dept. of Computer Science & Engineering The Chinese University of Hong Kong 1 Interaction of Overlay Networks: Properties and Control Professor John C.S.
Rethinking Traffic Management: Using Optimization Decomposition to Derive New Architectures Jennifer Rexford Princeton University Jiayue He, Ma’ayan Bresler,
Rethinking Internet Traffic Management Using Optimization Theory Jennifer Rexford Princeton University Joint work with Jiayue He, Martin Suchara, Ma’ayan.
Network Protocols Designed for Optimizability Jennifer Rexford Princeton University
1IMIC, 8/30/99 Constraint-Based Unicast and Multicast: Practical Issues Bala Rajagopalan NEC C&C Research Labs Princeton, NJ
CISS Princeton, March Optimization via Communication Networks Matthew Andrews Alcatel-Lucent Bell Labs.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley Asynchronous Distributed Algorithm Proof.
Distributed-Dynamic Capacity Contracting: A congestion pricing framework for Diff-Serv Murat Yuksel and Shivkumar Kalyanaraman Rensselaer Polytechnic Institute,
Rethinking Internet Traffic Management: From Multiple Decompositions to a Practical Protocol Jiayue He Princeton University Joint work with Martin Suchara,
Multipath Protocol for Delay-Sensitive Traffic Jennifer Rexford Princeton University Joint work with Umar Javed, Martin Suchara, and Jiayue He
Rethinking Internet Traffic Management Using Optimization Theory Jennifer Rexford Princeton University Joint work with Jiayue He, Martin Suchara, Ma’ayan.
On Self Adaptive Routing in Dynamic Environments -- A probabilistic routing scheme Haiyong Xie, Lili Qiu, Yang Richard Yang and Yin Yale, MR and.
Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)
Jennifer Rexford Princeton University MW 11:00am-12:20pm Wide-Area Traffic Management COS 597E: Software Defined Networking.
MATE: MPLS Adaptive Traffic Engineering Anwar Elwalid, et. al. IEEE INFOCOM 2001.
Distributed Quality-of-Service Routing of Best Constrained Shortest Paths. Abdelhamid MELLOUK, Said HOCEINI, Farid BAGUENINE, Mustapha CHEURFA Computers.
By: Gang Zhou Computer Science Department University of Virginia 1 A Game-Theoretic Framework for Congestion Control in General Topology Networks SYS793.
Distributed resource allocation in wireless data networks: Performance and design Alexandre Proutière Orange-FT / ENS Paris.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jennifer Rexford Princeton University With Jiayue He, Rui Zhang-Shen, Ying Li,
L13. Shortest path routing D. Moltchanov, TUT, Spring 2008 D. Moltchanov, TUT, Spring 2014.
A Fair and Dynamic Load Balancing Mechanism F. Larroca and J.L. Rougier International Workshop on Traffic Management and Traffic Engineering for the Future.
L14. Fair networks and topology design D. Moltchanov, TUT, Spring 2008 D. Moltchanov, TUT, Spring 2015.
Rethinking Traffic Management: Design Optimizable Networks Jiayue He May 9 th, 2008.
1 Transport BW Allocation, and Review of Network Routing 11/2/2009.
Interaction of Overlay Networks: Properties and Implications Joe W.J. Jiang Dah-Ming Chiu John C.S. Lui The Chinese University of Hong Kong.
Scalable Multi-Class Traffic Management in Data Center Backbone Networks Amitabha Ghosh (UtopiaCompression) Sangtae Ha (Princeton) Edward Crabbe (Google)
Minimax Open Shortest Path First (OSPF) Routing Algorithms in Networks Supporting the SMDS Service Frank Yeong-Sung Lin ( 林永松 ) Information Management.
EE 685 presentation Utility-Optimal Random-Access Control By Jang-Won Lee, Mung Chiang and A. Robert Calderbank.
Congestion Control for High Bandwidth-Delay Product Networks D. Katabi (MIT), M. Handley (UCL), C. Rohrs (MIT) – SIGCOMM’02 Presented by Cheng.
Michael Schapira Yale and UC Berkeley Joint work with P. Brighten Godfrey, Aviv Zohar and Scott Shenker.
Some questions about multipath Damon Wischik, UCL Trilogy UCL.
Simultaneous routing and resource allocation via dual decomposition AUTHOR: Lin Xiao, Student Member, IEEE, Mikael Johansson, Member, IEEE, and Stephen.
EE 685 presentation Optimization Flow Control, I: Basic Algorithm and Convergence By Steven Low and David Lapsley.
Intradomain Traffic Engineering By Behzad Akbari These slides are based in part upon slides of J. Rexford (Princeton university)
June 4, 2003EE384Y1 Demand Based Rate Allocation Arpita Ghosh and James Mammen {arpitag, EE 384Y Project 4 th June, 2003.
Jennifer Rexford Fall 2014 (TTh 3:00-4:20 in CS 105) COS 561: Advanced Computer Networks TCP.
End-2-End QoS Internet Presented by: Zvi Rosberg 3 Dec, 2007 Caltech Seminar.
Stochastic Optimization for Markov Modulated Networks with Application to Delay Constrained Wireless Scheduling Michael J. Neely University of Southern.
MATE: MPLS Adaptive Traffic Engineering Anwar Elwalid Cheng Jin Steven Low Indra Widjaja Bell Labs Michigan altech Fujitsu 2006.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Optimization-based Cross-Layer Design in Networked Control Systems Jia Bai, Emeka P. Eyisi Yuan Xue and Xenofon D. Koutsoukos.
1 Transport Bandwidth Allocation 3/29/2012. Admin. r Exam 1 m Max: 65 m Avg: 52 r Any questions on programming assignment 2 2.
1 Transport Bandwidth Allocation, Intro to Network Layer 4/3/2012.
Traffic Engineering with AIMD in MPLS Networks
TCP Congestion Control
TCP Congestion Control
TCP Congestion Control
Understanding Congestion Control Mohammad Alizadeh Fall 2018
Rethinking Internet Traffic Management Using Optimization Theory
Presentation transcript:

DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung Chiang Princeton University

Serving Diverse Applications  One network does not fit all Throughput-sensitive applications  Prefer high-bandwidth paths  Keep queues occupied Delay-sensitive applications  Prefer low-propagation delay paths  Keep queues small  An ISP can run multiple virtual networks Customized routing and congestion control Each VN maximizes its own notion of utility 2

3 Running Multiple Virtual Networks Multiple virtual networks share substrate node/link resources Substrate network Virtual Network 1 Virtual Network 2

ISP’s Problem How to allocate resources to maximize the aggregate performance of multiple applications with diverse requirements? 4

How to Allocate Bandwidth?  Static partitioning Simple, but can be inefficient One virtual network could be congested while another is idle  Dynamic partitioning based on demand Can be unstable  Customization may result in worse performance 5

Desired Properties of the Solution  System is stable  Aggregate utility of all VNs is maximized  Each VN independently runs distributed protocols to maximize its utility  The substrate links use simple local rules to adapt bandwidth allocation 6 DaVinci: a resource allocation scheme derived using optimization theory

Optimization Decomposition  Many network problems can be formulated as utility maximization problems E.g., TCP:  Optimization decomposition: technique for deriving a distributed protocol Links calculate prices s (penalty for violating bandwidth constraint): packet loss or delay Sources update rates x given prices: AIMD 7 maximize U ( x ) = ∑ i u i ( x i ) subject to Rx ≤ C happiness of user i, a function of flow rate routing matrix link bandwidths

The Master Optimization Problem: Maximizing aggregate utility  Objective: maximize weighted sum of utilities E.g., w 1 U 1 ( x 1,y 1 ) + w 2 U 2 ( x 2,y 2 ) The weights reflect tradeoff between the VNs  Constraint: allocated bandwidth to the VNs cannot exceed link bandwidth E.g., y l 1 + y l 2 · C l, for all l

Primal Decomposition 9 maximize w 1 U 1 ( x 1,y 1 ) + w 2 U 2 ( x 2,y 2 ) subject to y 1 + y 2 · C variables x, y ¸ 0 maximize U 1 ( x 1,y 1 ) subject to R 1 x 1 · y 1 variables x 1 ¸ 0 maximize U 2 ( x 2,y 2 ) subject to R 2 x 2 · y 2 variables x 2 ¸ 0 Bandwidth C reallocated between y 1 and y 2 periodically based on congestion prices of VNs

DaVinci Framework 10 Each virtual network runs customized traffic management to optimize convex objective Each virtual link calculates congestion price Each substrate link enforces isolation with traffic shapers Sources update rates Periodically reallocates bandwidth

Theorem (Stability and Optimality) The bandwidth allocation algorithm together with per virtual network problem maximizes aggregate performance if The master problem is convex Bandwidth adjustment stepsize diminishes The bandwidth shares are updated when each VN has converged Proof technique: primal decomposition and gradient update

Performance Evaluation 12  Two traffic classes: Delay-sensitive traffic (DST):  Fixed demand  Minimize average delay Throughput-sensitive traffic (TST):  Elastic  Maximize user aggregate utility without causing congestion  Bandwidth allocation updated after both VNs converge

13 Delay-Sensitive Traffic on Long Link DST does not use all the allocated bandwidth 21 5ms, 100 Mbps 10ms, 1000 Mbps Demand = 110 Mbps Allocated bandwidth Traffic rate Optimal allocation

14 Changing Demand Abilene topology DST:100 Mbps ! 200 Mbps ! 50 Mbps DaVinci reacts quickly to changing demand and topology Bandwidth allocated to DST DST traffic rate

Related Work  QoS (Intserv, DiffServ, etc.) Provides separate resources for each traffic class DaVinci provides separate protocols and dynamic resource allocation  Overlays Provide customized protocols for each traffic class Lack visibility and control of network conditions DaVinci provides dedicated resources  Network virtualization (VPN, VINI, etc.) Uses static resource allocation, adjusted manually DaVinci adjusts resource allocation according to demand 15

16  Adaptive network virtualization is key for supporting multiple traffic classes  The DaVinci architecture Derived from optimization theory—stable, efficient Each VN runs customized protocols Resource allocation based on local link information  Future directions What if a VN’s utility function is not convex? Economic incentives for selfish VNs to cooperate? Conclusion and Future Work

The End Thank you! 17

Motivation for Separate Queues and Routing  Two traffic classes: Delay-sensitive traffic (DST): fixed demand Throughput-sensitive traffic (TST): elastic  Single queue TST can fill up both links DST may not be satisfied  Shared routing DST chooses shorter path Bandwidth wasted 5ms, 100 Mbps 10ms, 1000 Mbps

Motivation for Resource Isolation 19 Flow A Flow B Flow A given extra bandwidth Network A congested Bandwidth taken from Network B

DaVinci: Substrate Link 20 Bandwidth shares computation link load y l (1) y l (2) y l (N) Congestion price computation s l (1) Use optimization to determine the computations Performance objective

Delay-sensitive Traffic Minimizes Delay 21 min.∑ lij H lj i z j i ( p l + f ( u l )) s.t. u l =( Hz ) l /c l ∑ i z j i ≥ x i D var. z Link Utilization u l Cost f ( u l ) Propagation delay Links are indexed by l u l =1 Cost function represents penalty for long queues Traffic demand

22 i source-destination pair, j path number Throughput-sensitive Traffic max.∑ i U i (∑ j z j i ) – q ∑ l h ( u l ) s.t. link load ≤ c l var. path rates z z11z11 z21z21 z31z31  Path rate z captures source rate and routing

Substrate link updates bandwidth allocation  Calculates the marginal utility of each VN Based on congestion price and utility function  Increase bandwidth allocation to each VN proportional to weight, marginal utility, and stepsize  Project onto feasible region 23 Feasible allocations v

The Master Problem: Updating bandwidth allocation for link l  Calculates λ l ( k ), the marginal utility gain for more bandwidth Based on s l ( k ) and utility function U ( k ) ()  Increase bandwidth allocation  Projection onto feasible region: 24 v l ( k ) ( t +1) = [ y l ( k ) ( t ) + ® y w ( k ) λ l ( k ) ] + ∑ k y l ( k ) ≤ c l v

25 Sensitivity to Stepsize Abilene topology Constant stepsize should be chosen carefully