Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania.

Slides:



Advertisements
Similar presentations
© 2006 Cisco Systems, Inc. All rights reserved. MPLS v2.2—8-1 MPLS TE Overview Introducing the TE Concept.
Advertisements

~1~ Infocom’04 Mar. 10th On Finding Disjoint Paths in Single and Dual Link Cost Networks Chunming Qiao* LANDER, CSE Department SUNY at Buffalo *Collaborators:
The Case for Enterprise Ready Virtual Private Clouds Timothy Wood, Alexandre Gerber *, K.K. Ramakrishnan *, Jacobus van der Merwe *, and Prashant Shenoy.
Data Center Fabrics. Forwarding Today Layer 3 approach: – Assign IP addresses to hosts hierarchically based on their directly connected switch. – Use.
ElasticTree: Saving Energy in Data Center Networks Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneed Sharma, Sujata Banerjee,
Data and Computer Communications Ninth Edition by William Stallings Chapter 12 – Routing in Switched Data Networks Data and Computer Communications, Ninth.
Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.
Small-World Graphs for High Performance Networking Reem Alshahrani Kent State University.
Discrete Structures & Algorithms The P vs. NP Question EECE 320.
ASWP – Ad-hoc Routing with Interference Consideration June 28, 2005.
ASWP – Ad-hoc Routing with Interference Consideration Zhanfeng Jia, Rajarshi Gupta, Jean Walrand, Pravin Varaiya Department of EECS University of California,
Traffic Engineering and Routing Hansen Bow. Topics Traffic Engineering with MPLS Issues Concerning Voice over IP Features of Netscope QoS Routing for.
Hardness of Approximation and Greedy Algorithms for the Adaptation Problem in Virtual Environments Ananth I. Sundararaj, Manan Sanghi, John R. Lange and.
Co-opetition in Network Tasks Yoram Bachrach, Peter Key, Jeff Rosenschein, Morteza Zadimoghaddam, Ely Porat.
An Optimization Problem in Adaptive Virtual Environments Ananth I. Sundararaj Manan Sanghi Jack R. Lange Peter A. Dinda Prescience Lab Department of Computer.
Two Discrete Optimization Problems Problem #2: The Minimum Cost Spanning Tree Problem.
CSE 550 Computer Network Design Dr. Mohammed H. Sqalli COE, KFUPM Spring 2007 (Term 062)
SMUCSE 8344 Constraint-Based Routing in MPLS. SMUCSE 8344 Constraint Based Routing (CBR) What is CBR –Each link a collection of attributes (performance,
Network Sharing Issues Lecture 15 Aditya Akella. Is this the biggest problem in cloud resource allocation? Why? Why not? How does the problem differ wrt.
Virtual Network Mapping: A Graph Pattern Matching Approach Yang Cao 1,2, Wenfei Fan 1,2, Shuai Ma University of Edinburgh 2 Beihang University.
Algorithms for Provisioning Virtual Private Networks in the Hose Model Source: Sigcomm 2001, to appear in IEEE/ACM Transactions on Networking Author: Amit.
Network Aware Resource Allocation in Distributed Clouds.
Computer Science Informed Content Delivery Across Adaptive Overlay Networks Overlay networks have emerged as a powerful and highly flexible method for.
Department of Computer Science at Florida State LFTI: A Performance Metric for Assessing Interconnect topology and routing design Background ‒ Innovations.
The Only Constant is Change: Incorporating Time-Varying Bandwidth Reservations in Data Centers Di Xie, Ning Ding, Y. Charlie Hu, Ramana Kompella 1.
Liping WANG 1, Yusheng JI 1,2, and Fuqiang Liu 3 1 The Graduate University for Advanced Studies, Tokyo, Japan 2 National Institute of Informatics, Tokyo,
Yu-Liang Liu1 On the Bandwidth Management for Hose-Model VPN Service GRADUATE INSTITUTE OF INFORMATION MANAGEMENT NATIONAL TAIWAN UNIVERSITY.
Network and Communications Ju Wang Chapter 5 Routing Algorithm Adopted from Choi’s notes Virginia Commonwealth University.
1 Self-stabilizing Algorithms and Frequency Assignment Problems.
1 Module 4: Implementing OSPF. 2 Lessons OSPF OSPF Areas and Hierarchical Routing OSPF Operation OSPF Routing Tables Designing an OSPF Network.
VL2: A Scalable and Flexible Data Center Network Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David.
CSE332: Data Abstractions Lecture 24.5: Interlude on Intractability Dan Grossman Spring 2012.
QoS Routing in Networks with Inaccurate Information: Theory and Algorithms Roch A. Guerin and Ariel Orda Presented by: Tiewei Wang Jun Chen July 10, 2000.
Efficient Route Computation on Road Networks Based on Hierarchical Communities Qing Song, Xiaofan Wang Department of Automation, Shanghai Jiao Tong University,
IBM T. J. Watson Research © 2004 IBM Corporation On Scalable Storage Area Network(SAN) Fabric Design Algorithm Bong-Jun Ko (Columbia University) Kang-Won.
COMPSCI 102 Introduction to Discrete Mathematics.
SIGCOMM 2012 (August 16, 2012) Private and Verifiable Interdomain Routing Decisions Mingchen Zhao * Wenchao Zhou * Alexander Gurney * Andreas Haeberlen.
Intradomain Traffic Engineering By Behzad Akbari These slides are based in part upon slides of J. Rexford (Princeton university)
1 Iterative Integer Programming Formulation for Robust Resource Allocation in Dynamic Real-Time Systems Sethavidh Gertphol and Viktor K. Prasanna University.
DynamicMR: A Dynamic Slot Allocation Optimization Framework for MapReduce Clusters Nanyang Technological University Shanjiang Tang, Bu-Sung Lee, Bingsheng.
Authors: Xiaoqiao Meng, Vasileio Pappas and Li Zhang
Resource Allocation in Network Virtualization Jie Wu Computer and Information Sciences Temple University.
SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s.
SecondNet: A Data Center Network Virtualization Architecture with Bandwidth Guarantees Chuanxiong Guo 1, Guohan Lu 1, Helen J. Wang 2, Shuang Yang 3, Chao.
Network-Aware Query Processing for Stream- based Application Yanif Ahmad, Ugur Cetintemel - Brown University VLDB 2004.
CS440 Computer Networks 1 Packet Switching Neil Tang 10/6/2008.
Paper Title Authors names Conference and Year Presented by Your Name Date.
Bing Wang, Wei Wei, Hieu Dinh, Wei Zeng, Krishna R. Pattipati (Fellow IEEE) IEEE Transactions on Mobile Computing, March 2012.
NetEgg: Scenario-based Programming for SDN Policies Yifei Yuan, Dong Lin, Rajeev Alur, Boon Thau Loo University of Pennsylvania 1.
Optimizing server placement in distributed systems in the presence of competition Jan-Jan Wu( 吳真貞 ), Shu-Fan Shih ( 施書帆 ), Pangfeng Liu ( 劉邦鋒 ), Yi-Min.
Introduction to Multiple-multicast Routing Chu-Fu Wang.
1 Traffic Engineering By Kavitha Ganapa. 2 Introduction Traffic engineering is concerned with the issue of performance evaluation and optimization of.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Roman Barták (Charles University in Prague, Czech Republic) ACAT 2010.
The Application of the Path Computation Element Architecture to the Determination of a Sequence of Domains in MPLS & GMPLS draft-king-pce-hierarchy-fwk-01.txt.
A Hierarchical Edge Cloud Architecture for Mobile Computing IEEE INFOCOM 2016 Liang Tong, Yong Li and Wei Gao University of Tennessee – Knoxville 1.
VL2: A Scalable and Flexible Data Center Network
Towards Scalable Traffic Management in Cloud Data Centers
Aaron Gember-Jacobson
CprE 458/558: Real-Time Systems
NTHU CS5421 Cloud Computing
Generic and Automatic Address Configuration for Data Center Networks
Generic and Automatic Address Configuration for Data Center Networks
T. C. van Dijk1, J.-H. Haunert2, J. Oehrlein2 1University of Würzburg
Multi-hop Coflow Routing and Scheduling in Data Centers
Resource Allocation in a Middleware for Streaming Data
Data Center Architectures
CSE 550 Computer Network Design
COMPUTER NETWORKS CS610 Lecture-16 Hammad Khalid Khan.
Towards Predictable Datacenter Networks
Presentation transcript:

Automated Bandwidth Allocation Problems in Data Centers Yifei Yuan, Anduo Wang, Rajeev Alur, Boon Thau Loo University of Pennsylvania

Motivation Managing network resources is the key computational problem in Data Centers. Applying verification/synthesis tool to network resource management? – Benefits: exact solutions, correctness guarantees – Challenges: efficiency This work: bandwidth allocation by SAT/SMT solvers 1

Bandwidth Allocation Problem 2

1G bps600M bps 500M bps 450M bps X1X1 X2X2 X3X3 S1S1 S2S2 S3S3 S4S4 Data Center’s Network 10G bps 2

Bandwidth Allocation Problem 1G bps600M bps 500M bps 450M bps X1X1 X2X2 X3X3 S1S1 S2S2 S3S3 S4S4 Data Center’s Network V1V1 V2V2 V3V3 400M bps Virtual Network 10G bps 2

Bandwidth Allocation Problem 1G bps600M bps 500M bps 450M bps X1X1 X2X2 X3X3 S1S1 S2S2 S3S3 S4S4 Data Center’s Network V1V1 V2V2 V3V3 400M bps Virtual Network 10G bps 2

Bandwidth Allocation Problem 1G bps600M bps 500M bps 450M bps X1X1 X2X2 X3X3 S1S1 S2S2 S3S3 S4S4 Data Center’s Network V1V1 V2V2 V3V3 400M bps Virtual Network v1v1 v1v1 v3v3 v3v3 v2v2 v2v2 10G bps 2

Bandwidth Allocation Problem 1G bps600M bps 500M bps 450M bps X1X1 X2X2 X3X3 S1S1 S2S2 S3S3 S4S4 Data Center’s Network V1V1 V2V2 V3V3 400M bps Virtual Network v1v1 v1v1 v3v3 v3v3 v2v2 v2v2 10G bps 2

BAP: Facts Complexity: – NP-complete: tree for physical network & virtual network Existing heuristics: – Pros: efficient – Cons: no guarantee Alternative approach: SAT/SMT solving 3

SAT/SMT Encoding: A Glimpse X(v,s): VM v is mapped to server s Y(l,e): physical link l is reserved bandwidth virtual link e R(l,e,k): physical link l is the k-th edge on the routing path for virtual link e Server capacity: – ∑ v X(v,s) < c(s), for every server s Link capacity: – ∑ e Y(l,e) < b(l), for every physical link l 4

Abstraction and Refinement Observation: Hierarchical physical network topology in data centers – Tree – Fat-tree Idea: – Abstract physical network: small size – Refine subgraphs 5

Abstraction

36 6

36 6

Refinement

Evaluation: Set up Physical network topology: tree with 200 servers:

Evaluation: Set up Virtual network topology: connected cliques

Evaluation: Set up Experiment: – Run allocation algorithm – Keep mapping the VN to the PN – Stop when no more VN can be mapped 10

Evaluation: Server Utilization 11

Evaluation: Link Utilization

Evaluation: Running Time per VN 12

Summary Alternative approach solving network resource allocation problem: using SAT/SMT solvers Abstract&refinement for scalability Strength: optimal solution Weakness: efficiency – Possible scenario: Optimal reallocation 13