FairCloud: Sharing the Network in Cloud Computing Computer Communication Review(2012) Arthur : Lucian Popa Arvind Krishnamurthy Sylvia Ratnasamy Ion Stoica.

Slides:



Advertisements
Similar presentations
Towards Predictable Datacenter Networks
Advertisements

1 EP2210 Fairness Lecture material: –Bertsekas, Gallager, Data networks, 6.5 –L. Massoulie, J. Roberts, "Bandwidth sharing: objectives and algorithms,“
VCRIB: Virtual Cloud Rule Information Base Masoud Moshref, Minlan Yu, Abhishek Sharma, Ramesh Govindan HotCloud 2012.
Resource Management §A resource can be a logical, such as a shared file, or physical, such as a CPU (a node of the distributed system). One of the functions.
Winter 2004 UCSC CMPE252B1 CMPE 257: Wireless and Mobile Networking SET 3f: Medium Access Control Protocols.
Sharing Cloud Networks Lucian Popa, Gautam Kumar, Mosharaf Chowdhury Arvind Krishnamurthy, Sylvia Ratnasamy, Ion Stoica UC Berkeley.
The Case for Enterprise Ready Virtual Private Clouds Timothy Wood, Alexandre Gerber *, K.K. Ramakrishnan *, Jacobus van der Merwe *, and Prashant Shenoy.
Barath Raghavan, Kashi Vishwanath, Sriram Ramabhadran, Kenneth Yocum, Alex C. Snoeren Defense: Rejaie Johnson, Xian Yi Teng.
Cloud Control with Distributed Rate Limiting Barath Raghavan, Kashi Vishwanath, Sriram Ramabhadran, Kenneth Yocum, and Alex C. Snoeren University of California,
Improving Datacenter Performance and Robustness with Multipath TCP Costin Raiciu, Sebastien Barre, Christopher Pluntke, Adam Greenhalgh, Damon Wischik,
O ptimal routingpower allocation full-duplex o ptimal routing and power allocation for wireless networks with imperfect full-duplex nodes David Ramírez.
CS 268: Lecture 8 Router Support for Congestion Control Ion Stoica Computer Science Division Department of Electrical Engineering and Computer Sciences.
A Flexible Model for Resource Management in Virtual Private Networks Presenter: Huang, Rigao Kang, Yuefang.
Reciprocal Resource Fairness: Towards Cooperative Multiple-Resource Fair Sharing in IaaS Clouds School of Computer Engineering Nanyang Technological University,
My Point of View about Bandwidth Sharing Bin Wang.
Course Name- CSc 8320 Advanced Operating Systems Instructor- Dr. Yanqing Zhang Presented By- Sunny Shakya Latest AOS techniques, applications and future.
XCP: Congestion Control for High Bandwidth-Delay Product Network Dina Katabi, Mark Handley and Charlie Rohrs Presented by Ao-Jan Su.
Texas A&M University Improving TCP Performance in High Bandwidth High RTT Links Using Layered Congestion Control Sumitha.
Alan Shieh Cornell University Srikanth Kandula Albert Greenberg Changhoon Kim Microsoft Research Seawall: Performance Isolation for Cloud Datacenter Networks.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
Bandwidth sharing: objectives and algorithms Jim Roberts France Télécom - CNET Laurent Massoulié Microsoft Research.
Network Bandwidth Allocation (and Stability) In Three Acts.
A Game Theoretic Approach to Provide Incentive and Service Differentiation in P2P Networks Richard Ma, Sam Lee, John Lui (CUHK) David Yau (Purdue)
Performance and Robustness Testing of Explicit-Rate ABR Flow Control Schemes Milan Zoranovic Carey Williamson October 26, 1999.
Data Center Network Topologies: FatTree
A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.
On Self Adaptive Routing in Dynamic Environments -- A probabilistic routing scheme Haiyong Xie, Lili Qiu, Yang Richard Yang and Yin Yale, MR and.
1 Algorithms for Bandwidth Efficient Multicast Routing in Multi-channel Multi-radio Wireless Mesh Networks Hoang Lan Nguyen and Uyen Trang Nguyen Presenter:
Quasi Fat Trees for HPC Clouds and their Fault-Resilient Closed-Form Routing Technion - EE Department; *and Mellanox Technologies Eitan Zahavi* Isaac Keslassy.
ElasticTree: Saving Energy in Data Center Networks 許倫愷 2013/5/28.
Network Sharing Issues Lecture 15 Aditya Akella. Is this the biggest problem in cloud resource allocation? Why? Why not? How does the problem differ wrt.
Sharing the Data Center Network Alan Shieh, Srikanth Kandula, Albert Greenberg, Changhoon Kim, Bikas Saha Microsoft Research, Cornell University, Windows.
Srikanth Kandula, Sudipta Sengupta, Albert Greenberg, Parveen Patel, Ronnie Chaiken Microsoft Research IMC November, 2009 Abhishek Ray
Bargaining Towards Maximized Resource Utilization in Video Streaming Datacenters Yuan Feng 1, Baochun Li 1, and Bo Li 2 1 Department of Electrical and.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jennifer Rexford Princeton University With Jiayue He, Rui Zhang-Shen, Ying Li,
Jason Ernst and Mieso Denko
Network Aware Resource Allocation in Distributed Clouds.
E VALUATION OF F AIRNESS IN ICN X. De Foy, JC. Zuniga, B. Balazinski InterDigital
Dominant Resource Fairness: Fair Allocation of Multiple Resource Types Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, Ion.
A.SATHEESH Department of Software Engineering Periyar Maniammai University Tamil Nadu.
Scalable Multi-Class Traffic Management in Data Center Backbone Networks Amitabha Ghosh (UtopiaCompression) Sangtae Ha (Princeton) Edward Crabbe (Google)
Congestion Control in CSMA-Based Networks with Inconsistent Channel State V. Gambiroza and E. Knightly Rice Networks Group
VL2: A Scalable and Flexible Data Center Network Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
DaVinci: Dynamically Adaptive Virtual Networks for a Customized Internet Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung.
Research Unit in Networking - University of Liège A Distributed Algorithm for Weighted Max-Min Fairness in MPLS Networks Fabian Skivée
A Case for Performance- Centric Network Allocation Gautam Kumar, Mosharaf Chowdhury, Sylvia Ratnasamy, Ion Stoica UC Berkeley.
Resource Allocation in Network Virtualization Jie Wu Computer and Information Sciences Temple University.
Dzmitry Kliazovich University of Luxembourg, Luxembourg
SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s.
Data Center Load Balancing T Seminar Kristian Hartikainen Aalto University, Helsinki, Finland
Toward Efficient and Simplified Distributed Data Intensive Computing IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 22, NO. 6, JUNE 2011PPT.
An Adaptive, High Performance MAC for Long-Distance Multihop Wireless Networks Sergiu Nedevschi *, Rabin K. Patra *, Sonesh Surana *, Sylvia Ratnasamy.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Presented by Qifan Pu With many slides from Ali’s NSDI talk Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, Ion Stoica.
Dominant Resource Fairness: Fair Allocation of Multiple Resource Types Ali Ghodsi, Matei Zaharia, Benjamin Hindman, Andy Konwinski, Scott Shenker, Ion.
6.888 Lecture 6: Network Performance Isolation Mohammad Alizadeh Spring
Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center NSDI 11’ Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D.
VL2: A Scalable and Flexible Data Center Network
Data Center Architectures
Data Center Network Architectures
HyGenICC: Hypervisor-based Generic IP Congestion Control for Virtualized Data Centers Conference Paper in Proceedings of ICC16 By Ahmed M. Abdelmoniem,
Improving Datacenter Performance and Robustness with Multipath TCP
Improving Datacenter Performance and Robustness with Multipath TCP
NTHU CS5421 Cloud Computing
ارائه دهنده : آزاده قادری استاد راهنما: دکتر کیارش میزانیان
VL2: A Scalable and Flexible Data Center Network
EE 122: Lecture 18 (Differentiated Services)
EE 122: Differentiated Services
Towards Predictable Datacenter Networks
Presentation transcript:

FairCloud: Sharing the Network in Cloud Computing Computer Communication Review(2012) Arthur : Lucian Popa Arvind Krishnamurthy Sylvia Ratnasamy Ion Stoica Presenter : 段雲鵬

2/20 Outline Introduction challenges sharing networks Properties for network sharing Mechanism Conclusion

3/20 Some concepts Bisection bandwidth – Each node has a unit weight – Each link has a unit weight Flow def – standard five-tuple in packet headers B denotes bandwidth T denotes traffic W denotes the weight of a VM

4/20 Background Resource in cloud computing – Network, CPU, memory Network allocation – More difficult Source, destination and cross traffic – Tradeoff payment proportionality VS bandwidth guarantees

5/20 Introduction Network allocation – Unkown to users, bad predictability Fairness issues – Flows, source-destination pairs, or sources alone, destination alone Difference with other resource – Interdependent Users – Interdependent Resources

6/20 Assumption From a per-VM viewpoint Be agnostic to VM placement and routing algorithms In a single datacenter Be largely orthogonal to work on network topologies to improve bisection bandwidth

7/20 Traditional Mechanism Per flow fairness – Unfair when simply instantiating more flow Per source-destination pair – Unfair when one VM communicates with more VMs Per source – Unfair to destinations Asymmetric – Only be fair for source or destination only

8/20 Examples Per source-destination pair Per source If there is little traffic on the A-F and B-E, B(A)=B(B) =B(E) =B(F) =2*B(C) =2*B(D) =B(G) =B(H) B(E) =B(F) =0.25*B(D), In the opposite direction, B(A) =B(B) =0.25*B(C)

9/20 Properties for network sharing(1) Strategy proofness – Can’t increase bandwidth by modifying behavior at application level Pareto Efficiency – X and Y is bottlenecked, when B(X-Y) increases, B(A-B) must decrease,otherwise congestion will be worse B A 1 M 10 M

10/20 Properties for network sharing(2) Non-zero Flow Allocation – A strictly +B() between each pairs are expected Independence – When T2 increase, B1 should not be affected Symmetry – If all flows’ direction are swiched, the allocation should be the same L2 L1

11/20 Network weight and user’s payment. Weight Fidelity(provide incentive) – Strict Monotonicity (Monotonicity) If W(VM) increases,then all its traffic must increase (not decrease). – Proportionality Guaranteed Bandwidth – Admission control They are conflicting, tradeoff Subset P(2/3) Subset Q(1/3) No communication between P and Q

12/20 Per Endpoint Sharing (PES) Can explicitly trade between weight fidelity and guaranteed bandwidth – N A denote the number of VMs A is communicating with – W S-D =f(W S,W D ), W A-B =W B-A – Normalized by L1 normalization Drawback : Static Method (out of discussion)

13/20 Example W A-D =W A /N A +W D /N D =1/2+1/2=1 W A-C =W B-D =1/2+1/1=1.5 Total Weight=4(4 VMs) So W A-D =1/4=0.25 W A-C =W B-D =1.5/4=0.325

14/20 Comparison

15/20 PES For one host, B ∝ (closer VMs) instead of (remote VMs) Higher guarantees for the worst case W A−B = W B−A =α*W A /N A + β*W B / N B – α and β can be designed to weight between bandwidth guarantees and weight fidelity

16/20 One Sided PES (OSPES) Designed for tree-based topology W A−B = W B−A =α*W A /N A + β*W B / N B When closer to A, α = 1 and β = 0 When closer to B, α = 0 and β = 1

17/20 OSPES fair sharing for the traffic towards or from the tree root – Resource allocation are depended on the root – Non-strict monotonicity When W(A) = W(B), If the access link is 1 Gbs, then each VM is guaranteed 500 Mbps W A-VM1 =1/1 W B-VMi =1/10(i=2,3……,11)

18/20 Max-Min Fairness The minimum data rate that a dataflow achieves is maximized – The bottleneck is fully utilized Can be applied

19/20 Conclusion Problem : sharing the network within a cloud computing datacenter Tradeoff between payment proportionality and bandwidth guarantees A mechanism to make tradeoff between conflicting requirements

Reference [1] Amazon web services. [2] M. Al-Fares, A. Loukissas, and A. Vahdat. A scalable, commodity data center network architecture. In SIGCOMM. ACM, [3] M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat. Hedera: Dynamic Flow Scheduling for Data Center Networks. In NSDI, [4] H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron. Towards Predictable Datacenter Networks. In ACM SIGCOMM, [5] D. P. Bertsekas and R. Gallager. Data networks (2. ed.). Prentice Hall, [6] B. Briscoe. Flow rate fairness: Dismantling a religion. ACM SIGCOMM Computer Communication Review, [7] N. G. Duffield, P. Goyal, A. G. Greenberg, P. P. Mishra, K. K. Ramakrishnan, and J. E. van der Merwe. A flexible model for resource management in virtual private networks. In SIGCOMM, [8] A. Ghodsi, M. Zaharia, B. Hindman, et al. Dominant resource fairness: fair allocation of multiple resource types. In USENIX NSDI, [9] A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. VL2: A Scalable and Flexible Data Center

21/20 Thanks !!