Jellyfish: Networking Data Centers Randomly

Slides:

Advertisements

Similar presentations

Data Center Networking with Multipath TCP

Advertisements

Improving Datacenter Performance and Robustness with Multipath TCP

Interconnection Networks: Flow Control and Microarchitecture.

Impact of Interference on Multi-hop Wireless Network Performance Kamal Jain, Jitu Padhye, Venkat Padmanabhan and Lili Qiu Microsoft Research Redmond.

Software-defined networking: Change is hard Ratul Mahajan with Chi-Yao Hong, Rohan Gandhi, Xin Jin, Harry Liu, Vijay Gill, Srikanth Kandula, Mohan Nanduri,

Data Center Fabrics. Forwarding Today Layer 3 approach: – Assign IP addresses to hosts hierarchically based on their directly connected switch. – Use.

Improving Datacenter Performance and Robustness with Multipath TCP Costin Raiciu, Sebastien Barre, Christopher Pluntke, Adam Greenhalgh, Damon Wischik,

1 Advancing Supercomputer Performance Through Interconnection Topology Synthesis Yi Zhu, Michael Taylor, Scott B. Baden and Chung-Kuan Cheng Department.

Cross-Layer Scheduling in Cloud Systems Hilfi Alkaff, Indranil Gupta, Luke Leslie Department of Computer Science University of Illinois at Urbana-Champaign.

Datacenter Network Topologies

Chuanxiong Guo, Haitao Wu, Kun Tan,

ProActive Routing In Scalable Data Centers with PARIS Joint work with Dushyant Arora + and Jennifer Rexford* + Arista Networks *Princeton University Theophilus.

FireFly: A Reconfigurable Wireless Datacenter Fabric using Free-Space Optics Navid Hamedazimi, Zafar Qazi, Himanshu Gupta, Vyas Sekar, Samir Das, Jon.

Data Center Basics (ENCS 691K – Chapter 5)

A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.

Ji-Yong Shin * Bernard Wong +, and Emin Gün Sirer * * Cornell University + University of Waterloo 2 nd ACM Symposium on Cloud ComputingOct 27, 2011 Small-World.

A Scalable, Commodity Data Center Network Architecture.

Storage area network and System area network (SAN)

Network Topologies.

Quasi Fat Trees for HPC Clouds and their Fault-Resilient Closed-Form Routing Technion - EE Department; *and Mellanox Technologies Eitan Zahavi* Isaac Keslassy.

Interconnect Network Topologies

Department of Computer Science at Florida State LFTI: A Performance Metric for Assessing Interconnect topology and routing design Background ‒ Innovations.

DARD: Distributed Adaptive Routing for Datacenter Networks Xin Wu, Xiaowei Yang.

Extreme-scale computing systems – High performance computing systems Current No. 1 supercomputer Tianhe-2 at petaflops Pushing toward exa-scale computing.

Patch Panels in the Sky: A Case for Free-Space Optics in Data Centers Navid Hamed Azimi, Himanshu Gupta Vyas Sekar, Samir Das.

© Copyright 2010 Hewlett-Packard Development Company, L.P. 1 Jayaram Mudigonda, HP Labs Praveen Yalagandula, HP Labs Mohammad Al-Fares, UCSD Jeff Mogul,

VL2: A Scalable and Flexible Data Center Network Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David.

Department of Computer Science A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares Alexander Loukissas Amin Vahdat SIGCOMM’08 Reporter:

InterConnection Network Topologies to Minimize graph diameter: Low Diameter Regular graphs and Physical Wire Length Constrained networks Nilesh Choudhury.

Measuring and Understanding Throughput of Network Topologies

Dzmitry Kliazovich University of Luxembourg, Luxembourg

Topology How the components are connected. Properties Diameter Nodal degree Bisection bandwidth A good topology: small diameter, small nodal degree, large.

Anonymous communication over social networks Shishir Nagaraja and Ross Anderson Security Group Computer Laboratory.

Interconnection Networks Communications Among Processors.

VL2: A Scalable and Flexible Data Center Network

Data Center Architectures

Yiting Xia, T. S. Eugene Ng Rice University

Impact of Interference on Multi-hop Wireless Network Performance

Data Center Network Topologies II

Architecture and Algorithms for an IEEE 802

Interconnect Networks

Data Center Network Architectures

Hydra: Leveraging Functional Slicing for Efficient Distributed SDN Controllers Yiyang Chang, Ashkan Rezaei, Balajee Vamanan, Jahangir Hasan, Sanjay Rao.

Ad-hoc Networks.

Chuanxiong Guo, et al, Microsoft Research Asia, SIGCOMM 2008

HyGenICC: Hypervisor-based Generic IP Congestion Control for Virtualized Data Centers Conference Paper in Proceedings of ICC16 By Ahmed M. Abdelmoniem,

ECE 544: Traffic engineering (supplement)

Improving Datacenter Performance and Robustness with Multipath TCP

Interconnection topologies

Impact of Neighbor Selection on Performance and Resilience of Structured P2P Networks Sushma Maramreddy.

Improving Datacenter Performance and Robustness with Multipath TCP

ElasticTree Michael Fruchtman.

Network Topologies CIS 700/005 – Lecture 3

NTHU CS5421 Cloud Computing

A Scalable, Commodity Data Center Network Architecture

An Equal-Opportunity-Loss MPLS-Based Network Design Model

Chuanxiong Guo, Haitao Wu, Kun Tan,

Dingming Wu+, Yiting Xia+*, Xiaoye Steven Sun+,

CS223 Advanced Data Structures and Algorithms

Congestion Control in Software Define Data Center Network

High Throughput Route Selection in Multi-Rate Ad Hoc Wireless Networks

Indirect Networks or Dynamic Networks

CMPE 252A : Computer Networks

Storage area network and System area network (SAN)

VL2: A Scalable and Flexible Data Center Network

Network Architecture for Cyberspace

Data Center Architectures

Backbone Traffic Engineering

Research Issues in Middleware (Bhaskar)

In-network computation

Presentation transcript:

Jellyfish: Networking Data Centers Randomly Ankit Singla† , Chi-Yao Hong†, Lucian Popa*, P. Brighten Godfrey† † University of Illinois at Urbana–Champaign *HP Labs Oversubscription

Tow Goals of Data Center Design High throughput Incremental expansion Easily add/replace servers & switches Throughput: the amount of data exchanged/processed within a unit time Good scalalibity.Easily add/replace servers and switches

Incremental expansion Facebook doubled their data center scale in the last year (2010) You can add the servers, how about the network? Distributed systems: Hadoop Why it matters. Map-reduce heavlity rely on the networks

Today’s structured networks CLOS Three-stage hierarchical datacenter. Single failure Fat tree CLOS Fat tree

Structure constrains expansion 3-level fat trees, commodity switches: 24-port switches – 3,456 servers 32-port switches – 8,192 servers 48-port switches – 27,648 servers How to expand a datacenter with 32-port switches, 8,192 servers to 10,000 servers?

Solution No structure Jellyfish: random graph

Quantifying expandability Bisection bandwidth if the network is bisected into two partitions, the bisection bandwidth of a network topology is the bandwidth available between the two partitions.

Throughput: Jellyfish vs Fat tree Give the same budget for network devices, jellyfish can sustain 25% more servers than fattree

Why it works? It fully utilizes all available capacity

Example

Example: Fat tree

Example: Jellyfish

Jellyfish has short paths

Degree-diameter bounded graph Degree: the degree of a node is the number of nodes connected to this node. Diameter: the longest distance between a node pair Indicates the optimal case

Degree-diameter vs. Jellyfish

Routing and congestion control K-shortest path MPLS TE, OpenFlow(SDN) Congestion control TCP, Multipath TCP Routing is important. Not a structured topology, need more time to lookup the routing table. MPLS - pre-compute the path. OpenFlow - (SDN)

Cabling One of the main drawbacks of this work Discussion: possible solutions wireless datacenter Xia Zhou, et.al.. "Mirror mirror on the ceiling: Flexible wireless links for data centers." ACM SIGCOMM Computer Communication Review 42, no. 4 (2012): 443-454. Daniel Halperin, et.al.. "Augmenting data center networks with multi-gigabit wireless links." In ACM SIGCOMM Computer Communication Review, vol. 41, no. 4, pp. 38-49. ACM, 2011. Not work Large latency for small flows Short transmission range

Questions on Piazza Is the fat-tree topology the most widely used data center network topology? Why weren’t other network topologies as heavily emphasized in the paper? Are there any theoretical tradeoffs to Jellyfish since the physical and routing complications seemed to be mostly resolved with the author’s proposals?