Schedulers for Hybrid Data Center Network Neelakandan Manihatty Bojan 2 nd Year PhD Student Advisor: Dr. Andrew W. Moore Eurosys Doctoral Workshop, 18.

Slides:



Advertisements
Similar presentations
Data Center Networking with Multipath TCP
Advertisements

Improving Datacenter Performance and Robustness with Multipath TCP
Dynamic Topology Optimization for Supercomputer Interconnection Networks Layer-1 (L1) switch –Dumb switch, Electronic “patch panel” –Establishes hard links.
BCube: A High Performance, Server-centric Network Architecture for Modular Data Centers Chuanxiong Guo1, Guohan Lu1, Dan Li1, Haitao Wu1, Xuan Zhang2,
J. K. Kim Portland. Trend of Data Center By J. Nicholas Hoover, InformationWeek June 17, :00 AMJ. Nicholas Hoover 200 million Euro Data centers.
PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric. Presented by: Vinuthna Nalluri Shiva Srivastava.
Improving Datacenter Performance and Robustness with Multipath TCP Costin Raiciu, Sebastien Barre, Christopher Pluntke, Adam Greenhalgh, Damon Wischik,
Small-World Graphs for High Performance Networking Reem Alshahrani Kent State University.
Progress Report Wireless Routing By Edward Mulimba.
Chuanxiong Guo, Haitao Wu, Kun Tan,
1Presentation_ID © 1999, Cisco Systems, Inc. IP Over Optical: Building Terabit Networks Today Larry McAdams
Data Center Basics (ENCS 691K – Chapter 5)
A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares, Alexander Loukissas, Amin Vahdat Presented by Gregory Peaker and Tyler Maclean.
A Modernize Version of the Antique Telephone Architecture Christopher Francis & Bertha Wilhelm.
Ji-Yong Shin * Bernard Wong +, and Emin Gün Sirer * * Cornell University + University of Waterloo 2 nd ACM Symposium on Cloud ComputingOct 27, 2011 Small-World.
A Scalable, Commodity Data Center Network Architecture Mohammad AI-Fares, Alexander Loukissas, Amin Vahdat Presented by Ye Tao Feb 6 th 2013.
A Scalable, Commodity Data Center Network Architecture
A Scalable, Commodity Data Center Network Architecture.
Helios: A Hybrid Electrical/Optical Switch Architecture for Modular Data Centers Nathan Farrington George Porter, Sivasankar Radhakrishnan,
Energy Aware Network Operations Authors: Priya Mahadevan, Puneet Sharma, Sujata Banerjee, Parthasarathy Ranganathan HP Labs IEEE Global Internet Symposium.
ElasticTree: Saving Energy in Data Center Networks 許倫愷 2013/5/28.
1J. Kim Web Science & Technology Forum Enabling Hardware Technology for Web Science John Kim Department of Computer Science KAIST.
LIGHTNESS Introduction 10th Oct, 2012 Low latency and hIGH Throughput dynamic NEtwork infrastructureS for high performance datacentre interconnectS.
DENS: Data Center Energy-Efficient Network-Aware Scheduling
David G. Andersen CMU Guohui Wang, T. S. Eugene Ng Rice Michael Kaminsky, Dina Papagiannaki, Michael A. Kozuch, Michael Ryan Intel Labs Pittsburgh 1 c-Through:
A Scalable, Commodity Data Center Network Architecture Jingyang Zhu.
DARD: Distributed Adaptive Routing for Datacenter Networks Xin Wu, Xiaowei Yang.
Reporter: 謝凱旭 Advisor: 曾學文 教授 An Efficient Multicast Scheduling based on Social Network in Data Center Networks 1.
Floodless in SEATTLE : A Scalable Ethernet ArchiTecTure for Large Enterprises. Changhoon Kim, Matthew Caesar and Jenifer Rexford. Princeton University.
A Survey on Optical Interconnects for Data Centers Speaker: Shih-Chieh Chien Adviser: Prof Dr. Ho-Ting Wu.
Delivering Circuit Services to Researchers: The HOPI Testbed Rick Summerhill Director, Network Research, Architecture, and Technologies, Internet2 Joint.
© 2006 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.0 Introducing Network Design Concepts Designing and Supporting Computer Networks.
VL2: A Scalable and Flexible Data Center Network Albert Greenberg, James R. Hamilton, Navendu Jain, Srikanth Kandula, Changhoon Kim, Parantap Lahiri, David.
Department of Computer Science A Scalable, Commodity Data Center Network Architecture Mohammad Al-Fares Alexander Loukissas Amin Vahdat SIGCOMM’08 Reporter:
© 2006 Cisco Systems, Inc. All rights reserved.Cisco PublicITE I Chapter 6 1 Introducing Network Design Concepts Designing and Supporting Computer Networks.
Oz – Foundations of Electronic Commerce © 2002 Prentice Hall Essentials of Telecommunications.
Dual Centric Data Center Network Architectures DAWEI LI, JIE WU (TEMPLE UNIVERSITY) ZHIYONG LIU, AND FA ZHANG (CHINESE ACADEMY OF SCIENCES) ICPP 2015.
Networks-on-Chip (NoC) Suleyman TOSUN Computer Engineering Deptartment Hacettepe University, Turkey.
SYMBIOTIC ROUTING IN FUTURE DATA CENTER 工科三 陳泰穎. Outline 1. CamCube 1. Traditional data center 2. The problems 3. CamCube philosophy 4. Feature 5. What’s.
Data Center Energy-Efficient Network-Aware Scheduling
GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich ERCIM Fellow University of Luxembourg Apr 16, 2010.
SecondNet: A Data Center Network Virtualization Architecture with Bandwidth Guarantees Chuanxiong Guo 1, Guohan Lu 1, Helen J. Wang 2, Shuang Yang 3, Chao.
Accounting for Load Variation in Energy-Efficient Data Centers
C-Through: Part-time Optics in Data centers Aditi Bose, Sarah Alsulaiman.
Scalable Congestion Control Protocol based on SDN in Data Center Networks Speaker : Bo-Han Hua Professor : Dr. Kai-Wei Ke Date : 2016/04/08 1.
1 Scalability and Accuracy in a Large-Scale Network Emulator Nov. 12, 2003 Byung-Gon Chun.
ICTCP: Incast Congestion Control for TCP in Data Center Networks By: Hilfi Alkaff.
Course Project for CS Objective Simulate a datacenter network using Mininet.
VL2: A Scalable and Flexible Data Center Network
Data Center Architectures
DENS: Data Center Energy-Efficient Network-Aware Scheduling
GreenCloud: A Packet-level Simulator of Energy-aware Cloud Computing Data Centers Dzmitry Kliazovich, Pascal Bouvry, Yury Audzevich, and Samee Ullah Khan.
Energy Aware Network Operations
Yiting Xia, T. S. Eugene Ng Rice University
Data Center Network Topologies
Data Center Network Topologies II
Data Center Network Architectures
Chris Cai, Shayan Saeed, Indranil Gupta, Roy Campbell, Franck Le
A Bandwidth-Efficient and Low-Latency Packet Assembly Strategy for Optical Burst Switching in Metro Ring Prasanna Krishnamoorthy, Andrea Fumagalli Optical.
Chuanxiong Guo, et al, Microsoft Research Asia, SIGCOMM 2008
Improving Datacenter Performance and Robustness with Multipath TCP
DATA COMMUNICATION Lecture-6.
A Scalable, Commodity Data Center Network Architecture
writing a career award: think like an educator
Chuanxiong Guo, Haitao Wu, Kun Tan,
Dingming Wu+, Yiting Xia+*, Xiaoye Steven Sun+,
Congestion Control in Software Define Data Center Network
VL2: A Scalable and Flexible Data Center Network
Data Center Architectures
NetFPGA - an open network development platform
Presentation transcript:

Schedulers for Hybrid Data Center Network Neelakandan Manihatty Bojan 2 nd Year PhD Student Advisor: Dr. Andrew W. Moore Eurosys Doctoral Workshop, 18 th April 2016

Schedulers for Hybrid Data Center Network Problem:  Designing scalable and cost effective Data Center Networks (DCN) for future.

Packet Switching & Circuit Switching Hybrid DCN = Packet Switching + Circuit Switching

Schedulers for Hybrid Data Center Network Problem:  Designing scalable and cost effective Data Center Networks (DCN) for future. Motivation:  DCN require more Bandwidth, better energy efficiency.  Hybrid DCNs (with dynamic Hybrid schedulers) are needed.

Our Approach: Flow classification at Host

Flow transition

Summary  Hybrid networks are essential to meet requirements of future DCN.  Need dynamic schedulers for hybrid networks.  Ideas for the dynamic hybrid scheduler:  Flow classification at host  Flow transition  Evaluation through simulation and implementation (NetFPGA).  HyNS: a Hybrid Network Simulator.

Backup slides

EPS Vs OCS Has buffers, TCAM Arista ToR switch (48x10G and 4x40G) has a power consumption of 400 W. There is packet processing No buffers Glimmerglass OCS with 192x192 optical cross-connect has a power consumption of 85 W. No packet processing

Case for hybrid switching Consider 130,000 node data center using EPS with folded Clos topology. Increase maintenance and ToR ( switch ports) Power consumption = * 2 W = 524 KW Aggregation ( switch ports) Power consumption = * 2 W = 524 KW Core ( switch ports) Power consumption = * 2 W = 262 KW Total Power consumption of transceivers alone1.3 MW

Packet Switching & Circuit Switching Hybrid DCN = Packet Switching + Circuit Switching

Traditional Fat Tree topology ……… TOR 1 TOR N ……… Core switch Aggregation Switch K Aggregation Switch 1 TOR 1 TOR N Server 1 Server N Server 1 Server N Server 2.. …..

Hybrid Network

HyNS: Hybrid Network Simulator