Inside the Social Network’s (Datacenter) Network

Slides:



Advertisements
Similar presentations
Fast Data at Massive Scale Lessons Learned at Facebook Bobby Johnson.
Advertisements

Big Data + SDN SDN Abstractions. The Story Thus Far Different types of traffic in clusters Background Traffic – Bulk transfers – Control messages Active.
NDN in Local Area Networks Junxiao Shi The University of Arizona
By: Chris Hayes. Facebook Today, Facebook is the most commonly used social networking site for people to connect with one another online. People of all.
Database System Architectures  Client-server Database System  Parallel Database System  Distributed Database System Wei Jiang.
Answering the Database Scale Out Problem: SSDs in the Data Center April 14, 2010 Dan Marriott Director - Production Operations
Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.
SQL Server Replication By Karthick P.K Technical Lead, Microsoft SQL Server.
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
Databases and the Internet. Lecture Objectives Databases and the Internet Characteristics and Benefits of Internet Server-Side vs. Client-Side Special.
Network Aware Resource Allocation in Distributed Clouds.
Why I LIKE the Facebook Database… Sharon Viente May 2010.
Introduction to Hadoop and HDFS
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
Introduction to Computer Networks Dr. Sanjay P. Ahuja, Ph.D FIS Distinguished Professor of Computer Science School of Computing, UNF.
Application Development
How Web Database Architectures Work CPS181s April 8, 2003.
Scalable Data Scale #2 site on the Internet (time on site) >200 billion monthly page views Over 1 million developers in 180 countries.
FIFE Architecture Figures for V1.2 of document. Servers Desktops and Laptops Desktops and Laptops Off-Site Computing Off-Site Computing Interactive ComputingSoftware.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
Mary Ganesan and Lora Strother Campus Tours Using a Mobile Device.
Lecture 1 Book: Hadoop in Action by Chuck Lam Online course – “Cloud Computing Concepts” lecture notes by Indranil Gupta.
Course Project for CS Objective Simulate a datacenter network using Mininet.
Network Requirements for Resource Disaggregation
Warehouse Scaled Computers
Chen Qian, Xin Li University of Kentucky
CIS 700-5: The Design and Implementation of Cloud Networks
Lecture 2: Cloud Computing
CREATED BY: JEAN LOIZIN CLASS: CS 345 DATE: 12/05/2016
NET 536 Network Security Firewalls and VPN
Cassandra - A Decentralized Structured Storage System
NETWORK Unit 1 Module: 2 Objective: 7.
A Survey of Data Center Network Architectures By Obasuyi Edokpolor
Improving searches through community clustering of information
Multiprocessor Systems
Operating System.
Distributed Systems.
Module 2: DriveScale architecture and components
Large-scale file systems and Map-Reduce
Chuanxiong Guo, et al, Microsoft Research Asia, SIGCOMM 2008
Network Architecture Layered system with alternative abstractions available at a given layer.
Spark Presentation.
EC-322 COMPUTER NETWORKS E.DIVYA, AP/ECE
Introduction to client/server architecture
Introduction to Cloud Computing
CS222 Web Programming Course Outline
Distributed Systems CS
Topic 5: Communication and the Internet
Networking Computer network A collection of computing devices that are connected in various ways in order to communicate and share resources Usually,
Cloud Computing Data Centers
I. Basic Network Concepts
湖南大学-信息科学与工程学院-计算机与科学系
Do it now – PAGE 11 You will find your do it now task in your workbook – look for the start button! Wednesday, 21 November 2018.
آزمايشگاه سيستمهای هوشمند علی کمالی زمستان 95
Web Design & Development
Building a Database on S3
Pong: Diagnosing Spatio-Temporal Internet Congestion Properties
Lecture 1: Multi-tier Architecture Overview
Tiers vs. Layers.
Chapter Goals Compare and contrast various technologies for home Internet connections Explain packet switching Describe the basic roles of various network.
NETWORK Unit 1 Module: 2 Objective: 7.
Internet and Web Simple client-server model
CS 345A Data Mining MapReduce This presentation has been altered.
NETWORK Unit 1 Module: 2 Objective: 7.
Cloud Computing Data Centers
Distributed Systems CS
Networking Computer network A collection of computing devices that are connected in various ways in order to communicate and share resources Usually,
Chapter 11: Network Address Translation for IPv4
Caching 50.5* + Apache Kafka
In-network computation
Presentation transcript:

Inside the Social Network’s (Datacenter) Network By: Austin Christian Paper written by: Arjun Roy, Hongyi Zheng, Jasmeet Bagga, George Porter and Alex Snoeren

Main Paper Discussions A look inside Facebook’s datacenter to see how network traffic is managed. Discuss contrasting locality, stability, and predictability of network traffic in Facebook’s datacenter. Comment on the implications of Facebook’s network traffic(locality, stability, and predictability) for network architecture, traffic engineering and switch design.

Facebook’s Network Topology Machines organized into racks and connected to top-of-rack switches (RSW) @ 10Gbps Ethernet links. Each RSW connected via 10Gbps links to four aggregation switches called cluster switches(CSW). CSWs connected by another set of aggregation switches called Fat Cats (FC).

Datacenter server jobs A unique aspect about Facebook’s datacenter is servers do one job and do not deviate from that task. Web Servers (Web) serve web traffic MySQL servers (DB) store user data Cache Servers (Cache) handle temp storage for query results, handle cache coherency, serve most read requests Hadoop servers (Hadoop) handle offline analysis and data mining Multifeed servers (MF) assemble news feeds Racks do not contain more than one type of server( ie A rack consisting of only Web servers)

Locality and Stability Web Server Hadoop Server Cache Leader Cache Follower

Locality and Stability Cont. What is observed from the graphs: - Hadoop Server is only server out of the four which is rack-local (traffic stays within cluster and not very stable over the 2min interval). (Note the cyan bars). - Web server, Cache Leader, and Cache Follower display constant stability over the 2min interval Most of the web server traffic stays within the cluster and majority of it is destined to the cache. (Note green and blue bars). Due to cache followers interact with a majority of hosts in cluster and communicates with over most of the web servers. Thus the high intra- cluster traffic (blue bars) The cache leader however engage in primarily inter and intra- datacenter traffic, since cache leader communicates with multiple servers on a large scale (thus the red and green bars).