Engineering a Content Delivery Network Bruce Maggs.

Slides:

Advertisements

Similar presentations

Let's say we want to access domain - reliablescribe.com First we need to buy a computer We need to subscribe to an Internet Service Provider (ISP) The.

Advertisements

Akamai Content Delivery Network Slides from Bruce Maggs.

CS 4700 / CS 5700 Network Fundamentals Lecture 15: Content Delivery Networks (Over 1 billion served … each day) Revised 10/22/2014.

1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)

Netflix Content Delivery RIPE – April 2012 – David Temkin 1.

Jan 17, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements.

Key Algorithms in a Content Delivery System Akamai Technologies and Carnegie Mellon University Bruce Maggs.

Engineering a Content Delivery Network COMPSCI 214 Computer Networks and Distributed Systems Bruce Maggs.

Engineering a Content Delivery Network Bruce Maggs.

A Security Pattern for a Virtual Private Network Ajoy Kumar and Eduardo B. Fernandez Dept. of Computer Science and Eng. Florida Atlantic University Boca.

Logically Centralized, Physically Distributed Mark Stuart Day Cisco Systems.

Internet Content Providers End Users The Internet: Simple on the Outside…

7/9/2001 Edward Chow Content Switch 1 Clients Content Delivery Network (CDN) Host Server Mind Spring PSINet Sprint UUnet Huge Requests.

CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.

ECOMMERCE TECHNOLOGY SUMMER 2002 COPYRIGHT © 2002 MICHAEL I. SHAMOS eCommerce Technology Web Content Delivery.

1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:

Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.

Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.

Content Distribution Networks (CDNs) Mike Freedman COS 461: Computer Networks Lectures: MW 10-10:50am in Architecture N101

OARtech Patrick W. Gilmore April 11, 2001.

Asfandyar Qureshi (MIT) Rick Weber (Akamai) Hari Balakrishnan (MIT) John Guttag (MIT) Bruce Maggs (Duke/Akamai) cutting the electric bill for internet-

Microsoft Load Balancing and Clustering. Outline Introduction Load balancing Clustering.

Content Delivery Networks - Principles & Practice Northeastern& Akamai Technologies Ravi Sundaram.

Content Distribution Networks CPE 401 / 601 Computer Network Systems Modified from Ravi Sundaram, Janardhan R. Iyengar, and others.

The Role of Content Delivery Networks in Protecting Web Sites from Attacks Bruce Maggs VP for Research, Akamai Technologies.

Domain Name System | DNSSEC. 2  Internet Protocol address uniquely identifies laptops or phones or other devices  The Domain Name System matches IP.

Norman SecureSurf Protect your users when surfing the Internet.

1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy Craig Wills Yin Zhang Presenter: Wei Zhang CSE Department of Lehigh.

CSE 534 – Fundamentals of Computer Networks Lecture 11: Content Delivery Networks (Over 1 billion served … each day) Based on slides by D. NEU.

Sipat Triukose, Zhihua Wen, Michael Rabinovich WWW 2011 Presented by Ye Tian for Course CS05112.

Welcome Thank you for taking our training. Collection 6421: Configure and Troubleshoot Windows Server® 2008 Network Course 6690 – 6709 at

{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.

Niels Provos and Panayiotis Mavrommatis Google Google Inc. Moheeb Abu Rajab and Fabian Monrose Johns Hopkins University 17 th USENIX Security Symposium.

HOW ACCESS TO WWW Student Name : Hussein Alkhaldi.

Web Page Design I Retest Terms Review. 1. Web pages are created using a language known as ___________. The coding of this language must follow specific.

Chapter 1: Introduction to Web Applications. This chapter gives an overview of the Internet, and where the World Wide Web fits in. It then outlines the.

Global Internet Content Delivery Akamai Technologies and Carnegie Mellon University Bruce Maggs.

Akamai vs. Flash Crowds and Distributed Denial of Service Akamai Technologies & Carnegie Mellon Bruce Maggs.

How Akamai Handles Large Events Bruce Maggs Carnegie Mellon Duke Akamai Technologies.

The Inter-network is a big network of networks.. The five-layer networking model for the internet.

Introduction. Readings r Coulouris, Dollimore and Kindberg Distributed Systems: Concepts and Design Edn. 3 m Note: All figures from this book.

CDN: Content Distribution Networks  References:  CS613 textbook, “Computer Networking – A Top-Down Approach”, 6 th edition. Chapter  The text.

11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.

Bruce Maggs Duke University Akamai Technologies Carnegie Mellon University delivering content to the next billion.

Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.

Content Distribution Network, Proxy CDN: Distributed Environment

IEEE MEDIA INDEPENDENT HANDOVER Title: An existing use of DNS Date Submitted: Authors or Sources: H Anthony Chan Abstract: Current.

Ming-Chen Zhao, Paarijaat Aditya, Yin Lin Andreas Haeberlen, Peter Druschel, Bruce Maggs, and William Wishon A First Look at a Hybrid Content Delivery.

Content Delivery Networks in Flux Bruce Maggs Duke University Akamai Technologies.

09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.

Network Services. Domain Controllers: – Used for Account management (e.g. user accounts, group accounts Register Hardware like Printers and PC Authentication.

Content Distribution Networks (CDNs)

The Internet What is the Internet? The Internet is a lot of computers over the whole world connected together so that they can share information. It.

MICROSOFT AJAX CDN (CONTENT DELIVERY NETWORK) Make Your ASP.NET site faster to retrieve.

CIS 1203 Web Technologies Introduction to the Internet and the WWW.

Content Distribution Networks

Engineering a Content Delivery Network

Netscape Application Server

Content Distribution Networks

Algorithmic Nuggets in Content Delivery

CS 4700 / CS 5700 Network Fundamentals

IS 651: Distributed Systems Web Technologies

Content Distribution Networks

Internet and Web Simple client-server model

Educational Computing

Engineering a Content Delivery Network

AKAMAI Content Delivery Services

Engineering a Content Delivery Network

The Evolution of a Content Delivery Network: A 21-Year Perspective

Presentation transcript:

Engineering a Content Delivery Network Bruce Maggs

CDN Services Video deliveryVideo delivery Software deliverySoftware delivery Web-page deliveryWeb-page delivery Domain name system servicesDomain name system services Protection against attacksProtection against attacks

Current Installations Network Deployment Servers Networks 139+ Countries

Akamai Statistics Peak bit rate: over 33 trillion bps ( ) Peak IPv4 HTTP daily requests: over 2.7 trillion ( ) Peak IPv6 HTTP daily requests: over 50 billion 812 million unique IPv4 addresses connected to Akamai in Q1 2015

Design Themes RedundancyRedundancy Self-assessmentSelf-assessment Fail-over at multiple levelsFail-over at multiple levels Robust algorithmsRobust algorithms

Embedded Image Delivery (e.g., Facebook) <html><head> Welcome to xyz.com! Welcome to xyz.com! </head><body> <img src=“ Welcome to our Web site! Welcome to our Web site! Click here to enter Click here to enter </body></html> Embedded URLs are Converted to ARLs ak

End User Akamai DNS Resolution Akamai High-Level DNS Servers 10 g.akamai.net 1 Browser’s Cache OS 2 Local Name Server 3 xyz.com’s nameserver 6 ak.xyz.com 7 a212.g.akamai.net Akamai Low-Level DNS Servers 12 a212.g.akamai.net xyz.com.com.net Root (Verisign) akamai.net8 select cluster select servers within cluster

FirstPoint – DNS (e.g., Microsoft!) Selects from among several mirror sites operated by content providerSelects from among several mirror sites operated by content provider

Akamai Cluster Servers pool resources RAM Disk Throughput

View of Clusters hardware failure buddy suspended datacenter odd man out

Network Failures E.g., congestion at public and private peering points, misconfigured routers, inaccessible networks, etc., etc., etc.

Core Points Core point X is the first router at which all paths to nameservers 1, 2, 3, and 4 intersect.Core point X is the first router at which all paths to nameservers 1, 2, 3, and 4 intersect. X can be viewed as the straddling the core and the edge of the network.X can be viewed as the straddling the core and the edge of the network. X 1 234

Core Points 500,000 nameservers reduced to 90,000 core points 90,000 core points 7,000 account for 95% end-user load

Engineering Methodology C programming language (gcc). Reliance on open-source code. Large distributed testing systems. Burn-in on “invisible” system. Staged rollout to production. Backwards compatibility.