Internet Content Providers End Users The Internet: Simple on the Outside…

Slides:



Advertisements
Similar presentations
Internet Applications INTERNET APPLICATIONS. Internet Applications Domain Name Service Proxy Service Mail Service Web Service.
Advertisements

Akamai Content Delivery Network Slides from Bruce Maggs.
CS 4700 / CS 5700 Network Fundamentals Lecture 15: Content Delivery Networks (Over 1 billion served … each day) Revised 10/22/2014.
Module 1 – Akamai Essentials
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
Netflix Content Delivery RIPE – April 2012 – David Temkin 1.
Akamai networks,48000 servers and 70 countries in the world.
Jan 17, 2001CSCI {4,6}900: Ubiquitous Computing1 Announcements.
Multicast Fundamentals n The communication ways of the hosts n IP multicast n Application level multicast.
The Challenges of Delivering Content on the Internet Tom Leighton Chief Scientist Akamai Technologies.
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
Engineering a Content Delivery Network COMPSCI 214 Computer Networks and Distributed Systems Bruce Maggs.
Engineering a Content Delivery Network Bruce Maggs.
19 Historical overview Main challenge: How to distribute content in high quality over the Internet cost-effectively? • Traditional “Best-effort” model:
Toolbox Mirror -Overview Effective Distributed Learning.
Experience with some Principles for Building an Internet-Scale Reliable System Mike Afergan (Akamai and MIT) Joel Wein (Akamai and Polytechnic University,
EEC-484/584 Computer Networks Lecture 6 Wenbing Zhao
Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )
The Internet Useful Definitions and Concepts About the Internet.
EEC-484/584 Computer Networks Discussion Session for HTTP and DNS Wenbing Zhao
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
ECOMMERCE TECHNOLOGY SUMMER 2002 COPYRIGHT © 2002 MICHAEL I. SHAMOS eCommerce Technology Web Content Delivery.
1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:
AKAMAI Content Delivery Services AKAMAI Content Delivery Services CIS726 : PRESENTATION Avinash Ponugoti Avinash Ponugoti Nagarjuna Nagulapati Sathish.
Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.
 Proxy Servers are software that act as intermediaries between client and servers on the Internet.  They help users on private networks get information.
OARtech Patrick W. Gilmore April 11, 2001.
Content Delivery Networks - Principles & Practice Northeastern& Akamai Technologies Ravi Sundaram.
NET0183 Networks and Communications Lecture 25 DNS Domain Name System 8/25/20091 NET0183 Networks and Communications by Dr Andy Brooks.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
Content Distribution March 8, : Application Layer1.
CSE 534 – Fundamentals of Computer Networks Lecture 11: Content Delivery Networks (Over 1 billion served … each day) Based on slides by D. NEU.
IT 210 The Internet & World Wide Web introduction.
Chapter 16 – DNS. DNS Domain Name Service This service allows client machines to resolve computer names (domain names) to IP addresses DNS works at the.
{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.
1 Computer Communication & Networks Lecture 28 Application Layer: HTTP & WWW p Waleed Ejaz
Infrastructure for Better Quality Internet Access & Web Publishing without Increasing Bandwidth Prof. Chi Chi Hung School of Computing, National University.
Global Internet Content Delivery Akamai Technologies and Carnegie Mellon University Bruce Maggs.
Akamai vs. Flash Crowds and Distributed Denial of Service Akamai Technologies & Carnegie Mellon Bruce Maggs.
AKAMAI Technologies AKAMAI Akamai company stores copies of web content in different locations Mainly provides co-location and marketing.
2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.
How Akamai Handles Large Events Bruce Maggs Carnegie Mellon Duke Akamai Technologies.
12-Oct-15Ubiquitous Computing1 Outline Applications –Central Server –Hierarchical –Peer-to-peer.
CDN: Content Distribution Networks  References:  CS613 textbook, “Computer Networking – A Top-Down Approach”, 6 th edition. Chapter  The text.
Kiew-Hong Chua a.k.a Francis Computer Network Presentation 12/5/00.
Akamai capabilities overview and it’s impact on Iowa.Gov and selected web pages.
Setup and Management for the CacheRaQ. Confidential, Page 2 Cache Installation Outline – Setup & Wizard – Cache Configurations –ICP.
Information-Centric Networks Section # 3.2: DNS Issues Instructor: George Xylomenos Department: Informatics.
Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.
Kona Security Solutions - Overview
Content Distribution Networks (CDNs)
Engineering a Content Delivery Network Bruce Maggs.
CSEN 404 Application Layer II Amr El Mougy Lamia Al Badrawy.
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
MICROSOFT AJAX CDN (CONTENT DELIVERY NETWORK) Make Your ASP.NET site faster to retrieve.
August 2001Copyright UserLand Software 2001 Next Generation Internet Software How Broadband will be used John Robb, President and COO UserLand Software.
Engineering a Content Delivery Network
The Challenges of Delivering Content through the Internet
Content Distribution Networks
Caching Temporary storage of frequently accessed data (duplicating original data stored somewhere else) Reduces access time/latency for clients Reduces.
The Internet.
Internet Applications
Utilization of Azure CDN for the large file distribution
ECE 671 – Lecture 16 Content Distribution Networks
Content Distribution Networks
INTERNET APPLICATIONS
Engineering a Content Delivery Network
EE 122: Lecture 22 (Overlay Networks)
AKAMAI Content Delivery Services
Engineering a Content Delivery Network
Presentation transcript:

Internet Content Providers End Users The Internet: Simple on the Outside…

NAP UUNet Qwest AOL Network Providers Content Providers End Users Peering Points …But Problematic on the Inside

The Four Bottlenecks The First MileThe First Mile Peering PointsPeering Points Network BackbonesNetwork Backbones The Last MileThe Last Mile

400 million potential users = huge infrastructure problem Bottleneck #1: First Mile Content Provider now has worldwide audience; centralization doesn’t workContent Provider now has worldwide audience; centralization doesn’t work

% of Network Traffic ISPs (7,000) 6% Worldcom Bottleneck #2: Peering Points No single network controls a large % of access trafficNo single network controls a large % of access traffic No economic incentive to peer and difficult to implementNo economic incentive to peer and difficult to implement

Bottleneck Implications Slow downloadsSlow downloads -Content must traverse multiple backbones and long distances Unreliable performanceUnreliable performance -Content may be blocked by congestion or backbone peering problems Not scalableNot scalable -Usage limited by bandwidth available at master site Inferior streaming qualityInferior streaming quality -Packet loss, congestion, and narrow pipes degrade stream quality Broadband doesn’t helpBroadband doesn’t help -As broadband becomes ubiquitous, the disaster of centralized solutions becomes more obvious— not better

How the Internet Works How the Internet Works The Akamai Solution The Akamai Solution Company Origins & Overview Company Origins & Overview Technology Overview Technology Overview Technological Challenges Technological ChallengesOutline

The Akamai Solution Akamai Servers at Network Edge Content Providers End Users NAP

Advantages FastFast -Content is served from locations near to end users ReliableReliable -No single point of failure -Automatic failover ScalableScalable -Master site no longer requires massive available bandwidth

Web Site Performance Typical Improvement with Akamai Noon May 15 Noon May 16 Noon May 17 Noon May 18 Noon May 19Noon May 20Noon May 21 Noon May 22 Noon May 23 Noon May 24 Noon May 25Noon May 26Noon May 27 Web object delivered by Akamai Web object delivered without Akamai Keynote  Results

Average speedup of 2-46 timesAverage speedup of 2-46 times Median of 7 times, 86% reduction in download timesMedian of 7 times, 86% reduction in download times Speedup for sample of 94 websites

3 Customer Web Server DNS 1 User enters enters Browser requests IP address for requests IP address for Browser requests embedded objectsBrowser requests embedded objects Customer Web server returns HTMLCustomer Web server returns HTML Browser requests HTMLBrowser requests HTML DNS returns IP addressDNS returns IP address Browser obtains IP address for domain of embedded objects for pageBrowser obtains IP address for domain of embedded objects for page Customer’s Web server returns embedded objectsCustomer’s Web server returns embedded objects Downloading — The Old Way

Finding the IP Address for — The Old Way Browser’s Cache 1 OS 2 Local Name Server 3.net Root (InterNIC) 4 xyz.com DNS Servers TTL: 1 Day TTL: 30 Minutes

Downloading with Akamai’s EdgeSuite User enters enters Browser requests IP address for requests IP address for DNS Optimal Akamai server returns Akamaized HTMLOptimal Akamai server returns Akamaized HTML5 Browser requests HTMLBrowser requests HTML 3 Akamai server assembles page, contacting customer Web server if necessaryAkamai server assembles page, contacting customer Web server if necessary 4 Customer Web server DNS returns IP address of optimal Akamai serverDNS returns IP address of optimal Akamai server 2 Browser obtains IP address of optimal Akamai servers for embedded objectsBrowser obtains IP address of optimal Akamai servers for embedded objects 6 Browser obtains objects from optimal Akamai serversBrowser obtains objects from optimal Akamai servers 7

Key Components DNS Resolution: Finding the IP address for Resolution: Finding the IP address for Page AssemblyPage Assembly Connecting from the edge to the sourceConnecting from the edge to the source

End User Finding the IP Address: The Akamai Way Akamai High-Level DNS Servers 10 g.akamai.net 1 Browser’s Cache OS 2 Local Name Server 3 xyz.com’s nameserver a212.g.akamai.net Akamai Low-Level DNS Servers 12 a212.g.akamai.net xyz.com.net Root (InterNIC) akamai.net8

Root HLDNS LLDNS 1 day 30 min. 30 sec. T ime T o L ive TTL of DNS responses gets shorter further down the hierarchy DNS Maps & Time-To-Live Maps created using info on:Maps created using info on: -Internet congestion -System loads -User demands -Server status Maps are constantly recalculated:Maps are constantly recalculated: -Every few minutes for HLDNS -Every few seconds for LLDNS

Page Assembly Site owners create container pages that can be populated with varying content Container Page [TTL=5d] [XYZ news, content, promotions, etc. TTL=5d] [Breaking headlines TTL=2h] [TTL=15m] [TTL=8h]

Page Assembly EdgeSuite enables Web sites to build and deliver customized content at the edge If gender = male and geography = New York then show article on NY Giants Sportswear [XYZ news, content, promotions, etc. TTL=5d] [Breaking headlines TTL=2h] [TTL=15m] [TTL=8h]

Syntax Example Akamai Weather Forecast Similar to SSI so it’s easily understood— but also breaks performance bottlenecks when distributed across 6,000 serversSimilar to SSI so it’s easily understood— but also breaks performance bottlenecks when distributed across 6,000 servers Used as an API to third-party applications on Akamai’s networkUsed as an API to third-party applications on Akamai’s network