1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

Slides:



Advertisements
Similar presentations
1 Data-Oriented Network Architecture (DONA) Scott Shenker (M. Chowla, T. Koponen, K. Lakshminarayanan, A. Ramachandran, A. Tavakoli, I. Stoica)
Advertisements

Scheduling in Web Server Clusters CS 260 LECTURE 3 From: IBM Technical Report.
Information-Centric Networks05c-1 Week 5 / Paper 3 Democratizing content publication with Coral –Michael J. Freedman, Eric Freudenthal, David Mazières.
EDNS0 Client-Subnet for DNS based CDNs
Ningning HuCarnegie Mellon University1 Optimizing Network Performance In Replicated Hosting Peter Steenkiste (CMU) with Ningning Hu (CMU), Oliver Spatscheck.
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
1 Routing and Scheduling in Web Server Clusters. 2 Reference The State of the Art in Locally Distributed Web-server Systems Valeria Cardellini, Emiliano.
Spring 2003CS 4611 Content Distribution Networks Outline Implementation Techniques Hashing Schemes Redirection Strategies.
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
1 Improving Web Servers performance Objectives:  Scalable Web server System  Locally distributed architectures  Cluster-based Web systems  Distributed.
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
SERVER LOAD BALANCING Presented By : Priya Palanivelu.
1 Web Proxies Dr. Rocky K. C. Chang 6 November 2005.
Anycast Jennifer Rexford Advanced Computer Networks Tuesdays/Thursdays 1:30pm-2:50pm.
Application-Layer Anycasting: A Server Selection Architecture and Use in a Replicated Web Service IEEE/ACM Transactions on Networking Vol.8, No. 4, August.
1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:
Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.
1 ENHANCHING THE WEB’S INFRASTUCTURE: FROM CACHING TO REPLICATION ECE 7995 Presented By: Pooja Swami and Usha Parashetti.
Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.
AKAMAI Content Delivery Services AKAMAI Content Delivery Services CIS726 : PRESENTATION Avinash Ponugoti Avinash Ponugoti Nagarjuna Nagulapati Sathish.
Caching and Content Distribution Networks. Web Caching r As an example, we use the web to illustrate caching and other related issues browser Web Proxy.
Content Delivery Networks (CDN) Dr. Yingwu Zhu Reverse Proxy Reverse Proxy Reverse Proxy Intranet Web Cache Architecure Browser Local ISP cache L4 Switch.
Content Distribution Networks (CDNs) Mike Freedman COS 461: Computer Networks Lectures: MW 10-10:50am in Architecture N101
DNS. Outline r Domain Name System r DNS Hierarchy r Resolution.
Content Distribution Network (CDN) Performance Punit Shah CSE581 Internet Technologies OGI, OHSU 2002, Jan 16th.
Information-Centric Networks05a-1 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills,
Caching and Content Distribution Networks. Some Interesting Observations r Top 1 % of all documents account for 20% - 35% of proxy requests r Top 10%
On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy Craig Wills Yin Zhang Presenter: Wei Zhang CSE Department of Lehigh.
Content Distribution March 8, : Application Layer1.
Active Network Applications Tom Anderson University of Washington.
CSE 534 – Fundamentals of Computer Networks Lecture 11: Content Delivery Networks (Over 1 billion served … each day) Based on slides by D. NEU.
Redirection and Load Balancing
1. 1.Charting the CDNs(locating all their content and DNS servers). 2.Assessing their server availability. 3.Quantifying their world-wide delay performance.
{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.
Ao-Jan Su, David R. Choffnes, Fabián E. Bustamante and Aleksandar Kuzmanovic Department of EECS Northwestern University Relative Network Positioning via.
CPSC 441: Multimedia Networking1 Outline r Scalable Streaming Techniques r Content Distribution Networks.
2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
Application of Content Computing in Honeyfarm Introduction Overview of CDN (content delivery network) Overview of honeypot and honeyfarm New redirection.
CDN: Content Distribution Networks  References:  CS613 textbook, “Computer Networking – A Top-Down Approach”, 6 th edition. Chapter  The text.
Web Hosting Herng-Yow Chen. Outline How different web site can be “ virtually hosted ” on the same server, and how this affects HTTP How to make web sites.
Content distribution networks (CDNs) r The content providers are the CDN customers. Content replication r CDN company installs hundreds of CDN servers.
The Intranet.
DYNAMIC LOAD BALANCING ON WEB-SERVER SYSTEMS by Valeria Cardellini Michele Colajanni Philip S. Yu.
DotSlash – or how to deal with 15 minutes of fame Weibin Zhao Henning Schulzrinne Columbia University CATT/WICAT Annual Research Review November 14, 2003.
Information-Centric Networks Section # 3.2: DNS Issues Instructor: George Xylomenos Department: Informatics.
Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.
Content Distribution Network, Proxy CDN: Distributed Environment
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Information-Centric Networks Section # 5.1: Content Distribution Instructor: George Xylomenos Department: Informatics.
Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/
09/13/04 CDA 6506 Network Architecture and Client/Server Computing Peer-to-Peer Computing and Content Distribution Networks by Zornitza Genova Prodanoff.
Content Distribution Networks (CDNs)
CIS679: Anycast r Review of Last lecture r Network-layer Anycast m Single-path routing for anycast messages r Application-layer anycast.
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Content Distribution Networks
The Intranet.
Content Distribution Networks
Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting
LECTURE 34: WEB PROGRAMMING FOR SCALE
ECE 671 – Lecture 16 Content Distribution Networks
Content Distribution Networks
LECTURE 32: WEB PROGRAMMING FOR SCALE
LECTURE 33: WEB PROGRAMMING FOR SCALE
Content Distribution Networks
Content Delivery and Remote DNS services
EE 122: Lecture 22 (Overlay Networks)
LECTURE 33: WEB PROGRAMMING FOR SCALE
AKAMAI Content Delivery Services
Presentation transcript:

1 Content Distribution Networks

2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers. Server selection: how to select a server replica for a given request. Content placement: how to decide how many replicas of given content to have and on which servers to place these replicas.

3 Request distribution Transparent replication: techniques that require no user involvement or even awareness of the underlying replication scheme. Clients use a single logical name when requesting content. Basic issue: redirection of logically identical requests to distinct servers.

4 Request Redirection At the client At the intermediate proxies At the DNS system At the primary origin server Somewhere in the network

5 Content-blind request distribution with Full Replication Client redirection Redirection by a balancing switch Redirection through DNS servers anycast.

6 Client redirection (1/2) Use the Web client’s DNS.

7 Client redirection (2/2) Client redirection at the client. Use Web site DNS to return a list of server replicas. The entire list is passed to the client by the client DNS. Client selects server replica to contact.

8 Advantages of client schemes Client can make the server selection. Client can compare routing paths, measure response times, packet loss rates or other metrics. Does not interfere with the DNS caching. Problem: server selection in performed by the client (sub-optimal selection of servers).

9 Balancing switch redirection Hardware-based solution to redirect requests. “Balancer” is placed in front of a server farm. Balancer modifies addresses.

10 Switch-based redirection L3, L4 switch: IP balancing Uses standard clients, DNS and Web servers. Low geographical scalability. IBM Network dispatcher.

11 Web Site DNS redirection Many DNS implementations allow the Web site DNS to map a host domain name to a set of IP addresses and chose one of them for every query.

12 Web site DNS redirection: pros and cons Scales well geographically. No modifications of the client or DNS are needed. DNS response caching complicates the management of caching replicas and request distribution.

13 Anycast Multiple physical servers use a single IP addr called anycast addr. Each server advertises both the anycast addr and its regular addr. Routers build paths that lead to the nearest anycast member-server.

14 Anycast

15 Content-blind request distribution with partial replication Servers may have the entire replica of the web site. Full replication is often used but imposes considerable overhead. Typically only a small fraction of content is responsible for most of the requests. Partial replication.

16 Surrogates as server replicas Content requests are distributed among surrogates that are distinct from the origin servers. A surrogate can fulfill the posed request. Otherwise the object is retrieved from the origin server. DNS redirection is often used for distributing requests among the surrogates.

17 Partial replication through surrogates

18 Back-end distributed file systems Use a distributed file system to allow each replication server access the same, shared file set.

19 Content Delivery Networks CDN: agents of content providers A CDN signs up individual content providers for scalable content delivery and delivers their content to any client that accesses the respective Web sites. CDN customers, CDN clients. The latter download content from the CDN that the former provide to the CDN.

20 Benefits to content providers Global reach: A CDN serves content from multiple CDN servers deployed around the globe. By signing up with a CDN, a content provider gains instant presence around the globe at virtually no upfront cost. Flash event protection: Sometimes a Web site experiences a sudden increase in demand called a flash event. A CDN offers an easy way to prepare for a predictable flash event or to protect from an unforeseen one.

21 CDN benefits A CDN is an intermediate layer of infrastructure between origin servers and clients (middleware). A CDN can achieve scalable content delivery by distributing load among its servers, by serving client requests from servers that are close to requesters, and by bypassing congested network paths. CDN infrastructure is shared among multiple content provider sites. CDN has close relationship with the underlying networks. A technical consequence of shared infrastructure is that CDNs must implement a mechanism for finding the origin server for a given piece of content. close relationship with underlying networks: CDNs place their servers within PoPs or backbone nodes of ISPs.

22 Types of CDNs Classification: relationship to ISPs, relationship to customers, mechanisms for delivering requests to CDN servers. Multi ISP, single ISP. CDN with hosting service (CDN servers for relaying content from origin servers and the origin servers themselves, customer maintains a staging server). Relaying CDNs: origin servers remain external to the CDN.

23 CDN types

24 Relaying CDN: 1 st origin

25 Relaying CDN: 1 st CDN

26 Request delivery mechanisms DNS outsourcing. Customer delegates the DNS service for its domain to the CDN. Customer’s DNS replies (when queried) with a point to the CDN DNS. CDN DNS resolves query to one of the CDN servers.

27 Relaying CDNs with 1 st origin Embedded urls that the CDN is supposed to deliver use host names that are controlled by the CDN DNS. Alternatively, the embedded content uses domain names that belong to the CDN. Method adopted by Akamai.

28 Comparing CDN types Origin-first CDNs require that embedded urls use distinct domains from container pages. Relative urls are avoided. CDN-first CDNs allow embedded objects to share the same domain name as the container page. Origin-first CDN: two tcp connections are required.

29 Request distribution in CDNs DNS/Balancing switch redirection. CDN DNS returns the IP addr of the balancing switch.

30 Request distribution in CDNs Two-level DNS redirection This architecture distributes the DNS load among leaf DNS servers and allows client DNS servers to use nearby DNS servers for queries while they cache high-level DNS responses.

31 Problems in DNS-based request distribution Originator problem: large networks often have a few DNS servers to handle clients’ requests. The client may be far away from the client DNS. Hidden load factor problem. Client DNS masking problem (recursive resolution of requests).

32 Server Selection Metrics Proximity metrics Server load metrics Aggregate metrics Passive measurements obtain metrics by simply observing the normal operation of the system. Active measurements involve actions that the system performs only for the purpose of obtaining the metric. Synchronous/Asynchronous measurements.

33 Proximity metrics Geographical distance Number of network routers Number of AS

34 Server Load Metrics Number of connections Number of requests Ready queue length Response time >> uptime 5:12pm up 30 day(s), 7:01, 3 users, load average: 0.11, 0.09, 0.09

35 Aggregate metrics Tcp ping latency Icmp ping latency http request latency Download latency, download time