Existing CDNs Fail to Address these Challenges

Slides:



Advertisements
Similar presentations
Dynamic Replica Placement for Scalable Content Delivery Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy, EECS Department.
Advertisements

A KTEC Center of Excellence 1 Cooperative Caching for Chip Multiprocessors Jichuan Chang and Gurindar S. Sohi University of Wisconsin-Madison.
Intelligent File System Changgyu Oh 04/02/02. Problem Domain(1) Scalability of Current Decentralized P2P Networks similar to Gnutella –A total number.
1 Server Selection & Content Distribution Networks (slides by Srini Seshan, CS CMU)
Ceph: A Scalable, High-Performance Distributed File System Priya Bhat, Yonggang Liu, Jing Qin.
Module 10: Troubleshooting Active Directory, DNS, and Replication Issues.
Cooperative Caching of Dynamic Content on a Distributed Web Server Vegard Holmedahl, Ben Smith, Tao Yang Speaker: SeungLak Choi, DB Lab., CS Dept.
Distributed Systems Fall 2010 Replication Fall 20105DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
Toolbox Mirror -Overview Effective Distributed Learning.
A Taxonomy and Survey of Content Delivery Networks Meng-Huan Wu 2011/10/26 1.
Spring 2003CS 4611 Content Distribution Networks Outline Implementation Techniques Hashing Schemes Redirection Strategies.
SCAN: A Dynamic, Scalable, and Efficient Content Distribution Network Yan Chen, Randy H. Katz, John D. Kubiatowicz {yanchen, randy,
1 Clustering Web Content for Efficient Replication Yan Chen, Lili Qiu*, Weiyu Chen, Luan Nguyen, Randy H. Katz EECS Department UC Berkeley *Microsoft Research.
Logically Centralized, Physically Distributed Mark Stuart Day Cisco Systems.
FRIENDS: File Retrieval In a dEcentralized Network Distribution System Steven Huang, Kevin Li Computer Science and Engineering University of California,
TCP/IP Support Protocols. ICMP ARP Can’t deliver IP packet to ethernet NIC without the ethernet address Runs over datalink.
1 Clustering Web Content for Efficient Replication Yan Chen, Lili Qiu*, Weiyu Chen, Luan Nguyen, Randy H. Katz EECS Department UC Berkeley *Microsoft Research.
Chord and CFS Philip Skov Knudsen Niels Teglsbo Jensen Mads Lundemann
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
Distributed Systems Fall 2009 Replication Fall 20095DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
Object Naming & Content based Object Search 2/3/2003.
Squirrel: A decentralized peer- to-peer web cache Paul Burstein 10/27/2003.
Wide-area cooperative storage with CFS
What Can Databases Do for Peer-to-Peer Steven Gribble, Alon Halevy, Zachary Ives, Maya Rodrig, Dan Suciu Presented by: Ryan Huebsch CS294-4 P2P Systems.
Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.
Client-Server Computing in Mobile Environments
Information-Centric Networks05a-1 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills,
ACDN: A CDN for Applications Pradnya Karbhari Michael Rabinovich Zhen Xiao Fred Douglis AT&T Labs -- Research.
DNS and CDNs (Content Distribution Networks) Paul Francis Cornell Computer Science.
{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.
SCAN: a Scalable, Adaptive, Secure and Network-aware Content Distribution Network Yan Chen CS Department Northwestern University.
Thesis Proposal Data Consistency in DHTs. Background Peer-to-peer systems have become increasingly popular Lots of P2P applications around us –File sharing,
Google File System Simulator Pratima Kolan Vinod Ramachandran.
5.1 Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED.
Overcast: Reliable Multicasting with an Overlay Network CS294 Paul Burstein 9/15/2003.
2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.
CEPH: A SCALABLE, HIGH-PERFORMANCE DISTRIBUTED FILE SYSTEM S. A. Weil, S. A. Brandt, E. L. Miller D. D. E. Long, C. Maltzahn U. C. Santa Cruz OSDI 2006.
Dr. Yingwu Zhu Summary Cache : A Scalable Wide- Area Web Cache Sharing Protocol.
Introduction to DFS. Distributed File Systems A file system whose clients, servers and storage devices are dispersed among the machines of a distributed.
MapReduce and GFS. Introduction r To understand Google’s file system let us look at the sort of processing that needs to be done r We will look at MapReduce.
Serverless Network File Systems Overview by Joseph Thompson.
By Shruti poundarik.  Data Objects and Files are replicated to increase system performance and availability.  Increased system performance achieved.
PROP: A Scalable and Reliable P2P Assisted Proxy Streaming System Computer Science Department College of William and Mary Lei Guo, Songqing Chen, and Xiaodong.
Towards a Transparent and Proactively-Managed Internet Ehab Al-Shaer School of Computer Science DePaul University Yan Chen EECS Department Northwestern.
Web Caching and Replication Presented by Bhushan Sonawane.
Globally Distributed Content Delivery Presenter: Baoning Wu 03/25/2003.
Information-Centric Networks Section # 5.1: Content Distribution Instructor: George Xylomenos Department: Informatics.
Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/
/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.
Distributed Hash Tables
Lecture 5: Synchronization
VIRTUAL SERVERS Presented By: Ravi Joshi IV Year (IT)
1. Public Network - Each Rackspace Cloud Server has two networks
Chapter 19: Distributed Databases
Flat Datacenter Storage
The Google File System Sanjay Ghemawat, Howard Gobioff and Shun-Tak Leung Google Presented by Jiamin Huang EECS 582 – W16.
Managing Online Services
Jinyang Li’s Research Distributed Systems Wireless Networks
Providing Secure Storage on the Internet
Distributed Systems CS
Content Distribution Networks (CDNs)
Edge computing (1) Content Distribution Networks
Outline Midterm results summary Distributed file systems – continued
Advanced Operating Systems Chapter 11 Distributed File systems 11
CSE 4340/5349 Mobile Systems Engineering
Active Directory Sites
Dynamic Replica Placement for Scalable Content Delivery
Chord and CFS Philip Skov Knudsen
Your computer is the client
Simulation for Cache Mesh Design
Presentation transcript:

Existing CDNs Fail to Address these Challenges No coherence for dynamic content X Unscalable network monitoring - O(M × N) M: # of client groups, N: # of server farms Client from GWU try to access it again? Even if sparse clients have very sparse requests, it will end up placing replicas on every CDN servers. Inefficient replication will have two effects: 1. wastes a lot of replication bandwidth, and consequently, update bandwidth; 2. the replicas are not fully utilized. CDN servers have limit storage. So the inefficient replication will cause old content replicas constantly replaced by new content replicas before serving more clients. Questions on consistent caching: it is another type of hash table for directory scheme with high probability on query success. It mainly supports fixed # of replicas for each URL, and is not very flexible for hot URLs, have to continuously and manually change the hash functions. Not really used by Akamai, talk w/ Tom Leighton, Chief scientist. Second, can’t choose optimal locations for replicas Third, it doesn’t really record the location of replicas. So can’t update them when change occurs. Non-cooperative replication inefficient