Distributed Dynamic Replica Placement and Request Redirection in Content Delivery Networks Advisor : Ho-Ting Wu Student : Yu-Chiang Lin Date:2011/5/30.

Slides:



Advertisements
Similar presentations
VSMC MIMO: A Spectral Efficient Scheme for Cooperative Relay in Cognitive Radio Networks 1.
Advertisements

19 Historical overview Main challenge: How to distribute content in high quality over the Internet cost-effectively? • Traditional “Best-effort” model:
Distributed Systems Fall 2010 Replication Fall 20105DV0203 Outline Group communication Fault-tolerant services –Passive and active replication Highly.
One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,
Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.
A Comparison of Layering and Stream Replication Video Multicast Schemes Taehyun Kim and Mostafa H. Ammar.
Beneficial Caching in Mobile Ad Hoc Networks Bin Tang, Samir Das, Himanshu Gupta Computer Science Department Stony Brook University.
An Analysis of Internet Content Delivery Systems Stefan Saroiu, Krishna P. Gommadi, Richard J. Dunn, Steven D. Gribble, and Henry M. Levy Proceedings of.
Peer-to-Peer Based Multimedia Distribution Service Zhe Xiang, Qian Zhang, Wenwu Zhu, Zhensheng Zhang IEEE Transactions on Multimedia, Vol. 6, No. 2, April.
Distributed DBMSPage 5. 1 © 1998 M. Tamer Özsu & Patrick Valduriez Outline Introduction Background Distributed DBMS Architecture  Distributed Database.
1 Efficient Retrieval of User Contents in MANETs Marco Fiore, Claudio Casetti, Carla-Fabiana Chiasserini Dipartimento di Elettronica, Politecnico di Torino,
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
Kyushu University Graduate School of Information Science and Electrical Engineering Department of Advanced Information Technology Supervisor: Professor.
Performance Evaluation of Peer-to-Peer Video Streaming Systems Wilson, W.F. Poon The Chinese University of Hong Kong.
1 The Effectiveness of Request Redirection on CDN Robustness Limin Wang, Vivek Pai and Larry Peterson Presented by: Eric Leshay Ian McBride Kai Rasmussen.
Squirrel: A decentralized peer- to-peer web cache Paul Burstein 10/27/2003.
Adaptive Content Delivery for Scalable Web Servers Authors: Rahul Pradhan and Mark Claypool Presented by: David Finkel Computer Science Department Worcester.
Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.
Information-Centric Networks05a-1 Week 5 / Paper 1 On the use and performance of content distribution networks –Balachander Krishnamurthy, Craig Wills,
Buffer Management for Shared- Memory ATM Switches Written By: Mutlu Apraci John A.Copelan Georgia Institute of Technology Presented By: Yan Huang.
1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.
On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy Craig Wills Yin Zhang Presenter: Wei Zhang CSE Department of Lehigh.
Distributing Content Simplifies ISP Traffic Engineering Abhigyan Sharma* Arun Venkataramani* Ramesh Sitaraman*~ *University of Massachusetts Amherst ~Akamai.
A User Experience-based Cloud Service Redeployment Mechanism KANG Yu.
Redirection and Load Balancing
1 One-Click Hosting Services: A File-Sharing Hideout Demetris Antoniades Evangelos P. Markatos ICS-FORTH Heraklion,
Professor OKAMURA Laboratory. Othman Othman M.M. 1.
Location-aware MapReduce in Virtual Cloud 2011 IEEE computer society International Conference on Parallel Processing Yifeng Geng1,2, Shimin Chen3, YongWei.
INFORMATION AND COMMUNICATION SYSTEMS MERIT 2008 Research Symposium Melbourne Engineering Graduates Look to the Future System Architecture An internetworking.
Schoolnet Benchmarks. Schoolnet Technical Disruptions from October Database overload High volume Reporting Static Content.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
An Efficient Approach for Content Delivery in Overlay Networks Mohammad Malli Chadi Barakat, Walid Dabbous Planete Project To appear in proceedings of.
SOS: Security Overlay Service Angelos D. Keromytis, Vishal Misra, Daniel Rubenstein- Columbia University ACM SIGCOMM 2002 CONFERENCE, PITTSBURGH PA, AUG.
Application of Content Computing in Honeyfarm Introduction Overview of CDN (content delivery network) Overview of honeypot and honeyfarm New redirection.
User Cooperation via Rateless Coding Mahyar Shirvanimoghaddam, Yonghui Li, and Branka Vucetic The University of Sydney, Australia IEEE GLOBECOM 2012 &
Paper Group: 20 Overlay Networks 2 nd March, 2004 Above papers are original works of respective authors, referenced here for academic purposes only Chetan.
A Scalable Content-Addressable Network (CAN) Seminar “Peer-to-peer Information Systems” Speaker Vladimir Eske Advisor Dr. Ralf Schenkel November 2003.
A High Performance Channel Sorting Scheduling Algorithm Based On Largest Packet P.G.Sarigiannidis, G.I.Papadimitriou, and A.S.Pomportsis Department of.
1 Fairness Index Lee Cheng-Ta October 3, Jain’s Fairness Index Fairness Index = where x i is the normalized throughput (in Kbps) of the i−th TCP.
Web Cache Redirection using a Layer-4 switch: Architecture, issues, tradeoffs, and trends Shirish Sathaye Vice-President of Engineering.
1 On the Placement of Web Server Replicas Lili Qiu, Microsoft Research Venkata N. Padmanabhan, Microsoft Research Geoffrey M. Voelker, UCSD IEEE INFOCOM’2001,
Optimal Content Delivery with Network Coding Derek Leong, Tracey Ho California Institute of Technology Rebecca Cathey BAE Systems CISS 2009 March 19, 2009.
Content distribution networks (CDNs) r The content providers are the CDN customers. Content replication r CDN company installs hundreds of CDN servers.
Authors: Mianyu Wang, Nagarajan Kandasamy, Allon Guez, and Moshe Kam Proceedings of the 3 rd International Conference on Autonomic Computing, ICAC 2006,
The IEEE International Conference on Cluster Computing 2010
CS 6401 Overlay Networks Outline Overlay networks overview Routing overlays Resilient Overlay Networks Content Distribution Networks.
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT By Jyothsna Natarajan Instructor: Prof. Yanqing Zhang Course: Advanced Operating Systems.
Overlay Networks : An Akamai Perspective
Web Prefetching Lili Qiu Microsoft Research March 27, 2003.
Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/
Data Consolidation: A Task Scheduling and Data Migration Technique for Grid Networks Author: P. Kokkinos, K. Christodoulopoulos, A. Kretsis, and E. Varvarigos.
On the Placement of Web Server Replicas Yu Cai. Paper On the Placement of Web Server Replicas Lili Qiu, Venkata N. Padmanabhan, Geoffrey M. Voelker Infocom.
Quality Is in the Eye of the Beholder: Meeting Users ’ Requirements for Internet Quality of Service Anna Bouch, Allan Kuchinsky, Nina Bhatti HP Labs Technical.
Research Direction Introduction Advisor: Frank, Yeong-Sung Lin Presented by Hui-Yu, Chung 2011/11/22.
/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.
Dynamic Proxy Tree-Based Data Dissemination Schemes for Wireless Sensor Networks Wensheng Zhang, Guohong Cao and Tom La Porta Department of Computer Science.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Analysis of the increase and Decrease Algorithms for Congestion in Computer Networks Portions of the slide/figures were adapted from :
Courtesy Piggybacking: Supporting Differentiated Services in Multihop Mobile Ad Hoc Networks Wei LiuXiang Chen Yuguang Fang WING Dept. of ECE University.
John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.
Presenter: Kuei-Yu Hsu Advisor: Dr. Kai-Wei Ke 2013/9/30 Performance analysis of video streaming on different hybrid CDN & P2P infrastructure.
Content Distribution Networks
Mohammad Malli Chadi Barakat, Walid Dabbous Alcatel meeting
1. Public Network - Each Rackspace Cloud Server has two networks
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT -Sumanth Kandagatla Instructor: Prof. Yanqing Zhang Advanced Operating Systems (CSC 8320)
Content Distribution Networks
Cashing In On the Caching Game
Smart Content Delivery in Large Networks: En-Route Caching
Replica Placement Heuristics of Application-level Multicast
Content Delivery and Remote DNS services
Presentation transcript:

Distributed Dynamic Replica Placement and Request Redirection in Content Delivery Networks Advisor : Ho-Ting Wu Student : Yu-Chiang Lin Date:2011/5/30

 Page 2 OUTLINE  CDN introduce  Distributed Dynamic Replica Placement  Cloning of a replica  Replica removal  Redirection  Future work  Reference

 Page 3 OUTLINE  CDN introduce  Distributed Dynamic Replica Placement  Cloning of a replica  Replica removal  Redirection  Future work  Reference

 Page 4 CDN Introduce Fig:Server Farm(source from EBU technical review)

 Page 5 CDN Introduce  Consider TCP transmittion , throughput may affect by latency or packet lost 。

 Page 6 CDN Introduce  The Content Delivery Networks (CDN) paradigm is based on the idea to transparently move third-party content closer to the users  content is replicated on CDN servers which are located close to the final users so that users perceive a better content access service.

 Page 7 CDN Introduce Fig:Content Delivery Network(source from EBU technical review)

 Page 8 CDN Introduce Fig:Content Delivery Network

 Page 9 CDN Introduce  Four Important technique  1.Content route  2.Content distribution  3.Content store  4.Content management

 Page 10 CDN Introduce  CDN issue  1) Deciding the kind of content that should be hosted (replica placement)  2) selecting the best replica for a given user  3) designing mechanisms for transparent redirection of the users requests to the best replicas

 Page 11 OUTLINE  CDN introduce  Distributed Dynamic Replica Placement  Cloning of a replica  Replica removal  Redirection  Future work  Reference

 Page 12 Distributed Dynamic Replica  Distributed scheme to allocate and deallocate replicas, so that the user requests are satisfied while minimizing the CDN costs in a dynamic scenario  This scheme always accounts for the current replica placement,adding replicas or changing replica location only when needed.  Each site j ∈ V R autonomously decides on whether some of the replicas it stores should be cloned or removed.

 Page 13 Problem Formulation  V A : access nodes  V R : CDN servers sites  d(i, j): user (access node) i to a replica j  d max : distance threshold  x i,c : the volume of user requests originated at node i ∈ V A for content c ∈ C  U max, U mid, U low: load threshold

 Page 14 Cloning of a replica  Function add_replica(j, c)  1: l j,c =i ∈ V A α ij,c · x i,c  2: while l j,c /r j,c − U max > 0  3: best_served = 0  4: best_distance = ∞  5: best_vr = undefined  6: for all j’ ∈ ρ(j) s.t. r j,c < V maxR do

 Page 15 Cloning of a replica  7: l’ j,c =i ∈ α(j’) α ij,c · x i,c  8: total_distance =i ∈ α(j’)α ij,c · x i,c · d i,j’  9: if (l’ j’,c < best_served) ∨  10: (l’ j’,c = best_served ∧  11: total_distance < best_distance) then  12: best_distance = total_distance  13: best_served = l’ j’,c

 Page 16 Cloning of a replica  14: best_vr = j’  15: end if  16: end for  17: if best_vr = undefined then  18: exit  19: end if  20: ask best_vr to add a replica

 Page 17 Cloning of a replica  21: compute l’’ best vr,c = min(i ∈ α(best vr ) α ij,c · x i,c, 1)  22: l j,c = l j,c − l’’ best vr,c  23: remove from the set of requests those that can be offloaded  24: end while

 Page 18 Replica removal  A replica can be removed if (and only if) it serves no requests  A replica is removed only when it has not been serving requests for a time long enough to bring the exponential average down to zero.

 Page 19 Redirection  Based on this feedback users requests are directed away from a replica in response to threshold events (if the replica load exceeds U max or falls below U low )  As an example, an underloaded replica informs the redirection system which then tries to offload requests to some other replicas (if possible)  A perfect load balancing may be impossible due to the distance constraint

 Page 20 Redirection Fig. A model for the redirection scheme

 Page 21 OUTLINE  CDN introduce  Distributed Dynamic Replica Placement  Cloning of a replica  Replica removal  Redirection  Future work  Reference

 Page 22 Future Work  comparison of different settings of the U mid  observe d max and add remove replica relationship

 Page 23 Reference  [1] N. Bartolini, F. Lo Presti, and C. Petrioli, “Optimal dynamic replica placement in Content Delivery Networks,” in Proceedings of the 11 th IEEE International Conference on Networks, ICON 2003, Sydney, Australia, September 28– October , pp. 125–130.  [2] F. Lo Presti, C. Petrioli, and C. Vicari, “Dynamic replica placement in content delivery networks,” in Proceedings of MASCOTS 05, September  [3] F. Lo Presti, C. Petrioli, and C. Vicari, “Distributed Dynamic Replica Placement and Request Redirection in Content Delivery Networks,” in Proceedings of MASCOTS 07, 2008.