DotSlash An Automated Web Hotspot Rescue System Jonathan Bulava CSC8530 – Distributed Systems Dr. Paul Schragger.

Slides:

Advertisements

Similar presentations

NetServ Dynamic in-network service deployment Henning Schulzrinne (Columbia University) Srinivasan Seetharaman (Georgia Tech) Volker Hilt (Bell Labs)

Advertisements

Internet Control Protocols Savera Tanwir. Internet Control Protocols ICMP ARP RARP DHCP.

Module 7: Configuring Access to Internal Resources.

Toolbox Mirror -Overview Effective Distributed Learning.

DotSlash – A Web Hotspot Rescue System Weibin Zhao Henning Schulzrinne Department of Computer Science Columbia University June 11, 2004.

Web Caching Schemes1 A Survey of Web Caching Schemes for the Internet Jia Wang.

Rheeve: A Plug-n-Play Peer- to-Peer Computing Platform Wang-kee Poon and Jiannong Cao Department of Computing, The Hong Kong Polytechnic University ICDCSW.

Cis e-commerce -- lecture #6: Content Distribution Networks and P2P (based on notes from Dr Peter McBurney © )

Web Servers How do our requests for resources on the Internet get handled? Can they be located anywhere? Global?

Handling Web Hotspots at Dynamic Content Web Sites Using DotSlash Weibin Zhao Henning Schulzrinne Columbia University NYMAN’04.

Flash Crowds And Denial of Service Attacks: Characterization and Implications for CDNs and Web Sites Aaron Beach Cs395 network security.

Multiple Tiers in Action

Handling Web Hotspots at Dynamic Content Web Sites Using DotSlash Weibin Zhao Henning Schulzrinne Columbia University Dagstuhl.

Capacity planning for web sites. Promoting a web site Thoughts on increasing web site traffic but… Two possible scenarios…

Web Caching and CDNs March 3, Content Distribution Motivation –Network path from server to client is slow/congested –Web server is overloaded Web.

Internet Real Time (IRT) Lab at Columbia University Professor: Henning Schulzrinne Columbia University Presenter: Suman Srinivasan, PhD student

12/6/06 1 Hofstra University - CSC005 Special Topics LAMP Technologies.

Towards Autonomic Computing: Service Discovery and Web Hotspot Rescue Weibin Zhao Department of Computer Science Columbia University.

DotSlash: Providing Dynamic Scalability to Web Applications Weibin Zhao and Henning Schulzrinne Department of Computer Science, Columbia University More.

Content Delivery Networks. History Early 1990s sees 100% growth in internet traffic per year 1994 o Netscape forms and releases their first browser.

March 31, 2005Thomson1 Advanced Network Services: P2P VoIP, location-based services and self-managing server farms Henning Schulzrinne (and members of.

Feeds Computer Applications to Medicine NSF REU at University of Virginia July 27, 2006 Paul Lee.

Towards Autonomic Hosting of Multi-tier Internet Services Swaminathan Sivasubramanian, Guillaume Pierre and Maarten van Steen Vrije Universiteit, Amsterdam,

Windows Server 2008 Chapter 8 Last Update

1 Content Distribution Networks. 2 Replication Issues Request distribution: how to transparently distribute requests for content among replication servers.

On the Use and Performance of Content Distribution Networks Balachander Krishnamurthy Craig Wills Yin Zhang Presenter: Wei Zhang CSE Department of Lehigh.

Distributed Computing COEN 317 DC2: Naming, part 1.

Additional SugarCRM details for complete, functional, and portable deployment.

Active Network Applications Tom Anderson University of Washington.

{ Content Distribution Networks ECE544 Dhananjay Makwana Principal Software Engineer, Semandex Networks 5/2/14ECE544.

Web Caching: Replication on the World Wide Web Jonathan Bulava CSC8530 – Distributed Systems Dr. Paul Schragger.

Infrastructure for Better Quality Internet Access & Web Publishing without Increasing Bandwidth Prof. Chi Chi Hung School of Computing, National University.

Travis Portz.  Large, sudden increases in the traffic to a website  Low-traffic website being linked to by a popular news feed  “Slashdot Effect” 

2: Application Layer1 Chapter 2 outline r 2.1 Principles of app layer protocols r 2.2 Web and HTTP r 2.3 FTP r 2.4 Electronic Mail r 2.5 DNS r 2.6 Socket.

Distributed Computing COEN 317 DC2: Naming, part 1.

Peer-to-peer systems for autonomic VoIP and web hotspot handling Kundan Singh, Weibin Zhao and Henning Schulzrinne Internet Real Time Laboratory Computer.

On the use of Reliable Multicast for Content Distribution Vassilis Chatzigiannakis

Application of Content Computing in Honeyfarm Introduction Overview of CDN (content delivery network) Overview of honeypot and honeyfarm New redirection.

1 Welcome to CSC 301 Web Programming Charles Frank.

DotSlash: Handling Web Hotspots at Dynamic Content Web Sites Weibin Zhao Henning Schulzrinne Department of Computer Science Columbia.

Adaptive Web Caching CS411 Dynamic Web-Based Systems Flying Pig Fei Teng/Long Zhao/Pallavi Shinde Computer Science Department.

Hands-On Microsoft Windows Server Implementing Microsoft Internet Information Services Microsoft Internet Information Services (IIS) –Software included.

Content distribution networks (CDNs) r The content providers are the CDN customers. Content replication r CDN company installs hundreds of CDN servers.

Denial of Service Sharmistha Roy Adversarial challenges in Web Based Services.

DYNAMIC LOAD BALANCING ON WEB-SERVER SYSTEMS by Valeria Cardellini Michele Colajanni Philip S. Yu.

1 Distributed Systems Distributed Web-Based Systems Chapter 12.

7DS - Node Cooperation and Information Exchange in Mostly Disconnected Networks Suman Srinivasan, Arezu Moghadam, Se Gi Hong, Henning Schulzrinne IRT Lab,

DotSlash – or how to deal with 15 minutes of fame Weibin Zhao Henning Schulzrinne Columbia University CATT/WICAT Annual Research Review November 14, 2003.

B2C Hosting March 21, Executive Summary Business Problem: The primary goal of the project is to provide a world class web hosting Infrastructure.

ASP-2-1 SERVER AND CLIENT SIDE SCRITPING Colorado Technical University IT420 Tim Peterson.

Apache Web Server Architecture Chaitanya Kulkarni MSCS rd April /23/20081Apache Web Server Architecture.

Renesas Electronics America Inc. © 2010 Renesas Electronics America Inc. All rights reserved. Overview of Ethernet Networking A Rev /31/2011.

By Ruizhe Ma, Avinash Madineni Sidoine Lafleur Kamgang Nov,

Web Prefetching Lili Qiu Microsoft Research March 27, 2003.

Content Delivery Networks: Status and Trends Speaker: Shao-Fen Chou Advisor: Dr. Ho-Ting Wu 5/8/

BZUPAGES.COM WEB SERVER PRESENTED TO: SIR AHMAD KAREEM.

/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.

Web Cache. What is Cache? Cache is the storing of data temporarily to improve performance. Cache exist in a variety of areas such as your CPU, Hard Disk.

John S. Otto Mario A. Sánchez John P. Rula Fabián E. Bustamante Northwestern, EECS.

E-commerce Architecture Ayşe Başar Bener. Client Server Architecture E-commerce is based on client/ server architecture –Client processes requesting service.

University of Maryland College Park

Module 8: Networking Services

1. Public Network - Each Rackspace Cloud Server has two networks

Processes The most important processes used in Web-based systems and their internal organization.

PHP / MySQL Introduction

Overview Introduction VPS Understanding VPS Architecture

DotSlash: An Automated Web Hotspot Rescue System

Co-operative Server Pool for Hotspot Rescue Service

Specialized Cloud Architectures

Web Mining Department of Computer Science and Engg.

Presentation transcript:

DotSlash An Automated Web Hotspot Rescue System Jonathan Bulava CSC8530 – Distributed Systems Dr. Paul Schragger

What is DotSlash?  An automated web hotspot rescue system.  Implementation is similar to Content Delivery Networks (CDN).  People: Weibin Zhao & Henning Schulzinne at Columbia University

Slashdot Effect  A term used when web servers cannot handle an influx of traffic due to links from more popular websites.  Bandwidth is consumed and/or the large number of requests cannot be processed.

Core Techniques  Detecting and predicting overload conditions in real time.  Discovering rescue servers in wide area networks.  Manage rescue relationships.  Designing and evaluating efficient mechanisms for replicating contents dynamically and redirecting client requests in wide area networks.

A Mutual-aid Community  Cost effective solution compared to CDN systems.  Spare capacity in the community is utilized to handle hotspots for an individual site.  Establishes a peer-to-peer communication model.

Configurations Configuration Bottlenecks Addressed Used By Dots_ApacheNetwork and web server Static/dynamic content web sites Dots_Apache + Dots_PHP Network, web server, and application server Dynamic content web sites Dots_Apache + Dots_PHP + Dots_MySQL Network, web server, application server, and database server Dynamic content web sites The prototype uses a LAMP configuration. Only Dots_Apache is required to use DotSlash.

Dots_Apache  An Apache module that supports basic DotSlash functions. Workload monitoring Rescue server discovery Rescue relationship management Request redirection Dynamic virtual hosting Dynamic DNS update

Dots_PHP  An extension for the PHP module that supports replicating PHP scripts dynamically. Dots_MySQL  A cache-enhanced data driver that supports caching database query results on demand.  Requires the memcached engine and libmemcache C library.

State Transitions and Restrictions NormalSOSRescue Complete release Initial allocation Additional allocation Partial release Accept rescue request Partial shutdown Accept rescue request Complete shutdown S1 S2 S8 S7 S4 S3 S4 S6 rescuing States are mutually exclusive i.e. a server cannot provide a rescue server while receiving a rescue service.

HTTP Request Rescue Client origin.com DNS rescue.com DNS ( ) ( ) Cache DNS round-robin and Dynamic Virtual Hosting are implemented to manage rescue servers. (e.g. www-vh1.rescue.com, www-vh2.rescue.com, etc.)

Rescuing Dynamic Content  Original PHP (or other server-side script) is cached on rescue servers.  File Inclusions (include, require, etc.) Customized error handler for each script.  Security Issues? Client (So) (Sr) DB (1) (2) (7) (6) (5) (4) (3) (8)

Effectiveness

The Database Bottleneck Client Database Server Query Result Cache Web/Application Server Data Driver Query Result Cache Web/Application Server Data Driver Original Server Rescue Server Database Server

References  Weibin Zhao, DotSlash,.  Weibin Zhao and Henning Schulzrinne, "Building an Adaptive Distributed Web Server System on the Fly for Handling Web Hotspots," in ACM Symposium on Principles of Distributed Computing (PODC'04) (brief announcement), St. John's, Newfoundland, Canada, July  Weibin Zhao and Henning Schulzrinne, "DotSlash: Handling Web Hotspots at Dynamic Content Web Sites," in IEEE Global Internet Symposium, Miami, Florida, March  “Slashdot effect.” Wikipedia.