Architecture of Large-Scale Websites

Slides:

Advertisements

Similar presentations

Drupal in the Enterprise

Advertisements

Capacity Planning for LAMP Architectures John Allspaw Manager, Operations Flickr.com Web Builder 2.0 Las Vegas.

Fast Data at Massive Scale Lessons Learned at Facebook Bobby Johnson.

Prime’ Senior Project. Presentation Outline What is Our Project? Problem Definition What does our system do? How does the system work? Implementation.

Creating WordPress Websites. Creating a site on your computer Local server Local WordPress installation Setting Up Dreamweaver.

Progress Report 11/1/01 Matt Bridges. Overview Data collection and analysis tool for web site traffic Lets website administrators know who is on their.

12/11/01 Matt Bridges Advisor: Ralph Morelli. What is Web Analytics? In traditional commerce, store owners can observe their customers habits: What time.

IST346:  Web Services. Today’s Agenda  Learn the basics of how the Web works  Understand various web service architectures  Address scaling, security,

SIP Routing Proxy Integrated Routing solution. General functionality  The Routing Proxy is based on Session Initial Protocol(SIP) and is acting as a.

How WebMD Maintains Operational Flexibility with NoSQL Rajeev Borborah, Sr. Director, Engineering Matt Wilson – Director, Production Engineering – Consumer.

22-Aug-15 | 1 |1 | Help! I need more servers! What do I do? Scaling a PHP application.

Distributed Data Stores – Facebook Presented by Ben Gooding University of Arkansas – April 21, 2015.

What makes Facebook do what it does? By Gavin Mais.

IDK0040 Võrgurakendused I Building a site: Implementation Deniss Kumlander.

AK Software Company Video Solution Le Dinh Ka:

Making it easier to develop, deploy and maintain Drupal web sites Name, Title Date.

NCICB Systems Architecture Bill Britton Terrapin Systems LPG/NCICB Dedicated Support.

Web Caching By Neeraj Agrawal. Caching Caching is widely used for improving performance in many context( e.g processor caches in hardware, buffer pool.

Www2.computer.org Basic Architecture Leo Wadsworth, Staff Manager April 2008.

Scaling Dynamic Content Applications through Data Replication - Opportunities for Compiler Optimizations Cristiana Amza UofT.

Jeremy Bingham, DailyKos.com. Initial Problems Site tipped over way too often Required intensive administration Load times needed to be faster.

Windows Azure Conference 2014 LAMP on Windows Azure.

A Comparative Evaluation of Transparent Scaling Techniques for Dynamic Content Servers Presented by Chen Zhang Written by C. Amza, A. L. Cox,

Fronting Tomcat With Apache V0.1 – Nguyễn Bá Thành Software Manager, Game Platform & Integration.

Copyright ©2003 Dell Inc. All rights reserved. Scaling-Out with Oracle® Grid Computing on Dell™ Hardware J. Craig Lowery, Ph.D. Software Architect and.

Scalable Data Scale #2 site on the Internet (time on site) >200 billion monthly page views Over 1 million developers in 180 countries.

/ Fast Web Content Delivery An Introduction to Related Techniques by Paper Survey B Li, Chien-chang R Sung, Chih-kuei.

Web Cache. What is Cache? Cache is the storing of data temporarily to improve performance. Cache exist in a variety of areas such as your CPU, Hard Disk.

Speeding Up Alfresco and Share using Nginx Reverse/Caching Frontend Proxy Ishara Fernando Senior Linux Systems Administrator.

Speeding Up Alfresco and Share using Nginx Reverse/Caching Frontend Proxy Ishara Fernando Senior Linux Systems Administrator.

Cloud Computing: Pay-per-Use for On-Demand Scalability Developing Cloud Computing Applications with Open Source Technologies Shlomo Swidler.

Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.

The vMatrix: Teleporting Servers via Virtual Machine Monitors (work in progress – LISA’02) Amr A. Awadallah Mendel Rosenblum

Andrew Lahiff HEP SYSMAN June 2016 Hiding infrastructure problems from users: load balancers at the RAL Tier-1 1.

Wikimedia architecture Ryan Lane Wikimedia Foundation Inc.

Wikimedia architecture Ryan Lane Wikimedia Foundation Inc.

EZ Publish NYPHP 10/25/2005 Andrew Yochum Michael DeWitt.

1 Super/Ultra-Basic Load-Balancing Introduction For AFNOG 2012 Joel Jaeggli.

Memory-efficient and fast websites Malcolm Tredinnick.

CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland.

Less Than 0.5 Second to Load Emile Heitor – NBS System 28 / 05 / 2010.

Presented by Michael Rainey South Mississippi Linux Users Group

From infra admin's point of view

Building an E-Commerce website

Abhinav Kamra, Vishal Misra CS Department Columbia University

N-Tier Architecture.

Ssb.no - launching a new website

Time is the enemy: Ten Core Lessons for Achieving Peak

From Algorithm to System to Cloud Computing

APA-OTS WordPress Multi-Site HTTPS Migration: a Case Study

1. Public Network - Each Rackspace Cloud Server has two networks

WordPress “WordPress is a free and open source blog publishing application.” Christina Vasileiou Database management system.

Distributed Multimedia Systems

Processes The most important processes used in Web-based systems and their internal organization.

Change Deployment in ServiceN w

2017 Real Questions

Moodle Scalability What is Scalability?

Table Partitioning Intro and make that a sliding window too!

How and why to use caching on your website

IST346: Scalability.

Table Partitioning Intro and make that a sliding window too!

DD Sir-Infomatics Web Development Part-1.

Distributed Availability Groups

Supercharge your website with Cherokee, Varnish, and MariaDB

LOAD BALANCING INSTANCE GROUP APPLICATION #1 INSTANCE GROUP Overview

Speed is key My personal quest for a faster website

University of Glasgow Sharepoint

© 2017, Mike Murach & Associates, Inc.

Windows Azure SDK 1.7 and New Features

Presentation transcript:

Architecture of Large-Scale Websites Yu Feng 06/08/2008

Static Content Image Servers Database Cache Mirror Load Balance Agenda Static Content Image Servers Database Cache Mirror Load Balance

Static Content Use CMS (Content Management System) Can be managed easily (add/remove/modify) Channels

Static Content (cont’d) Make it static as much as possible Dynamic pages are always much slower Static pages are more cache-friendly The ways that high traffic sites do Netease, Sina, Mop Convert dynamic pages to static ones (BBS)

Image Servers Use separate image servers Images Small size Large amount Reduce the stress of the main server Can be optimized nginx lighttpd

Improve the design of your database Tables Tuning Your application

Database (cont’d) Use database clusters Oracle MySQL MySQL Replication Master/Slave) MySQL-Proxy

Why caching is important? Cache Why caching is important?

Apache Squid Ncache Memcached … Cache (cont’d) Apache Squid Ncache Memcached …

Mirror Different entrance

Load Balance DNS What is a L4/L7 switch?

Load Balance (cont’d) Hardware F5, Aleton

Load Balance (cont’d) LVS HAProxy

The End Thanks