Measuring End-User Availability on the Web: Practical Experience Matthew Merzbacher (visiting research scientist) Dan Patterson (undergraduate) Recovery-Oriented.

Slides:



Advertisements
Similar presentations
Best Practise in Using Finance Simulations in UK Higher Education By: Neil Marriott and Siew Min (Amy) Tan.
Advertisements

ONE STOP THE TOTAL SERVICE SOLUTION FOR REMOTE DEVICE MANAGMENT.
Troubleshooting methodology Unit objectives: Describe troubleshooting models and problem tracking systems Interact professionally with users and achieve.
Planning for Sustainable Desktop Computing Access ’98 Presentation Robert N. Kavanagh Associate Vice-President, Information Technology Services, University.
VxWorks Real-Time Kernel Connectivity
Well, Sort-of.
Reliability and Dependability in Computer Networks CS 552 Computer Networks Side Credits: A. Tjang, W. Sanders.
YNG Solutions Website Usability Review Prepared by Josepha Rood December 19, 2008.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 8 Introduction to Printers in a Windows Server 2008 Network.
5th Edition, Irv Englander
0-1 Team ?? Status Report (1 of 3) Client Contact –Point 1 –Point 2 Team Meetings –Point 1 –Point 2 Team Organization –Point 1 –Point 2 Team 1: Auraria.
Words & Definitions By: Naftaly Garcia Birruete. Address Bar  The space provided on a web browser that shows the addresses of websites.
Presentation outline IT pain points Top features Product snapshot
7 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
CompSci Self-Managing Systems Shivnath Babu.
Internet Marketing Session: 17 Prof: Yasmin. Definition Internet Marketing is the process of building and maintaining customer relationships through online.
Project Team: James Cryan, Ashley Reddick, Christopher Pendleton, and Isaiah Lyons 4/9/2013.
Gordon Kass CEO & President 919/ x26 Porivo Technologies Inc. Measuring end-to-end web performance.
Marketing of Information Security Products. The business case for Information Security Management.
The Evolution of Fleet Management How do you get device information now? Manually? Configuration pages?
14 Publishing a Web Site Section 14.1 Identify the technical needs of a Web server Evaluate Web hosts Compare and contrast internal and external Web hosting.
Being Ecommerce Sophon Thanasrivilai #100485
Quality Attributes of Web Software Applications – Jeff Offutt By Julia Erdman SE 510 October 8, 2003.
1 Expose – Acquire - Engage. 2 Would you agree that technology has changed the way you do business?
CWIC Developers Meeting January 29 th 2014 Calin Duma Service Level Agreements High-Availability, Reliability and Performance.
Simple Database.
E-commerce is the most promising and fastest growing technology. We build this software with latest tools in the field. This supports all types of commerce.
ENTERPRISE COMPUTING QUIZ By: Lean F. Torida
The Internet  Internet Hardware connected together Creates a massive worldwide network  Hardware Computers Communication lines  Interlinked collection.
Welcome to the world of !. What does it mean?  Business through internet.  E-Business or E-Engineering.  Transaction of products/services through telephone.
NETWORK ADMINISTRATOR. EXAMPLES OF SOME COMPUTING RELATED CAREERS Multimedia Artist / Graphics Artist Information System Manager Computer Scientist Network.
Chapter 5 Transactions and Electronic Commerce I. Methods of Data Capture (P.164-P.170) Point of sale (POS) Process control Electronic data interchange.
Communication in the Real World SOCIAL MEDIA’S AFFECT ON SOCIETY.
Microsoft Reseach, CambridgeBrendan Murphy. Measuring System Behaviour in the field Brendan Murphy Microsoft Research Cambridge.
Business Data Communications, Fourth Edition Chapter 11: Network Management.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
Introduction to Microsoft Windows 2000 Welcome to Chapter 1 Windows 2000 Server.
Network Administration Internship By: Isaac Johnson II.
{ Cloud computing. Exciting and relatively new technologies allow computing to be a part of our everyday lives. Cloud computing allows users to save their.
Module 9 Planning and Implementing Monitoring and Maintenance.
 why it is important for you to be very familiar with how a computer works and what it can do. A computer is simply a machine that is programmed to follow.
Free search engine finds 10,000 lathes for users in first month.

A s s i g n m e n t W e e k 7 : T h e I n t e r n e t B Y : P a t r i c k O b i s p o.
Operations Good –Telescope downtime is low –Important repairs accomplished –Observer satisfaction is high Bad –Maintenance is deferred –Unfinished work.
What part of the URL tell the computer to find the server?
Introduction to Networks. When Personal Computers first appeared in business, software programs were designed for a single user. However as computers.
1 Automating Network Diagnostics to Help End-Users Dave Thaler
 Internet Hardware connected together Creates a massive worldwide network  Hardware Computers Communication lines  Interlinked collection of smaller.
 Computer hardware refers to the physical parts of a computer and related devices. Internal hardware devices include motherboards, hard drives,
What do System Administrators Do? William Kakes Calvin Ling Leonard Chung Aaron Brown EECS Computer Science Division University of California, Berkeley.
FROM CLOUD COMPUTING TO CLOUD MANUFACTURING Jenia Brook.
Successfully Implementing The Information System Systems Analysis and Design Kendall and Kendall Fifth Edition.
Stamatia Bibi1, Dimitris Katsaros2, Panayiotis Bozanis2
5th Edition, Irv Englander
Introduction Of Information Technology
Software Architecture in Practice
Netscape Application Server
Introduction to Operating Systems
Introduction Of Information Technology
Large Distributed Systems
T. Kadowaki (Accelerator Engineering Corporation)
3.2 Virtualisation.
What Do We Do? Managed IT services
Managing Information Systems and Communications Technology
Section 14.1 Section 14.2 Identify the technical needs of a Web server
Tiers vs. Layers.
Low Level Architecture
IT OPERATIONS Session 7.
Client/Server and Peer to Peer
Presentation transcript:

Measuring End-User Availability on the Web: Practical Experience Matthew Merzbacher (visiting research scientist) Dan Patterson (undergraduate) Recovery-Oriented Computing (ROC) University of California, Berkeley

E—Commerce Goal Non-stop Availability –24 hours/day –365 days/year How realistic is this goal? How do we measure availability? –To evaluate competing systems –To see how close we are to optimum

The State of the World Uptime measured in “nines” –Four nines == 99.99% uptime (just under an hour downtime per year) –Does not include scheduled downtime Manufacturers advertise six nines –Under 30s unscheduled downtime/year –May be true in perfect world –Not true in practice on real Internet

Measuring Availability Measuring “nines” of uptime is not sufficient –Reflects unrealistic operating conditions Must capture end-user’s experience –Server + Network + Client Client Machine and Client Software

Existing Systems Topaz, Porvio, SiteAngel –Measure response time, not availability –Monitor service-level agreements NetCraft –Measures availability, not performance or end-user experience We measured end-user experience and located common problems

Experiment “Hourly” small web transactions –From two relatively proximate sites (Mills CS, Berkeley CS) –To a variety of sites, including Internet Retailer (US and international) Search Engine Directory Service (US and international) Ran for 6+ months

Availability: Did the Transaction Succeed? AllRetailerSearchDirectory Raw (Overall) Ignoring local problems Ignoring local and network problems Ignoring local, network, and transient problems

Types of Errors Local (82%) Network: Medium (11%) Severe (4%) Server (2%) Corporate (1%)

Client Hardware Problems Dominate User Experience System-wide crashes Administration errors Power outages And many many more… –Many, if not most, caused or aggravated by human error

What About Speed?

Does Retry Help? Error TypeAllRetailerSearchDirectory Client Medium Network Severe Network Server Corporate n/a Green > 80%Red < 50%

What Guides Retry? Uniqueness of data Importance of data to user Loyalty of user to site Transience of information And more…

Conclusion Experiment modeled user experience Vast majority (81%) of errors were on the local end Almost all errors were in the “last mile” of service Retry doesn’t help for local errors –User may be aware of the problem and therefore less frustrated by it