Survey Results Aaron Brown Billy Kakes Calvin Ling Professor David Patterson

Selected Questions What is your supported environment? How many users?  Daily volume?  Amount of downtime they’ll accept?  Number of complaints? What tasks?  Diagnosis vs. repair?  Number of problems?

Interface Sample

First Trial: Response Sent to known admins and contacts 68 responses received  …mostly complete with useful answers  Only 21 “unsures” total Many responses from educational admins  Yet still lots from within industry

Results: Number of Users

Results: Volume

Results: Tasks Common TasksChallenging Tasks Configuration (56%) Upgrades/ Patches (12%) Tool Dev. (1%) Repairs (15%) Backup & Restore (3%) Monitor/ Test (10%) User Ed. (<1%) Other (3%) Filter Installation (37%) Platform Change/ Upgrade (26%) Tool Dev. (6%) Config. (13%) Other (6%) User Ed. (4%) Architecture Changes (7%) (151 total) (68 total)

Results: Acceptable Downtime

Results: Acceptable Downtime (2)

Results: Critical Affected User %

Results: Unique Problems

Results: User Requests

Results: Diagnosis vs. Repair

Results: Confidence Time

Results: Selected Comments High user expectations  “Users do not understand ; they expect it to be instantaneous, reliable, and single-hop.”  “Users have an intimate relationship with their …when is involved users get quite excitable.”  “Many of our users would be far less affected by losing their phone for a week than by losing access for a day (or even hours).”

Results: Selected Comments (2) Spam is a tremendous headache  “Spam…is our largest problem. Our machines are well spec'd and very stable, until they are hit with too much all at once!”  “I want to find the spammers and toss them off a 12 story building, then drive over them with a truck a few times.”  “Spammers should be charged for every piece of junk mail we have to accommodate in load planning, users assistance, and bounce tracing. I’d be able to buy Bill Gates at only $0.01 per junk message.” Viruses and worms, too

Results: Selected Comments (3) New technologies are useful  “Automation of all sorts has been improving performance and increasing reliability of our servers.”  “If you choose the right software, you don’t generally have any problems.”  “ is old hat, actually.” …more are needed  “Testing correctness of configurations is one of the hardest things to do.”  “No matter how much work you do with it, you are never sure that it is secure and stable.”  “sendmail.cf is a bitch”

Conclusions Most sites had relatively few problems  is one of the most critical services Confidence time varies widely  Pretty similar curve to “number of users”, but correlation mostly absent  Hard to test configurations Better tools and practices are useful, more are needed  Worries over configuration, silent errors