Performance Metrics Panel Monday, June
Panelists John Rauser - Moderator Peter Sevcik- NetForecast Eric Goldsmith - AOL Eric Schurman - Microsoft Vik Chaudhary - Keynote Systems
How Apdex Works Tolerating Apdex T = Total samples Satisfied 2 + Frustrated Satisfied Tolerating Report Group: Application User Group Time Period Existing Task Response Time Measurement Samples T F 1.Define T for the application T = Target time (satisfied-tolerating threshold) F = 4T (tolerating-frustrated threshold) 2.Define a Report Group 3.Extract data set from existing measurements 4.Count number of samples in three zones 5.Calculate the Apdex formula 6.Display Apdex value showing T 7.Optionally display value using quality colors [6] Value T Good Fair Poor Unacceptable 0.00 T 0.50 T 1.00 T 0.85 T 0.94 T 0.70 T Excellent
Apdex Methodology Measure Gather baseline data Test Apdex Parameters A TA T 1) Work with users to set T 2) Work with business managers to define the service objective for A Apdex reports & trends Improve performance where needed Continual performance & process improvement Gather Agree Improve
The Apdex Alliance Manufacturing IT Product Manufacturing Financial Services Government Transportation Education & Research Healthcare Carriers & Utilities Business & IT Services Other Contributing Members See Apdex.org to learn more More that 800 Supporting Members
Apdex Report Example
Memory Constraints During Peak Hours Apdex [0.1]
Where do you draw the line? Timeout choice impacts results Large timeout value - longer response times reflected as higher aggregate response time Small timeout value - longer response times reflected as lower availability 30s Timeout20s Timeout10s Timeout Performance11.47s10.22s8.40s Availability100%91.91%62.50%
iGoogle Index Widget Data Feed every 15 mins Embedded Object in iGoogle Volume of data requires a data warehouse My Company
Google Maps Mashup Data Feed every 15 mins or 24 hours Integrated with Google Maps API Scripts of top Retail web sites For: Customer with geographically dispersed user-base Google API legal agreement requires data being public. If data is private then $10,000 license fee (to Google) applies
Yahoo! Alarms Widget Real-Time DataPulse 2 min frequency Stand-Alone Desktop Application Requirement: load Yahoo! Widget Framework Used by NOCs