KPIs and Machine Comparisons Joe Temple Copyright 5/2014 t Low Country North Shore Consulting
The Four basic KPIs Internal Throughput Rate (ITR) – Metric measured by most benchmarks – Given workload find the maximum steady state throughput – Divide result by steady state utilization. – Usually I~ Result because utilization is very high External Throughput Rate (ETR) – This is the average throughput rate over a period of time which has business significance – ETR ~ ITR/Average Utilization – This is the Enterprise view of performance (How much work do I do each shift?) N – The number of independent workload instances that a machine can host (VMs, Subsystems, Guests, Tenants, Applications, DBs, etc.) – Varies by workload usage pattern and size – It is determined by machine capacity Speed – The inverse of response time – Related to throughput rate, usage pattern, utilization, and service level. – This is the users’ view of performance (How fast does my work get done?) Copyright Low Country North Shore Consulting
The three Comparators Benchmarks – ITR at acceptable Speed Operational Throughput – ETR at acceptable Speed Operational Consolidation – N at acceptable Speed Copyright Low Country North Shore Consulting Enterprise class machines should be compared on Operational KPI Comparators Speed is included in these to represent the user point of view
Benchmarks Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting
Operational Throughput Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting
Capacity Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting
Comparing Cores using Benchmarks Intel 8890 v2 to zEC12 The indicated zEC12 advantage will not be compelling because of price Copyright Low Country North Shore Consulting
Comparing Cores on Operational Throughput Intel 8890 v2 to zEC12 Here Intel matches zEC12 speed because of low utilization but ETR suffers. Copyright Low Country North Shore Consulting
Comparing Cores on Operational Consolidation Intel 8890 v2 to zEC12 Here zEC12 consolidates farm more workloads per core. Copyright Low Country North Shore Consulting