KPIs and Machine Comparisons Joe Temple Copyright 5/2014 t Low Country North Shore Consulting.

Slides:



Advertisements
Similar presentations
GH Telstra Internet 1 Capacity Measurement for IP Networks Geoff Huston Technical Manager Telstra Internet.
Advertisements

Applying Benchmark Data To A Model for Relative Server Capacity CMG 2013 Joseph Temple, LC-NS Consulting John J Thomas, IBM.
Copyright © 2010, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Performance, Energy and Thermal Considerations of SMT and CMP architectures Yingmin Li, David Brooks, Zhigang Hu, Kevin Skadron Dept. of Computer Science,
Performance What differences do we see in performance? Almost all computers operate correctly (within reason) Most computers implement useful operations.
Analyzing CAD Spending
Evaluating Performance
Proactive Prediction Models for Web Application Resource Provisioning in the Cloud _______________________________ Samuel A. Ajila & Bankole A. Akindele.
Computer Performance CS350 Term Project-Spring 2001 Elizabeth Cramer Bryan Driskell Yassaman Shayesteh.
Charles Reiss *, Alexey Tumanov †, Gregory R. Ganger †, Randy H. Katz *, Michael A. Kozuch ‡ * UC Berkeley† CMU‡ Intel Labs.
Capacity Management for Large Virtual Server Estates A Rationalized Approach Copyright 2014, PerfCap Corporation.
COMMA: Coordinating the Migration of Multi-tier applications 1 Jie Zheng* T.S Eugene Ng* Kunwadee Sripanidkulchai† Zhaolei Liu* *Rice University, USA †NECTEC,
Lincoln University Canterbury New Zealand Evaluating the Parallel Performance of a Heterogeneous System Elizabeth Post Hendrik Goosen formerly of Department.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice In search of a virtual yardstick:
An Adaptable Benchmark for MPFS Performance Testing A Master Thesis Presentation Yubing Wang Advisor: Prof. Mark Claypool.
Lecture 14 Case Study Postgirot Bank and Provment AB.
Copyright © 1998 Wanda Kunkle Computer Organization 1 Chapter 2.1 Introduction.
Fall 2001CS 4471 Chapter 2: Performance CS 447 Jason Bakos.
Distributed Systems Meet Economics: Pricing In The Cloud Authors: Hongyi Wang, Qingfeng Jing, Rishan Chen, Bingsheng He, Zhengping He, Lidong Zhou Presenter:
SPC-1C / SPC-2C. Page: 2 Storage Performance Council (SPC) SPC-1C / SPC-2C Overview Storage Component Performance  There is a distinct need to provide.
Virtualization Performance H. Reza Taheri Senior Staff Eng. VMware.
Measuring zSeries System Performance Dr. Chu J. Jong School of Information Technology Illinois State University 06/11/2012 Sponsored in part by Deer &
Clarity on the performance of IT Metricus at a Glance Metricus Metricus has been acknowledged for breaking new ground on IT performance management and.
Copyright © 2012 Houman Homayoun 1 Dynamically Heterogeneous Cores Through 3D Resource Pooling Houman Homayoun Vasileios Kontorinis Amirali Shayan Ta-Wei.
Gary MarsdenSlide 1University of Cape Town Computer Architecture – Introduction Andrew Hutchinson & Gary Marsden (me) ( ) 2005.
Lecture 2b: Performance Metrics. Performance Metrics Measurable characteristics of a computer system: Count of an event Duration of a time interval Size.
Storage Management in Virtualized Cloud Environments Sankaran Sivathanu, Ling Liu, Mei Yiduo and Xing Pu Student Workshop on Frontiers of Cloud Computing,
Improving Disk Latency and Throughput with VMware Presented by Raxco Software, Inc. March 11, 2011.
Ian Alderman A Little History…
Powered by 3PILLAR LABS HAILSTORM 4.0 TM PERFORMANCE REPORT.
10/19/2015Erkay Savas1 Performance Computer Architecture – CS401 Erkay Savas Sabanci University.
Carrying capacity The level of use that a resource, site or facility can support before suffering significant deterioration.
1 University of Maryland Linger-Longer: Fine-Grain Cycle Stealing in Networks of Workstations Kyung Dong Ryu © Copyright 2000, Kyung Dong Ryu, All Rights.
© 2012 MELLANOX TECHNOLOGIES 1 Disruptive Technologies in HPC Interconnect HPC User Forum April 16, 2012.
Dynamic and Secure Application Consolidation with Nested Virtualization and Library OS in Cloud Kouta Sannomiya and Kenichi Kourai (Kyushu Institute of.
Price Performance Metrics CS3353. CPU Price Performance Ratio Given – Average of 6 clock cycles per instruction – Clock rating for the cpu – Number of.
IBM Software Group AIM Core and Enterprise Solutions IBM z/Transaction Processing Facility Enterprise Edition Any references to future plans are.
Computer Architecture
2012 Redwood Analytics® User Conference Analysis. Insight. Action. Benchmarking Making Sense of Market Data Chris Burgess Consultant, Redwood Analytics.
CS 360 Lecture 11.  In most computer systems:  The cost of people (development) is much greater than the cost of hardware  Yet, performance is important.
Heracles: Improving Resource Efficiency at Scale ISCA’15 Stanford University Google, Inc.
Alternative Performance Metrics for Server RFPs Joe Temple Low Country North Shore Consulting
Embedded System Lab. 정범종 A_DRM: Architecture-aware Distributed Resource Management of Virtualized Clusters H. Wang et al. VEE, 2015.
Metric System & Scientific Notation. Metric System Standardized measurement system used in Science Decimal based = conversions between units of different.
Chapter 3 System Performance and Models Introduction A system is the part of the real world under study. Composed of a set of entities interacting.
IBM Software Group AIM Enterprise Platform Software IBM z/Transaction Processing Facility Enterprise Edition © IBM Corporation 2005 TPF Users Group.
1© Copyright 2012 EMC Corporation. All rights reserved. EMC VNX5700, EMC FAST Cache, SQL Server AlwaysOn Availability Groups Strategic Solutions Engineering.
1 Dynamically Heterogeneous Cores Through 3D Resource Pooling Houman Homayoun Vasileios Kontorinis Amirali Shayan Ta-Wei Lin Dean M. Tullsen Speaker: Houman.
1  1998 Morgan Kaufmann Publishers How to measure, report, and summarize performance (suorituskyky, tehokkuus)? What factors determine the performance.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Private Cloud Stack Deep Dive Enterprise Cloud Summit.
Technical Reading Report Virtual Power: Coordinated Power Management in Virtualized Enterprise Environment Paper by: Ripal Nathuji & Karsten Schwan from.
Jacqui Dowd LibQUAL+ and Beyond: Using Results Effectively University of Glasgow 24 th May 2010 LibQUAL+ & LibQUAL Lite at the University of Glasgow.
X = Y. Direct variation X 1 X = Y 1 Y 2.
EGRE 426 Computer Organization and Design Chapter 4.
© 2004 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Understanding Virtualization Overhead.
Capacity Planning in a Virtual Environment Chris Chesley, Sr. Systems Engineer
REMINDER Check in on the COLLABORATE mobile app Oracle Performance Management with vCenter Operations Manager and Oracle Enterprise Manager (OEM) Adapter.
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice ProLiant G5 to G6 Processor Positioning.
JULY 2010– POWER TRAINING INTRODUCTION 1 Rough “Rules of Thumb” to Gauge a Host Look up Passmark score at: Assess.
CSE 340 Computer Architecture Summer 2016 Understanding Performance.
Network Operating System Lab
Get more done with Windows 10 Pro for Workstations
Process Design and Analysis
Are Low Power Server CPUs Worth the Cost?
How do you write 4.3 ÷ 104?.
WLCG dedicated accounting portal (proposal)
Chapter 2: Performance CS 447 Jason Bakos Fall 2001 CS 447.
Computer Organization and Design Chapter 4
Presentation transcript:

KPIs and Machine Comparisons Joe Temple Copyright 5/2014 t Low Country North Shore Consulting

The Four basic KPIs Internal Throughput Rate (ITR) – Metric measured by most benchmarks – Given workload find the maximum steady state throughput – Divide result by steady state utilization. – Usually I~ Result because utilization is very high External Throughput Rate (ETR) – This is the average throughput rate over a period of time which has business significance – ETR ~ ITR/Average Utilization – This is the Enterprise view of performance (How much work do I do each shift?) N – The number of independent workload instances that a machine can host (VMs, Subsystems, Guests, Tenants, Applications, DBs, etc.) – Varies by workload usage pattern and size – It is determined by machine capacity Speed – The inverse of response time – Related to throughput rate, usage pattern, utilization, and service level. – This is the users’ view of performance (How fast does my work get done?) Copyright Low Country North Shore Consulting

The three Comparators Benchmarks – ITR at acceptable Speed Operational Throughput – ETR at acceptable Speed Operational Consolidation – N at acceptable Speed Copyright Low Country North Shore Consulting Enterprise class machines should be compared on Operational KPI Comparators Speed is included in these to represent the user point of view

Benchmarks Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting

Operational Throughput Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting

Capacity Wider diamonds have greater comparator values Copyright Low Country North Shore Consulting

Comparing Cores using Benchmarks Intel 8890 v2 to zEC12 The indicated zEC12 advantage will not be compelling because of price Copyright Low Country North Shore Consulting

Comparing Cores on Operational Throughput Intel 8890 v2 to zEC12 Here Intel matches zEC12 speed because of low utilization but ETR suffers. Copyright Low Country North Shore Consulting

Comparing Cores on Operational Consolidation Intel 8890 v2 to zEC12 Here zEC12 consolidates farm more workloads per core. Copyright Low Country North Shore Consulting