Www.OASUS.ca “Come out of the desert of ignorance to the OASUS of knowledge” Benchmarking and SAS Tom Kari, Tom Kari Consulting Ltd.

Slides:



Advertisements
Similar presentations
Assimilation of radar data - research plan
Advertisements

Tales from the Lab: Experiences and Methodology Demand Technology User Group December 5, 2005 Ellen Friedman SRM Associates, Ltd.
CSCI 4717/5717 Computer Architecture
Copyright © 2005 Department of Computer Science CPSC 641 Winter PERFORMANCE EVALUATION Often in Computer Science you need to: – demonstrate that.
“Come out of the desert of ignorance to the OASUS of knowledge” Proc du Jour: PROC TRANSPOSE Tom Kari Tom Kari Consulting OASUS, November.
Software Design & Development Year 12. Structure of the Course Development and Impact of Software Solutions Development and Impact of Software Solutions.
Where Do the 7 layers “fit”? Or, where is the dividing line between hdw & s/w? ? ?
1 Foundations of Software Design Fall 2002 Marti Hearst Lecture 4: Operating Systems.
Source Code Optimization and Profiling of Energy Consumption in Embedded System Simunic, T.; Benini, L.; De Micheli, G.; Hans, M.; Proceedings on The 13th.
Revisions If you received the grade: “R” If you received the grade: “R” You must do a revision to receive a grade for lab 2. You must do a revision to.
1 PERFORMANCE EVALUATION H Often in Computer Science you need to: – demonstrate that a new concept, technique, or algorithm is feasible –demonstrate that.
Operating Systems CS208. What is Operating System? It is a program. It is the first piece of software to run after the system boots. It coordinates the.
PRASHANTHI NARAYAN NETTEM.
Cambodia-India Entrepreneurship Development Centre - : :.... :-:-
Installing software on personal computer
Developed by Klaus Knopper Linux Consultant. What is Knoppix?  Unix-like operating system  Run directly from CD or DVD  Bootable from USB flash drive.
Virtualization Concept. Virtualization  Real: it exists, you can see it.  Transparent: it exists, you cannot see it  Virtual: it does not exist, you.
Computer Science 1000 Terminology. The Language of Computer Science field is notorious for cryptic terms WYSIWYG GPU flops even recognizable terms may.
CS 1308 Computer Literacy and the Internet Computer Systems Organization.
1 Computing Software. Programming Style Programs that are not documented internally, while they may do what is requested, can be difficult to understand.
Y. Kotani · F. Ino · K. Hagihara Springer Science + Business Media B.V Reporter: 李長霖.
Software. Software or Programs A set of detailed directions telling the computer exactly what to do, one step at a time. Can be one line of code or several.
Operation Frequency No. of Clock cycles ALU ops % 1 Loads 25% 2
Software Project Management With Usage of Metrics Candaş BOZKURT - Tekin MENTEŞ Delta Aerospace May 21, 2004.
LoadComplete Testing Tool. LoadComplete Testing Tool.
Software Testing. What is Testing? The process consisting of all life cycle activities, both static and dynamic, concerned with planning, preparation.
Dr. Tucker Balch Associate Professor School of Interactive Computing Computational Investing, Part I 211: More complete back testing Find out how modern.
The IBM VM CS450/550 Section 2 Stephen Kam. IBM VM - Origins Originally an experimental OS called “CP-67” Designed to run on the IBM System/360 Model.
“Come out of the desert of ignorance to the OASUS of knowledge” Grid Computing with SAS ® Foundation Statistics Canada SAS Technology Centre.
Computer Architecture Lecture 2 System Buses. Program Concept Hardwired systems are inflexible General purpose hardware can do different tasks, given.
Page 1 Process Migration & Allocation Paul Krzyzanowski Distributed Systems Except as otherwise noted, the content of this.
Lecture 8: 9/19/2002CS149D Fall CS149D Elements of Computer Science Ayman Abdel-Hamid Department of Computer Science Old Dominion University Lecture.
ECEG-3202 Computer Architecture and Organization Chapter 3 Top Level View of Computer Function and Interconnection.
Nonbehavioral Specifications Non-behavioral Characteristics Portability Portability Reliability Reliability Efficiency Efficiency Human Engineering.
Computer Architecture 2 nd year (computer and Information Sc.)
BenchMarking. What is a benchmark? A benchmark is a point whose position is known to a high degree of accuracy and is normally marked in some way. The.
CS 1308 Computer Literacy and the Internet. Objectives In this chapter, you will learn about:  The components of a computer system  Putting all the.
Chapter 6: Computer Components Dr Mohamed Menacer Taibah University
Summary of Astrapé Reserve Margin Impact Analysis for the PUCT Pete Warnken WMS February 4, 2015.
Ch 1 - Introduction to Computers and Programming Hardware Terminology Main Memory Auxiliary Memory Drives Writing Algorithms Using Pseudocode Programming.
Introduction to Performance Testing Performance testing is the process of determining the speed or effectiveness of a computer, network, software program.
Introduction To Computers
1 Cloud Services Requirements and Challenges of Large International User Groups Laurence Field IT/SDC 2/12/2014.
Page 1 Monitoring, Optimization, and Troubleshooting Lecture 10 Hassan Shuja 11/30/2004.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 4: Processes Process Concept Process Scheduling Types of shedulars Process.
Interrupts and Exception Handling. Execution We are quite aware of the Fetch, Execute process of the control unit of the CPU –Fetch and instruction as.
Software System Performance CS 560. Performance of computer systems In most computer systems:  The cost of people (development) is much greater than.
Difference between External and Internal Server Monitoring.
COMPUTER COMPONENTS Ms Jennifer Computer Components.
2016 Education Services Australia Ltd, unless otherwise indicated. Creative Commons BY 4.0 licence, unless otherwise indicated. Technologies curriculum.
Performance Management IACT 418/918 Autumn 2005 Gene Awyzio SITACS University of Wollongong.
GCSE OCR Computing A451 The CPU Computing hardware 1.
CE 454 Computer Architecture
Online Backup Service 30 Day FREE Trial
BA Continuum India Pvt Ltd
SOFTWARE and OPERATING SYSTEM.
Performance Testing Methodology for Cloud Based Applications
A Framework for Automatic Resource and Accuracy Management in A Cloud Environment Smita Vijayakumar.
CATIA V5 Surface Design Sample Exam
Resource Management in the Greenplum Parallel Database
How much does OS operation impact your code’s performance?
Operating Systems.
BIC 10503: COMPUTER ARCHITECTURE
Chapter 6: Understanding and Assessing Hardware
Determining the Accuracy of Event Counts - Methodology
Arani Bhattacharya, Han Chen, Peter Milder, Samir R. Das
(Software) reuse, is the use of (Software) knowledge, to build new (something) software.
Software Testing Software Testing is a process of evaluating a system by manual or automatic means and verify that it satisfies specified requirements.
Presentation transcript:

“Come out of the desert of ignorance to the OASUS of knowledge” Benchmarking and SAS Tom Kari, Tom Kari Consulting Ltd.

What are benchmarks Historical: “...originates from the chiseled horizontal marks that surveyors made in stone structures, into which an angle-iron could be placed to form a "bench" for a leveling rod, thus ensuring that a leveling rod could be accurately repositioned in the same place in the future.” Thursday, November 26, 20152

What are benchmarks IT: The act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it. Thursday, November 26, 20153

Some well-known IT benchmarks Thursday, November 26, 20154

Benchmark software using SAS A SAS program that contains code to produce heavy CPU usage, heavy disk usage, and no activity (sleep) Duration of each component can be specified The three segments are repeated a specified number of times Thursday, November 26, 20155

Benchmark software using SAS Thursday, November 26, 20156

Benchmark software using SAS Thursday, November 26, Equal duration CPU, Disk, Sleep, two cycles

Run multiple programs to load a multiprocessor CPU Thursday, November 26, 20158

Run multiple programs to load a multiprocessor CPU Thursday, November 26, 20159

Run multiple programs to load a multiprocessor CPU Thursday, November 26, The “liar, liar, pants on fire” performance zone!

Use Case 1: Is something wrong with my system? Thursday, November 26,

Use Case 1: Is something wrong with my system? Thursday, November 26, For this presentation, a USB disk was used to simulate a faulty disk subsystem Results from a regularly run benchmark Suddenly the execution time jumps Running the CPU portion is fine But the disk result is terrible

Use Case 2: What would be the impact of new technology? Thursday, November 26, What if I used a solid-state disk instead of spinning disk? Spinning disk Solid-state disk

Use Case 3: How heavily loaded is my system? Thursday, November 26,

Use Case 4: How does my system compare to others? Thursday, November 26, The grid was also running 41 other programs at the time

Use Case 5: Provide an artificial load on a system for demonstration purposes Thursday, November 26, You can’t demonstrate all these beautiful monitoring graphics unless you have a diverse, changing load on the system!