“Come out of the desert of ignorance to the OASUS of knowledge” Benchmarking and SAS Tom Kari, Tom Kari Consulting Ltd.
What are benchmarks Historical: “...originates from the chiseled horizontal marks that surveyors made in stone structures, into which an angle-iron could be placed to form a "bench" for a leveling rod, thus ensuring that a leveling rod could be accurately repositioned in the same place in the future.” Thursday, November 26, 20152
What are benchmarks IT: The act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it. Thursday, November 26, 20153
Some well-known IT benchmarks Thursday, November 26, 20154
Benchmark software using SAS A SAS program that contains code to produce heavy CPU usage, heavy disk usage, and no activity (sleep) Duration of each component can be specified The three segments are repeated a specified number of times Thursday, November 26, 20155
Benchmark software using SAS Thursday, November 26, 20156
Benchmark software using SAS Thursday, November 26, Equal duration CPU, Disk, Sleep, two cycles
Run multiple programs to load a multiprocessor CPU Thursday, November 26, 20158
Run multiple programs to load a multiprocessor CPU Thursday, November 26, 20159
Run multiple programs to load a multiprocessor CPU Thursday, November 26, The “liar, liar, pants on fire” performance zone!
Use Case 1: Is something wrong with my system? Thursday, November 26,
Use Case 1: Is something wrong with my system? Thursday, November 26, For this presentation, a USB disk was used to simulate a faulty disk subsystem Results from a regularly run benchmark Suddenly the execution time jumps Running the CPU portion is fine But the disk result is terrible
Use Case 2: What would be the impact of new technology? Thursday, November 26, What if I used a solid-state disk instead of spinning disk? Spinning disk Solid-state disk
Use Case 3: How heavily loaded is my system? Thursday, November 26,
Use Case 4: How does my system compare to others? Thursday, November 26, The grid was also running 41 other programs at the time
Use Case 5: Provide an artificial load on a system for demonstration purposes Thursday, November 26, You can’t demonstrate all these beautiful monitoring graphics unless you have a diverse, changing load on the system!