1. George Tsouloupas University of Cyprus Task 2.3 GridBench ● 1 st Year Targets ● Background ● Prototype ● Problems and Issues ● What's Next

2. George Tsouloupas University of Cyprus 1 st Year Targets ● Investigate benchmarking the grid – Existing benchmarking efforts and tools ● Consolidate our thoughts into a Requirements Document. ● Specify the GridBench architecture in a Design Document. ● Prototype Development – deployment testing

3. George Tsouloupas University of Cyprus Background ● Benchmark Hierarchies

4. George Tsouloupas University of Cyprus Background (design) RB/LB Server CE Portal Server Client Applet Application Plugin GBAchive R-GMA DB RB LB GBArchive GBBMWrapper MPI/other executable GBControl CE GBBMWrapper MPI/other executable GBControl CE GBBMWrapper MPI/other executable GBControl control/mo nitor R-GMA flow LB information G-PM flow

5. George Tsouloupas University of Cyprus Current Status ● Month 12 prototype in good shape – Code compiles and installs – RPM is close done (thanks to Christos!) ● Updated Design Document – Updated use case ● A better understanding of our platform, it's potential.

6. George Tsouloupas University of Cyprus Choosing a prototype –Why HPL? ● It's targeted at measuring the performance of a single site. ● Simple input and output requirements. ● HPL is well known in the HPC community ● Configuring and building HPL on our testbed was supposed to be easy :) ● HPL was chosen to be our champion benchmark which would provide us with the experience of deploying benchmarks on the grid.

7. George Tsouloupas University of Cyprus Month 12 Prototype ● Implementation of a prototype benchmark that runs on a local cluster. ● Benchmark gb_site_hpl will run on a cluster that supports MPI. – Based on the High Performance Linpack benchmark. ● Alteration of HPL to accept XML input and produce XML output. ● Current cvs version builds and runs on testbed (requires minor changes including a revision of the input XML schema)

8. George Tsouloupas University of Cyprus Month 12 Prototype ● Input of the benchmark is an XML document that specifies a number of parameters such as: – Problem size – Algorithm – Number of processes and data partitioning – Other tuning parameters ● Output of the benchmark is an estimate of floating point operations per second (FLOPS).

9. George Tsouloupas University of Cyprus XML schema for Input...... <xs:element name="benchmark" type="benchmarkType

10. George Tsouloupas University of Cyprus Month 12 Prototype ● Dependencies: (for gb_site_hpl only!) – BLAS (provided by cernlib) – MPI ● Currently these are dependencies for building only. (Executable is statically linked)

11. George Tsouloupas University of Cyprus Implementation / Integration problems and issues. ● Measurement depends on the efficiency of the underlying BLAS library – BLAS may not be optimized for the specific CPU (i386 Vs P4 etc.) (May use statically linked optimized routines) ● moving target with respect to how things would run – user-space installation, CE installation, UI installation,... ● Lack of real support for MPI for job submission – Currently staging is partially manual ● Building on our platform was not as easy as expected.

12. George Tsouloupas University of Cyprus What's next? 1) Specifying & implementing more complex (workflow-type) benchmarks – GGF Research Group (NGB) – Tools for specifying (JDL-DAGMan –EDG, TRIANA –GRIDLAB) – Evolution of Design Doc Lau nch BT. S MG. S FT. S Rep ort BT. S MG. S FT. S BT. S MG. S FT. S B.1 B.2 B.3 M.1 M.2 M.3 F.1 F.2 F.3

13. George Tsouloupas University of Cyprus What's next? 2) Extraction, Collection and Archival of benchmark results – Integration with monitoring (through a G-PM API) – R-GMA (collection and archival) – MDS 3) Interpretation – Models – Tools – Metrics

14. George Tsouloupas University of Cyprus Related Activities ● Investigation of Benchmarks ● Functional Simulator for Processor Design – Looking at real apps for deployment on the testbed and their use as application benchmarks ● Exploitation of other IST projects results and tools

15. George Tsouloupas University of Cyprus ROADMAP 1)A detailed doc with specifications for each of the GridBench suite benchmarks outlined in the Design Document. (an Addendum?) 2)Employment of monitoring architectures for benchmark data collection (i.e. R-GMA and G-PM-based on API availability). 3)Specification of benchmark result encoding (XML) and archival