Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter, Computer Science Department University of Manitoba Winnipeg Manitoba

Outline Grid Computing Issues u Network computing environment u Scalability, Extensibility, and Adaptability u Quality of Service Grid Models u Resource Management Techniques u Application Execution Models Grid Architecture Example Applications u Compiling, Numerical Processing, Grid Aware Application Related Work

Grid Computing Issues

Network Computing Environment Heterogeneous Nodes u Autonomous administration domains with different resource management policies u Servers, network devices, workstations, PDA, etc. Connected by Communication Links u Support differentiated service levels Use native operating system services u Does not replace existing scheduling and resource control mechanisms u Native operating system is a Grid device driver

Scalability Target Size u Hundreds to Millions of nodes u Different platforms for different scale Grids Global resource management protocols u Fixed format messages u Ability to locally tune protocol performance parameters to match local infrastructure and administrative policy Local policies for resource management u Scheduling, Quality of Service, Tolerance to faults

Extensibility and Adaptability Extensible resource protocol content u Fixed message framework with structured extensibility (XML like) Extensible resource management protocol processing u Message content extensions are processed by extension modules u Modules are dynamically loaded and register content identifiers Variability u Multiple different implementations of the resource protocols Adaptability u Nodes and resources enter and leave the grid continuously u Fault tolerance by resource replication u Operate in an actively hostile environment u Try to survive Byzantine failures

Quality of Service Not restricted to end-to-end network u Processor, memory, I/O also need to support QoS specifications Co-allocation and Co-reservation u Allocation and scheduling need to take into account QoS given to other jobs already in the Grid Providing Service Level Agreements u Aggregate performance levels or on a per job basis? u Site autonomy and resource control restricts the ability to provide guarantees Applications should be able to negotiate QoS with the Grid

Grid Models

Resource Management Techniques Super Scheduler u Hierarchy of cooperating schedulers u Issues: Co-allocation Market Based u Auctioning for resources u Issues: Price management and co-allocation Resource Discovery u Resource attribute and status in a distributed database u Centralized, Agent based, or Hybrid u Issues: devise highly distributed, scalable, fault tolerant schemes

Application Execution Models Legacy application u Native OS resource and scheduling, implicit QoS u Use external resource description language u Modify native OS and service libraries and infer resource requirements and QoS u Recompile with Grid aware compiler that inserts specialized Grid code Grid Aware application u Use specialized Grid API u First “applications” will be compilers, service libraries (MPI, PVM), Grid workbenches and monitoring tools

Grid Aware Applications

Non-Grid Aware Applications

Grid Architecture

Design Approach Layered u Grid Kernel u Grid Core Services u Grid toolkits, workbenches, and user interfaces Fully distributed peer-to-peer model u No centralized information servers u Implementations free to use specialized servers Minimal configuration u Use Service Location Protocol like service

Grid Kernel Architectural Principles Functions that use the services are aware of the distributed environment No guarantees made about reliability of nodes or links Operate on all types of heterogeneous nodes using minimal resources Services will be implemented using native OS with minimal changes to trusted computing base Provide uniform extensible API and services across all nodes Provide resource management mechanisms but do not implement resource management policies

Grid Architecture

Grid Layers and Core Services

Grid Example Applications

Applications Compiling u Ensure similar compiler and libraries are used on all nodes u Compute how long to transfer and compile u Perform deadline scheduling Legacy Numerical Processing u Dynamically linking of Grid code, variable QoS for job steps u Describe network QoS requirements or infer dynamically u Much further research required Collaborative Research Workbench u Negotiate video bandwidth required u Query if a simulation can be run and completed quickly, or schedule it later u Different GUI depending on resources nearby to a research

Related Work

Related Work Application Enabling Systems u Provide tools to allow applications to access globally distributed resources in an integrated fashion u ATLAS, Globe, Globus/GUSTO, Legion, ParaWeb, Symera User Access Systems u Provide end users of the Grid transparent access to geographically distributed systems in a location independent manner u CCS, MOL, NetSolve, PUNCH

Questions ?