Computational Grids and Computational Economy: Nimrod/G Approach David Abramson Rajkumar Buyya Jonathan Giddy

Parametric Execution of Applications Coarse-grained SPMD model Coarse-grained SPMD model Execute one application repeatedly for many combinations of input parameters Execute one application repeatedly for many combinations of input parameters Legacy applications: add iteration and distribution without modifying code Legacy applications: add iteration and distribution without modifying code New applications: remove iteration and distribution from design New applications: remove iteration and distribution from design Parametrised modeling experiments: Parametrised modeling experiments: – Require very high levels of performance – Generate – Large amounts of work & concurrency – Uncoupled computations – Tolerate - moderately high latencies

Job 1Job 2Job 3 Job 4Job 5Job 6 Job 7Job 8Job 9 Job 10Job 11Job 12 Job 13Job 14Job 15 Job 16Job 17Job 18 Description of Parameters

Working with Small Clusters Nimrod ( ) Nimrod ( ) – DSTC funded project – Designed for department level clusters – Proof of concept Clustor (Activetools) ( ) Clustor (Activetools) ( ) – Commercial version of Nimrod – Re-engineered Features Features – Workstation orientation – Access to idle workstations – Random allocation policy – Password security Nimrod ( ) Nimrod ( ) – DSTC funded project – Designed for department level clusters – Proof of concept Clustor (Activetools) ( ) Clustor (Activetools) ( ) – Commercial version of Nimrod – Re-engineered Features Features – Workstation orientation – Access to idle workstations – Random allocation policy – Password security

Clustor limitations Manual resource location Manual resource location – static file of machine names No resource scheduling No resource scheduling – first come first served No cost model No cost model – all machines cost alike Single access mechanism Single access mechanism

Towards Grid Computing…. Source: & updated

Nimrod/G - Nimrod over Globus/Grid Wide-Area Network Support Wide-Area Network Support – redesigned architecture – use of high-performance networks Scalable Scheduling Scalable Scheduling – guaranteed deadline – use of existing schedulers Computational Economy Computational Economy – I am willing to pay $$, can you complete the job by given deadline – trading, bidding, resource reservation... Wide-Area Network Support Wide-Area Network Support – redesigned architecture – use of high-performance networks Scalable Scheduling Scalable Scheduling – guaranteed deadline – use of existing schedulers Computational Economy Computational Economy – I am willing to pay $$, can you complete the job by given deadline – trading, bidding, resource reservation...

Layered Architecture (Grid Components) Applications Core Services Metacomputing Directory Service GRAM Globus Security Interface Heartbeat Monitor Nexus Gloperf Local Services LSF CondorMPI NQEEasy TCP SolarisIrixAIX UDP High-level Services and Tools DUROCglobusrunMPI Nimrod/G MPI-IOCC++ GlobusViewTestbed Status GASS Source:

Nimrod/G Architecture Grid Middleware Services Dispatcher Nimrod/G Client Grid Directory Services Schedule Advisor Resource Discovery Parametric Engine GUSTO Test Bed Persistent Info.

Nimrod/G Interactions MDS server Resource location Queuing System GRAM server Resource allocation (local) Additional services used implicitly: GSI (authentication & authorization) Nexus (communication) User process File access GASS server Gatekeeper node Job Wrapper Computational node Dispatcher Root node Scheduler Prmtc.. Engine

Scheduling Algorithm Find a set of machines (MDS search) Distribute jobs from root to machines Establish job consumption rate for each machine For each machine Can we meet deadline? If not, then return some jobs to root If yes, distribute more jobs to resource If cannot meet deadline with current resource Find additional resources Find a set of machines (MDS search) Distribute jobs from root to machines Establish job consumption rate for each machine For each machine Can we meet deadline? If not, then return some jobs to root If yes, distribute more jobs to resource If cannot meet deadline with current resource Find additional resources

A Nimrod/G Client CostDeadline AvailableMachines

Sample Applications of Nimrod Bioinformatics: Protein Modeling Bioinformatics: Protein Modeling Sensitivity experiments on smog formation Sensitivity experiments on smog formation Parametric study of Laser detuning Parametric study of Laser detuning Combinatorial Optimization: Simulated Annealing Combinatorial Optimization: Simulated Annealing Ecological Modeling: Control Strategies for Cattle Tick Ecological Modeling: Control Strategies for Cattle Tick Electronic CAD: Field Programmable Gate Arrays Electronic CAD: Field Programmable Gate Arrays Computer Graphics: Ray Tracing Computer Graphics: Ray Tracing High Energy Physics: Searching for Rare Events High Energy Physics: Searching for Rare Events Physics: Laser-Atom Collisions Physics: Laser-Atom Collisions VLSI Design: SPICE Simulations VLSI Design: SPICE Simulations Radiation Protection and Nuclear Safety

Electronic CAD

Some early results -

Related Works AppLeS (UC. San Diego) AppLeS (UC. San Diego) – application level scheduling & case-by-case NetSolve (UTK/ORNL) NetSolve (UTK/ORNL) – API for creating farms DISCWorld (U. Adelaide) DISCWorld (U. Adelaide) – remote information access Millennium (UC. Berkeley) Millennium (UC. Berkeley) – remote execution environment on clusters and supports computational economy

Conclusions Nimrod/G architecture offers a scalable model for resource management and scheduling on computational grids Nimrod/G architecture offers a scalable model for resource management and scheduling on computational grids Supports Computational Economy Supports Computational Economy The current model supporting Parametric Computing can be extended to support parallel jobs or any other computational model. The current model supporting Parametric Computing can be extended to support parallel jobs or any other computational model. Plan to use the concept of Advance Resource Reservation in order to offer the feature wherein the user can say I am willing to pay $…, can you complete my job by this time… Plan to use the concept of Advance Resource Reservation in order to offer the feature wherein the user can say I am willing to pay $…, can you complete my job by this time… Further Information: ml Further Information: ml