Presented by: Priti Lohani Cluster scheduling Presented by: Priti Lohani

What is cluster? It is a group of loosely coupled computers. They are arranged in a way to improvise in a speed and reliability provided by a single computer. It allows the organizations to boost their processing power. It provides expandability.

Classification of clusters: High -availability clusters Load-balancing clusters High-Performance clusters Grid clusters

Clustering algorithm requirements: scalability Broad scope Sensitivity to compute node and interconnect architecture Fair share capability Capability to integrate with standard resource managers Fault tolerance

Resource management system It manages the processing of load by preventing jobs from competing with each other for limited compute resources Resource managers do basic node state monitoring, receive job submission requests and executes the requests on the computer node. The scheduler communicates with the resource manager to obtain information about queues, loads on compute nodes, and resource availability to make scheduling decisions.

Cluster scheduling algorithms: There are two types of schedulers: Time sharing Space sharing Time sharing: Local scheduling Gang scheduling Communication driven co-scheduling Space sharing: Batch scheduling

Batch scheduling: FCFS (First come first serve) SJF (Shortest job first) LJF (Longest job first) Advance reservation Backfilling Preemptive backfilling

Classifications of clustering algorithms: Exclusive Clustering Overlapping Clustering Hierarchical Clustering Probabilistic Clustering

Maui cluster scheduler: It is an open source advanced job scheduler. It focuses on large turn around of large parallel jobs It is a best open source scheduler. It is capable of optimizing scheduling and node allocation decisions. It has a 2 phase scheduling algorithm.

Resource managers for Maui: PBS Version of PBS: Open PBS Professional PBS Torque

Open PBS VS Torque Torque is better than PBS in following areas: Fault tolerance Scheduling interface Scalability Usability

Scheduling policies for Maui Advance reservation Backfill Job prioritization

Backfill algorithm:

Thank you for listening!