Grid Load Balancing Scheduling Algorithm Based on Statistics Thinking The 9th International Conference for Young Computer Scientists Bin Lu, Hongbin Zhang.

Slides:



Advertisements
Similar presentations
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
Advertisements

Ch 11 Distributed Scheduling –Resource management component of a system which moves jobs around the processors to balance load and maximize overall performance.
Hadi Goudarzi and Massoud Pedram
SLA-Oriented Resource Provisioning for Cloud Computing
An Advance Algorithm for Task Management On Activity Based Costing in Cloud Computing By : Ashutosh Ingole Sumit Chavan Rajesh Singh Sinhgad Institute.
Pei Fan*, Ji Wang, Zibin Zheng, Michael R. Lyu Toward Optimal Deployment of Communication-Intensive Cloud Applications 1.
Locality Aware Dynamic Load Management for Massively Multiplayer Games Jin Chen, Baohua Wu, Margaret Delap, Bjorn Knutson, Honghui Lu and Cristina Amza.
Hermes: An Integrated CPU/GPU Microarchitecture for IPRouting Author: Yuhao Zhu, Yangdong Deng, Yubei Chen Publisher: DAC'11, June 5-10, 2011, San Diego,
Design and Performance Evaluation of Queue-and-Rate-Adjustment Dynamic Load Balancing Policies for Distributed Networks Zeng Zeng, Bharadwaj, IEEE TRASACTION.
1 Peer-To-Peer-Based Resource Discovery In Global Grids: A Tutorial Rajiv Ranjan, Aaron Harwood And Rajkumar Buyya, The University Of Melbbourne IEEE Communications.
On the Construction of Energy- Efficient Broadcast Tree with Hitch-hiking in Wireless Networks Source: 2004 International Performance Computing and Communications.
Locality-Aware Request Distribution in Cluster-based Network Servers 1. Introduction and Motivation --- Why have this idea? 2. Strategies --- How to implement?
Fair Scheduling in Web Servers CS 213 Lecture 17 L.N. Bhuyan.
1 Introduction to Load Balancing: l Definition of Distributed systems. Collection of independent loosely coupled computing resources. l Load Balancing.
Present by Chen, Ting-Wei Adaptive Task Checkpointing and Replication: Toward Efficient Fault-Tolerant Grids Maria Chtepen, Filip H.A. Claeys, Bart Dhoedt,
CS4514 Networks1 Distributed Dynamic Channel Selection in Chaotic Wireless Networks By: Matthias Ihmig and Peter Steenkiste Presented by: James Cialdea.
GHS: A Performance Prediction and Task Scheduling System for Grid Computing Xian-He Sun Department of Computer Science Illinois Institute of Technology.
An Adaptive Multi-Objective Scheduling Selection Framework For Continuous Query Processing Timothy M. Sutherland Bradford Pielech Yali Zhu Luping Ding.
On Fairness, Optimizing Replica Selection in Data Grids Husni Hamad E. AL-Mistarihi and Chan Huah Yong IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,
1 Scalable Pattern-Matching via Dynamic Differentiated Distributed Detection (D 4 ) Author: Kai Zheng, Hongbin Lu Publisher: GLOBECOM 2008 Presenter: Han-Chen.
Cmpt-225 Simulation. Application: Simulation Simulation  A technique for modeling the behavior of both natural and human-made systems  Goal Generate.
Distributed Process Management1 Learning Objectives Distributed Scheduling Algorithms Coordinator Elections Orphan Processes.
1 Incentive-Based Scheduling for Market-Like Computational Grids Lijuan Xiao, Yanmin Zhu, Member, IEEE, Lionel M. Ni, Fellow, IEEE, and Zhiwei Xu, Senior.
1 A Cooperative Game Framework for QoS Guided Job Allocation Schemes in Grids Riky Subrata, Member, IEEE, Albert Y. Zomaya, Fellow, IEEE, and Bjorn Landfeldt,
Self-Organizing Agents for Grid Load Balancing Junwei Cao Fifth IEEE/ACM International Workshop on Grid Computing (GRID'04)
Department of Computer Science Engineering SRM University
Simulation of Memory Management Using Paging Mechanism in Operating Systems Tarek M. Sobh and Yanchun Liu Presented by: Bei Wang University of Bridgeport.
OPERATING SYSTEMS CPU SCHEDULING.  Introduction to CPU scheduling Introduction to CPU scheduling  Dispatcher Dispatcher  Terms used in CPU scheduling.
Kaichen Zhao & Junhan Zhu ECE 750 Course Project PID Control for GPS.
A Novel Adaptive Distributed Load Balancing Strategy for Cluster CHENG Bin and JIN Hai Cluster.
Agent-based Device Management in RFID Middleware Author : Zehao Liu, Fagui Liu, Kai Lin Reporter :郭瓊雯.
Load Balancing in Distributed Computing Systems Using Fuzzy Expert Systems Author Dept. Comput. Eng., Alexandria Inst. of Technol. Content Type Conferences.
Service Architecture of Grid Faults Diagnosis Expert System Based on Web Service Wang Mingzan, Zhang ziye Northeastern University, Shenyang, China.
Lecture 2 Process Concepts, Performance Measures and Evaluation Techniques.
GRID’2012 Dubna July 19, 2012 Dependable Job-flow Dispatching and Scheduling in Virtual Organizations of Distributed Computing Environments Victor Toporkov.
A Survey of Distributed Task Schedulers Kei Takahashi (M1)
Dynamic Resource Monitoring and Allocation in a virtualized environment.
Euro-Par, A Resource Allocation Approach for Supporting Time-Critical Applications in Grid Environments Qian Zhu and Gagan Agrawal Department of.
Dynamic Load Balancing and Job Replication in a Global-Scale Grid Environment: A Comparison IEEE Transactions on Parallel and Distributed Systems, Vol.
Autonomic scheduling of tasks from data parallel patterns to CPU/GPU core mixes Published in: High Performance Computing and Simulation (HPCS), 2013 International.
TECHNION – Israel Institute of Technology Department of Electrical Engineering The Computer Network Laboratory Crankback Prediction in ATM According to.
Zhuo Peng, Chaokun Wang, Lu Han, Jingchao Hao and Yiyuan Ba Proceedings of the Third International Conference on Emerging Databases, Incheon, Korea (August.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems with Multi-programming Chapter 4.
GSAF: A Grid-based Services Transfer Framework Chunyan Miao, Wang Wei, Zhiqi Shen, Tan Tin Wee.
A Hyper-heuristic for scheduling independent jobs in Computational Grids Author: Juan Antonio Gonzalez Sanchez Coauthors: Maria Serna and Fatos Xhafa.
Modelling job allocation where service duration is unknown Nigel Thomas University of Newcastle upon Tyne.
GridNets 2006 – October 1 st Grid Resource Management by means of Ant Colony Optimization Gustavo Sousa Pavani and Helio Waldman Optical Networking Laboratory.
Quality of Service Schemes for IEEE Wireless LANs-An Evaluation 主講人 : 黃政偉.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
A Bandwidth Scheduling Algorithm Based on Minimum Interference Traffic in Mesh Mode Xu-Yajing, Li-ZhiTao, Zhong-XiuFang and Xu-HuiMin International Conference.
1 Καστοριά Μάρτιος 13, 2009 Efficient Service Task Assignment in Grid Computing Environments Dr Angelos Michalas Technological Educational Institute of.
1 Hardware-Software Co-Synthesis of Low Power Real-Time Distributed Embedded Systems with Dynamically Reconfigurable FPGAs Li Shang and Niraj K.Jha Proceedings.
Zeta: Scheduling Interactive Services with Partial Execution Yuxiong He, Sameh Elnikety, James Larus, Chenyu Yan Microsoft Research and Microsoft Bing.
1 / 21 Providing Differentiated Services from an Internet Server Xiangping Chen and Prasant Mohapatra Dept. of Computer Science and Engineering Michigan.
Distributed Scheduling Motivations: reduce response time of program execution through load balancing Goal: enable transparent execution of programs on.
Architecture for Resource Allocation Services Supporting Interactive Remote Desktop Sessions in Utility Grids Vanish Talwar, HP Labs Bikash Agarwalla,
Name : Mamatha J M Seminar guide: Mr. Kemparaju. GRID COMPUTING.
Spark on Entropy : A Reliable & Efficient Scheduler for Low-latency Parallel Jobs in Heterogeneous Cloud Huankai Chen PhD Student at University of Kent.
Igor EPIMAKHOV Abdelkader HAMEURLAIN Franck MORVAN
Introduction to Load Balancing:
Load Balancing and Data centers
Edinburgh Napier University
Load Balancing and It’s Related Works in Cloud Computing
Mean Value Analysis of a Database Grid Application
Pei Fan*, Ji Wang, Zibin Zheng, Michael R. Lyu
Load Balancing/Sharing/Scheduling Part II
by Xiang Mao and Qin Chen
Maximizing MAC Throughputs by Dynamic RTS-CTS Threshold
CPU SCHEDULING SIMULATION
Approximate Mean Value Analysis of a Database Grid Application
Presentation transcript:

Grid Load Balancing Scheduling Algorithm Based on Statistics Thinking The 9th International Conference for Young Computer Scientists Bin Lu, Hongbin Zhang Present by Chen, Ting-Wei

2 Table of content Introduction Hierarchical Grid system model Grid resource allocation and task scheduling Simulative experiments Conclusions

3 Introduction Propose a new task scheduling and resource allocation algorithm –Load tracking module –Job distributing module –Load monitoring module Simulate the algorithm

4 Introduction (cont.) Based on the hierarchical Grid structure model –Distribution of Grid resources –The strategy of task scheduling –Following statistical thinking

5 Hierarchical Grid system model

6 Grid resource allocation and task scheduling Load (L x ) Length of CPU Ready queue CPU Utilization Light Load L x L x < L low ShortLow Heavy Load L x L x >L high LongHigh Moderate Load L x L low < L x < L high Normal Definition of the Load

7 Grid resource allocation and task scheduling (cont.) Algorithm analysis and implementation –Three components Load tracing module Job distributing module Load monitor module

8 Grid resource allocation and task scheduling (cont.) –Three tables are installed on the database server in GRM and DRM The first: Every sub-DRM load information The second: The number of tasks being operated The third: The throughput and the average delayed response

9 Grid resource allocation and task scheduling (cont.) Load tracing module –Get the load information of DRM –Monitor periodically the implementation state of operations –Report it to the upper level for the overall management and scheduling

10 Grid resource allocation and task scheduling (cont.) Job distributing module –According to load balancing –GRM chooses a suitable DRM to carry out job distributing –Consider CPU utilization Memory usage –The weight of load indicators can be determined statically or dynamically

11 Grid resource allocation and task scheduling (cont.) –Load computing formula of the CN –The average of the sub-DRM’s load or CN’s load –Variance of load

12 Grid resource allocation and task scheduling (cont.) –Job algorithm Initialize; For (;;) {do If (There was information form the DRMs or CNs) { Updating the load information of DRM or CNs according to the formula (1)-(3); Calculating the rate of throughput; Calculating the average response delay; If (There was information of completed assignment) { Deducting one assignment of corresponding DRM; }

13 Grid resource allocation and task scheduling (cont.) If (Portal gives the assignment to GRM) { If (The node having the load is not unique) { ; Making the node whose variance is as the scheduling nodes, if still not unique, selecting the first node; } Else { Making the node whose load value is be the scheduling node; } Giving it the assignment for scheduling, and updating the number of assignment of DRM; }

14 Grid resource allocation and task scheduling (cont.) Load monitor module –Surveillance The current load of all the DRMs

15 Grid resource allocation and task scheduling (cont.) For (;;) { If (sum < ) { The opening of stand-by resources manager; } Reading the load vector of domain resources manager; Reading the upper and lower threshold provided in profile; If (Every load exceeds the threshold ) { Opening the stand-by resources manager; } If (Every load is below the threshold ) { Removing stand-by resources manager; }

16 Grid resource allocation and task scheduling (cont.) Else { Get the last updated time of the node If (The current time – last updated time) > (timeout) Means that the main resource manager failed and it takes proper measures; }

17 Simulative experiments Use Gridsim to simulate Compare performance of the load balancing scheduling method –Min-Min algorithm –Ant algorithm –This algorithm (This paper proposed)

18 Simulative experiments (cont.) Configuration of experiment environment

19 Simulative experiments (cont.) Comparison of experiment results

20 Conclusions Statistical load balancing scheduling scheme Future work –Granular computing idea to improve this algorithm –More the flexibility and efficiency of this algorithm

Thank you for your attention