GSAF: A Grid-based Services Transfer Framework Chunyan Miao, Wang Wei, Zhiqi Shen, Tan Tin Wee.

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

Current methods for negotiating firewalls for the Condor ® system Bruce Beckles (University of Cambridge Computing Service) Se-Chang Son (University of.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
Extensibility, Safety and Performance in the SPIN Operating System Presented by Allen Kerr.
A system Performance Model Instructor: Dr. Yanqing Zhang Presented by: Rajapaksage Jayampthi S.
SoRTGrid: A Framework compliant with Soft Real Time requirements A. Merlo 1, V. Gianuzzi 1, A. Corana 2, A. Clematis 3, D. D’Agostino 3, A Quarati 3 1.
CoreGRID Workpackage 5 Virtual Institute on Grid Information and Monitoring Services Authorizing Grid Resource Access and Consumption Erik Elmroth, Michał.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
Operating System Support Focus on Architecture
CS 104 Introduction to Computer Science and Graphics Problems
ATSN 2009 Towards an Extensible Agent-based Middleware for Sensor Networks and RFID Systems Dirk Bade University of Hamburg, Germany.
1 Introduction to Load Balancing: l Definition of Distributed systems. Collection of independent loosely coupled computing resources. l Load Balancing.
Computer Organization and Architecture
Resource Manager for Grid with global job queue and with planning based on local schedules V.N.Kovalenko, E.I.Kovalenko, D.A.Koryagin, E.Z.Ljubimskii,
Grid Load Balancing Scheduling Algorithm Based on Statistics Thinking The 9th International Conference for Young Computer Scientists Bin Lu, Hongbin Zhang.
SERVICE BROKER. SQL Server Service Broker SQL Server Service Broker provides the SQL Server Database Engine native support for messaging and queuing applications.
IHP Im Technologiepark Frankfurt (Oder) Germany IHP Im Technologiepark Frankfurt (Oder) Germany ©
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
Katanosh Morovat.   This concept is a formal approach for identifying the rules that encapsulate the structure, constraint, and control of the operation.
Zhiyong Wang In cooperation with Sisi Zlatanova
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Managing a Cloud For Multi Agent System By, Pruthvi Pydimarri, Jaya Chandra Kumar Batchu.
Service Architecture of Grid Faults Diagnosis Expert System Based on Web Service Wang Mingzan, Zhang ziye Northeastern University, Shenyang, China.
Cluster Reliability Project ISIS Vanderbilt University.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Frascati, October 9th, Accounting in DataGrid Initial Architecture Albert Werbrouck Frascati, October 9, 2001.
Young Suk Moon Chair: Dr. Hans-Peter Bischof Reader: Dr. Gregor von Laszewski Observer: Dr. Minseok Kwon 1.
February 20, AgentCities - Agents and Grids Prof Mark Baker ACET, University of Reading Tel:
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DOMENICO TALIA (joint work with M. Cannataro, A. Congiusta, P. Trunfio) DEIS University of Calabria ITALY Grid-Based Data Mining and.
Cracow Grid Workshop, October 27 – 29, 2003 Institute of Computer Science AGH Design of Distributed Grid Workflow Composition System Marian Bubak, Tomasz.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
1 Introduction to Software Engineering Lecture 1.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Middleware for Grid Computing and the relationship to Middleware at large ECE 1770 : Middleware Systems By: Sepehr (Sep) Seyedi Date: Thurs. January 23,
Superscheduling and Resource Brokering Sven Groot ( )
1 BRUSSELS - 14 July 2003 Full Security Support in a heterogeneous mobile GRID testbed for wireless extensions to the.
Cracow Grid Workshop ‘06 17 October 2006 Execution Management and SLA Enforcement in Akogrimo Antonios Litke Antonios Litke, Kleopatra Konstanteli, Vassiliki.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
Virtual Memory. Background Virtual memory is a technique that allows execution of processes that may not be completely in the physical memory. Virtual.
AN SLA-BASED RESOURCE VIRTUALIZATION APPROACH FOR ON-DEMAND SERVICE PROVISION Gabor Kecskemeti MTA SZTAKI International Workshop on Virtualization Technologies.
1 Supporting Dynamic Migration in Tightly Coupled Grid Applications Liang Chen Qian Zhu Gagan Agrawal Computer Science & Engineering The Ohio State University.
 Copyright 2005 Digital Enterprise Research Institute. All rights reserved. Enabling Components Management and Dynamic Execution Semantic.
Integration of Workflow and Agent Technology for Business Process Management Yuhong Yan. Maamar, Z. Weiming Shen Enterprise Integration Lab.Toronto Univ.Canada.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Chapter 8 System Management Semester 2. Objectives  Evaluating an operating system  Cooperation among components  The role of memory, processor,
From Use Cases to Implementation 1. Structural and Behavioral Aspects of Collaborations  Two aspects of Collaborations Structural – specifies the static.
Use of Performance Prediction Techniques for Grid Management Junwei Cao University of Warwick April 2002.
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
From Use Cases to Implementation 1. Mapping Requirements Directly to Design and Code  For many, if not most, of our requirements it is relatively easy.
1 Supporting a Volume Rendering Application on a Grid-Middleware For Streaming Data Liang Chen Gagan Agrawal Computer Science & Engineering Ohio State.
Wrap up. Structures and views Quality attribute scenarios Achieving quality attributes via tactics Architectural pattern and styles.
Chapter 1: Introduction to Systems Analysis and Design
Introduction to Load Balancing:
OO Methodology OO Architecture.
Liang Chen Advisor: Gagan Agrawal Computer Science & Engineering
Basic Grid Projects – Condor (Part I)
Operating Systems.
Chapter 1: Introduction to Systems Analysis and Design
Wide Area Workload Management Work Package DATAGRID project
Market-based Dynamic Task Allocation in Mobile Surveillance Systems
Chapter 1: Introduction to Systems Analysis and Design
System Analysis and Design:
From Use Cases to Implementation
Presentation transcript:

GSAF: A Grid-based Services Transfer Framework Chunyan Miao, Wang Wei, Zhiqi Shen, Tan Tin Wee

Motivation Grid provides an integrated computing environment, facilitating maintenance and control of information and other kinds of resources e.g. services. However, –Existing services are still tied with definite containers. –When new services are deployed, they come to function only after container is restarted.

Objective Execute services dynamically to break the tight coupling between services and computers

Grid Resource Allocation Grid resource allocation has attracted a lot of attention in recent years: –Globus focuses on providing uniform and scalable mechanisms for naming and locating computational and communication resources on remote systems. –GRASP [1] supports some features for user-friendly resource allocation such as resource brokering, scheduling, monitoring, and so forth. –Nassif et al. [2] presented a Multi-Agent System that chooses the best place to run a grid job by making use of negotiation.

GSAF Existing work mainly focuses on how to find, locate, select and schedule existing static services. GSAF (A Grid-based Services Allocation Framework) is proposed to: –dynamically extend and adjust computing ability of nodes in grid systems. –balance the total weight by fully utilizing free or idle computing resources. –and provide a form of resource management to improve the flexibility of Systems

GSAF—Resource View Service components viewed as explicitly manageable resources GSAF partitions resources into: –Service Components Repository (SCR): logical pool gathering all the available service components –Computing Nodes Repository (CNR): hardware pool gathering available computers –Data Sources Repository (DSR): logical pool gathering all the data related to service components.

GSAF—R-language R-language: a resource-oriented workflow description language Three logical elements –Action: a definite resource processing behavior –Scenario: a finite series of actions –Task: scenario which has definite and meaningful purpose according to user request. A task is basically a running script

GSAF—R-language Example The first example defines an action to transfer a DBSCAN [9] service component in SCR from local computer to remote computer named OEM-MICRO. The second example selects computing node named DMGROUP in CNR for service executing. The third example defines the action to find the address of a certain data source named DBSCANinput in DSR.

GSAF Architecture Computers are categorized into two different kinds of nodes: –central nodes: responsible for central management and scheduling such as resource managing and task scheduling –and computing nodes: contribute computing ability to run services, i.e. the resources in CNR Each node is controlled by an agent. The whole system is thus a multi-agent system (MAS).

GSAF Architecture (cont’d) Architecture of Central Node Agent

GSAF Architecture (cont’d) Architecture of Computing Node Agent

GSAF Architecture (cont’d)

GSAF Strategies Use service cache to deal with the service components swapping: a distinct feature of GSAF. –LRU (Least Recently Used): The least recently used service component in buffer is recorded. If replacement is needed, swat it out. –NRU (Not Recently Used): The service component which hasn't been used in a certain period is recorded. If replacement is needed, swat it out. –FIFO (First-In First-Out): The service components are organized in a queue according to the order of arrival. If replacement is needed, swat out the service at the head of queue.

GSAF—Strategies (cont’d) Although the best solution is to select the most powerful computer, it may not be practical in real use because of the changings on-the-fly, for example the CPU usage. A heuristic selection strategy is used in GSAF, namely, weighted ranking.

Prototype An application of GSAF is implemented in the field of bio data mining system. –Use Globus Toolkit 3.2 to provide grid environment. –The modules of central node and computing node are implemented as grid services in Java supported by Globus grid service container.

Conclusion GSAF is proposed to dynamically allocate services –Swap and execute services dynamically to break the tight coupling between services and computers. –All the resources are categorized and managed in corresponding repository. –Dynamic binding among different kinds of resources provides a flexible pattern to execute services On going and Future work: –Applications of GSAF to Bio Applications. –Mobile Service Flow on WWW –Trusted Service Grid

Thank You!

References [1] OGSA(Open Grid Services Architecture) Documents: [2] Globus: Research in Resource Management, [3] L. Nassif, J. M. Nogueira, M. Ahmed, R. Impey, A. Karmouch. Agent-based Negotiation for Resource Allocation in Grid. Workshop on Computational Grids and Applications, 2005 [4] R. Parra-Hernandez, D. Vanderster and N. J. Dimopoulos. Resource Management and Knapsack Formulations on the Grid. IEEE/ACM International Workshop on Grid Computing (GRID'04), 2004