Junwei Cao Darren J. Kerbyson Graham R. Nudd

Slides:



Advertisements
Similar presentations
Technology Drivers Traditional HPC application drivers – OS noise, resource monitoring and management, memory footprint – Complexity of resources to be.
Advertisements

The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
Efficient Event-based Resource Discovery Wei Yan*, Songlin Hu*, Vinod Muthusamy +, Hans-Arno Jacobsen +, Li Zha* * Chinese Academy of Sciences, Beijing.
Evaluation of Advertising Effectiveness Using Agent-Based Modeling and Simulation Junwei Cao Department of Computer Science University of Warwick.
Resource Management of Grid Computing
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Nadia Ranaldo - Eugenio Zimeo Department of Engineering University of Sannio – Benevento – Italy 2008 ProActive and GCM User Group Orchestrating.
Effective Coordination of Multiple Intelligent Agents for Command and Control The Robotics Institute Carnegie Mellon University PI: Katia Sycara
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
The new The new MONARC Simulation Framework Iosif Legrand  California Institute of Technology.
Research & Development Roadmap 1. Outline A New Communication Framework Giving Bro Control over the Network Security Monitoring for Industrial Control.
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Self-Organizing Agents for Grid Load Balancing Junwei Cao, Ph.D. Research Scientist Center for Space Research Massachusetts Institute of Technology Cambridge,
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
Architecting Web Services Unit – II – PART - III.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
SmartGRID Ongoing research work in Univ. Fribourg and Univ. Applied Sciences of Western Switzerland (HES-SO) SwiNG Grid Day, Bern, Nov. 26th, 2009 Ye HUANG.
A Novel Approach to Workflow Management in Grid Environments Frank Berretz*, Sascha Skorupa*, Volker Sander*, Adam Belloum** 15/04/2010 * FH Aachen - University.
CCGrid 2003, Tokyo, Japan GridFlow: Workflow Management for Grid Computing Junwei Cao ( 曹军威 ) C&C Research Labs, NEC Europe Ltd., Germany Stephen A. Jarvis.
Management for IP-based Applications Mike Fisher BTexaCT Research
Perspectives on Grid Technology Ian Foster Argonne National Laboratory The University of Chicago.
©Ferenc Vajda 1 Semantic Grid Ferenc Vajda Computer and Automation Research Institute Hungarian Academy of Sciences.
Futures Lab: Biology Greenhouse gasses. Carbon-neutral fuels. Cleaning Waste Sites. All of these problems have possible solutions originating in the biology.
Department of Electronic Engineering Challenges & Proposals INFSO Information Day e-Infrastructure Grid Initiatives 26/27 May.
13-Oct-2003 Internet2 End-to-End Performance Initiative: piPEs Eric Boyd, Matt Zekauskas, Internet2 International.
Model Integrated Computing and Autonomous Negotiating Teams for Autonomic Logistics G.Karsai (ISIS) J. Doyle (MIT) G. Bloor (Boeing)
Agent-Based Resource Management for Grid Computing Agent-Based Resource Management for Grid Computing Junwei Cao Darren J. Kerbyson Graham R. Nudd Junwei.
Globus: A Report. Introduction What is Globus? Need for Globus. Goal of Globus Approach used by Globus: –Develop High level tools and basic technologies.
Performance Modelling of Parallel and Distributed Computing Using PACE High Performance Systems Laboratory University of Warwick Junwei Cao Darren J. Kerbyson.
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
Agent-Based Grid Load-Balancing Daniel P. Spooner University of Warwick, UK Junwei Cao NEC Europe Ltd., Germany.
Use of Performance Prediction Techniques for Grid Management Junwei Cao University of Warwick April 2002.
MSF and MAGE: e-Science Middleware for BT Applications Sep 21, 2006 Jaeyoung Choi Soongsil University, Seoul Korea
IPDPS 2003, Nice, France Agent-Based Grid Load Balancing Using Performance-Driven Task Scheduling Junwei Cao (C&C Research Labs, NEC Europe Ltd., Germany)
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
CHaRy Software Synthesis for Hard Real-Time Systems
A Meta-Object Protocol for Environmental Adaptation in a Grid
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
The DPIaaS Controller Prototype
A G3-PLC Network Simulator with Enhanced Link Level Modeling
Agent-Based Grid Load-Balancing
High Performance Computing Lab.
Architecting Web Services
Design and Manufacturing in a Distributed Computer Environment
Globus —— Toolkits for Grid Computing
Architecting Web Services
Ruslan Fomkin and Tore Risch Uppsala DataBase Laboratory
Architecture Components
Structural Simulation Toolkit / Gem5 Integration
Building Grids with Condor
Topic I Introduction to Computer Architecture and Organization
postgrad. Sergiy Korotunov prof. Galyna Tabunshchyk
Department of Computer Science University of Warwick
DOE 2000 PI Retreat Breakout C-1
CSS490 Grid Computing Textbook No Corresponding Chapter
Department of Computer Science University of Warwick
Agent-based Resource Management for Grid Computing
Project II Rule Optimizer for the Atlas Reactivity Engine CNT
Optena: Enterprise Condor
Horizontally Partitioned Hybrid Main Memory with PCM
A Component-based Architecture for Mobile Information Access
Wide Area Workload Management Work Package DATAGRID project
Proposed Grid Protocol Architecture Working Group
Presented By: Darlene Banta
Experiences in Running Workloads over OSG/Grid3
Towards Unified Management
System architecture, Def.
Architecture Issue in the New Disciple System
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

Junwei Cao Darren J. Kerbyson Graham R. Nudd Use of Agent-Based Service Discovery for Resource Management in Metacomputing Environment Junwei Cao Darren J. Kerbyson Graham R. Nudd Department of Computer Science University of Warwick

PACE Toolkit User Interface Resource Tools Application Tools Code Analysis Object Editor Object Library CPU Network Cache HMCL Scripts Resource Model Resource Model PSL Scripts Evaluation Engine Compiler Application Model Application Model Evaluation Engine Performance Analysis Performance Analysis On-the-fly Analysis

The Question Is … ?

A4 Methodology An agent is … A local manager An user middleman A broker A coordinator A service provider A service requestor A matchmaker A router

Service Discovery NEXT! Service Advertisement Local Management Layer Coordination Layer Communication Layer Service Advertisement NEXT!

Service Advertisement Hi, please find attached my service information. Hi, could you please give me some service information that you have? Full service advertisement – requires no service discovery. No service advertisement – results in complex service discovery. Make Balance!

Agent Capability Tables The process of the service advertisement and discovery corresponds to the maintenance and lookup of the ACTs. Vary by source: T_ACT: contains service info of local resources L_ACT: contains service info coming from lower agents G_ACT: contains service info coming from upper agent C_ACT: contains cached service info during discovery Strategies: Data-push: submit service info to other agents Data-pull: ask for service info from other agents Periodical: Periodical ACT maintenance Event-driven: ACT maintenance driven by system events

The Answer Is … At meta level, At local level, agents cooperate with each other for service discovery. At local level, PACE functions can supply accurate performance info.

ARMS ARMS in Context A4 Grid Grid Users Resources PACE A4 Simulator PMA PACE Application Tools (AT) Evaluation Engine (EE) Resource Tools (RT)

ARMS Architecture ? Bottleneck? ACT EE Agents PMA Application Models Resource Models ? Application Models Cost Models Users AT RT Processors

Application Execution ARMS Agent Structure Local Application Management Resource Allocation Monitoring Application Execution Coordination Sched. Cost ACTs App. Info Service Info Res. Info Scheduler Match Maker Eval Results Cost Model Advertisement ACT Manager PACE Evaluation Engine To Another Agent Agent ID Application Model Comm. Communication Module Discovery

PMA Structure ARMS Agent PMA Model Composer Monitoring Reconfiguration Statistical data Model Composer Simulation Engine Policies Performance Model Strategies

Conclusions Performance prediction driven for QoS support of grid resource management Agent based hierarchical model for grid resource advertisement and discovery Simulation based performance optimisation and steering of service discovery in large scale multi-agent systems In summary, all of above go together to provides an available methodology and prototype implementation of agent-based resource management for grid computing, which can be used as a fundamental framework for further improvement and refinement.