06/08/10 P-GRADE Portal and MIMOS P-GRADE portal developments in the framework of the MIMOS-SZTAKI joint project Mohd Sidek Salleh MIMOS Berhad Zoltán.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Introduction to EGEE hands-on Gergely Sipos.
Advertisements

Summary XBRL Challenge Objective: Tools that rely on XBRL data, e.g., tool that extracts data for multi-company comparison via desktop application; or.
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Generic MPI Job Submission by the P-GRADE Grid Portal Zoltán Farkas MTA SZTAKI.
Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann P. Kacsuk, G. Sipos, A. Toth, Z. Farkas, G. Kecskemeti and G. Hermann MTA SZTAKI.
Polish Infrastructure for Supporting Computational Science in the European Research Space EUROPEAN UNION Services and Operations in Polish NGI M. Radecki,
06/08/10 PBS, LSF and ARC integration Zoltán Farkas MTA SZTAKI LPDS.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Supporting MPI Applications on EGEE Grids Zoltán Farkas MTA SZTAKI.
GridFlow: Workflow Management for Grid Computing Kavita Shinde.
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
CloudBroker integration to WS- PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS
AHM /09/05 AHM 2005 Automatic Deployment and Interoperability of Grid Services G.Kecskemeti, Yonatan Zetuny, G.Terstyanszky,
1 portal.p-grade.hu Further information on P-GRADE Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Łukasz Skitał 2, Renata Słota 1, Maciej Janusz 1 and Jacek Kitowski 1,2 1 Institute of Computer Science AGH University of Science and Technology, Mickiewicza.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
EGrid Software Packages Overview. EGrid Introduction Egrid Introduction : A description of the main software packages EGrid Inside : A detailed description.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
Enabling Grids for E-sciencE EGEE-II INFSO-RI E-Marketplace Model Integrated with Logistics MTA SZTAKI Hungarian Academy of Sciences International.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
1 1 Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI
The EDGeS project receives Community research funding 1 SG-DG Bridges Zoltán Farkas, MTA SZTAKI.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
CERN IT Department CH-1211 Genève 23 Switzerland t Monitoring: Tracking your tasks with Task Monitoring PAT eLearning – Module 11 Edward.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
AN SLA-BASED RESOURCE VIRTUALIZATION APPROACH FOR ON-DEMAND SERVICE PROVISION Gabor Kecskemeti MTA SZTAKI International Workshop on Virtualization Technologies.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Portal Update Plan Ashok Adiga (512)
Federating PL-Grid Computational Resources with the Atmosphere Cloud Platform Piotr Nowakowski, Marek Kasztelnik, Tomasz Bartyński, Tomasz Gubała, Daniel.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
1 P-GRADE Portal tutorial at EGEE’09 Introduction to hands-on Gergely Sipos MTA SZTAKI EGEE.
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
1 Practical information for the GEMLCA / P-GRADE hands-on Gergely Sipos On behalf of: MTA.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
1 Other features and next steps Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 P-GRADE Portal hands-on Gergely Sipos MTA SZTAKI Hungarian Academy of Sciences.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
07/02/2012 WS-PGRADE/gUSE in use Lightweight introduction Zoltán Farkas MTA SZTAKI LPDS.
DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Breaking the frontiers of the Grid R. Graciani EGI TF 2012.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
1 Support for parameter study applications in the P-GRADE Portal Gergely Sipos MTA SZTAKI (Hungarian Academy of Sciences)
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
1 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF-SP International Desktop Grid Federation - Support Project SZTAKI.
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Accounting at the T1/T2 Sites of the Italian Grid
Lightweight introduction
Lightweight introduction
Description of some gUSE service properties
DARIAH Competence Centre: architecture and activity summary
On the Use of Service Level Agreements in AssessGrid
a middleware implementation
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

06/08/10 P-GRADE Portal and MIMOS P-GRADE portal developments in the framework of the MIMOS-SZTAKI joint project Mohd Sidek Salleh MIMOS Berhad Zoltán Farkas MTA SZTAKI

06/08/10MIMOS and P-GRADE Portal 2 Outline Introduction About the project MIMOS infrastructure Developments Accounting solution SLA solution: Static Dynamic Split GUI and runtime Summary

06/08/10MIMOS and P-GRADE Portal 3 Project description 1 year duration started at main actitity groups: Trainings: Grid application developer, P-GRADE Portal developer (I and II), application specific module developer Developments: Accounting-related developments SLA-related developments Split GUI and runtime Support: Up to 12 MM second-level support for P-GRADE Portal

06/08/10MIMOS and P-GRADE Portal 4 MIMOS infrastructure

06/08/10MIMOS and P-GRADE Portal 5 In focus: main development tasks I. Accounting: Keep track of user activities Rely on gLite services Extend P-GRADE Portal with user and administrator interface SLA: Two phases: static and dynamic Static: predict job start time based on static values Dynamic: prefict job start time based on the infrastructure's status Users may ask for and SLA: jobs will be submitted to HA resources

06/08/10MIMOS and P-GRADE Portal 6 In focus: main development tasks II. Split GUI and runtime: User interface is detached from runtime Delays of runtime layer do not increase response time Multiple runtime installation may be used to increase throughput

06/08/10MIMOS and P-GRADE Portal 7 Accounting I. Additional portlet for keeping track of computing resources consumed by users Two operations: Sysadmin: able to query every users' data Normal user: ability to query data belonging to proxies possessed by the user Based on gLite's APEL accounting system

06/08/10MIMOS and P-GRADE Portal 8 Accounting II. - APEL

06/08/10MIMOS and P-GRADE Portal 9 Accounting III.

06/08/10MIMOS and P-GRADE Portal 10 SLA I. Service Level Agreement Present users an estimated startup deadline for their workflows before submission If a user accepts the deadline, their jobs will be submitted to high-availability resources If not, jobs are sent to normal resources Static SLA: calculated deadline depends on static values Dynamic SLA: deadline depends on the system's status

06/08/10MIMOS and P-GRADE Portal 11 SLA II. - Dynamic SLA Properties changing deadline: Application (workflow) properties Job properties Tier 1 site properties Jobs running on Tier 1 sites according to BDII Jobs running on Tier 1 sites according to P-GRADE Portal P-GRADE Portal's status: Number of workflows running Number of running jobs

06/08/10MIMOS and P-GRADE Portal 12 SLA III. - Formula

06/08/10MIMOS and P-GRADE Portal 13 SLA IV. - User Interface extensions

06/08/10MIMOS and P-GRADE Portal 14 Split GUI and runtime I. Provide a way to install GUI and runtime components on different machines Offer the possibility to install a number of runtime components This way, a heavily loaded runtime component doesn't increase the response time of the user interface

06/08/10MIMOS and P-GRADE Portal 15 Split GUI and runtime II.

06/08/10MIMOS and P-GRADE Portal 16 Split GUI and runtime III. Workflow storage is common through a shared filesystem GUI component sends user requests to runtime components using XML-RPC Runtime components are periodically „pinged” Runtime components are used in a round-robin method.

06/08/10MIMOS and P-GRADE Portal 17 Summary Additional developments for P-GRADE Portal to increase its usability Accounting: keep track of resources consumed by users in a convenient way SLA: „one-click” way to have a guarantee for the workflow's startup time Split GUI and runtime: increase user experience by detaching from overloaded runtime