GLOBAL GRID FORUM 10 Workflows in PROGRESS and GridLab environments Michał Kosiedowski.

Slides:

Advertisements

Similar presentations

PIONIER 2003, Poznan, , PROGRESS Grid Access Environment for SUN Computing Cluster Poznań Supercomputing and Networking Center Cezary Mazurek.

Advertisements

The National Grid Service and OGSA-DAI Mike Mineter

Interaction model of grid services in mobile grid environment Ladislav Pesicka University of West Bohemia.

C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.

GLOBUS PLUG-IN FOR WINGS WOKFLOW ENGINE Elizabeth Martí ITACA Universidad Politécnica de Valencia

Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.

Global Grid Access Cezary Mazurek, PSNC. Cezary Mazurek, PSNC, Enable access to global grid, Supercomputing 2003, Phoenix, AZ 2 Agenda Introduction PROGRESS.

A Computation Management Agent for Multi-Institutional Grids

ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),

PROGRESS: ICWS'2003 Web Services Communication within the PROGRESS Grid-Portal Environment Michał Kosiedowski.

Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.

Workload Management Workpackage Massimo Sgaravatto INFN Padova.

A Grid Resource Broker Supporting Advance Reservations and Benchmark- Based Resource Selection Erik Elmroth and Johan Tordsson Reporter ： S.Y.Chen.

DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.

Workload Management Massimo Sgaravatto INFN Padova.

Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”

© 2008 by M. Stümpert, A. Garcia; made available under the EPL v1.0 | Access the power of Grids with Eclipse Mathias Stümpert (Karlsruhe Institute.

EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Towards scalable, semantic-based virtualized storage.

SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

Grid Computing - AAU 14/ Grid Computing Josva Kleist Danish Center for Grid Computing

Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.

Integration of the Biological Databases into Grid-Portal Environments Michal Kosiedowski, Michal Malecki, Cezary Mazurek, Pawel Spychala, Marcin Wolski.

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

WP9 Resource Management Current status and plans for future Juliusz Pukacki Krzysztof Kurowski Poznan Supercomputing.

PROGRESS – Computing Portal and Data Management in the Cluster of SUNs Michał Kosiedowski Sun HPC Consortium Heidelberg 2003.

Computational grids and grids projects DSS,

Grid Computing I CONDOR.

COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.

3-2.1 Topics Grid Computing Meta-schedulers –Condor-G –Gridway Distributed Resource Management Application (DRMAA) © 2010 B. Wilkinson/Clayton Ferner.

1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.

Nadia LAJILI User Interface User Interface 4 Février 2002.

Facilitating access to the scientific data service with the use of the Data Management System Cezary Mazurek

The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.

Grid Workload Management Massimo Sgaravatto INFN Padova.

Application portlets within the PROGRESS HPC Portal Michał Kosiedowski

Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.

PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.

Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.

1 5th AstroGrid-D Meeting, MPE Garching Frank Breiting, AIP November 14, 2006 Status of the Dynamo Use Case as prepared by Michael Braun Frank Breitling.

Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.

SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no.

Using the GAT (GAT the semester project?) :-P Hartmut Kaiser

Review of Condor,SGE,LSF,PBS

Terena conference, June 2004, Rhodes, Greece Norbert Meyer The effective integration of scientific instruments in the Grid.

GridLab Resource Management System (GRMS) Jarek Nabrzyski GridLab Project Coordinator Poznań Supercomputing and.

Portal Update Plan Ashok Adiga (512)

Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,

Copyright © 2010, SAS Institute Inc. All rights reserved. SAS ® Using the SAS Grid.

International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.

Job Submission with Globus, Condor, and Condor-G Selim Kalayci Florida International University 07/21/2009 Note: Slides are compiled from various TeraGrid.

SUPERCOMPUTING 2002, Baltimore, , SUN „Grid Day” PROGRESS Access environment to computational services performed by cluster of SUNs Poznań Supercomputing.

The NorduGrid toolkit user interface Mattias Ellert Presented at the 3 rd NorduGrid workshop, Helsinki,

Tool Integration with Data and Computation Grid “Grid Wizard 2”

Grid Compute Resources and Job Management. 2 Grid middleware - “glues” all pieces together Offers services that couple users with remote resources through.

PEPC 2003, Geneva, , PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek.

PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.

EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.

STAR Scheduler Gabriele Carcassi STAR Collaboration.

Joint Institute for Nuclear Research Synthesis of the simulation and monitoring processes for the data storage and big data processing development in physical.

CSF4 Meta-Scheduler Zhaohui Ding College of Computer Science & Technology Jilin University.

InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.

GridWay Overview John-Paul Robinson University of Alabama at Birmingham SURAgrid All-Hands Meeting Washington, D.C. March 15, 2007.

Flowbster: Dynamic creation of data pipelines in clouds

Design rationale and status of the org.glite.overlay component

EMI Interoperability Activities

Wide Area Workload Management Work Package DATAGRID project

gLite Job Management Christos Theodosiou

Presentation transcript:

GLOBAL GRID FORUM 10 Workflows in PROGRESS and GridLab environments Michał Kosiedowski

GLOBAL GRID FORUM 10 PROGRESS (1) Duration: December 2001 – December 2003 Budget: ~4,0 MEuro Project Partners –Sun Microsystems Poland –PSNC IBCh Poznań –Cyfronet AMM, Kraków –Technical University Łódź Co-funded by The State Committee for Scientific Research (KBN) and Sun Microsystems Poland

GLOBAL GRID FORUM 10 PROGRESS (2)

GLOBAL GRID FORUM 10 Grid Service Provider Job Submission Service –delivers functions for computing job building, submitting them to the grid for execution and viewing the results. It allows to create jobs, configure its tasks and set the requirements for grid environment resources. The service prepares grid job descriptions using the XRSL language. The description is then transferred to the GRB for the execution of the job. Application Management Service –manages the PROGRESS application repository. An application descriptor contains a reference to the application ’ s executable and a set of its available, required or optional arguments, required environment variables as well as input and output files. One executable may be referenced by many applications. Different application configurations are recognized as independent applications

GLOBAL GRID FORUM 10 Grid Resource Broker built on the top of core infrastructure provided by the Globus Toolkit 2.x enables the execution and control of PROGRESS grid jobs through the GRAM protocol on computing resources connected to the PROGRESS grid matches and submits the job to the best fitting resource, according to the job description and application requirements, additionally taking into account policies set by the grid administrators grid job definitions are sent to the GRB in the form of XRSL documents

GLOBAL GRID FORUM 10 Workflows (1)

GLOBAL GRID FORUM 10 Workflows (2)

GLOBAL GRID FORUM 10 Workflows (3)

GLOBAL GRID FORUM 10 Workflows (4)

GLOBAL GRID FORUM 10 XRSL (1) : describes a single task to be performed on the grid together with all application and user requirements, including static and dynamic resource parameters, environment variables, stdin, stdout, stderr, etc., : describes a sequence of tasks to be performed on the grid, must contain at least one or, : describes tasks to be executed in parallel on the grid, must contain at least one or.

GLOBAL GRID FORUM 10 XRSL (2) T3T3 T4T4 T5T5 T1T1 T2T2

GLOBAL GRID FORUM 10 Virtual Applications (1) A user can create and save different workflow structures of regular applications as virtual applications and thus allow other users to choose a virtual application from the list of available applications. Then, the workflow is automatically created by the GSP ’ s Job Submission Service based on the application description obtained from the Application Management Service.

GLOBAL GRID FORUM 10 Virtual Applications (2)

GLOBAL GRID FORUM 10 Grid(Lab) RMS (1) Grid Resource Broker

GLOBAL GRID FORUM 10 Grid(Lab) RMS (2)

GLOBAL GRID FORUM 10 Contacts