EUFORIA FP7-INFRASTRUCTURES-2007-1, Grant 211804 Scientific Workflows Kepler and Java API 4 HPC/GRID ITM meeting Juelich 2009 Michał Owsiak Marcin Płóciennik.

Slides:



Advertisements
Similar presentations
Nimrod/K: Towards Massively Parallel Dynamic Grid Workflows David Abramson, Colin Enticott, Monash Ilkay Altinas, UCSD.
Advertisements

1 Flexible IO Services in the Kepler Grid Workflow System David Abramson Jagan Kommineni Ilkay Altintas
Dominik Stokłosa Pozna ń Supercomputing and Networking Center, Supercomputing Department INGRID 2008 Lacco Ameno, Island of Ischia, ITALY, April 9-11 Workflow.
W w w. h p c - e u r o p a. o r g HPC-Europa Portal: Uniform Access to European HPC Infrastructure Ariel Oleksiak Poznan Supercomputing.
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Digital Object Lifecycle in dLibra Digital Library Framework Cezary Mazurek, Marcin Werla
EGEE 08, Istanbul, September 25th, Support for experimental science communities Istanbul, September 25th, 2008 Norbert Meyer, Marcin Płóciennik.
EGC 2005, CrossGrid technical achievements, Amsterdam, Feb. 16th, 2005 WP2-3 New Generation Environment for Grid Interactive MPI Applications M igrating.
Jianwu Wang, Daniel Crawl, Ilkay Altintas San Diego Supercomputer Center, University of California, San Diego 9500 Gilman Drive, MC 0505 La Jolla, CA ,
February 11, 2010 Center for Hybrid and Embedded Software Systems Ptolemy II - Heterogeneous Concurrent Modeling and Design.
Introduction to Kepler Deana Pennington, PhD University of New Mexico LTER Network Office, Sevilleta LTER PI CI-Team: Advancing CI-Based Science through.
EUFORIA FP7-INFRASTRUCTURES , Grant JRA3 B. Guillerminet on behalf of the JRA3 project 22 January 2008 Kick-Off Meeting January 2008.
Computational Physics Kepler Dr. Guy Tel-Zur. This presentations follows “The Getting Started with Kepler” guide. A tutorial style manual for scientists.
February 12, 2009 Center for Hybrid and Embedded Software Systems Model Transformation Using ERG Controller Thomas H. Feng.
Introduction to Rational Rose 2000 Create Use Case Model Visual Modeling Text – Chapter 3 Original notes from Rational Software Corporation – 1998 Modified.
Workflow API and workflow services A case study of biodiversity analysis using Windows Workflow Foundation Boris Milašinović Faculty of Electrical Engineering.
1 Application Specific Module for P-GRADE Portal 2.7 Application Specific Module overview Akos Balasko MTA-SZTAKI LPDS
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
 Scientific workflow management system based on Ptolemy II  Allows scientists to visually design and execute scientific workflows  Actor-oriented.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik University of Manchester materials by Dr Katy Wolstencroft and Dr Aleksandra.
Scientific Workflows Scientific workflows describe structured activities arising in scientific problem-solving. Conducting experiments involve complex.
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
EUFORIA FP7-INFRASTRUCTURES , Grant Scientific Workflows Kepler and Java API 4 HPC/GRID Hands on tutorial - ITM Meeting 2009 Michal Owsiak.
“Automate Anything You See” Uses image recognition to identify and control GUI components Useful when there is no easy access to a GUI's internal or source.
Composing Models of Computation in Kepler/Ptolemy II
Chapter 11: Introduction to the Visual Basic Environment Spreadsheet-Based Decision Support Systems Prof. Name Position (123) University.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
GLOBAL GRID FORUM 10 Workflows in PROGRESS and GridLab environments Michał Kosiedowski.
Chad Berkley NCEAS National Center for Ecological Analysis and Synthesis (NCEAS), University of California Santa Barbara Long Term Ecological Research.
1 Ilkay ALTINTAS - July 24th, 2007 Ilkay ALTINTAS Director, Scientific Workflow Automation Technologies Laboratory San Diego Supercomputer Center, UCSD.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
WS-Freefluo-VLAM Tutorial Spiros Koulouzis. Outline Get the WS-Freefluo-VLAM (GUI) Start the WS-Freefluo-VLAM (GUI) Generate modules from WSDL Compose.
EUFORIA FP7-INFRASTRUCTURES , Grant EUFORIA: EU Fusion fOR ITER Applications Marcus Hardt
Migrating Desktop Marcin Płóciennik Marcin Płóciennik Kick-off Meeting, Santander, Graphical.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Introduction to ArcGIS for Environmental Scientists Module 3 – GIS Analysis Model Builder.
WALSAIP Portal Automated Composition of Signal Processing Operators Mariana Mendoza Botero.
© Geodise Project, University of Southampton, Knowledge Management in Geodise Geodise Knowledge Management Team Barry Tao, Colin Puleston, Liming.
Kepler Deana Pennington LTER Network Office. Download Kepler Kepler website: website:
Migrating Desktop Bartek Palak Bartek Palak Poznan Supercomputing and Networking Center The Graphical Framework.
Introduction to Taverna Online and Interaction service Aleksandra Pawlik University of Manchester.
Clotho in Kepler Help sharing Clotho’s awesomeness to the world Use scientific workflow to create, reuse, share and extend Clotho’s operations.
JWire Concepts AComposite foo : Foobar : Bar Components are Java objects. Components play roles in one or more interaction protocols. Roles are named and.
1 P-GRADE Portal tutorial at EGEE’09 Introduction to hands-on Gergely Sipos MTA SZTAKI EGEE.
Convert generic gUSE Portal into a science gateway Akos Balasko.
1 Practical information for the GEMLCA / P-GRADE hands-on Tamas Kiss University of Westminster.
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
Satisfying Requirements BPF for DRA shall address: –DAQ Environment (Eclipse RCP): Gumtree ISEE workbench integration; –Design Composing and Configurability,
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
EGI-InSPIRE RI EGI Community Forum 2012 EGI-InSPIRE EGI-InSPIRE RI EGI Community Forum 2012 Kepler Workflow Manager.
ACCESSING DATA IN THE NIS USING THE KEPLER WORKFLOW SYSTEM Corinna Gries.
Kepler BEAM Workshop Samantha Romanello LTER Network Office.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
Convert generic gUSE Portal into a science gateway Akos Balasko.
Scientific workflow in Kepler – hands on tutorial
Tamas Kiss University Of Westminster
Support to MPI, Schedulers and Complex Workflows
Ptolemy II - Heterogeneous Concurrent Modeling and Design in Java
How to automatise the grid production - using model builder in ArcGIS
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
Robert Szuman – Poznań Supercomputing and Networking Center, Poland
BricsCAD BIM Training Session Documents:
Raspberry Pi Stefan konzelmann
Computational Physics Kepler
CIRCABC Proof Of Concept
Presentation transcript:

EUFORIA FP7-INFRASTRUCTURES , Grant Scientific Workflows Kepler and Java API 4 HPC/GRID ITM meeting Juelich 2009 Michał Owsiak Marcin Płóciennik PSNC

Accessing tutorial machines Training room 2 (GRID and HPC from KEPLER) Participants: itmb itmb1069 PCs: zam1045-zam1069 The password for all accounts is: EUFORIA FP7-INFRASTRUCTURES , Grant

Agenda - Main components: Director, Actor, Port, Relation - Workflow building area - Different workflow types - Actor related details - Concept of composite actor - Java API 4 HPC/GRID EUFORIA FP7-INFRASTRUCTURES , Grant

How can I build workflow? Kepler allows you to build workflows using standard elements: - Workflow - Director - Actor - Port - Relation EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing workflow - Workflow allows to compose data flow between elements - Elements can be Dragged and Dropped into Workflow's area - After workflow is ready it can be started two ways: directly from the GUI from the command line EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing workflow EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing Actors and Directors - Available elements can be accessed through the component's browser - Elements can be Dragged and Dropped into Workflow's area - You can search for elements if you don't know the exact name of the component - You can add your own components into library EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing Actors and Directors EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing Supplementary Components - Components that bind all elements together are accessible from toolbar - Ports, relations, can be Dragged and Dropped into Workflow's area - You can easily Start/Stop workflow directly from the GUI using toolbar icons EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing Supplementary Components EUFORIA FP7-INFRASTRUCTURES , Grant

Main components EUFORIA FP7-INFRASTRUCTURES , Grant

Directors Directors are responsible for the orchestration of the workflow. Directors can provide various means of execution: - CT Director (Continuous Time) - DDF Director (Dynamic Data flow) - SDF Director (Sequential Data flow) - PN Director (Process Network) - parallel executions EUFORIA FP7-INFRASTRUCTURES , Grant

Actors Actors perform actions basing on input ports and parameters EUFORIA FP7-INFRASTRUCTURES , Grant

Actors - You can use already existing actors that are available within Kepler - You can import actors from the other sources into Kepler - You can develop your own actors and add them to the Kepler EUFORIA FP7-INFRASTRUCTURES , Grant

Concept of composite actor - Composite actors allow to encapsulate workflows - Composite actors can be copy-pasted between workflows - Composite actors can be exported as components EUFORIA FP7-INFRASTRUCTURES , Grant

Concept of composite actor EUFORIA FP7-INFRASTRUCTURES , Grant

Java API 4 HPC/GRID Developed within EUFORIA project - One of the goals of the project is to provide users with convenient way of accessing HPC/GRID infrastructures using Kepler orchestration tool - Java API 4 HPC/GRID is based on vine:toolkit EUFORIA FP7-INFRASTRUCTURES , Grant

What is Java API 4 HPC/GRID EUFORIA FP7-INFRASTRUCTURES , Grant

What Java API 4 HPC/GRID provides Java API 4 HPC/GRID provides: - set of actors that extends Kepler with HPC access - set of actors that extends Kepler with GRID access - already existing workflows that can be modified - set of composite actors for faster workflow building EUFORIA FP7-INFRASTRUCTURES , Grant

Thank you for your attention EUFORIA FP7-INFRASTRUCTURES , Grant

Accessing tutorial machines Training room 2 (GRID and HPC from KEPLER) Participants: itmb itmb1069 PCs: zam1045-zam1069 The password for all accounts is: EUFORIA FP7-INFRASTRUCTURES , Grant