SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481 Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks MyProxy and EGEE Ludek Matyska and Daniel.
Advertisements

EDGI is supported by the FP7 Capacities Programme under contract nr RI End-User view of the AutoDock Portal Zoltán Farkas, MTA SZTAKI
P-GRADE and WS-PGRADE portals supporting desktop grids and clouds Peter Kacsuk MTA SZTAKI
06/08/10 PBS, LSF and ARC integration Zoltán Farkas MTA SZTAKI LPDS.
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Connecting Workflow-Oriented Science Gateways to Multi-Cloud Systems Zoltán Farkas, Péter Kacsuk, Ákos Hajnal MTA SZTAKI.
CloudBroker integration to WS- PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI gUSE Services Remote API, DCI Bridge, Data Bridge, Robot Certificate Zoltán.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI CloudBroker Platform Presentation Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Build and Test Portal SCI-BUS - agINFRA OSD Eva Takacs 4D Soft Kft. Budapest,
Integration and Sites Rob Gardner Area Coordinators Meeting 12/4/08.
EDGI European Desktop Grid Initiative EDGI Portal usage and use-case studies EDGI is supported by the FP7 Capacities Programme under contract.
1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration:
Sharing, integrating and executing different workflows in heterogeneous multi-cloud systems Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
1 Overview of the Application Hosting Environment Stefan Zasada University College London.
Sharing Workflows through Coarse-Grained Workflow Interoperability : Sharing Workflows through Coarse-Grained Workflow Interoperability G. Terstyanszky,
The EDGeS project receives Community research funding 1 SG-DG Bridges Zoltán Farkas, MTA SZTAKI.
Supported by EU projects 12/12/2013 Athens, Greece Open Data in Agriculture Hands-on with data infrastructures that can power your agricultural data products.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI CloudBroker Platform Tutorial Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
How to Read gUSE Documents Orange Docs Series for General Pruposes RELEASE ISSUE POLICY LICENSE HOW TO READ GUSE DOCUMENTS GUSE IN A NUTSHELL by Tibor.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
How to Deploy and Configure the Smart Net Total Care CSPC Collector
A scalable and flexible platform to run various types of resource intensive applications on clouds ISWG June 2015 Budapest, Hungary Tamas Kiss,
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.
06/08/10 P-GRADE Portal and MIMOS P-GRADE portal developments in the framework of the MIMOS-SZTAKI joint project Mohd Sidek Salleh MIMOS Berhad Zoltán.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI Science Gateways and Clouds Dr. Wibke Sudholt CloudBroker GmbH Technoparkstrasse.
SHIWA: Is the Workflow Interoperability a Myth or Reality PUCOWO, June 2011, London Gabor Terstyanszky, Tamas Kiss, Tamas Kukla University of Westminster.
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
1 WS-PGRADE/gUSE generic DCI gateway framework for EGI user communities Zoltan Farkas and Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
INFSO-RI JRA2 Test Management Tools Eva Takacs (4D SOFT) ETICS 2 Final Review Brussels - 11 May 2010.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
07/02/2012 WS-PGRADE/gUSE in use Lightweight introduction Zoltán Farkas MTA SZTAKI LPDS.
OpenNebula: Experience at SZTAKI Peter Kacsuk, Sandor Acs, Mark Gergely, Jozsef Kovacs MTA SZTAKI EGI CF Helsinki.
WS-PGRADE/gUSE in use Advance use of WS- PGRADE/gUSE gateway framework Zoltán Farkas and Peter Kacsuk MTA SZTAKI LPDS.
EGI-InSPIRE RI EGI Webinar EGI-InSPIRE RI Porting your application to the EGI Federated Cloud 17 Feb
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
RI EGI-TF 2010, Tutorial Managing an EGEE/EGI Virtual Organisation (VO) with EDGES bridged Desktop Resources Tutorial Robert Lovas, MTA SZTAKI.
1 Globe adapted from wikipedia/commons/f/fa/ Globe.svg IDGF-SP International Desktop Grid Federation - Support Project SZTAKI.
SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI SCI-BUS and the CloudBroker Platform: Extending Science Gateways to Clouds.
WP5 – Infrastructure Operations Test and Production Infrastructures StratusLab kick-off meeting June 2010, Orsay, France GRNET.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
DCI BRIDGE Introduction its Native Access Hands-On Akos Balasko
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
WS-PGRADE + ASM Basic hands-on Zoltán Farkas, MTA SZTAKI
Peter Kacsuk, Zoltan Farkas MTA SZTAKI
How to connect your DG to EDGeS? Zoltán Farkas, MTA SZTAKI
Data Bridge Solving diverse data access in scientific applications
WS-PGRADE for Molecular Sciences and XSEDE
Lightweight introduction
THE STEPS TO MANAGE THE GRID
Lightweight introduction
Description of some gUSE service properties
Basic hands-on Zoltán Farkas, MTA SZTAKI
What Is Sharepoint? Mohsen Ashkboos
Cloud Connect Seamlessly
Module 01 ETICS Overview ETICS Online Tutorials
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS

Outline Aim of this presentation Generic portal administrator tasks Generic initial user tasks SaaS execution mode: – Portal administrator tasks – Workflow node configuration IaaS execution mode: – Portal administrator tasks – Workflow node configuration Generic user tasks (workflow cost estimate, submission, cost display) Security aspects, using robot certificates

Aim To show what are the necessary setup tasks on the portal side to cloud-enable a portal To show how the extension can be used To introduce the security aspects of using clouds in the portal

Covered portal user roles Portal administrator – The one who is able to configure the portal services Workflow developer – The one who is able to create and run workflows End user – The one who is able to use existing workflows

Generic portal admin tasks I. Through the DCI Bridge Admin interface:

Generic portal admin tasks II. Settings: – Enable plugin: set to „Enabled” – Number of threads: the plugin will manage at most so many jobs in parallel – Number of resubmissions: the plugin will resubmit a failed job at most so many times Leave other settings unchanged

Generic portal admin tasks III. Add access to CloudBroker Platform service – Name: users will see the resource using this name – URL: URL of the CBP service – Own executable: see IaaS execution mode later

Status The portal administrator has enabled the CloudBroker plugin in the DCI Bridge, and all the CloudBroker services that users would like to use have been added These are set by default: CB plugin is enabled, Public and SCI-BUS CB services are added

Generic initial user tasks If one would like to configure CBP jobs, proper CBP user credentials have to be set Make use of the Security / CloudBroker portlet

Saas and IaaS execution modes IaaS modelSaaS model Enables users to run their own executablesYesNo What has to be pre-deployed in the virtual machine image A single wrapper applicationEvery application that users would like to use What has to be configured in the CloudBroker Platform Only the wrapper applicationApplications for the different application Level of securityLow: user can run anythingHigh: users can run only pre-registered, tested apps Ease of use (user’s perspective)Easy: very similar to existing WS- PGRADE/gUSE interface Easy: user simply selects from the pre- defined Software Ease of use (portal administrator’s perspective) Easy: only two additional properties have to be set Very easy: no need to set additional properties Ease of use (CloudBroker administrator’s perspective) Easy: only one application has to be configured for each cloud resource Hard: a number of applications have to be configured Easy of use (cloud administrator’s perspective) Easy: only one VM image has to be deployedHard: either a number of VM images have to be deployed or one VM image must be updated a number of times.

SaaS execution – Overview Enables portal users to run applications registered in the selected CBP service (for example AutoDock 1.0 Software and ad_worker.sh Executable) Thus, no executable, only input files have to be provided by the portal user

SaaS execution „architecutre”

SaaS – Portal admin tasks Nothing special Only the generic portal admin tasks have to be performed (configure CBP service access in DCI Bridge)

SaaS – Workflow node configuration Set „Type” to „cloudbroker”, and „Name” to the CBP service to be used Afterwards, select Software, Executable, Resource, Region and Instance type for your job A cost estimate is displayed as well

SaaS – Data cost estimate Depending on the selected resource, the data fee is displayed as well

IaaS execution - Overview Enables to run executables uploaded by the user A specially prepared wrapper application has to be registered in the target CBP service (see Wrapper 1.0) This wrapper application must be configured the DCI Bridge plugin instance The portal will upload the user-provided executable as an input called „execute.bin” to the CloudBroker job, which will be started by the wrapper application

IaaS execution „architecture”

IaaS – Portal admin tasks The Software and Executable in the CBP enabling IaaS execution should be defined in the DCI Bridge Following Day 2’s hands-on these are: – Software: „Wrapper XY 1.0” – Executable: „Wrapper XY 1.0 guse_wrapper.sh”

IaaS – Workflow node configuration Set „Type” to „cloudbroker”, and „Name” to the CBP service to be used Click „Enable own executable” Afterwards, select Software, Executable, Resource, Region and Instance type for your job A cost estimate is displayed as well (note: no cost is assigned to using the Resource below)

IaaS – Data cost estimate Depending on the selected resource, the data fee is displayed as well (note: no cost is assigned to using the Storage below)

Generic user tasks – Workflow cost estimate Once the workflow is fully configured, estimated cost can be calculated on-demand Simply click „Refresh” below the WF graph

Generic user tasks – Workflow submission Once the workflow is ready, click „Submit” to submit a workflow instance After the workflow has been submitted, you can check its progress as usual

Generic user tasks – Workflow cost display Cost of individual jobs can be checked Overall workflow cost can be checked as well

Security aspects CloudBroker entity (Resource, Software) visibility: – Private: only the user who defined the entity + admins can use it – Protected: users of the organization where the defining user belongs to + admins can use it – Public: every user of the CloudBroker Platform service can use it Robot certificates: – Can be assigned to CloudBroker jobs – Take care (EGI VO Portal Policy): Enable only for the SaaS model, or Enable for IaaS model, but do not allow the users to upload their executables