1. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 Science Gateways and Clouds Dr. Wibke Sudholt CloudBroker GmbH Technoparkstrasse 1, CH-8005 Zurich, Switzerland Phone: +41 44 633 79 34 Email: wibke.sudholt@cloudbroker.com Web: http://www.cloudbroker.comwibke.sudholt@cloudbroker.comhttp://www.cloudbroker.com

2. © CloudBroker GmbH All rights reserved. Presentation Outline Cloud computing Science gateways CloudBroker Platform SCI-BUS project GaaS = Gateway as a Service 20.09.2012 / EGI Technical Forum 2012 2

3. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 Cloud Computing

4. © CloudBroker GmbH All rights reserved. Cloud Definition Self service: Access to computer resources on demand, without much initial investment in time, money or expertise Pay per use: Only pay for what you actually use in small steps, OpEx instead of CapEx, micropayments Scalability: Nearly unlimited elasticity, grow and shrink the resource size upon request ⇒ Not only change in technology, but change in business model ⇒ Interface between providers and users set at the right place 20.09.2012 / EGI Technical Forum 2012 4

5. © CloudBroker GmbH All rights reserved. Cloud Services 20.09.2012 / EGI Technical Forum 2012 5 Scientific / office / business / etc. applications Salesforce, Google Apps, etc. SaaS = Software as a Service Programming / deployment frameworks, distribution / messaging / monitoring systems, databases, etc. Google App Engine, Windows Azure, etc. PaaS = Platform as a Service Virtual machines, storage, network, etc. Amazon EC2 and S3, Rackspace, etc. IaaS = Infrastructure as a Service

6. © CloudBroker GmbH All rights reserved. Types of Clouds 20.09.2012 / EGI Technical Forum 2012 6 Private Clouds In-house or hosted Just for internal use Multi-tenant across organization sites, departments, groups and users Focus on self- service and accountability Hybrid Clouds Mixture of public and private clouds Focus on scalability and failover Public Clouds Offered by partner organizations or cloud providers Available to certain external user communities or to everybody Multi-tenant across organizations Focus on on- demand and pay- per-use

7. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 Science Gateways

8. © CloudBroker GmbH All rights reserved. Gateway Description Portals to scientific applications for scientific end users, hiding the infrastructure complexity in the background Usually focus on a certain scientific domain, application area, geographic region, user group, organization or similar Front-ends might be web-based, client software, mobile apps, APIs, CLIs, etc. Back-ends are typically distributed computing infrastructures (DCIs) such as clusters, supercomputers, grids or clouds, but can also include sensors, etc. Additional functionalities such as data handling, workbenches, workflows, parameter sweeps, visualization, graphs, user management, community interaction, social media, publications, reporting, etc. Often have domain-specific functionalities such as naming, annotation and display of items, metadata, item connections, access to content databases, etc. Example scientific domains include molecular science, proteomics, medical imaging, astrophysics, seismology, rendering, etc. Example providers include academic institutes, scientific communities, research projects, NGIs, companies, etc. 20.09.2012 / EGI Technical Forum 2012 8

9. © CloudBroker GmbH All rights reserved. Gateway Architecture 20.09.2012 / EGI Technical Forum 2012 9 User Gateway Technology (Liferay, WS-PGRADE/gUSE, etc.) Science Gateway Applications, Databases DCIs Clusters, Supercomputers (SGE, PBS, LSF, etc.) Institutional Grids (Globus, UNICORE, etc.) Desktop Grids (BOINC, Condor, etc.) Clouds IaaS PaaS SaaS Public Private Public Private Public Private Visualization, Reporting Workflows, Parameter Sweeps Data Handling, Metadata User Management, Community

10. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 CloudBroker Platform

11. © CloudBroker GmbH All rights reserved. CloudBroker Platform Web-based application store for the deployment and execution of scientific and technical software in the cloud On demand, pay per use, browser / programmatic / command-line access, cross-domain Uses infrastructure as a service (IaaS) from resource providers Offers platform as a service (PaaS) for software vendors and software as a service (SaaS) for end users Easy to use, speeds up time to market, no need for own HPC infrastructure, OpEx instead of CapEx 20.09.2012 / EGI Technical Forum 2012 11

12. © CloudBroker GmbH All rights reserved. User Tools Java Client Library Platform Architecture 20.09.2012 / EGI Technical Forum 2012 12 CloudBroker Platform Amazon Cloud Open- Stack Cloud … Cloud Chemistry Appli- cations Biology Appli- cations Health Appli- cations Web Browser UI … Appli- cations REST Web Service API CloudBroker Integration End Users, Software Vendors, Resource Providers CLI Engineering Appli- cations IBM Cloud Euca- lyptus Cloud

13. © CloudBroker GmbH All rights reserved. Clouds and Applications Cloud Resources Use your own resources and/or resources offered by others Configuration in platform needed for own resources: – Instance types, regions, storages, prices Currently supported public clouds / storages: – Amazon EC2 / S3 – IBM SmartCloud Enterprise / Nirvanix Currently supported private clouds / storages: – OpenStack (via EC2 API) – Eucalyptus / Walrus Support in preparation: – OpenNebula Resources offered by CloudBroker: – Amazon EC2 / S3 – IBM SmartCloud Enterprise Application Software Use your own software on your own resources and/or software offered by others on resources offered by others Any batch-oriented Linux command-line application: – Multi-threading and MPI possible Configuration in platform needed for own software: – Executables, deployments, prices Auto-deployment with installation script: – Amazon EC2 – IBM SmartCloud Enterprise Software offered by CloudBroker: – BLAST, AutoDock, Gromacs, X! Tandem, OpenFOAM Also already ported: – Rosetta, TransAT, Siesta, T-Coffee, FoldX, R 20.09.2012 / EGI Technical Forum 2012 13

14. © CloudBroker GmbH All rights reserved. Platform Features Computations: – Job creation, submission and control – Data file upload and download – Automatic queuing, instance startup and shutdown, data transfer (via cloud storage) and fault tolerance – Pipeline jobs, archives and tagging Interfaces: – Web browser UI – REST web service API – Java client library – CLI Marketplace: – Platform usage surcharges as percentage of resource and software prices – Free resources and software have zero surcharges Further features: – Registration (with user check in public platform) – User authentication with email and password – SSL transport-layer encryption – Dashboard, activity logs – User and organization management – Different organization, user and visibility levels – Resource access and software license limits – Invoicing and billing, pre-payment or monthly payment – Documentation Platform flavors: – Public installation under https://platform.cloudbroker.com https://platform.cloudbroker.com – Also hosted and in-house installations offered 20.09.2012 / EGI Technical Forum 2012 14

15. © CloudBroker GmbH All rights reserved. Reference Examples Protein modeling with Rosetta (collaboration with ETH Zurich and IBM) Computational fluid dynamics web UI for TransAT (collaboration with ASCOMP and HSR) Platform node for KNIME (Konstanz Information Miner) workflow framework Access to clouds in SCI-BUS (SCIentific gateway Based User Support) EU FP7 project Further projects in industry, government and academia 20.09.2012 / EGI Technical Forum 2012 15

16. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 SCI-BUS Project

17. © CloudBroker GmbH All rights reserved. SCI-BUS Setup EU FP7 project http://www.sci-bus.eu Running 10/2011-09/2014 Consortium: – 15 partners from 10 countries (10 academic, 5 industrial) – 6 subcontractors – Additional associated partners (via MoU) Goals: – Provide researchers seamless access to major computing, data and networking infrastructures and services – Develop gateway technology – Support community gateways – Focus on scientific workflows Generic-purpose technologies: – WS-PGRADE/gUSE from MTA SZTAKI (see http://www.guse.hu and presentation of Zoltan Farkas in the morning)http://www.guse.hu – CloudBroker Platform Initial gateway communities: – Systems biology, computational chemistry, astrophysics, heliophysics, seismology, medicine, rendering, electronic document handling, business process optimization, SMEs, software testing SCI-BUS booth at EGI Technical Forum 2012: – CloudBroker Platform demo at 15:40 today 20.09.2012 / EGI Technical Forum 2012 17

18. © CloudBroker GmbH All rights reserved. SCI-BUS Architecture 20.09.2012 / EGI Technical Forum 2012 18 Source: SCI-BUS

19. © CloudBroker GmbH All rights reserved. WS-PGRADE/gUSE 20.09.2012 / EGI Technical Forum 2012 19 Source: http://www.guse.hu/?m=architecture&s=0http://www.guse.hu/?m=architecture&s=0

20. © CloudBroker GmbH All rights reserved. CloudBroker Platform Integration in WS-PGRADE/gUSE Method: – Use of the CloudBroker Platform Java client library Existing features: – CloudBroker DCI Bridge backend plugin and configuration interface – CloudBroker security portlet – Concrete workflow portlet extension for CloudBroker jobs Upcoming features: – Support for running any kind of application via wrapper script – Display of prices, costs and invoices – Different types of user mapping 20.09.2012 / EGI Technical Forum 2012 20 Source: Zoltan Farkas, MTA SZTAKI

21. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 GaaS = Gateway as a Service

22. © CloudBroker GmbH All rights reserved. Gateway Sustainability Over time, science gateways need to become sustainable It does not make sense to offer a gateway if there is not enough user interest in it There are more and more moves towards also metering and billing academic services Many governments don’t have enough money for large CapEx anymore and thus prefer stepwise OpEx Sponsors are hard to attract to science gateways Not always gateways can be outsourced or a spin-off company generated from them ⇒ Base government funding to build, operate and support science gateways is needed ⇒ Beyond that, apply the cloud business model to science gateways 20.09.2012 / EGI Technical Forum 2012 22

23. © CloudBroker GmbH All rights reserved. Gateway Business Models Build science gateways from cloud building blocks (model used in the CloudBroker Platform and SCI-BUS) Charge for not freely accessible resource consumption and application usage (model used in the CloudBroker Platform and SCI- BUS) Have a freemium model with extra charges for additional services (model used in the CloudBroker Platform and SCI-BUS) Offer user subscriptions with different features Let commercial and other external users pay for gateway services Have a shareholder charge-back model Provide professional consulting, training and support ⇒ Develop your own business model 20.09.2012 / EGI Technical Forum 2012 23

24. SCI-BUS is supported by the FP7 Capacities Programme under contract no. RI-283481 Thank you! – Questions? Try out the CloudBroker Platform under https://platform.cloudbroker.com https://platform.cloudbroker.com Visit SCI-BUS under http://www.sci-bus.eu http://www.sci-bus.eu