From P-GRADE to SCI-BUS Peter Kacsuk, Zoltan Farkas and Miklos Kozlovszky MTA SZTAKI - Computer and Automation Research Institute of the Hungarian Academy of Sciences

2 Content 1.P-GRADE 2.WS-PGRADE & gUSE in a nutshell 3.Basic and new services 4.Case studies 5.SCI-BUS 6.How to access

3 P-GRADE Portals around the globe National Grid portals (UK, Ireland, Croatia, Turkey, Spain, Belgium, Malaysia, Kazakhstan, Switzerland, Australia, ClGrid, etc.) HP-SEE/SEE-GRID-SCI, BalticGrid US Open Science Grid, TeraGrid IDGF (International Desktop Grid Federation) SHIWA Simulation Platform Economy-Grid, Swiss BioGrid, Bio és Biomed Virtual Organisations, MathGrid, etc. HP-SEE

4 P-GRADE Portal software family P-GRADE Portal 2.4 NGS P-GRADE portal P-GRADE Portal 2.5 P-GRADE Portal 2.8 P-GRADE Portal WS-PGRADE Portal 3.1 WS-PGRADE Portal 3.2 GEMLCA Grid Legacy Code Arch. GEMLCA, storage concepts Basic concepts WS-PGRADE Portal 3.3 P-GRADE Portal 2.10 Open source from 2008 stats: 2011

5 Motivations of creating gUSE To overcome (most of) the limitations of P-GRADE portal: To provide better modularity  to replace any service To improve scalability  to millions of jobs To enable advanced dataflow patterns To interface with wider range of resources To separate Application Developer view from Application User view WS-PGRADE (Web Services Parallel Grid Runtime and Developer Environment) and gUSE (Grid User Support Environment) architecture

6 gUSE and WS-PGRADE architecture Graphical User Interface: WS-PGRADE Workflow Engine Workflow storage File storage Application repository Logging gUSE information system Submitters Gridsphere  LIFERAY Large set of portlets Autonomous Services: high level middleware service layer Resources: middleware service layer Local resources, service grid VOs, Desktop Grid resources, Web services, Databases gUSE Meta-broker Submitters File storage Submitters

7 WS-PGRADE/gUSE Creating complex workflow and parameter sweeps Seamless access to various types of resources clusters, service grids, desktop grids, databases. Scalable architecture Advanced data-flows and workflow concept Creating complex applications using embedded workflows, legacy codes Comfort features Separated views for application developers and end-users Community components from workflow repository

8 WS-PGRADE in a nutshell General purpose, workflow-oriented portal. Supports the development and execution of workflow-based applications Based on Liferay Services supported by the portal: New functionalities Web services DB connectors Embedded workflows Job level PS Conditional jobs Recursive graph Multi-generator Multi-collector CROSS product PS DOT product PS Simultaneous use of various clusters, service and desktop Grids at workflow level Basic ServicesEGEE grids (LCG2,GLite) Globus grids (GT2,GT4) Desktop grids clusters Job execution File storage Certificate management Information system Brokering Job monitoring Workflow & job visualization

9 WS-PGRADE in European and national projects CancerGrid (EU FP6) ProSim (UK) EDGeS and EDGI (EU FP7) MosGrid (D-Grid) Swiss Proteomics Portal HP-SEE (EU FP7) SHIWA (EU FP7) SCI-BUS (EU FP7)

10 The CancerGrid portal for anti-cancer drug research Workflow development & configuration Algorithms configuration Workflow execution Molecule database browser Integrated components of CancerGrid portal Structure viewer

11 Creating multi-workflow applications and executing them in the multi-middleware SHIWA VO SHIWA Simulation Platform v1 (P-GRADE) and v2 (WS-PGRADE) SHIWA RepositorySHIWA Portal WF1 e-scientist SHIWA Science Gateway invoke WE GEMLCA Service WFn WE1WEp search WF GEMLCA Repository edit WF WE + WF WF1WFm GEMLCA with GIB s1 s2 s3 s5 s2 s4 WF list PGRADE Workflow engine PGRADE Workflow editor gLite DCI MOTEUR WE GWES WE Globus DCI pre-deployed- WEs MOTEUR WE Kepler WE Taverna WE Triana WE local cluster ASKALON WE SHIWA VO ASKALON WE GEMLCA admin

12 WS-PGRADE and SCI-BUS P-GRADE and WS-PGRADE has been developed in the framework of EU and Hungarian projects This tradition will be followed in SCI-BUS The major goals: To further develop WS-PGRADE/gUSE To develop customization methodology To create production gateways both Generic-purpose gateways for NGIs Customized gateways for at least 17 user communities

14 Portal Access Portal related information Access to multi-grid environment WS-PGRADE/gUSE portal For application porting GASUC (Grid Appl. Support Centre) success stories Interoperable workflow and DCI support SHIWA Simulation platform GASUC

15 Thank you for your attention! Questions?