SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481 Improving the Swiss Grid Proteomics Portal Peter Kunszt, Lorenz Blum,

Slides:



Advertisements
Similar presentations
P-GRADE and WS-PGRADE portals supporting desktop grids and clouds Peter Kacsuk MTA SZTAKI
Advertisements

WS-PGRADE: Supporting parameter sweep applications in workflows Péter Kacsuk, Krisztián Karóczkai, Gábor Hermann, Gergely Sipos, and József Kovács MTA.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Lower costs and improve predictability Automation Enable service owners to focus on work that adds business value Reduce error-prone manual activities.
Integrate into existing systems with PowerShell integration modules Extend by building PS modules to enable integrating into other systems Optimize.
EXTENDING SCIENTIFIC WORKFLOW SYSTEMS TO SUPPORT MAPREDUCE BASED APPLICATIONS IN THE CLOUD Shashank Gugnani Tamas Kiss.
What’s New in WatchGuard SSL v3.1. WatchGuard Training 2 Ease-of-Use Security Scalability 1.Streamlined resource configuration 2.Centralized access rules.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
SyBIT Tools for SystemsX.ch Ela Hunt and Peter Kunszt, SyBIT, SystemsX.ch, ETH Zurich {ela.hunt, SystemsX.ch is a consortium.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI WS-PGRADE/gUSE Supporting e-Science communities in Europe Zoltan Farkas.
Apache Airavata GSOC Knowledge and Expertise Computational Resources Scientific Instruments Algorithms and Models Archived Data and Metadata Advanced.
W EB - BASED B IOINFORMATICS P IPELINES FOR B IOLOGISTS Integrative Services for Genomic Analysis (ISGA) Chris Hemmerich Center for Genomics and Bioformatics.
Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University.
CloudBroker integration to WS- PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Cloud Usage Overview The IBM SmartCloud Enterprise infrastructure provides an API and a GUI to the users. This is being used by the CloudBroker Platform.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker Platform integration into WS-PGRADE/gUSE Zoltán Farkas MTA.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
iPortal Ease of use and scale-up of Workflows for Proteomics Analysis
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
1 EDIT 2013 User Interface Enhancements European Commission – Eurostat.
1 Developing domain specific gateways based on the WS- PGRADE/gUSE framework Peter Kacsuk MTA SZTAKI Start date: Duration:
GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Creating the Autodock gateway from WS-PGRADE/gUSE and making it cloud-enabled.
Introduction to WS-PGRADE and gUSE Tutorial Akos Balasko 04/17/
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
Framework of Job Managing for MDC Reconstruction and Data Production Li Teng Zhang Yao Huang Xingtao SDU
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Using SWARM service to run a Grid based EST Sequence Assembly Karthik Narayan Primary Advisor : Dr. Geoffrey Fox 1.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
1 P-GRADE Portal: a workflow-oriented generic application development portal Peter Kacsuk MTA SZTAKI, Hungary Univ. of Westminster, UK.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.
A PanDA Backend for the Ganga Analysis Interface J. Elmsheuser 1, D. Liko 2, T. Maeno 3, P. Nilsson 4, D.C. Vanderster 5, T. Wenaus 3, R. Walker 1 1: Ludwig-Maximilians-Universität.
Structural Biology on the GRID Dr. Tsjerk A. Wassenaar Biomolecular NMR - Utrecht University (NL)
1 The EDIT System, Overview European Commission – Eurostat.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no Workflow repository, user.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing Cloud Systems from WS-PGRADE/gUSE Zoltán Farkas MTA SZTAKI LPDS.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
1 SCI-BUS: building e-Science gateways in Europe: building e-Science gateways in Europe Peter Kacsuk and Zoltan Farkas MTA SZTAKI.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.
1 Further information and next steps Further information and next steps Gergely Sipos MTA SZTAKI
1 WS-PGRADE/gUSE generic DCI gateway framework for EGI user communities Zoltan Farkas and Peter Kacsuk MTA SZTAKI SCI-BUS is supported.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI MTA SZTAKI background for the DARIAH CC Zoltan Farkas MTA SZTAKI LPDS,
Supporting Big Data Processing via Science Gateways EGI CF 2015, November, Bari, Italy Dr Tamas Kiss, CloudSME Project Director University of Westminster,
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
The use of the SCMS-EMI as scientific gateway in BCC of NGI_UA Authors: Andrii Golovynskyi, Andrii Malenko, Valentyna Cherepynets V. Glushkov Institute.
SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Accessing cloud resources through the WS-PGRADE/gUSE and CloudBroker integrated.
Convert generic gUSE Portal into a science gateway Akos Balasko.
SCI-BS is supported by the FP7 Capacities Programme under contract nr RI Quality assurance in SCI-BUS project by applying agile testing practices.
Exposing WS-PGRADE/gUSE for large user communities Peter Kacsuk, Zoltan Farkas, Krisztian Karoczkai, Istvan Marton, Akos Hajnal,
Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,
FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.
Peter Kacsuk, Zoltan Farkas MTA SZTAKI
Data Bridge Solving diverse data access in scientific applications
WS-PGRADE for Molecular Sciences and XSEDE
Recap: introduction to e-science
Lightweight introduction
Lightweight introduction
MIK 2.1 DBNS - introduction to WS-PGRADE, 2013
Module 01 ETICS Overview ETICS Online Tutorials
Distributing META-pipe on ELIXIR compute resources
Network Analysis using Python
Introduction to the SHIWA Simulation Platform EGI User Forum,
Presentation transcript:

SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI Improving the Swiss Grid Proteomics Portal Peter Kunszt, Lorenz Blum, Béla Hullár, Emanuel Schmid, Adam Srebniak, Witold Wolski, Bernd Rinn, Franz-Josef Elmer, Chandrasekhar Ramakrishnan, Andreas Quandt and Lars Malmström

Introduction Life Sciences have become data intensive o Systems Biology has to deal with large amounts of mass spectrometry data SyBIT (part of SystemsX.ch initiative) provides data management support for laboratories o Build a web-based science gateway for data analysis at the Institute of Systems Biology (IMSB) at ETHZ. 2

System Setup 3 openBIS Data Storage Server Mass Spectrometry Instruments ETH Cluster openBIS WebUI Proteomics Portal

What happened so far… Built Swiss Grid Proteomics Portal in 2010, based on P-GRADE After initial phase feedback was collected Assembled requirements for next version 4

Problems/Requirements Grid accessibility o All jobs were submitted with the same credentials o Setup of Grid certificates too complex 5

Problems/Requirements Portal User Interface o Not intuitive enough (one large page) o Not flexible enough (parameters / parameter sets) o Lack of reference dataset management 6

Problems/Requirements Workflow development o Input/output handling, logging different for each tool o No simple way to prototype workflows outside P-GRADE infrastructure 7

2 nd edition: iPortal 8

Grid Acessibility new P-GRADE version (gUSE/WS-PGRADE) + first-time login popup to set up cluster resources Grid certificate handling still not solved 9

Portal UI gUSE is Liferay based -> simpler web development Workflow wizard o Better guidance, simplified UI o Simple to add more configuration options (number, text, selection) Workflow monitor o Compact UI o Simple "rescue" button 10

Workflow Wizard

openBIS

Workflow Wizard

ETH Cluster

Workflow Monitor

BioDB o "The BioDB project is about providing a synchronized distribution mechanism for public and secondary (derived) datasets all across Switzerland. " o Automatical update and distribution of reference databases like Swiss-Prot, SGD 17 BioDB Server

Workflow Development applicake o Each node gets one input parameter file executes a program validates the run creates one output parameter file, which is passed to the next node o Errors and log messages are standardized 18

Workflow Development Ruffus o Lightweight workflow engine Manages dependencies Parallel jobs Rescuing of failed workflows o Works well with applicake nodes o Simple DRMAA extension allows to use cluster 19

Summary New P-GRADE version for better cluster support Workflow Wizard & Monitor are (more) easy to use user interfaces BioDB for reference database handling Applicake to wrap execution of tools Ruffus to prototype workflows w/o portal 20

Outlook BioDB: Extend with personal databases Access to further infrastructure o Grid certificates o Public cloud access New workflows 21

Acknowledgements IMSB: Peter Kunszt, Béla Hullár, Emanuel Schmid, Adam Srebniak, Witold Wolski CISD: Bernd Rinn, Franz-Josef Elmer, Chandrasekhar Ramakrishnan IMSB: Andreas Quandt and Lars Malmström …you for your attention 22