14/11/11 Taverna Roadmap Shoaib Sufi myGrid Project Manager.

Slides:



Advertisements
Similar presentations
Pulan Yu School of Informatics Indiana University Bloomington Web service based Varuna.Net.
Advertisements

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Introduction to the BinX Library eDIKT project team Ted Wen Robert Carroll
A PPARC funded project AstroGrid Framework Consortium meeting, Dec 14-15, 2004 Edinburgh Tony Linde Programme Manager.
CACORE TOOLS FEATURES. caCORE SDK Features caCORE Workbench Plugin EA/ArgoUML Plug-in development Integrated support of semantic integration in the plugin.
IWay Service Manager 6.1 Product Update Scott Hathaway iWay Software Copyright 2010, Information Builders. Slide 1.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
UvA, Amsterdam June 2007WS-VLAM Introduction presentation WS-VLAM Requirements list known as the WS-VLAM wishlist System and Network Engineering group.
Aleksi Kallio CSC – IT Center for Science Chipster and collaboration with other bioinformatics platforms.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Windows.Net Programming Series Preview. Course Schedule CourseDate Microsoft.Net Fundamentals 01/13/2014 Microsoft Windows/Web Fundamentals 01/20/2014.
Provenance in my Grid Jun Zhao School of Computer Science The University of Manchester, U.K. 21 October, 2004.
CLARIN tools for workflows Overview. Objective of this document  Determine which are the responsibilities of the different components of CLARIN workflows.
January, 23, 2006 Ilkay Altintas
An Introduction to Designing and Executing Workflows with Taverna Aleksandra Pawlik University of Manchester materials by Dr Katy Wolstencroft and Dr Aleksandra.
Introduction to the Atlas Platform Mobile & Pervasive Computing Laboratory Department of Computer and Information Sciences and Engineering University of.
CIS 375—Web App Dev II Microsoft’s.NET. 2 Introduction to.NET Steve Ballmer (January 2000): Steve Ballmer "Delivering an Internet-based platform of Next.
Taverna and my Grid Basic overview and Introduction Tom Oinn
XML in Development of Distributed Systems Tooling Programming Runtime.
25/07/12 Input from Taverna team – slides by Shoaib Sufi Taverna – State of the nation.
Per Møldrup-Dalum State and University Library SCAPE Information Day State and University Library, Denmark, SCAPE Scalable Preservation Environments.
INFSO-RI Enabling Grids for E-sciencE Logging and Bookkeeping and Job Provenance Services Ludek Matyska (CESNET) on behalf of the.
Taverna and my Grid Open Workflow for Life Sciences Tom Oinn
Taverna Workflow. A suite of tools for bioinformatics Fully featured, extensible and scalable scientific workflow management system – Workbench, server,
A framework to support collaborative Velo: Knowledge Management for Collaborative (Science | Biology) Projects A framework to support collaborative 1.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
IT 456 Seminar 5 Dr Jeffrey A Robinson. Overview of Course Week 1 – Introduction Week 2 – Installation of SQL and management Tools Week 3 - Creating and.
Migrating Desktop The graphical framework for running grid applications Bartek Palak Poznan Supercomputing and Networking Center The.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Phase II Additions to LSG Search capability to Gene Browser –Though GUI in Gene Browser BLAST plugin that invokes remote EBI BLAST service Working set.
SDD/DFS R. Hook. VLT 2 nd Generation Instrumentation Pipelines, 18 Apr Richard Hook Sampo & ESO Reflex background, status and plans.
Taverna Workflows for Systems Biology Katy Wolstencroft School of Computer Science University of Manchester.
SCAP E SCAPE Project EU project aimed at building a scalable platform for planning and execution of computation intensive processes for ingestion or migration.
1 Taverna CISTIB Ernesto Coto Taverna Open Workshop, October 2014.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grid programming with components: an advanced COMPonent platform for an effective invisible grid © 2006 GridCOMP Grids Programming with components. An.
ModelPedia Model Driven Engineering Graphical User Interfaces for Web 2.0 Sites Centro de Informática – CIn/UFPe ORCAS Group Eclipse GMF Fábio M. Pereira.
Moby Web Services Iván Párraga García MSc on Bioinformatics for Health Sciences May 2006.
Stian Soiland-Reyes myGrid, School of Computer Science University of Manchester, UK UKOLN DevSci: Workflow Tools Bath,
11 CORE Architecture Mauro Bruno, Monica Scannapieco, Carlo Vaccari, Giulia Vaste Antonino Virgillito, Diego Zardetto (Istat)
6 February 2009 ©2009 Cesare Pautasso | 1 JOpera and XtremWeb-CH in the Virtual EZ-Grid Cesare Pautasso Faculty of Informatics University.
Migrating Desktop Bartek Palak Bartek Palak Poznan Supercomputing and Networking Center The Graphical Framework.
MyGrid/Taverna Provenance Daniele Turi University of Manchester OMII f2f Meeting, London, 19-20/4/06.
1 The EDIT System, Overview European Commission – Eurostat.
A Technical Overview Bill Branan DuraCloud Technical Lead.
PLANETS, OPF & SCAPE A summary of the tools from these preservation projects, and where their development is heading.
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
SHIWA Desktop Cardiff University, Budapest, 3 rd July 2012.
The 10 Best Practices for Workflow Design BioVeL M6 Workshop Göteborg, May 10-11, 2012 Kristina Hettne, Marco Roos (LUMC), Katy Wolstencroft, Carole Goble.
Activiti Dima Ionut Daniel. Contents What is Activiti? Activiti Basics Activiti Explorer Activiti Modeler Activiti Designer BPMN 2.0 Activiti Process.
INFSO-RI JRA2 Test Management Tools Eva Takacs (4D SOFT) ETICS 2 Final Review Brussels - 11 May 2010.
ICAT Status Alistair Mills Project Manager Scientific Computing Department.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
Taverna, myExperiment and HELIO services Anja Le Blanc Stian Soiland-Reyes Alan Willams University of Manchester.
The Taverna Software Suite Prof Carole Goble FREng FBCS CITP The University of Manchester, UK
Workflow and myGrid Justin Ferris IT Innovation Centre 7 October 2003 Life Sciences Grid GGF9.
SysML v2 Model Interoperability & Standard API Requirements Axel Reichwein Consultant, Koneksys December 10, 2015.
ECLIPSE RICH CLIENT PLATFORM Part 1 Introduction.
Exploring Taverna 2 Katy Wolstencroft myGrid University of Manchester.
Aleksandra Pawlik University of Manchester. Something that can be put into a workflow Well described - what the component does Behaves “well” - conforms.
Aleksandra Pawlik Alan Williams University of Manchester.
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
Open Governance Platform
An Introduction to Designing and Executing Workflows with Taverna
Alan Williams, Donal Fellows, Finn Bacall,
Continuous Automated Chatbot Testing
The Re3gistry software and the INSPIRE Registry
Module 01 ETICS Overview ETICS Online Tutorials
Google App Engine Ying Zou 01/24/2016.
Presentation transcript:

14/11/11 Taverna Roadmap Shoaib Sufi myGrid Project Manager

14/11/11 Sources of Influence  Projects  SCAPE – Digital preservation  BioVel – Biodiversity science  CA4LS – Next Generation Sequencing  Wf4ever – Workflow preservation Astronomy & Bioinformatics focus  e-Lico – Data mining – (Kidney function data)  NeISS – Social Simulation  Collaboration  IMPACT – Digital preservation  HELIO – Solar physics  Taverna - Galaxy – Bioinformatics  ViBRANT – Biodiversity  User communities  Super users requests (experts e.g. Andrea Wiggins)  User requests  Carole  Feedback from conference attendance  Developer community  What are other projects doing  Developer requests and contributions (integration)  Useful to do / take into account  Clouds  Semantic Web  Other promising or proven technologies

14/11/11 Taverna 2.3 Server Release 1 (November 2011)  Hardened, debugged and tested  Improved large input and output data handling  Security support  User authentication to the Server  Secure service invocation from inside workflows  Workflow run access control  Improved job management and accounting trails  Notification of workflow finishing using various mechanisms

14/11/11 Taverna 3  Why – Standards compliance (OSGi), aid reuse  Taverna 3 Platform OSGi beta and Command Line Tool (January 2012)  Re-engineering the Taverna Engine using OSGi  Support programmatic access to the Taverna Core  New Run/Execution Manager and Edits API  Embeddable in applications for executing workflows  Taverna 3 Platform OSGi and Command Line Tool (July 2012)  Stabilized and hardened  Plugin-enabled  Taverna 3 Platform OSGi and Workbench alpha (July 2012)  Based on the Taverna 3 Platform OSGi  Taverna 3 Platform OSGi and Server beta (July 2012)  Based on the Taverna 3 Platform OSGi

14/11/11 Draft Taverna 3 features  Better user-interaction during workflow run  - Improved interaction with visualizing tools and services  ‘Blackboard’ support  Improved workflow diagram  Mark as boring  More obvious looping & iteration strategy  Data  JSON related services (create, search, extract) (in 2.x also)  XML related service (create via templates) (in 2.x also)  Table support (structured objects)  Services  Choice of languages for in-workflow-programming via Java Scripting framework  A better ‘bean shell’ (e.g. python or other languages supported by JVM)  Components (semantically annotated workflows as pipeline steps)  - Components creation/deletion  - Components registry  Enhanced execution  Ability to change WSDL bindings  Intelligent re-run/resume of workflows (use results before error occurred)  Tarpit mitigation – i.e. XSD caching (2.x also)

14/11/11 Taverna 3 features continued …  Improved Provenance  More efficient provenance capture  More detailed provenance capture  Export of Provenance in OPM and W3 PROV serialisation  Research Object support  via SCUFL 2 Data bundle:  Workflow  Provenance  Data  In  Out  Intermediate  Manifest  Control flow  Branching support (if/else)  Better looping (explicit while)

14/11/11 Taverna 3 features continued(2) …  Domain specific support (from projects req’s)  Astronomy  VOTable visualisation support (Workbench)  VOTable local workers support (Engine)  Opens way for Table support +XML template use case  SAMP support (Workbench) local blackboard  Biodiversity  Asynchronous input support  Sensor data  Relevant to other instruments producing continuous data  Security  Single Sign On  Server  Pause/resume  Fine grained monitoring and feedback for a running workflow.  Where is it upto

14/11/11 SCUFL2 – the new workflow format  SCUFL2 Language Specification (January 2012)  Taverna workflow language specification more like SCUFL from Taverna 1.7.x to replace the current t2flow serialisation format  Easier for third party use  A packaged format with annotation support  SCUFL2 Tools beta (January 2012)  Tools for conversion from t2flow to SCUFL2  SCUFL2 Tools Release (July 2012)  A stabilised and fully tested version  Plugin for the Taverna Workbench 2.3  Plugin for the Taverna Server 2.3  Other SCULF2 tooling  workflows to Hadoop/MapReduce (SCAPE project)  Workflows to Wf4ever abstract workflow format  Processers and links (no activities) – Skeleton workflow  Conversion from abstract format to SCULF2 (won’t execute but act as template)

14/11/11 Cloudy with a chance of Taverna  Taverna Infrastructure Virtual Appliance  Taverna Server Virtual Machine (VM) (December 2011)  Including Taverna 2.3 Server and management interface  Amazon Machine Interface (AMI) (December 2011)  Including Taverna 2.3 Server and management interface

14/11/11 KISS – Taverna keeping it simple  (December 2011 alpha)  Web based interface  Connecting workflows  Hides complex iterations/looping/config in ‘components’  Build ‘component’ workflows in Taverna Workbench and then deploy in KISS  Simple install and one config file containing workflow definitions for a particular domain/instance  Uses Wireit  Will shortly have a Baclava data viewer  Alpha (uses command line)  Multi user support Q  Will use Taverna Server

14/11/11

Plugins  Data Mining plugin (December 2011)  Makes all the RapidMiner ( services available in Taverna  more than 500 operators for data integration and transformation, data mining, evaluation, and visualization  Automatic workflow building via metadata and goals  SPARQL plugin (2.x and 3)  Query RDF data sources (e.g Linked Data)