K-WfGrid: Grid Workflows with Knowledge Ladislav Hluchy II SAS, Slovakia

EGEE User Forum, March 2006K-Wf Grid Project - IST Contents  Project consortium  Objectives and architecture  Workflow construction and refinement  Monitoring infrastructure  Ontologies for knowledge management  Knowledge assimilation  Knowledge sharing between users  Pilot applications Flood prediction Flood prediction Testbed Testbed

EGEE User Forum, March 2006K-Wf Grid Project - IST Partners  Fraunhofer FIRST (Berlin, Germany)  UIBK (Innsbruck, Austria)  IISAS (Bratislava, Slovak Republic)  CYFRONET (Cracow, Poland)  LogicDIS S.A. (Athens, Greece)  Softeco Sismat SpA (Genoa, Italy)

EGEE User Forum, March 2006K-Wf Grid Project - IST K-WfGrid Consortium K-WfGrid Consortium Bratislava Athens Genova Kraków Innsbruck Berlin

EGEE User Forum, March 2006K-Wf Grid Project - IST K-Wf Grid: Objectives  Objectives of K-Wf grid To enable users to create complex workflows and use grid resources without detailed knowledge of grid To enable users to create complex workflows and use grid resources without detailed knowledge of grid To construct workflows optimized for underlying infrastructure, using its advantages and avoiding its bottlenecks To construct workflows optimized for underlying infrastructure, using its advantages and avoiding its bottlenecks To (semi-)automatically construct workflows based on user’s requirements, using semantic annotation of services, data, applications and resources To (semi-)automatically construct workflows based on user’s requirements, using semantic annotation of services, data, applications and resources To constantly renew information about the grid by using complex monitoring network – to learn from experience To constantly renew information about the grid by using complex monitoring network – to learn from experience To provide simple, easy-to-use interface to K-Wf Grid services To provide simple, easy-to-use interface to K-Wf Grid services

EGEE User Forum, March 2006K-Wf Grid Project - IST K-Wf Grid: Advantages  Composition of workflow from a set of services System composes the workflow for you – just tell him what you want to get at the end System composes the workflow for you – just tell him what you want to get at the end System uses services which are available at the time and which are expected (based on past experience) to provide good results (good = what you want) System uses services which are available at the time and which are expected (based on past experience) to provide good results (good = what you want)  Usability Less grid language, more application domain language Less grid language, more application domain language Integrated collaboration interfaces Integrated collaboration interfaces  Reuse of components K-Wf Grid is based on respected standards K-Wf Grid is based on respected standards

EGEE User Forum, March 2006K-Wf Grid Project - IST K-Wf Grid: Concept Execute workflow Capture knowledge Reuse knowledge Monitor environment Analyze information Construct workflow

EGEE User Forum, March 2006K-Wf Grid Project - IST Process of Workflow Refinement Web Service Classes Web Service Operations Abstract Operation Grid Resources User Request “ ” “I want this data” “ ” “There is my data!”

EGEE User Forum, March 2006K-Wf Grid Project - IST User Interfaces  Service interfaces WSRF or WS application services, using standard implementations (GT4, Apache Axis) WSRF or WS application services, using standard implementations (GT4, Apache Axis) Middleware is mostly WS services, deployable as stand-alone components with defined interfaces Middleware is mostly WS services, deployable as stand-alone components with defined interfaces  Portal interface Workflow construction and execution Workflow construction and execution Knowledge management Knowledge management User collaboration User collaboration Data management Data management Monitoring visualization Monitoring visualization

EGEE User Forum, March 2006K-Wf Grid Project - IST Workflow Management Interface  Workflow management interface Applet for workflow visualization Applet for workflow visualization Portlet (right side) for workflow information display Portlet (right side) for workflow information display

EGEE User Forum, March 2006K-Wf Grid Project - IST Knowledge Management  Knowledge management You may view, add, modify knowledge which is used in workflow composition You may view, add, modify knowledge which is used in workflow composition

EGEE User Forum, March 2006K-Wf Grid Project - IST File Management  File management Locate files by their attributes (metadata) Locate files by their attributes (metadata) Download/upload files, modify attributes Download/upload files, modify attributes

EGEE User Forum, March 2006K-Wf Grid Project - IST  User Assistant Agent allows collaboration among users  Knowledge Sharing and Recommendation  User Problem specification  Representation of Experience or Knowledge with text notes Information Sharing Current Research:  Experience (Knowledge) Management  Knowledge, Semantic, Ontologies  Text Processing & Semantic Annotation  User Interaction  Knowledge Relevance, Problem detection  Proactive knowledge provision  Works with any domain ontology

EGEE User Forum, March 2006K-Wf Grid Project - IST K-Wf Grid: Standards  WSRF interfaces to application services Globus Toolkit 4 implementation Globus Toolkit 4 implementation  Web Services – applications and middleware  JSR-168 – user interface portlets We develop reusable portlets We develop reusable portlets  XML Workflow definition language (GWorkflowDL) is a XML language, with open schema Workflow definition language (GWorkflowDL) is a XML language, with open schema Monitoring information and events are transported as XML-structured data, with open schema Monitoring information and events are transported as XML-structured data, with open schema

EGEE User Forum, March 2006K-Wf Grid Project - IST Pilot applications (PAs)  PAs as domain-related instances of a typical K-Wf Grid-based application system Common horizontal features / Specific vertical customization Common horizontal features / Specific vertical customization  Flood Forecasting Simulation Cascade (FFSC, PA1)  Enterprise Resource Planning (ERP, PA2)  Coordinated Traffic Management (CTM, PA3)  Focus on specific aspects demonstration of K-Wf Grid solutions and value added demonstration of K-Wf Grid solutions and value added enhancement of functionalities enhancement of functionalities system testing & validation system testing & validation real end users’ active involvement and contribution real end users’ active involvement and contribution  production of dissemination material

EGEE User Forum, March 2006K-Wf Grid Project - IST PA1 – FFSC  Flood Forecasting Simulation Cascade a cascade of simulation models for weather forecasting, hydrological and hydraulic simulations, able to produce predictions of possible floods in target areas a cascade of simulation models for weather forecasting, hydrological and hydraulic simulations, able to produce predictions of possible floods in target areas  Input – map of area, precipitation, river water level etc.  Output – water flow in target area  Suggestions / user support – applicability of different models to specific scenarios (QoS) – comparison between stored predictions and real data – future dispersion forecasting

EGEE User Forum, March 2006K-Wf Grid Project - IST Flood Forecasting Application (PA1-FFSC)  Flood forecasting based on a series of simulations  Several simulation models for Meteorology Meteorology Hydrology Hydrology Hydraulics Hydraulics  2D/3D visualization  Implementation using GT4 WSRF  Being extended More models More models More services – towards risk management More services – towards risk management

EGEE User Forum, March 2006K-Wf Grid Project - IST PA1 – FFSC + K-Wf Grid  Improvement of application reliability Creation of a Grid of modular (scalable) dedicated Web Services Creation of a Grid of modular (scalable) dedicated Web Services  General improvement of performances CPU time-demanding meteorological and hydraulic simulation models CPU time-demanding meteorological and hydraulic simulation models gigabytes/month transferred and stored datasets gigabytes/month transferred and stored datasets  Knowledge management support multi-user, extensible multi-module system (with potentially tens of thousands of existing datasets) needing sophisticated collaboration tools to enable cooperation in a multidisciplinary context multi-user, extensible multi-module system (with potentially tens of thousands of existing datasets) needing sophisticated collaboration tools to enable cooperation in a multidisciplinary context

EGEE User Forum, March 2006K-Wf Grid Project - IST Future Plans  More usable interface Workflow management applet will display “nicer”, better readable workflows Workflow management applet will display “nicer”, better readable workflows Data management will be better integrated into knowledge and workflow management interfaces Data management will be better integrated into knowledge and workflow management interfaces Integration of user assistance (display of context-related notes) into collaboration tools Integration of user assistance (display of context-related notes) into collaboration tools Interface customized to user’s needs Interface customized to user’s needs Voting on notes (in User Assistant Agent) Voting on notes (in User Assistant Agent)  Stable release of middleware  Easier application integration Manuals - how to describe your application, so K-Wf Grid can compose workflows for you Manuals - how to describe your application, so K-Wf Grid can compose workflows for you Service discovery Service discovery

Thank you! Ladislav Hluchy II SAS, Slovakia