EC-project number: 027446 ViroLab Virtual Laboratory Marian Bubak ICS / CYFRONET AGH Krakow virolab.cyfronet.pl.

Slides:



Advertisements
Similar presentations
Polska Infrastruktura Informatycznego Wspomagania Nauki w Europejskiej Przestrzeni Badawczej Institute of Computer Science AGH ACC Cyfronet AGH The PL-Grid.
Advertisements

OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Scientific Workflow Support in the PL-Grid Infrastructure with HyperFlow Bartosz Baliś, Tomasz Bartyński, Kamil Figiela, Maciej Malawski, Piotr Nowakowski,
CGW 2009 Vine Toolkit A uniform access and portal solution to existing grid middleware services P.Dziubecki, T.Kuczynski, K.Kurowski, D.Szejnfeld, D.Tarnawczyk,
Polish Infrastructure for Supporting Computational Science in the European Research Space GridSpace Based Virtual Laboratory for PL-Grid Users Maciej Malawski,
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
Dagstuhl, February 16, 2009 Layers in Grids Uwe Schwiegelshohn 17. Februar 2009 Layers in Grids.
Workflows Information Flows Prof. Silvia Olabarriaga Dr. Gabriele Pierantoni.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
Towards auto-scaling in Atmosphere cloud platform Tomasz Bartyński 1, Marek Kasztelnik 1, Bartosz Wilk 1, Marian Bubak 1,2 AGH University of Science and.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Towards scalable, semantic-based virtualized storage.
Seamless Medical Image Processing on the Grid on the Example of Segmentation and Partition of the Airspaces Andrzej Rutkowski 1, Michał Chlebiej 1, Marcelina.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Environment for Management of Experiments on the Grid Master of Science Thesis AGH University of Science and Technology, Krakow, Poland Faculty of Electrical.
CGW 2003 Institute of Computer Science AGH Proposal of Adaptation of Legacy C/C++ Software to Grid Services Bartosz Baliś, Marian Bubak, Michał Węgiel,
Security in Virtual Laboratory System Jan Meizner Supervisor: dr inż. Marian Bubak Consultancy: dr inż. Maciej Malawski Master of Science Thesis.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
Recording application executions enriched with domain semantics of computations and data Master of Science Thesis Michał Pelczar Krakow,
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
A DΙgital Library Infrastructure on Grid EΝabled Technology ETICS Usage in DILIGENT Pedro Andrade
T.Jadczyk, Bioinformatics Applications in the Virtual Laboratory Bioinformatics Applications in the Virtual Laboratory Tomasz Jadczyk AGH University of.
Cracow Grid Workshop, October 27 – 29, 2003 Institute of Computer Science AGH Design of Distributed Grid Workflow Composition System Marian Bubak, Tomasz.
London e-Science Centre GridSAM Job Submission and Monitoring Web Service William Lee, Stephen McGough.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Experience with the OpenStack Cloud for VPH Applications Jan Meizner 1, Maciej Malawski 1,2, Piotr Nowakowski 1, Paweł Suder 1, Marian Bubak 1,2 AGH University.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
DataNet – Flexible Metadata Overlay over File Resources Daniel Harężlak 1, Marek Kasztelnik 1, Maciej Pawlik 1, Bartosz Wilk 1, Marian Bubak 1,2 1 ACC.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Rochester Institute of Technology Cyberaide Shell: Interactive Task Management for Grids and Cyberinfrastructure Gregor von Laszewski, Andrew J. Younge,
EC-project number: Universal Grid Client: Grid Operation Invoker Tomasz Bartyński 1, Marian Bubak 1,2 Tomasz Gubała 1,3, Maciej Malawski 1,2 1 Academic.
AKOGRIMO Integration of Grid services with mobile technologies; validation in e-health, e-learning and disaster management areas CoreGRID European Grid.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1 The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI Towards Environment.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE User Forum, Manchester, 10 May ‘07 Nicola Venuti
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Federating PL-Grid Computational Resources with the Atmosphere Cloud Platform Piotr Nowakowski, Marek Kasztelnik, Tomasz Bartyński, Tomasz Gubała, Daniel.
Approaching Fine-grain Access Control for Distributed Biomedical Databases within Virtual Environments Onur Kalyoncu, Yi Pan, Matthias Assel High Performance.
Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
K-WfGrid: Grid Workflows with Knowledge Ladislav Hluchy II SAS, Slovakia.
Collection and storage of provenance data Jakub Wach Master of Science Thesis Faculty of Electrical Engineering, Automatics, Computer Science and Electronics.
December, 2006 ws-VLAM Workflow Management System a Re-factoring of VLAM Dmitry Vasyunin Adianto Wibisono Adam Belloum.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
Support for Taverna Workflows in VPH-Share Cloud Platform Marek Kasztelnik 1, Marian Bubak 2,1, Maciej Malawski 2,1, Piotr Nowakowski 1, Ernesto Coto 3,
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Overview on the work performed during EPIKH Training Faiza MEDJEK /INFN, CATANIA 1.
PLG-Data and rimrock Services as Building
Demo of the Model Execution Environment WP2 Infrastructure Platform
Demo of the Model Execution Environment WP2 Infrastructure Platform
Model Execution Environment Current status of the WP2 Infrastructure Platform Marian Bubak1, Daniel Harężlak1, Marek Kasztelnik1 , Piotr Nowakowski1, Steven.
From VPH-Share to PL-Grid: Atmosphere as an Advanced Frontend
Model Execution Environment for Investigation of Heart Valve Diseases
June 1, 2008 Michael Erdmann, Peter Haase, Holger Lewen, Rudi Studer
A Collaborative Environment Allowing Clinical Investigations on Integrated Biomedical Databases Matthias Assel HealthGrid 2009.
DICE - Distributed Computing Environments Team
Similarities between Grid-enabled Medical and Engineering Applications
PROCESS - H2020 Project Work Package WP6 JRA3
Knowledge Based Workflow Building Architecture
High Performance Computing Center – HLRS
The ViroLab Virtual Laboratory for Viral Diseases
Presentation transcript:

EC-project number: ViroLab Virtual Laboratory Marian Bubak ICS / CYFRONET AGH Krakow virolab.cyfronet.pl

CGW’07, Krakow, Poland, 17 October 2007 Outline ViroLab applications and users Structure of the virtual laboratory Challenges Team

CGW’07, Krakow, Poland, 17 October 2007 Classes of Users Experiment developer (scientific programmer) –Plans a ViroLab experiment using the VLvl development tools –Knows both how to script an experiment and the modelled domain –May develop dedicated UI for an experiment user Experiment user (research-oriented user, scientist) –Uses prepared experiment to gather scientific results (via Portal) –Results may be shared with others using collaboration tools –Results provenance could be tracked and recorded –Results may be stored in ViroLab Laboratory Database Medical User (clinical virologists) –Interested mainly in meta DSS drug ranking system –Uses dedicated web GUI (inside ViroLab Portal) –The system may use some ViroLab applications (Binding Affinity Calculator, rule mining,...) to provide better support over time, but not in automatic way

CGW’07, Krakow, Poland, 17 October 2007 Generic Use Cases

CGW’07, Krakow, Poland, 17 October 2007 Requirements Mechanisms for user-friendly experiment creation and execution – an integrated development/execution environment Possibility of reusing existing libraries, tools etc. Gathering and exposing provenance information Integration of geographically-distributed data resources Access to WS, WSRF, MOCCA components and jobs Secure access to data and applications

CGW’07, Krakow, Poland, 17 October 2007 Overview of Workflow Systems and Virtual Laboratories Virtual LaboratoryApp constructionMiddleware Kepler Drag&DropPtolemy II, Globus Toolkit, WS Triana Drag&DropGlobus Toolkit, GAT myGrid, Taverna Drag&DropGlobus Toolkit, WS Geodise Matlab scriptsComputational Toolbox, Jython, WS, Java CoG (1.1), GT2 NESSgrid webpage with tools Globus Toolkit, WS VL-e Drag&DropGlobus Toolkit, SoapLab VL PSNC JWS apps, batch jobsGlobus Toolkit, GAT Conclusions: There is no solution that fulfills all ViroLab requirements Many useful ideas have already been implemented and ViroLab vl reuses them (in semantic modeling, tool registry, provenance tracking etc.) Using a scripting language for creating scripts has turned out to be useful (Geodise) and it is the best solution for ViroLab users

CGW’07, Krakow, Poland, 17 October 2007 Virtual Laboratory layers Experiment developer Scientist Clinical Virologist Experiment Planning Environment Experiment scenario ViroLab Portal Virtual Laboratory runtime components (Required to select resources and execute experiment scenarios) Computational services (WS, WSRF, components, jobs) Data services (DAS data sources, standalone databases) Grids (EGEE), Clusters, Computers, Network Users Interfaces Runtime Services Infrastructure Drug Ranking Scenario

CGW’07, Krakow, Poland, 17 October 2007 Architecture of ViroLab virtual lab

CGW’07, Krakow, Poland, 17 October 2007 Status of ViroLab virtual lab

CGW’07, Krakow, Poland, 17 October 2007 Available Experiments Developing (planning) a new experiment From virus genotype to drug resistance Provenance information about experiments Drug Resistance System based on the Retrogram set of rules Data mining and classification with Weka...

CGW’07, Krakow, Poland, 17 October 2007 Scientific Challenges Development of collaborative, multidisciplinary applications –Abstract layer to hide technological changes –Semantic description of applications –Integration of provenance recording and tracking –A new method of collaborative application development Constructing the virtual laboratory –Semantic description of resources –Deployment on available Grid systems, clusters, and single CEs –Integration of technologies: WS, WSRF, components, jobs –Secure data access and integration –Virtual laboratory as a complex system (formal description, modeling, analysis,...) –Software engineering aspects –Exploitation of modern IT technologies

CGW’07, Krakow, Poland, 17 October 2007 Technologies 1/2 GridSphere as the user portal Compliant with widely accepted portlet standards Many portlets already available Eclipse RCP as the developer UI Tool of choice of many software developers (including ViroLab consortium) Industry standard with a large number of available plug-ins, extensions JRuby for experiment planning Powerful standard library combined with simple, easy to learn syntax Enables smooth integration with existing Java software (including Grid software)

CGW’07, Krakow, Poland, 17 October 2007 Technologies 2/2 Middleware WS (for simple, stateless services with blocking calls) MOCCA (for stateful components and asynchronous calls) WSRF and Grid job submission support OGSA-DAI for data sources integration Well-developed, quite stable and under standardization process by OGF OWL, Jena, eXist for ontology storage and processing of semantically-rich provenance data Popular tools for ontology modelling GEMINI, Ganglia and JMX for experiment and infrastructure monitoring Standard, generic and extendable solutions

CGW’07, Krakow, Poland, 17 October 2007 The Team –WP3 leader: Marian Bubak –Task 3.1 Runtime Tomasz Gubala, Marek Kasztelnik, Piotr Nowakowski –Task 3.2 Collaboration Tools Alfredo Tirado –Task 3.3 Data Access Stefan Wesner, Matthias Assel, Aenne Loehden, Bettina Krammer –Task 3.4 Provenance Bartosz Balis, Jakub Wach, Michal Pelczar –Task 2.2 Middleware Maciej Malawski, Tomasz Bartynski, Eryk Ciepiela, Joanna Kocot, Iwona Ryszka, Katarzyna Rycerz –Task 2.3 Presentation Wlodzimierz Funika, Piotr Pegiel, Dariusz Krol

CGW’07, Krakow, Poland, 17 October 2007 More ViroLab Project web site ViroLab Virtual Laboratory description, demos, downloads,... virolab.cyfronet.pl ViroLab Session at CGW’07