Ecological Niche Modelling in the EGI Cloud Federation

Slides:



Advertisements
Similar presentations
 Amazon Web Services announced the launch of Cluster Compute Instances for Amazon EC2.  Which aims to provide high-bandwidth, low- latency instances.
Advertisements

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
FIORANO SERVICE BUS The Cloud Enablement Platform
1/8 Enhancing Grid Infrastructures with Virtualization and Cloud Technologies Ignacio M. Llorente Business Workshop EGEE’09 September 21st, 2009 Distributed.
1 1 Hybrid Cloud Solutions (Private with Public Burst) Accelerate and Orchestrate Enterprise Applications.
Massimiliano Assante – Leonardo Candela – Donatella Castelli – Pasquale Pagano Fourteenth International Conference on Grey Literature An Environment Supporting.
Introduction to Cloud Computing
Dimitris Koureas, PhD Natural History Museum London Linking layers of biodiversity data: Informatics challenges for the long tail research RDA - Long Tail.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Interoperability Grids, Clouds and Collaboratories Ruth Pordes Executive Director Open Science Grid, Fermilab.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Cloud Interoperability & Standards. Scalability and Fault Tolerance Fault tolerance is the property that enables a system to continue operating properly.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Nov 22/26 Tech Forum 2015 Roberto Trinconi Cloud the New Path to the Business Leadership.
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware A Cloud Computing Methodology Study of.
Windows Azure poDRw_Xi3Aw.
Cloud Architecture. SPI Model Cloud Computing Classification Model – SPI Cloud Computing Classification Model – SPI - SaaS: (Software as a Service) -
1 TCS Confidential. 2 Objective : In this session we will be able to learn:  What is Cloud Computing?  Characteristics  Cloud Flavors  Cloud Deployment.
EGI Technical Forum Madrid COMPSs in the EGI Federated Cloud Daniele Lezzi – BSC EGI Technical Forum Madrid.
The EUBrazilOpenBio-BioVeL Use Case in EGI Daniele Lezzi, Barcelona Supercomputing Center EGI-TF September 2013.
Servizi di brokering Valerio Venturi CCR Giornata di formazione dedicata al Cloud Computing 6 Febbraio 2013.
Cloud interoperability and elasticity with COMPSs Federated Cloud F2F Jan , Amsterdam Daniele Lezzi – Barcelona Supercomputing Center.
An Open Data Platform in the framework of the EGI-LifeWatch Competence Centre Fernando Aguilar Jesús Marco
Open Data and Cloud Computing e-Infrastructure for Biodiversity Daniele Lezzi Barcelona Supercomputing Center International Workshop on Science Gateways.
EGI Technical Forum Madrid The EUBrazilOpenBio-BioVeL Use Case in EGI Daniele Lezzi – BSC EGI Technical Forum Madrid.
Daniele Lezzi Execution of scientific workflows on federated multi-cloud infrastructures IBERGrid Madrid, 20 September 2013.
Norman Morrison Senior Research Fellow, The University of Manchester Biodiversity Virtual e-Laboratory An e-Infrastructure and e-Science environment supporting.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
LOFAR - Calibration, Analysis and Modelling of Radio-Astronomy Data EGI Conference May 2015, Lisbon Daniele Lezzi – Barcelona Supercomputing.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
Support to user communities in EGI with COMPSs Federated Cloud F2F Jan , Amsterdam Daniele Lezzi – Barcelona Supercomputing Center.
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
Clouding with Microsoft Azure
PaaS services for Computing and Storage
Chapter 1 Characterization of Distributed Systems
Unit 3 Virtualization.
CLOUD ARCHITECTURE Many organizations and researchers have defined the architecture for cloud computing. Basically the whole system can be divided into.
New Paradigms: Clouds, Virtualization and Co.
Chapter 6: Securing the Cloud
Use of HLT farm and Clouds in ALICE
Clouds , Grids and Clusters
Joslynn Lee – Data Science Educator
Federated Cloud Computing
Population Imaging Use Case - EuroBioImaging
Supporting Research on Biodiversity: LifeWatch on the Cloud
IaaS Layer – Solutions for “Enablers”
INTAROS WP5 Data integration and management
StratusLab Final Periodic Review
StratusLab Final Periodic Review
Alexandre M.J.J. Bonvin MoBrain CC coordinator
DIRAC services.
Large scale modelling of the distribution
Tools and Services Workshop Overview of Atmosphere
The EGI Federated Cloud, architecture and use cases
Recap: introduction to e-science
Abstract Major Cloud computing companies have started to integrate frameworks for parallel data processing in their product portfolio, making it easy for.
Brief introduction to the project
EGI-Engage Engaging the EGI Community towards an Open Science Commons
Azure Lays the Path to Achieving Holistic App Performance Management, Cloud Optimization MINI-CASE STUDY “Microsoft Azure has allowed us to build a unified,
Cloud Computing Dr. Sharad Saxena.
Cloud Computing.
DARIAH Competence Centre: architecture and activity summary
LifeWatch Cloud Computing Workshop
Brandon Hixon Jonathan Moore
ELIXIR Competence Center
Cloud Computing: Concepts
Stakeholders consultation
A Research Data Catalogue supporting Blue Growth: the BlueBRIDGE case
GLENNA2 – The Nordic Cloud
Presentation transcript:

Ecological Niche Modelling in the EGI Cloud Federation Daniele Lezzi1, Roger Rafanell1, Francesc Lordan1, Renato De Giovanni2, Erik Torres3, Ignacio Blanquer3 1 Barcelona Supercomputing Center, Spain 2 Centro de Referência em Informação Ambiental, Brasil 3 Universitat Politecnica de Valencia, Spain Objectives This work describes the collaboration between EU-BrazilOpenBio and BioVeL projects in order to provide biodiversity community with a computational cloud infrastructure able to efficiently process Ecological Niche Modelling (ENM) workflows characterized by intensive computing requirements. The cloud-enabled ENM Service developed in EU-BrazilOpenBio, allows the execution of ENM workflows through the EU-BrazilOpenBio Gateway and through the Workflow Management System available in the BioVeL project. A new application, developed as part of EU-BrazilOpenBio, allows scientists to carry out complex experiments leveraging the openModeller environment and generating models for a large number of species, using complex modelling strategies and involving several algorithms and high-resolution environmental data. The application exploits the interoperability features of the VENUS-C COMPSs middleware aggregating computational resources available to the projects through the EGI Cloud Federation. An Infrastructure beyond Computing and Storage Resources EU-BrazilOpenBio is a collaborative initiative addressing strategic barriers in biodiversity research by integrating open access data and user-friendly tools widely available in Brazil and Europe. EU-BrazilOpenBio deploys a joint EU-Brazil cloud-based e-infrastructure that allows the sharing of hardware, software and data on-demand. Biodiversity scientists can use these open access resources and the applications developed by the project to conduct a wide range of conservation and research programmes. EU-BrazilOpenBio operates a Hybrid Data Infrastructure, i.e. a new type of Data Infrastructure specifically conceived to deal with data-intensive science. Such an infrastructure nicely integrates several technologies, infrastructures and information systems to enable a data-management-capability delivery model in which computing, storage, data and software are made available by the Infrastructure as-a-Service. Biodiversity Virtual e-Laboratory The BioVeL project is creating a set of workflows and Web Services for scientists to perform different analyses in the fields of ecology, taxonomy, phylogenetics and metagenomics. Each workflow is comprised by a number of tasks that can for example communicate with Web Services, interact with the end user or run other specific procedures. Tasks can be organized and connected in order to achieve a desired goal, exploiting data resources and tools and facilitating in-silico experiments. Some of the show cases being carried out as part of the project involve ecological niche modelling to help preventing species invasions and assessing the impact of climate changes. BioVeL workflows are created and managed with the myGrid suite of tools: Taverna, BioCatalogue and myExperiment. There are different ways in which a workflow can be run, including the Taverna Workbench Desktop environment and the TavernaLite Web interface. Taverna workbench Taverna Lite User communities Application #1 Application #2 Application #N Services Data Services Computing Services Management Services Existing Infrastructures Grids Clouds Clusters Data Sources VENUS-C HTCondor COMPSs gCube storage Usto.re Biodiversity VRE CoL GBIF EasyGrid AMS gHNs Taverna Server Service 1 Service 2 Service 3 The COMPSs framework An interoperable solution In order to provide BioVeL with a cloud enabled openModeller endpoint, the EUBrazilOpenBio ENM service is exposed through an extended openModeller Web Service interface (OMWS+ in the picture). Such interface in EUBrazilOpenBio supports multi-staging and multiparametric experiments implemented through COMPSs and the openModeller software and managed through a Virtual Research Environment (VRE) portal. The OMWS extensions are backwards compatible with the original specification, allowing existing clients, as the Taverna Workflow Management System in BioVeL, to be fully supported in the new implementation. An Experiment Orchestrator Service acts as dispatcher of user’s requests towards different infrastructures. In the case of the EGI Federated Cloud, the VENUS-C middleware is used to instantiate openModeller workflows on cloud resources. The COMPSs Workflow Orchestrator receives the execution requests and takes care of the execution of the openModeller pipelines on dynamically deployed virtual machines. An rOCCI connector is used for the VMs management while data management supports CDMI endpoints. OMWS+ Experiment Orchestrator Service VENUS-C Connector VENUS-C Cloud Middleware The COMPSs programming framework, developed by BSC, allows the development of scientific applications and their seamless execution on a wide number of distributed infrastructures. In cloud environments, COMPSs provides scaling and elasticity features allowing to adapt the number of available resources to the actual need of the execution. This is achieved through the use of connectors for IaaS offerings, as Amazon EC2, OpenNebula and OCCI compliant middlewares. A specific adaptor allows COMPSs to benefit from the Microsoft Azure (PaaS). COMPSs Workflow Orchestrator OCCI CDMI EGI Federated Cloud Collaborators: Michel Drescher, Nuno Ferreira, Boris Parak, Matteo Turilli