The EGI Perspective A European federated community cloud

Slides:



Advertisements
Similar presentations
From CESSDA to European Research Infrastructure Developments in cross-European data sharing.
Advertisements

1 EGI Federated Clouds Task Force HEPiX Spring 2012 Workshop Matteo Turilli
Pre-Commercial Procurement proposal - HNSciCloud
European Life Sciences Infrastructure for Biological Information ELIXIR
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
C ross-European data sharing made easy EDAF Luxembourg.
European Grid Initiative Federated Cloud update Peter solagna Pre-GDB Workshop 10/11/
Rackspace Analyst Event Tim Bell
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Future Plans T. Ferrari/EGI.eu 1.
Notur: - Grant f.o.m is 16.5 Mkr (was 21.7 Mkr) - No guarantees that funding will increase in Same level of operations maintained.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Towards H2020 Tiziana Ferrari/EGI.eu WLCG Collaboration Workshop.
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
The MICHAEL Project is funded under the European Commission eTEN Programme The multilingual catalogue of digital cultural heritage in Europe.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI (Present and) Future of the EGI Services for WLCG Peter Solagna – EGI.eu.
Stakeholder Relations at Large-Scale Infrastructures The CERN Model Rolf Heuer 7 th Canadian Science Policy Conference, Ottawa, 26 November 2015.
1 FedCloud Task Force Demo EGI CF2012 – Munich 28/29 March Matteo Turilli
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI strategy and Grand Vision Ludek Matyska EGI Council Chair EGI InSPIRE.
EGI-Engage EGI, EGI-Engage and the DARIAH CC Gergely Sipos Technical Outreach Manager 3/9/
25-September-2005 Manjit Dosanjh Welcome to CERN International Workshop on African Research & Education Networking September ITU, UNU and CERN.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Federated Cloud 1 17 Feb 2014 Diego Scardaci, EGI.eu Technical Outreach.
EGI-Engage EGI-Engage JRA2.1: Federated Open Data NA2.2: Strategy, Business Development and Exploitation SA2.7: LifeWatch Competence.
European Life Sciences Infrastructure for Biological Information ELIXIR Cloud Roadmap Chairs: Steven Newhouse, EMBL-EBI & Mirek Ruda,
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Federated Cloud Status David Wallom University of Oxford Chair, EGI Federated.
IBERGRID as RC Total Capacity: > 10k-20K cores, > 3 Petabytes Evolving to cloud (conditioned by WLCG in some cases) Capacity may substantially increase.
The Helix Nebula marketplace 13 May 2015 Bob Jones, CERN.
EGI-InSPIRE EGI-InSPIRE RI CAP4SME and EGI.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
European Grid Initiative The EGI Federated Cloud as Educational and Training Infrastructure for Data Science Tiziana Ferrari/ EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.
EMI is partially funded by the European Commission under Grant Agreement RI Commercial applications of open source middleware: the EMI and DCore.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI OpenSource GeoSpatial Catalogue Platform-as-a-Service Salvatore Pinto Cloud.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
EGI-InSPIRE EGI-InSPIRE RI A European Cloud federation EGI’s Cloud strategy for 2020 EGI position paper:
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
The EGI Federated Cloud
J.Marco Spanish JRU EGI-ENGAGE meeting Madrid, 23 Feb 2015
EGI and Project Overview
User Engagement in EGI (With focus on the cloud)
Federated Cloud Computing
Supporting Research on Biodiversity: LifeWatch on the Cloud
IaaS Layer – Solutions for “Enablers”
EGI and EGI-Engage PY2 Overview
FedCloud Blueprint Update
Steven Newhouse EGI-InSPIRE Project Director, EGI.eu
EGI/EUDAT/INDIGO-DataCloud Joint project proposal for EINFRA-12 A
Marketplace & service catalog concepts, first design analysis
EGI.eu Technical Director EGI-Engage Technical Coordinator
The Federated Cloud solution
EGI and EGI-Engage PY2 Overview
EMBL – European Molecular Biology Laboratory
Introduction to EGI; Training activities and plans
EGI-Engage Engaging the EGI Community towards an Open Science Commons
Antonella Fresa Technical Coordinator
Solutions for federated services management EGI
Małgorzata Krakowian, Gergely Sipos
Federated Identity Management: Status and perspectives of EGI
The EGI Federated Cloud
EGI Webinar - Introduction -
EGI FedCloud in Digital Humanities
DARIAH Competence Centre: architecture and activity summary
LifeWatch Cloud Computing Workshop
Conference: Data and Life Sci +DC
EGI FedCloud User Support coordination meeting
Expand portfolio of EGI services
EOSC-hub Contribution to the EOSC WGs
Operations Management Board March 26
Presentation transcript:

The EGI Perspective A European federated community cloud for the Open Science Commons T. Ferrari, EGI.eu Technical Director COMMENTS/QUESTIONS: http://go.egi.eu/livedoc Federated Community Cloud Services for e-Science: EGi-GEANT Symposium

Federated Community Cloud Services for e-Science: EGi-GEANT Symposium Why a federated cloud? Provide a distributed cloud infrastructure that federates existing community cloud infrastructures in Europe Allowing the on-demand hosting of community-specific services Providing processing capabilities suitable to the distributed nature of big data Allowing single sign on Providing the needed level of trust and security Promoting the adoption of cloud open standards Commercial and publicly funded cloud providers Federated Community Cloud Services for e-Science: EGi-GEANT Symposium

The principles of federation Federated AAI One accounting system Monitoring services VM image management across multiple different cloud middleware frameworks and contextualization Data access and transfer Cloud service information Brokering Federated Community Cloud Services for e-Science: EGi-GEANT Symposium

For which customer groups? Academy International Research communities SMEs and Industry  an innovation space for the big data value chain of Europe Discovery, sharing, use and re-use of big data for added value services Education Federated Community Cloud Services for e-Science: EGi-GEANT Symposium

Federated Community Cloud Services for e-Science: EGi-GEANT Symposium At which cost? The EGI Federated Cloud relies on the existing services for federating NGIs/EIROs already provided as production services Federated Community Cloud Services for e-Science: EGi-GEANT Symposium

EGI Cloud Infrastructure EGI Collaboration Tools EGI Cloud Infrastructure Platform Instance Mgmt Storage Management Image Repository OCCI CDMI Cloud Management Stacks (OpenStack, OpenNebula, Synnefo, …) EGI Cloud Service Marketplace OVF EGI Application DB EGI Core Platform GLUE2 GSI SAM UR Service Registry Information Discovery Federated AAI Monitoring Accounting Help and Support Security Co-ordination Training and Outreach Sustainable Business Models

EGI Conference, Amsterdam, 24-26 September 2014 Use cases BBMRI: data and compute infrastructure that will allow a biobank federation for the storage of big data, parallel data analysis (EGI/EUDAT pilot) DARIAH: federated cloud storage for high availability of data exploitation EISCAT_3D: archiving and processing of data (joint EGI/EUDAT pilot) ELIXIR: enable a federated data analysis infrastructure EPOS: AAI, IaaS/PaaS/SaaS federated cloud services for data exploitation Structural biology/INSTRUCT: computation services for big data LifeWatch: Processing tools for biodiversity data, depositing of citizen scientist data, on demand virtual laboratories in the federated cloud On demand services for Digital Preservation EGI Conference, Amsterdam, 24-26 September 2014

Status Launch in May 2014 with the support of the EGI-InSPIRE project resources Czech Republic, Germany, Greece, Hungary, Italy, Macedonia, Poland, Slovakia, Spain, Sweden, Turkey, United Kingdom 2 countries currently integrating Croatia, Finland 5 countries interested Bulgaria, France, Israel, The Netherlands, Switzerland, Armenia Worldwide interest South Africa (SAGrid) South Korea (KISTI) Canada and Australia * Not shown on map

FedCloud in Numbers 19 certified Resource Resources from 17 Providers 100 Percent IT Ltd, United Kingdom The University of Zaragoza’s Institute for Biocomputation and Physics of Complex Systems (BIFI), Spain Barcelona Supercomputing Centre, Spain Academic Computer Centre CYFRONET AGH (Cyfronet), Poland The Supercomputing Centre of Galicia (CESGA), Spain The Czech Education and Scientific NETwork (CESNET), Czech Republic Forschungzentrum Juelich, Germany Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Germany Consejo Superior de Investigaciones Científicas (CSIC) / Instituto de Física de Cantabria (IFCA), Spain ~Okeanos by the Greek Research and Technology Network (GRNET), Greece Institute of Informatics, Slovak Academy of Sciences (II SAS), Slovakia Italian National Institute of Nuclear Physics (INFN), Division of Catania, Italy The Royal Institute of Technology, Sweden (KTH), Sweden Italian National Institute of Nuclear Physics (INFN), Division of Bari, Italy Italian National Institute of Nuclear Physics (INFN), Division of Padova, Italy The Hungarian Academy of Sciences Institute for Computer Science and Control (MTA SZTAKI), Hungary Turkish Academic Network and Information Centre (ULAKBIM), Turkey The European Information & Innovation Centre (UKIM), Macedonia Centro Extremeño de Tecnologías Avanzadas CIEMAT (CETA-CIEMAT), Spain 158 individuals participating and contributing to the Federated Cloud group >150 conference calls (Sep 2011 – Sept 2014) 78,422 VM instantiations accounted for in the last year 190,513 CPU Hours on certified resources Currently no storage accounting though sites have examples of heavy utilisation

Commercial exploitation A EGI marketplace of services will be established pay-for-use business model and its supporting tools for accounting and billing SLA management Cross-border procurement Engagement with SMEs and industry for the big data value chain Contribution to the HNX Required legal framework  EGI-Engage project proposal (H2020) EGI Conference, Amsterdam, 24-26 September 2014

EGI Platform Architecture Physical Infrastructure Core Infrastructure Platform Collaboration Platform Federated Cloud Platform Community Platforms High Throughput Data Analysis Platform Open Data Platform Open data publishing, discovery use, and re-use -> big data value RI and community-specific services Cloud Providers private/public

Value proposition The EGI Federated Cloud: a federation of institutional private Clouds, offering Cloud Services to researchers in Europe and worldwide A single cloud system able to Scale to user needs Integrate multiple different providers to give resilience Prevent vendor lock-in Enable resource provision targeted towards the research community Supporting Open Science and the Big Data Value Chain

EGI Conference, Amsterdam, 24-26 September 2014 EGI Vision The Open Science Commons Researchers from all disciplines have easy and open access to the innovative digital services, data, knowledge and expertise they need for performing collaborative excellent research EGI Conference, Amsterdam, 24-26 September 2014

EGI Conference, Amsterdam, 24-26 September 2014 EGI Mission Accelerate the implementation of the Open Science Commons by expanding the capabilities of a European backbone of federated services for compute, storage, data, communication, knowledge and expertise, complementing community-specific capabilities EGI Conference, Amsterdam, 24-26 September 2014