The EGI Perspective A European federated community cloud for the Open Science Commons T. Ferrari, EGI.eu Technical Director COMMENTS/QUESTIONS: http://go.egi.eu/livedoc Federated Community Cloud Services for e-Science: EGi-GEANT Symposium
Federated Community Cloud Services for e-Science: EGi-GEANT Symposium Why a federated cloud? Provide a distributed cloud infrastructure that federates existing community cloud infrastructures in Europe Allowing the on-demand hosting of community-specific services Providing processing capabilities suitable to the distributed nature of big data Allowing single sign on Providing the needed level of trust and security Promoting the adoption of cloud open standards Commercial and publicly funded cloud providers Federated Community Cloud Services for e-Science: EGi-GEANT Symposium
The principles of federation Federated AAI One accounting system Monitoring services VM image management across multiple different cloud middleware frameworks and contextualization Data access and transfer Cloud service information Brokering Federated Community Cloud Services for e-Science: EGi-GEANT Symposium
For which customer groups? Academy International Research communities SMEs and Industry an innovation space for the big data value chain of Europe Discovery, sharing, use and re-use of big data for added value services Education Federated Community Cloud Services for e-Science: EGi-GEANT Symposium
Federated Community Cloud Services for e-Science: EGi-GEANT Symposium At which cost? The EGI Federated Cloud relies on the existing services for federating NGIs/EIROs already provided as production services Federated Community Cloud Services for e-Science: EGi-GEANT Symposium
EGI Cloud Infrastructure EGI Collaboration Tools EGI Cloud Infrastructure Platform Instance Mgmt Storage Management Image Repository OCCI CDMI Cloud Management Stacks (OpenStack, OpenNebula, Synnefo, …) EGI Cloud Service Marketplace OVF EGI Application DB EGI Core Platform GLUE2 GSI SAM UR Service Registry Information Discovery Federated AAI Monitoring Accounting Help and Support Security Co-ordination Training and Outreach Sustainable Business Models
EGI Conference, Amsterdam, 24-26 September 2014 Use cases BBMRI: data and compute infrastructure that will allow a biobank federation for the storage of big data, parallel data analysis (EGI/EUDAT pilot) DARIAH: federated cloud storage for high availability of data exploitation EISCAT_3D: archiving and processing of data (joint EGI/EUDAT pilot) ELIXIR: enable a federated data analysis infrastructure EPOS: AAI, IaaS/PaaS/SaaS federated cloud services for data exploitation Structural biology/INSTRUCT: computation services for big data LifeWatch: Processing tools for biodiversity data, depositing of citizen scientist data, on demand virtual laboratories in the federated cloud On demand services for Digital Preservation EGI Conference, Amsterdam, 24-26 September 2014
Status Launch in May 2014 with the support of the EGI-InSPIRE project resources Czech Republic, Germany, Greece, Hungary, Italy, Macedonia, Poland, Slovakia, Spain, Sweden, Turkey, United Kingdom 2 countries currently integrating Croatia, Finland 5 countries interested Bulgaria, France, Israel, The Netherlands, Switzerland, Armenia Worldwide interest South Africa (SAGrid) South Korea (KISTI) Canada and Australia * Not shown on map
FedCloud in Numbers 19 certified Resource Resources from 17 Providers 100 Percent IT Ltd, United Kingdom The University of Zaragoza’s Institute for Biocomputation and Physics of Complex Systems (BIFI), Spain Barcelona Supercomputing Centre, Spain Academic Computer Centre CYFRONET AGH (Cyfronet), Poland The Supercomputing Centre of Galicia (CESGA), Spain The Czech Education and Scientific NETwork (CESNET), Czech Republic Forschungzentrum Juelich, Germany Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Germany Consejo Superior de Investigaciones Científicas (CSIC) / Instituto de Física de Cantabria (IFCA), Spain ~Okeanos by the Greek Research and Technology Network (GRNET), Greece Institute of Informatics, Slovak Academy of Sciences (II SAS), Slovakia Italian National Institute of Nuclear Physics (INFN), Division of Catania, Italy The Royal Institute of Technology, Sweden (KTH), Sweden Italian National Institute of Nuclear Physics (INFN), Division of Bari, Italy Italian National Institute of Nuclear Physics (INFN), Division of Padova, Italy The Hungarian Academy of Sciences Institute for Computer Science and Control (MTA SZTAKI), Hungary Turkish Academic Network and Information Centre (ULAKBIM), Turkey The European Information & Innovation Centre (UKIM), Macedonia Centro Extremeño de Tecnologías Avanzadas CIEMAT (CETA-CIEMAT), Spain 158 individuals participating and contributing to the Federated Cloud group >150 conference calls (Sep 2011 – Sept 2014) 78,422 VM instantiations accounted for in the last year 190,513 CPU Hours on certified resources Currently no storage accounting though sites have examples of heavy utilisation
Commercial exploitation A EGI marketplace of services will be established pay-for-use business model and its supporting tools for accounting and billing SLA management Cross-border procurement Engagement with SMEs and industry for the big data value chain Contribution to the HNX Required legal framework EGI-Engage project proposal (H2020) EGI Conference, Amsterdam, 24-26 September 2014
EGI Platform Architecture Physical Infrastructure Core Infrastructure Platform Collaboration Platform Federated Cloud Platform Community Platforms High Throughput Data Analysis Platform Open Data Platform Open data publishing, discovery use, and re-use -> big data value RI and community-specific services Cloud Providers private/public
Value proposition The EGI Federated Cloud: a federation of institutional private Clouds, offering Cloud Services to researchers in Europe and worldwide A single cloud system able to Scale to user needs Integrate multiple different providers to give resilience Prevent vendor lock-in Enable resource provision targeted towards the research community Supporting Open Science and the Big Data Value Chain
EGI Conference, Amsterdam, 24-26 September 2014 EGI Vision The Open Science Commons Researchers from all disciplines have easy and open access to the innovative digital services, data, knowledge and expertise they need for performing collaborative excellent research EGI Conference, Amsterdam, 24-26 September 2014
EGI Conference, Amsterdam, 24-26 September 2014 EGI Mission Accelerate the implementation of the Open Science Commons by expanding the capabilities of a European backbone of federated services for compute, storage, data, communication, knowledge and expertise, complementing community-specific capabilities EGI Conference, Amsterdam, 24-26 September 2014