Www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number 654142 Federated Cloud Update.

Slides:



Advertisements
Similar presentations
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Advertisements

EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
European Grid Initiative Federated Cloud update Peter solagna Pre-GDB Workshop 10/11/
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Towards H2020 Tiziana Ferrari/EGI.eu WLCG Collaboration Workshop.
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI (Present and) Future of the EGI Services for WLCG Peter Solagna – EGI.eu.
European Grid Initiative Data Services and Solutions Part 2: Data in the cloud Enol Fernández Data Services.
1 FedCloud Task Force Demo EGI CF2012 – Munich 28/29 March Matteo Turilli
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI VM Management Chair: Alexander Papaspyrou 2/25/
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT EGI interoperability.
OpenNebula: Experience at SZTAKI Peter Kacsuk, Sandor Acs, Mark Gergely, Jozsef Kovacs MTA SZTAKI EGI CF Helsinki.
EGI Technical Forum Madrid COMPSs in the EGI Federated Cloud Daniele Lezzi – BSC EGI Technical Forum Madrid.
EGI-InSPIRE RI EGI Webinar EGI-InSPIRE RI Porting your application to the EGI Federated Cloud 17 Feb
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Marios Chatziangelou, et al.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Data service requirements and provisioning models Gergely Sipos With input.
European Life Sciences Infrastructure for Biological Information ELIXIR Cloud Roadmap Chairs: Steven Newhouse, EMBL-EBI & Mirek Ruda,
Instituto de Biocomputación y Física de Sistemas Complejos Cloud resources and BIFI activities in JRA2 Reunión JRU Española.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
INFN/IGI contributions Federated Clouds Task Force F2F meeting November 24, 2011, Amsterdam.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Storage Accounting John Gordon, STFC OMB August 2013.
EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Marios Chatziangelou, et al.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
European Grid Initiative EGI FedCloud User Support coordination meeting Diego Scardaci - EGI.eu/INFN 01/04/2015.
European Grid Initiative The EGI Federated Cloud as Educational and Training Infrastructure for Data Science Tiziana Ferrari/ EGI.eu.
Daniele Lezzi Execution of scientific workflows on federated multi-cloud infrastructures IBERGrid Madrid, 20 September 2013.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI A pan-European Research Infrastructure supporting the digital European Research.
EGI-InSPIRE EGI-InSPIRE RI EGI strategy towards the Open Science Commons Tiziana Ferrari EGI-InSPIRE Director at EGI.eu.
EGI-InSPIRE RI EGI-InSPIRE RI EGI-InSPIRE Software provisioning and HTC Solution Peter Solagna Senior Operations Manager.
Testing and Release Procedures/Tools Cristina Aiftimiei (INFN-CNAF) Mario David (LIP)
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
INDICATE Final Conference, Ankara, Turkey – 15 October, INDICATE Final Conference, Ankara, Turkey EGI & eCulture The role of.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI SA1.2 Plans 2013 Security Operations David Kelsey (STFC) 26/02/2013 Operations.
1 EGI Federated Cloud Architecture Matteo Turilli Senior Research Associate, OeRC, University of Oxford Chair – EGI Federated Clouds Task Force
EGI… …is a Federation of over 300 computing and data centres spread across 56 countries in Europe and worldwide …delivers advanced computing.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Developing Horizon 2020 projects January 2014 EGI FedCloud F2F, Oxford.
The EGI Federated Cloud
PaaS services for Computing and Storage
The EGI Training Infrastructure
SA1 Operation of EGI technical platforms
Regional Operations Centres Core infrastructure Centres
EGI: advanced computing for research in Europe… and beyond!
Virtualization and Clouds ATLAS position
Steve Brewer Stichting European Grid Initiaitive
User Engagement in EGI (With focus on the cloud)
Federated Cloud Computing
Exploitation and Sustainability updates
FedCloud Blueprint Update
WLCG experiments FedCloud through VAC/VCycle in the EGI
Agenda Welcome Project Status (inc. Activity Reports)
EGI-Engage Engaging the EGI Community towards an Open Science Commons
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
Infrastructure Area EMI All Hands Summary.
An easier path? Customizing a “Global Solution”
Interoperability & Standards
Status report of the LToS platform
Introduction to the EGI cloud federations
Accelerated Computing in Cloud
Federated Identity Management: Status and perspectives of EGI
The EGI Federated Cloud
Case Study: Algae Bloom in a Water Reservoir
DARIAH Competence Centre: architecture and activity summary
ELIXIR Competence Center
Cloud computing mechanisms
"Cloud services" - what it is.
Pre-OMB meeting Preparation for the Workshop “EGI towards H2020”
Copernicus Data in the EGI infrastructure
EGI FedCloud User Support coordination meeting
Distributing META-pipe on ELIXIR compute resources
Operations Management Board March 26
Presentation transcript:

EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number Federated Cloud Update

27/8/2016 Outline CLOUD monitoring profile Integration of sites status New communities – ESA Exploitation platform – AUGER Cloud Lisbon

37/8/2016 Monitoring profile for CLOUD Currently there is a single monitoring profile for cloud resources – Includes all the tests (also the ones which are still under development) – A/R calculations based on this profile, sites are penalized because of non yet stable tests Proposal: – Create a new CLOUD-MON_CRITICAL profile that is used for A/R only including the production tests. OMB

47/8/2016 CLOUD-MON_CRITICAL profile Tests to include: – eu.egi.cloud.APEL-Pub  tests accounting records are being published for the site – eu.egi.cloud.OCCI-VM  tests a VM can be started/deleted at site – eu.egi.cloud.OCCI-Context  tests correctness of OCCI extensions of FedCloud – org.nagios.OCCI-TCP  checks OCCI service is reachable – org.nagios.CDMI-TCP  checks CDMI service is reachable Not to include (for the time being) – eu.egi.cloud.CDMI-CRUD  checks CDMI operations can be performed To deprecate: – org.nagios.CloudBDII-Check  functionality already covered by the generic BDII tests OMB

57/8/2016 Integration of sites New sites entering into the infrastructure – IN2P3-IRES (FR) 176 cores, 1024GB RAM, 3.6TB disk Max size: 16 cores, 32GB RAM, 320 GB disk – NCG-INGRID-PT (PT) 64 cores, 192 GB RAM, 1TB disk Max size: 8 cores, 16GB RAM, 160GB disk In progress – KISTI (KR)  most functionality ready, need some assistance to finalize the process – CSC (FI)  OCCI + VOMS now supported, migrating to new version of OpenStack and then complete integration Sites removed – BSC (ES)  only were providing test CDMI interfaces OMB

67/8/2016 ESA Exploitation platform use case ESA funded Terradue for the development of the e-Collaboration for Earth Observation (e-CEO) platform, to support on-line Data Challenges – This activity is part of a wider exploitation strategy of ESA, to make available tools to access and process earth observation datasets EGI to provide capacity to instantiate virtual machines to run the computational tasks generated by the users of the platform and to store temporary data – Access through OCCI interface – Starting with a set of cloud providers who volunteered to provide resources for the initial pilot phase. – Open also for pay per use models Use cases supported at the moment: – Hydrology – Geohazard Pilot/testing phase starting now, first production runs end 2015 – Cycles of ~60VM for 3-6 months to support the data challenges OMB

77/8/2016 AUGER use case AUGER VO running in EGI grid during last five years – Already produced a large number of files available in Storage Elements Site decommissioning triggered the evaluation of FedCloud for running their workloads Already running CORSIKA and OFFLINE in the EGI Federated Cloud – Software installed in CVMFS at GRIDPP – Access to files in Storage Elements  UMD software in VM – Using fedcloud VO, now moving to production with Auger VO. OMB

87/8/2016 EGI Conference Cloud Sessions Tuesday 19 th to contain a track on IaaS – Status of the FedCloud – Lightning talks by selected use cases – Demos of current capabilities – Detailed presentations on cloud usage by several communities – Plans in INDIGO for IaaS – Discussion – FedCloud F2F Wednesday 20 th, track on PaaS – Presentations on several PaaS solutions used or planned by communities OMB