INDIGO – DataCloud CERN CERN RIA-653549.

Slides:



Advertisements
Similar presentations
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI AAI in EGI Status and Evolution Peter Solagna Senior Operations Manager
Advertisements

Pre-Commercial Procurement proposal - HNSciCloud
WebFTS as a first WLCG/HEP FIM pilot
Testing as a Service with HammerCloud Ramón Medrano Llamas CERN, IT-SDC
CERN Cloud Infrastructure Report 2 Bruno Bompastor for the CERN Cloud Team HEPiX Spring 2015 Oxford University, UK Bruno Bompastor: CERN Cloud Report.
Cisco and OpenStack Lew Tucker VP/CTO Cloud Computing Cisco Systems,
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
 Cloud computing  Workflow  Workflow lifecycle  Workflow design  Workflow tools : xcp, eucalyptus, open nebula.
1 Doctor Fault Management - Updates - 30 July 2015 Ryota Mibu, NEC.
EGI-Engage EGI-Engage Engaging the EGI Community towards an Open Science Commons Project Overview 9/14/2015 EGI-Engage: a project.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
Rackspace Analyst Event Tim Bell
Tim Bell 24/09/2015 2Tim Bell - RDA.
A public-private partnership building a multidisciplinary cloud platform for data intensive science Bob Jones Head of openlab IT dept CERN This document.
26 September 2013 Federating OpenStack: a CERN and Rackspace Collaboration Tim Bell Toby Owen
EduGain Federation – Web SSO
RI EGI-InSPIRE RI EGI Future activities Peter Solagna – EGI.eu.
Infrastructure Manager, CERN Clouds and Research Collide at CERN TIM BELL.
Jose Castro Leon CERN – IT/OIS CERN Agile Infrastructure Infrastructure as a Service.
Tim 18/09/2015 2Tim Bell - Australian Bureau of Meteorology Visit.
WebFTS File Transfer Web Interface for FTS3 Andrea Manzi On behalf of the FTS team Workshop on Cloud Services for File Synchronisation and Sharing.
Cloud federation Are we there yet? Marek Denis CERN openlab Major Review Geneva, Switzerland › October
Ian Bird, WLCG MB; 27 th October 2015 October 27, 2015
Ian Bird CMS Computing & Software CERN, 15 th October Oct 2015 Ian Bird; CMS Offline & Computing1.
Authentication and Authorisation for Research and Collaboration Peter Solagna Milano, AARC General meeting Report and plans Attribute.
Federated Identity Management for HEP David Kelsey STFC – RAL Nijmegen workshop 22 June 2012.
Authentication and Authorisation for Research and Collaboration Peter Solagna Milano, AARC General meeting Current status and plans.
Commissioning the CERN IT Agile Infrastructure with experiment workloads Ramón Medrano Llamas IT-SDC-OL
Tim Bell 04/07/2013 Intel Openlab Briefing2.
Scaling the CERN OpenStack cloud Stefano Zilli On behalf of CERN Cloud Infrastructure Team 2.
LHC Computing, CERN, & Federated Identities
OpenStack overview of the project Belmiro Daniel Rodrigues Moreira CERN IT-PES-PS January 2011 Disclaimer: This presentation reflects the experience and.
Possibilities for joint procurement of commercial cloud services for WLCG WLCG Overview Board Bob Jones (CERN) 28 November 2014.
3rd Helix Nebula Workshop on Interoperability among e-Infrastructures and Commercial Clouds Carmela ASERO, EGI.eu 17 September 2013, Madrid
Ian Collier, STFC, Romain Wartel, CERN Maintaining Traceability in an Evolving Distributed Computing Environment Introduction Security.
INDIGO – DataCloud WP5 introduction INFN-Bari CYFRONET RIA
An Open Data Platform in the framework of the EGI-LifeWatch Competence Centre Fernando Aguilar Jesús Marco
WP4 Summary Patrick Fuhrmann for the WP4 Tream RIA
Overview of the global architecture Giacinto DONVITO INFN-Bari.
STFC in INDIGO DataCloud WP3 INDIGO DataCloud Kickoff Meeting Bologna April 2015 Ian Collier
INDIGO – DataCloud Security and Authorization in WP5 INFN RIA
CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Services for Distributed e-Infrastructure Access Tiziana Ferrari on behalf.
EGI-Engage EGI Webinar - Introduction - Gergely Sipos EGI.eu / MTA SZTAKI 6/26/
Authentication and Authorisation for Research and Collaboration AARC/CORBEL Workshop for Life Sciences AAI AARC Draft Blueprint.
INDIGO – DataCloud ATOS exploitation approach and plans Indigo-DataCloud Industrial Partner meeting Frascati (Rome) May 6 th F. Javier Nieto de Santos.
Security in the wider world David Kelsey (STFC-RAL) GridPP37 – Ambleside 2 Sep 2016.
PaaS services for Computing and Storage
WLCG Update Hannah Short, CERN Computer Security.
Resource Provisioning Services Introduction and Plans
A successful public-private partnership
The PaaS Layer in the INDIGO-DataCloud
Overview of the global architecture
Openlab Compute Provisioning Topics Tim Bell 1st March 2017
Exploitation and Sustainability updates
Cloud Providers and AARC
Identity Federations - Overview
StratusLab Final Periodic Review
Defining and tracking requirements for New Communities
StratusLab Final Periodic Review
Grid related projects CERN openlab LCG EDG F.Fluckiger
Openlab major review Marek Denis Openlab research fellow
A walkthrought by the cloud computing
EGI-Engage Engaging the EGI Community towards an Open Science Commons
An easier path? Customizing a “Global Solution”
Huawei : Clouds at Scale
OpenStack Ani Bicaku 18/04/ © (SG)² Konsortium.
AAI Architectures – current and future
Single Sign-On (SSO) Authentication
MMG: from proof-of-concept to production services at scale
Presentation transcript:

INDIGO – DataCloud CERN CERN RIA

Status of CERN IaaS Cloud  CERN IaaS Cloud in production since July 2013  4,700 hypervisors (120,000 cores) across two data centres  OpenStack Juno using RDO community distribution  Compute (OpenStack and EC2 APIs)  Storage using 3PB ceph pool for volumes  Identity including SAML with eduGain, X.509 and Kerberos authentication  1,800 projects active  ~1,000,000 VMs created since service started  Over 90% of LHC compute resources at CERN managed by the cloud  Approach  Stay very close to upstream open source community release  Keep staffing levels O(1) rather than expect more staff for more resources  Use open design process and contribute changes using standard OpenStack blueprints  Support RDO as an open source community  Collaborate with industry on common needs such as federation and delegated quotas INDIGO-DataCloud RIA CERN20/04/2015 2

People  Who  Ian Bird  WLCG Project Leader  INDIGO DataCloud Collaboration Board representative  Tim Bell  CERN IT Operating Systems and Infrastrusture (OIS) Group Leader  Member at the OpenStack Management Board and User Committee  Ricardo Rocha  CERN Cloud Engineer IT-OIS  Dedicated CERN fellow  Hiring process underway  Start expected in Summer /04/2015INDIGO-DataCloud RIA CERN 3

CERN WP3 Contributions  Pilot Infrastructures ( T3.3 )  Provide OpenStack resources for testbeds (10s?)  Using the existing production infrastructure  eduGAIN support  Identity including SAML with eduGain, X.509 and Kerberos authentication  Specialized OpenStack deployments and endpoints  Validation of specific features or developments  Hopefully not too intrusive... 20/04/2015INDIGO-DataCloud RIA CERN 4

CERN WP4 Contributions  AAI Management  OS-Federation, in production  Identity including SAML with eduGain, X.509 and Kerberos authentication  Container Support  Ongoing work at CERN, lxc integration with OpenStack Nova  Same for OpenStack Heat, close to deployment  Interest in Docker  Cloud Scheduling  Looking forward to more details in this meeting 20/04/2015INDIGO-DataCloud RIA CERN 5

CERN WP5 Contributions  Security and Authorization  OS-Federation, in production  Identity including SAML with eduGain, X.509 and Kerberos authentication  Architecture and Implementation  Ongoing work on:  Containers with LXC, Docker  Orchestration with OpenStack Heat  Interest in OpenStack Murano as an app store  With integrated federation and accounting  Also includes Kubernetes for orchestration, monitoring  Evaluation of existing solutions as first step  Goals for common interfaces? Things moving fast in this area 20/04/2015INDIGO-DataCloud RIA CERN 6

Further information  CERN cloud presentations  Includes federation and ceph   OpenStack in Production blog  INDIGO-DataCloud RIA CERN20/04/2015 7

Related Projects  AARC  Federated identity – Romain Wartel  Helix Nebula Initiative  HNSciCloud PCP proposal – Bob Jones  CERN Openlab  Rackspace funded collaboration for cloud federation 20/04/2015INDIGO-DataCloud RIA CERN 8