Rackspace Analyst Event Tim Bell Tim.Bell@cern.ch CERN OpenStack Status April 2014 Rackspace Analyst Event Tim Bell Tim.Bell@cern.ch

Tim Bell - CERN OpenStack About Tim Responsible for IT Infrastructure Group at CERN Operating Systems Clouds Security Infrastructure Member of the OpenStack Management Board and User Committee Prior to joining CERN Ran the Deutsche Bank European Private Banking Infrastructure team Consultant and Developer at IBM Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack

CERN Geneva Computing Facilities 100 PB archive 30 PB/year data to record and analyse 10,000 servers 75,000 disk drives 45,000 tapes Next run of LHC expected to double data rates But many limits… Tim Bell - CERN OpenStack

Private OpenStack Cloud Status Production since July 2013 Started with Grizzly version of OpenStack Upgrade online to Havana in February 2014 Team of 5 cloud engineers Currently ~3,000 hypervisors in two data centres ~60,000 cores ~3PB disk storage pool for volumes Adding around 100 hypervisors per week Outlook ~150,000 cores by 2015 with same staff levels Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack Using Clouds CERN data is currently sent to ~150 of sites around the world using the Worldwide LHC Computing Grid Many sites are working with clouds Local private clouds Bursting to public clouds for peak load Some opportunistic clouds emerging 2 clouds of around 20,000 cores in ATLAS and CMS experimental areas Grants for research Tim Bell - CERN OpenStack

CERN Openlab in a nutshell A science – industry partnership to drive R&D and innovation with over a decade of success Evaluate state-of-the-art technologies in a challenging environment and improve them Test in a research environment today what will be used in many business sectors tomorrow Train next generation of engineers/employees Disseminate results and outreach to new audiences See http://openlab.web.cern.ch Tim Bell - CERN OpenStack

Goals for a year of joint research A reference architecture for federation of OpenStack clouds Blueprints and code contributions to the open source communities Presentations and white papers to allow others to build on our findings Rackspace Public Cloud CERN Private Cloud Rackspace Private Cloud @ CERN Tim Bell - CERN OpenStack

Status – Completed Work Identity federation now in the latest open source release Developed by Openlab fellow Will be included in core OpenStack code base for Icehouse Rackspace cloud testing progressing well CERN workloads run in Rackspace London public cloud Installed a Rackspace private cloud on CERN premises Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack Next Steps Enhance federation of resources Images Service Catalog Demonstrate at the next Openlab summit Paris in November 2014 Test at scale and deploy Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack Conclusions CERN is running large scale OpenStack clouds in production Small team Growing and stable Openlab provides a framework for sharing challenges with industry Rackspace collaboration already producing enhancements to the open source cloud software Rackspace clouds have been successfully tested using CERN physics workloads Similar performance and stability with existing solutions Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack Questions Q & A Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack CERN was founded 1954: 12 European States “Science for Peace” Today: 21 Member States ~ 2,300 staff ~ 1,000 other paid personnel > 11,000 users Budget (2013) ~1,000 MCHF Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Israel, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland and the United Kingdom Candidate for Accession: Romania Associate Members in Pre-Stage to Membership: Serbia Applicant States for Membership or Associate Membership: Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack Move To The Clouds Constraints Staff levels fixed Budget flat Geneva computer centre at its limits Infrastructure tools were brittle and fragile Approach Expand to a second data centre in Hungary 200 Gbit/s network from Geneva to Budapest Adopt common open source tools Move to a cloud model Project started in 2012 Tim Bell - CERN OpenStack

Tim Bell - CERN OpenStack If you are interested... SAML2 specification http://docs.oasis-open.org/security/saml/v2.0/saml-core-2.0-os.pdf Shibboleth http://shibboleth.net/ Extenal Identity Providers blueprint https://blueprints.launchpad.net/keystone/+spec/identity-providers Identity Providers and Mapping rules CRUD specification https://review.openstack.org/#/c/59848/ Tim Bell - CERN OpenStack