2. Tim Bell @noggin143 18/09/2015 2Tim Bell - Australian Bureau of Meteorology Visit

3. 25/06/2015 3Tim Bell - Cloud World Forum

4. TIER-1: permanent storage, re-processing, analysis TIER-0 (CERN): data recording, reconstruction and distribution TIER-2: Simulation, end-user analysis > 2 million jobs/day ~350’000 cores 500 PB of storage nearly 170 sites, 40 countries 10-100 Gb links The Worldwide LHC Computing Grid

5. LHC Data Growth 2010 2015 2018 2023 PB per year 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit5

6. 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit 6 CPU needs Assuming no change of model from today is x3 too high What we think is affordable unless we do something differently

7. THE CERN MEYRIN DATA CENTRE http://goo.gl/maps/K5SoG 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit7

8. Public Procurement Cycle StepTime (Days)Elapsed (Days) User expresses requirement0 Market Survey prepared15 Market Survey for possible vendors3045 Specifications prepared1560 Vendor responses3090 Test systems evaluated30120 Offers adjudicated10130 Finance committee30160 Hardware delivered90250 Burn in and acceptance30 days typical with 380 worst case280 Total280+ Days 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit8

9. 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit 9

10. 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit 10

11. Good News, Bad News 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit11 Additional data centre in Budapest now online Increasing use of facilities as data rates increase But… Staff numbers are fixed, no more people Materials budget decreasing, no more money Legacy tools are high maintenance and brittle User expectations are for fast self-service

12. Innovation Dilemma How can we avoid the sustainability trap ? Define requirements No solution available that meets those requirements Develop our own new solution Accumulate technical debt How can we learn from others and share ? Find compatible open source communities Contribute back where there is missing functionality Stay mainstream Are CERN computing needs really special ? 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit12

13. CERN Tool Chain 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit 13

14. Job Trends Consideration 25/06/2015 Tim Bell - Cloud World Forum14

15. Source: eBay Upstream OpenStack on its own does not give you a cloud service Packaging Integration Burn In SLA Monitoring … Cloud is a service! Monitoring and alerting Metering and chargeback AutoscalingRemediationScale out Capacity planning UpgradesSLA Customer support User experience Incident resolution Alerting Cloud monitoring Metrics Log processing High availability Config management Infra onboarding CIBuilds Net/info sec Network design OpenStack APIs 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit 15

16. High Level Status Production in time for Run 2 Cloud – 130,000 cores across 2 data centres Configuration Management - Monitoring Ramp up of capacity completing for 2015 Same again in 2016 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit16

17. Hooke’s Law for Cultural Change Under load, an organization can extend proportional to external force Too much stretching leads to permanent deformation

18. Onwards the Federated Clouds 25/06/2015 Tim Bell - Cloud World Forum18 Public Cloud such as Rackspace CERN Private Cloud 130K cores ATLAS Trigger 28K cores ALICE Trigger 12K cores CMS Trigger 12K cores IN2P3 Lyon Brookhaven National Labs NecTAR Australia Many Others on Their Way

19. Challenges Looking Out Budget Computing is now recognised as part of the costs External collaborations and projects also contribute (but need to be relevant) Efficiency Facilities, Software, Staff Moore’s law is not enough (and only applies to hardware) Sustainability Build on industry and open source Don’t need to do it all ourselves Compute is the most ephemeral service Agility Fresh thinking versus service delivery and evolution (stopping services is never easy) Consensus favors the status quo 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit19

20. 18/09/2015 Tim Bell - Australian Bureau of Meteorology Visit20

21. CERN Networks Campus Network ~180,000 registered devices Servers, PCs, Macs, phones, tablets, … Structured Cabling: Over 65,536 UTP sockets Wi-Fi: ~1,600 access points, ~15,000 active devices per day Technical and Experiment Networks Dedicated networks for safety, controls, cooling, electricity Filters access to/from the outside world 24x7 First line support through contractors Significant investment in automation through custom developments External Networking High speed links to Wigner Data Centre in Budapest, WLCG Tier-1 sites, Academic and Research networks, general Internet CERN Internet Exchange Point: ~40 companies interconnect at CERN (including K-Net) Tim Bell - Australian Bureau of Meteorology Visit 21 18/09/2015

22. Costs 22 Main cost driver is active storage – disk