Vision for CERN IT Department

Slides:



Advertisements
Similar presentations
A successful public- private partnership Alberto Di Meglio CERN openlab Head.
Advertisements

The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Ian Bird WLCG Workshop Okinawa, 12 th April 2015.
Ian Bird WLCG Management Board CERN, 17 th February 2015.
Assessment of Core Services provided to USLHC by OSG.
Latin America: 8 Countries 22 Universities Argentina Brasil Chile Colombia Cuba Mexico Peru Venezuela Europe 5 Countries.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
Fermilab User Facility US-CMS User Facility and Regional Center at Fermilab Matthias Kasemann FNAL.
ICE-DIP Mid-term review Data Transfer WP4a - ESR4: Aram Santogidis › 16/1/2015.
ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.
CERN openlab V Technical Strategy Fons Rademakers CERN openlab CTO.
Outreach activities in Israel General press: Higgs and CERN Ensure that new generations are attracted to Science and Technology. Teachers and High School.
Next Generation Operating Systems Zeljko Susnjar, Cisco CTG June 2015.
HPC Centres and Strategies for Advancing Computational Science in Academic Institutions Organisers: Dan Katz – University of Chicago Gabrielle Allen –
Innovation & Entrepreneurship Alberto Di Meglio CERN openlab Head CERN – 26/11/2015 The Globe of Science and Innovation.
Slide David Britton, University of Glasgow IET, Oct 09 1 Prof. David Britton GridPP Project leader University of Glasgow UK-T0 Meeting 21 st Oct 2015 GridPP.
A successful public- private partnership Alberto Di Meglio CERN openlab Head.
Marie Curie Big-DATA Proposal Bob Jones CERN IT Department.
Cern.ch/knowledgetransfer. Knowledge Transfer | Accelerating Innovation BE-KT Innovation Day,
LHC Computing, CERN, & Federated Identities
Ian Bird WLCG Workshop, Barcelona, 9 th July July 2014 Ian Bird; Barcelona1.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
Ian Bird CERN, 17 th July 2013 July 17, 2013
Predrag Buncic ALICE Status Report LHCC Referee Meeting CERN
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Ian Bird, CERN WLCG LHCC Referee Meeting 1 st December 2015 LHCC; 1st Dec 2015 Ian Bird; CERN1.
The Worldwide LHC Computing Grid Frédéric Hemmer IT Department Head Visit of INTEL ISEF CERN Special Award Winners 2012 Thursday, 21 st June 2012.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
Towards Gendered Science and Research: Gender Mainstreaming in the EU Science Policies Alexandra Bitusikova 7 September 2005 Bratislava, Slovakia.
A successful public- private partnership Alberto Di Meglio CERN openlab Head.
Computing infrastructures for the LHC: current status and challenges of the High Luminosity LHC future Worldwide LHC Computing Grid (WLCG): Distributed.
A successful public- private partnership Maria Girone CERN openlab CTO.
LHCb Computing 2015 Q3 Report Stefan Roiser LHCC Referees Meeting 1 December 2015.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
ATLAS – statements of interest (1) A degree of hierarchy between the different computing facilities, with distinct roles at each level –Event filter Online.
Collaboration Board Meeting 11 March 2016 Alberto Di Meglio CERN openlab Head.
A successful public-private partnership
CEPC software & computing study group report
Review of the WLCG experiments compute plans
Knowledge Sharing and Innovation
HEP LTDP Use Case & EOSC Pilot
Crisis management related research at
Ian Bird WLCG Workshop San Francisco, 8th October 2016
Computing models, facilities, distributed computing
A successful public-private partnership
SuperB and its computing requirements
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
INFN Computing Outlook The Bologna Initiative
The “Understanding Performance!” team in CERN IT
A successful public-private partnership
Scientific Computing Strategy (for HEP)
A successful public-private partnership
FUTURE ICT CHALLENGES IN SCIENTIFIC COMPUTING
National e-Infrastructure Vision
WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017.
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
Sustainable EU Research Infrastructures
System performance and cost model working group
WLCG Collaboration Workshop;
The latest developments in preparations of the LHC community for the computing challenges of the High Luminosity LHC Dagmar Adamova (NPI AS CR Prague/Rez)
New strategies of the LHC experiments to meet
Horizon 2020: Key Enabling Technologies R&I for industrial leadership
EGI Webinar - Introduction -
Collaboration Board Meeting
An IT R&D Collaboration Framework
Brian Matthews STFC EOSCpilot Brian Matthews STFC
LHCb thinking on Regional Centres and Related activities (GRIDs)
MGT601 SME MANAGEMENT.
The LHC Computing Grid Visit of Professor Andreas Demetriou
Presentation transcript:

Vision for CERN IT Department Frédéric Hemmer – IT Department Head 28 February 2017 Intel Visit

IT Department Structure Department Infrastructure WLCG openlab Security EC Projects Collaboration, Devices & Applications Storage Databases Compute & Monitoring Communication Systems Computing Facilities 28 February 2017 Intel Visit

IT Services 28 February 2017 Intel Visit

HEP Computing Overview for the next 10 years How could/should HEP computing evolve in the next decade? What is the role of CERN and IT Dep.? How to address the needs of CERN HL-LHC as focus, but other experiments too 28 February 2017 Intel Visit

WLCG 55 GB/s global transfers LHCb ATLAS ALICE 2016: 49.4 PB LHC data 58 PB all experiments 73 PB total 55 GB/s global transfers LHCb ATLAS ALICE 28 February 2017 Intel Visit

LHC Run3 and Run4 Scale and Challenges 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 … … 2030? First run LS1 Second run LS2 Third run LS3 HL-LHC FCC? Raw data volume for LHC increases exponentially and with it processing and analysis load Technology at ~20%/year will bring x6-10 in 10-11 years Estimates of resource needs at HL-LHC x10 above what is realistic to expect from technology with reasonably constant cost Data: Raw 2016: 50 PB  2027: 600 PB Derived (1 copy): 2016: 80 PB  2027: 900 PB CPU: x60 from 2016 Technology revolutions are needed 28 February 2017 Intel Visit

WLCG Achievements – 2 preparations for HL-LHC Detector design, trigger rates, etc. Optimization of reconstruction, simulation, etc. New grid/cloud models; optimisation of CPU/disk/network Architecture, memory, etc.  HEP SW Foundation roadmap 28 February 2017 Intel Visit

28 February 2017 Intel Visit

IT Challenges Computing needs and technological challenges for the Data Center have been described this morning The role of the IT Department is to keep providing an excellent level of services while scaling up to the foreseen resource levels at an affordable cost 28 February 2017 Intel Visit

On-Premise Vs. Public Clouds Exclusive use of only on-premise or only cloud infrastructures not efficient, agile or cost-effective Hybrid computing and data infrastructures CERN/HEP managed resources based on LHC needs Transparent integration of commercially available resources for elastic scaling out as needed Take advantage of Opportunistic Computing 28 February 2017 Intel Visit

Open Science: Zenodo Infrastructure Impact Runs on 30 VMs in CERN Cloud 8TB of data storage (AFS > EOS) Major SW upgrade in Sept (9 months prep) [1 Staff (60% EC), 1 FELL, 1 TECH] Impact Biggest issuer of DOIs for SW in world Reference material for publications F1000, Wiley, eLife, PLoS, Elsevier, Nature, etc Recommended by EC and National programmes Pilot the “Cloud Credit” model With NIH in their Commons EC - metered usage recharging? Not just the long-tail Frequent requests for 10TB-PBs of storage Visitors from ~ all Countries Including Antarctica Vatican City 56% from Europe 57k Records 11k Software 3k Datasets 700 Communities Projects Institutes Subjects Conferences Publishers 28 February 2017 Intel Visit

Common Facilities Achieve economies of scale and operational efficiency by identifying additional common facilities across the LHC Experiments LHCb/ALICE by 2021 ATLAS/CMS by 2025 Investigation of possible models including the construction of a new (efficient) data center 28 February 2017 Intel Visit

International Collaborations The objective of CERN’s participation in the work programme is to develop policies, technologies and services that can support the Organization’s scientific programme, promote open science and expand the impact of fundamental research on society and the economy. European Open Science Cloud will be the context for future projects •We have to see the opportunities to contribute to it with CERN technologies and services •We are positioning ourselves to give input to the new program 2018-2020 28 February 2017 Intel Visit

Innovation & Entrepreneurship R&D and Innovation Seminars, training courses, academic training CERN openlab Summer Students Programme 200+ press cuttings 150,000 visits to our website 50+ events, visits, lectures 100+ presentations 50+ news articles, press releases, case studies GeneROOT Innovation & Entrepreneurship Applications to cross-disciplinary research 28 February 2017 Intel Visit

R&D and Innovation Growing interest in the community for new models and tools (in addition to what will be described). For example: Applications of Machine Learning What is the impact on the computing models and the data center resources? Applications of IoT-like infrastructures Impact on network requirements? Security? 28 February 2017 Intel Visit

Education and Skills Development Bi-directional requirements The introduction of new technologies requires new skills Engagement in educational and training programs (e.g. Marie-Curie, like the ICE-DIP project; openlab summer student program; etc.) Ensure that young engineer/scientist leaving CERN have state-of-the-art skills readily usable in their future careers 28 February 2017 Intel Visit

Increasing Incompressible Expenses for Software Licenses, Maintenance and Support Risk to see software costs continue to increase in the near future due to commercial trends impacting the academic world. Remark: License infringement by very few individuals has a significant cost. 28 February 2017 Intel Visit