WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017.

Slides:



Advertisements
Similar presentations
Ian Bird LHCC Referees’ meeting; CERN, 18 th November 2014.
Advertisements

Basic guidelines for the creation of a DW Create corporate sponsors and plan thoroughly Determine a scalable architectural framework for the DW Identify.
Lecture 5 Themes in this session Building and managing the data warehouse Data extraction and transformation Technical issues.
Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR.
Ian Bird WLCG Workshop Okinawa, 12 th April 2015.
Ian Bird WLCG Management Board CERN, 17 th February 2015.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
Information Systems Chapter 10 – Computers: Understanding Technology, 3 rd edition 1November 13, 2008.
Ian Bird LHCC Referee meeting 23 rd September 2014.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
Workshop summary Ian Bird, CERN WLCG Workshop; DESY, 13 th July 2011 Accelerating Science and Innovation Accelerating Science and Innovation.
1 Planning for Reuse (based on some ideas currently being discussed in LHCb ) m Obstacles to reuse m Process for reuse m Project organisation for reuse.
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
CMS Computing and Core-Software USCMS CB Riverside, May 19, 2001 David Stickland, Princeton University CMS Computing and Core-Software Deputy PM.
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
CS223: Software Engineering Lecture 2: Introduction to Software Engineering.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Ian Bird, CERN 2 nd February Feb 2016
Predrag Buncic ALICE Status Report LHCC Referee Meeting CERN
Ian Bird WLCG Networking workshop CERN, 10 th February February 2014
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
LHCbComputing Computing for the LHCb Upgrade. 2 LHCb Upgrade: goal and timescale m LHCb upgrade will be operational after LS2 (~2020) m Increase significantly.
Ian Bird, CERN WLCG LHCC Referee Meeting 1 st December 2015 LHCC; 1st Dec 2015 Ian Bird; CERN1.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB
Hall D Computing Facilities Ian Bird 16 March 2001.
LHCb Computing 2015 Q3 Report Stefan Roiser LHCC Referees Meeting 1 December 2015.
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
T0-T1 Networking Meeting 16th June Meeting
Evolution of storage and data management
CompSci 280 S Introduction to Software Development
Review of the WLCG experiments compute plans
HEP LTDP Use Case & EOSC Pilot
Ian Bird WLCG Workshop San Francisco, 8th October 2016
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
Computing models, facilities, distributed computing
Database System Concepts and Architecture
INFN Computing Outlook The Bologna Initiative
Methodology: Aspects: cost models, modelling of system, understanding of behaviour & performance, technology evolution, prototyping  Develop prototypes.
IS301 – Software Engineering Dept of Computer Information Systems
Scientific Computing Strategy (for HEP)
2. ISO Certification Discussed already at 2015 PoW and several WLCG OB meetings Proposed approach: An Operational Circular that describes the organisation's.
FUTURE ICT CHALLENGES IN SCIENTIFIC COMPUTING
for the Offline and Computing groups
Sergei V. Gleyzer University of Florida
Software Engineering Architectural Design Chapter 6 Dr.Doaa Sami
LHCb Software & Computing Status
Software Design and Architecture
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
Part 3 Design What does design mean in different fields?
Thoughts on Computing Upgrade Activities
R&D for HL-LHC from the CWP
ALICE Computing Model in Run3
Vision for CERN IT Department
Strategy document for LHCC – Run 4
Frequently asked questions about software engineering
Chapter 9 Moving to Design Part 1.
The latest developments in preparations of the LHC community for the computing challenges of the High Luminosity LHC Dagmar Adamova (NPI AS CR Prague/Rez)
New strategies of the LHC experiments to meet
Input on Sustainability
US ATLAS Physics & Computing
Chapter 6 – Architectural Design
Chapter 5 Architectural Design.
What does DPHEP do? DPHEP has become a Collaboration with signatures from the main HEP laboratories and some funding agencies worldwide. It has established.
THE REALITY OF USING CONTAINERS TO BUILD PRODUCTS
Systems Construction and Implementation
System Construction and Implementation
Systems Construction and Implementation
Presentation transcript:

WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017

HL-LHC Computing TDR Agreed with LHCC to produce TDR for HL-LHC computing in 2020 In 2017 we will provide a document describing the roadmap to the TDR (strategy document) Using the CWP as input Describing potential new computing models Defining prototyping and R&D work that will be needed The TDR will not be the end – technology evolution in 6-7 years will be significant, cannot afford not to follow it NB. Very different situation from the original TDR – we have a working and well-understood system that must continue to operate and evolve into the HL-LHC computing programme LHCC: 9 May 2017 Ian Bird

Strategy document in 2017 Describe the HL-LHC computing challenge given what we currently understand Running conditions, trigger rates, event complexity, based on reasonable extrapolations of today’s computing models This will be a snapshot of a (yearly?) update of these numbers Describe the potential computing models and how they could change the cost and/or physics output Necessarily at a high level Cost models Appropriate metrics, balance/trade-off between CPU, storage, network etc State-of-the-art understanding of evolution of technology 2-3 years is already difficult to predict; 10 years is impossible (even for the technology companies) Set out what we see as R&D areas, and potential prototyping activities or demonstrators: Goals, metrics, resources, plans The HSF CWP will provide the basis of this LHCC: 9 May 2017 Ian Bird

Technical topics Computing models Different scenarios Use of in-house, commercial, dedicated architectures, HPC, opportunistic, etc. resources Technology “choices” – may not be a choice but market-driven Data management and data access layer End-to-end performance considerations; models of data delivery, event streaming, etc. Networking Resource provisioning layer Workload management layer Analysis facilities – how will analysis be done – traditional vs ”query” vs ML, … These above lead to ideas about facilities and how they may look The stated (and agreed) intention in the CWP discussion is to make these components as common and non-experiment specific as possible Clarify what really needs to be specific The CWP will provide the details of progress and R&D roadmaps in many key areas LHCC: 9 May 2017 Ian Bird

CWP chapters Working groups: Working groups cont: Computing models Physics generators Math libraries Detector simulation Software trigger and event reconstruction Data access and management Event processing frameworks Working groups cont: Conditions database Security and access control Machine learning Data analysis Workflow and resource management Data and software preservation Careers, staffing, training LHCC: 9 May 2017 Ian Bird

What a 2020 TDR may contain Broad expectations of costs of computing – based on expected evolution of the models But 2020 is still 6 years before Run 4 – a lot will change and we must not be too prescriptive Rather have to show evolution goes towards maintaining a constant cost (or not!) Updated requirements for 1st years of HL-LHC To be regularly updated Updated technology expectations Snapshot as understood in 2020 Firmer ideas of computing models based on the prototyping work Roles of online, Tier 0, other facilities Bulk data management, processing, analysis models, simulation Roadmaps for R&D that is still required Data preservation – how to use Run 1,2,3 data A lot of details will not affect the cost significantly, and are part of the operating and evolving service Updates of key CWP strategic areas LHCC: 9 May 2017 Ian Bird