Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR.

Slides:



Advertisements
Similar presentations
Clara Gaspar on behalf of the LHCb Collaboration, “Physics at the LHC and Beyond”, Quy Nhon, Vietnam, August 2014 Challenges and lessons learnt LHCb Operations.
Advertisements

Software Process Models
Software Process Models
Resources for the ATLAS Offline Computing Basis for the Estimates ATLAS Distributed Computing Model Cost Estimates Present Status Sharing of Resources.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
1 IS112 – Chapter 1 Notes Computer Organization and Programming Professor Catherine Dwyer Fall 2005.
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
1 The ATLAS Online High Level Trigger Framework: Experience reusing Offline Software Components in the ATLAS Trigger Werner Wiedenmann University of Wisconsin,
Chapter 9 – Software Evolution and Maintenance
Hall D Online Data Acquisition CEBAF provides us with a tremendous scientific opportunity for understanding one of the fundamental forces of nature. 75.
INFO425: Systems Design INFORMATION X Finalizing Scope (functions/level of automation)  Finalizing scope in terms of functions and level of.
Chapter 2 The process Process, Methods, and Tools
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
CLAS12 CalCom Activity CLAS Collaboration Meeting, March 6 th 2014.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
Designing a HEP Experiment Control System, Lessons to be Learned From 10 Years Evolution and Operation of the DELPHI Experiment. André Augustinus 8 February.
Chapter 6 : Software Metrics
2 Systems Architecture, Fifth Edition Chapter Goals Describe the activities of information systems professionals Describe the technical knowledge of computer.
SCSC 311 Information Systems: hardware and software.
Offline Coordinators  CMSSW_7_1_0 release: 17 June 2014  Usage:  Generation and Simulation samples for run 2 startup  Limited digitization and reconstruction.
Use of GPUs in ALICE (and elsewhere) Thorsten Kollegger TDOC-PG | CERN |
Finnish DataGrid meeting, CSC, Otaniemi, V. Karimäki (HIP) DataGrid meeting, CSC V. Karimäki (HIP) V. Karimäki (HIP) Otaniemi, 28 August, 2000.
Requirements for a Next Generation Framework: ATLAS Experience S. Kama, J. Baines, T. Bold, P. Calafiura, W. Lampl, C. Leggett, D. Malon, G. Stewart, B.
4.2.1 Programming Models Technology drivers – Node count, scale of parallelism within the node – Heterogeneity – Complex memory hierarchies – Failure rates.
Plans for Trigger Software Validation During Running Trigger Data Quality Assurance Workshop May 6, 2008 Ricardo Gonçalo, David Strom.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
Future farm technologies & architectures John Baines 1.
Control in ATLAS TDAQ Dietrich Liko on behalf of the ATLAS TDAQ Group.
ATLAS in LHCC report from ATLAS –ATLAS Distributed Computing has been working at large scale Thanks to great efforts from shifters.
1 Planning for Reuse (based on some ideas currently being discussed in LHCb ) m Obstacles to reuse m Process for reuse m Project organisation for reuse.
The System and Software Development Process Instructor: Dr. Hany H. Ammar Dept. of Computer Science and Electrical Engineering, WVU.
Numerical Libraries Project Microsoft Incubation Group Mary Beth Hribar Microsoft Corporation CSCAPES Workshop June 10, 2008 Copyright Microsoft Corporation,
Future Framework John Baines for the Future Framework Requirements Group 1.
Trigger input to FFReq 1. Specific Issues for Trigger The HLT trigger reconstruction is a bit different from the offline reconstruction: – The trigger.
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
Preparations for the 2012 Athens Trigger Workshop Trigger Workshop Panel John Baines (chair), Thorsten Wengler, Bill Murray, Tatsuo Kawamoto, Olga Igonkina,
TDAQ Upgrade Software Plans John Baines, Tomasz Bold Contents: Future Framework Exploitation of future Technologies Work for Phase-II IDR.
Overview of DAQ at CERN experiments E.Radicioni, INFN MICE Daq and Controls Workshop.
Trigger Software Upgrades John Baines, Tomasz Bold, Joerg Stelzer, Werner Wiedenmann 1.
U.S. ATLAS Executive Committee August 3, 2005 U.S. ATLAS TDAQ FY06 M&O Planning A.J. Lankford UC Irvine.
1 LHCC RRB SG 16 Sep P. Vande Vyvre CERN-PH On-line Computing M&O LHCC RRB SG 16 Sep 2004 P. Vande Vyvre CERN/PH for 4 LHC DAQ project leaders.
Overview of RUP Lunch and Learn. Overview of RUP © 2008 Cardinal Solutions Group 2 Welcome  Introductions  What is your experience with RUP  What is.
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
Process Asad Ur Rehman Chief Technology Officer Feditec Enterprise.
Pierre VANDE VYVRE ALICE Online upgrade October 03, 2012 Offline Meeting, CERN.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
LHCbComputing Computing for the LHCb Upgrade. 2 LHCb Upgrade: goal and timescale m LHCb upgrade will be operational after LS2 (~2020) m Increase significantly.
A Validation System for the Complex Event Processing Directives of the ATLAS Shifter Assistant Tool G. Anders (CERN), G. Avolio (CERN), A. Kazarov (PNPI),
16 September 2014 Ian Bird; SPC1. General ALICE and LHCb detector upgrades during LS2  Plans for changing computing strategies more advanced CMS and.
COMPASS DAQ Upgrade I.Konorov, A.Mann, S.Paul TU Munich M.Finger, V.Jary, T.Liska Technical University Prague April PANDA DAQ/FEE WS Игорь.
FTK high level simulation & the physics case The FTK simulation problem G. Volpi Laboratori Nazionali Frascati, CERN Associate FP07 MC Fellow.
Mar 05 - hvdsOffline / HLT1  Athena SW Infrastructure  programming + applying tools wrt. dependencies between packages  developing + testing extra ideas.
GUIDO VOLPI – UNIVERSITY DI PISA FTK-IAPP Mid-Term Review 07/10/ Brussels.
Information Systems Development
Chapter 1 Computer Technology: Your Need to Know
Software Project Configuration Management
Lecture 3 Prescriptive Process Models
U.S. ATLAS TDAQ FY06 M&O Planning
How Systems are Developed
TDAQ Phase-II kick-off CERN background information
Project definition and organization milestones & work-plan
SuperB and its computing requirements
for the Offline and Computing groups
Controlling a large CPU farm using industrial tools
WLCG: TDR for HL-LHC Ian Bird LHCC Referees’ meting CERN, 9th May 2017.
ALICE, ATLAS, CMS & LHCb joint workshop on DAQ
Software What Is Software?
Information Systems Development
Chapter 8 Software Evolution.
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Presentation transcript:

Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR

Scope – Trigger software: runs in HLT farm, selects events – Online software: DAQ and HLT infrastructure – Upgrade only; M&O excluded Plans: – Main work during – Based on experience of original software, data taking, and planning LS1 S.George & R. Hauser2

Time line TDR (end 2013) – Will describe baseline assumptions and plan, with some potential options to consider – Some technology evaluations (e.g. GPGPU, Xeon Phi) already starting Advantage to delay technology decisions to 2016/17 – Most software upgrades will benefit from experience of development during LS1 and operational experience in 2015 – Hardware decisions best taken as late as practical - avoid being caught out by change in technology trends after decision – Lead time on software changes varies: plans will reflect this – Evaluate emerging hardware and software technologies until decision is needed Final software testing and iteration through 2018 S.George & R. Hauser LS1 LS2 TDR Phase 1 Phase 1 software upgrade

Drivers for changes to Trigger/DAQ/HLT software (1) LHC upgrade – higher energy, luminosity, pileup Detector and T/DAQ upgrades – L1Calo, L1Muon, L1Topo – FTK – Dataflow software, network and ROS upgrades The next rolling network upgrade will be in Performance requirements – Higher rates and bandwidth throughout the system – More complex algorithms and trigger strategies to achieve necessary rejection/efficiency – More precise/frequent online conditions updates S.George & R. Hauser4

Drivers for changes to Trigger/DAQ/HLT software (2) External computing trends – CPU evolution, co-processors, PC architecture (memory, cores, i/o) – Networking technology and prices – Developments and possible paradigm shifts in software languages, libraries, technologies – Rise and fall of numerous free & commercial products we use Offline computing – Offline software: framework, detector, data and reconstruction code – Common infrastructure: o/s, build, compilers, libraries Turnover of people and significant evolution of requirements – Some of the TDAQ core services and HLT core software will be over 10 years old, during which time they have been extended to do things that were never imagined when first designed – Plan refactoring and replacement where needed for future maintenance and to rebuild a pool of expertise Need for increased automation – Operations procedures, scaling of expert systems S.George & R. Hauser5

Summary of main trigger work Trigger core software – Includes steering, data access, configuration, monitoring, analysis – Need sub-event parallel code to exploit many-core and co-processor architectures – Work closely with offline to introduce new framework before phase 1 – Expect significant effort to contribute and adapt – New challenges for monitoring algorithm performance and code analysis/debugging tools – Also expect possible changes to i/o framework and data model – Interfaces with DAQ/HLT, steering, algorithms affected Menus & algorithms – A lot of work on studies, strategy development, code development and offline code adaption. – Includes use of IBL, FTK Trigger simulation – New L1 hardware – Implications of using specialist processors online such as GPGPUs and FTK – Fast trigger simulation S.George & R. Hauser6

Common Trigger and DAQ/HLT work Evaluate emerging software and hardware technologies – GPGPU, other co-processors, better CPU vector engines, performance vs. cost of many-core vs multi-core – Example: GPGPU evaluation Data preparation, tracking in HLT algorithms. Gatherer in DAQ? – Redesign of software to take advantage of chosen technologies S.George & R. Hauser7

Trigger work packages and effort Work package Total Core software Evaluate and exploit new technologies Menus & algorithms Simulation Total S.George & R. Hauser8

Summary of DAQ/HLT work Changes are required to HLTPU for new offline framework interface to data flow. DAQ/HLT core software, control and monitoring changes will depend on outcome of evaluation in 2015 – Some changes likely but not yet known which – Might also require many changes in detector sw that are not costed in this plan. Data flow changes will be driven by the availability/cost/capabilities of networking technology. S.George & R. Hauser9

DAQ/HLT work packages and effort Work package Total HLT Processing Unit DAQ/HLT Core Software, Infrastructure Configuration, Control & Monitoring, Web Services Data Flow, Event Format Detector and Control Room Software and Tools Evaluate and exploit new technologies Total S.George & R. Hauser10

Developer profile Due to extensive use of new software and hardware technologies and highly technical nature of work Most work requires people with software engineering background or significant experience. Estimate about 25% of trigger work could be done by motivated physicists, mainly in menus and algorithms. S.George & R. Hauser11

Major Milestones End 2013: TDR End 2015: Decisions on need to renew major software components and software technology choices Early 2017: Decision on PC architecture for new HLT farm nodes End 2017: Final software release ready for testing End 2018: Ready for data taking S.George & R. Hauser12

Summary S.George & R. Hauser13 Total effort over 4 years (FTE): 70.9 (Trigger) (DAQ/HLT) See document for more details LS1 LS2 TDR Phase 1 Phase 1 software upgrade 4-year software plan for Phase 1