LHC-B Computing Computing Tasks Computing Model Software Strategy

Slides:



Advertisements
Similar presentations
ASYCUDA Overview … a summary of the objectives of ASYCUDA implementation projects and features of the software for the Customs computer system.
Advertisements

March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
CIM2564 Introduction to Development Frameworks 1 Overview of a Development Framework Topic 1.
11.1 Lecture 11 CASE tools IMS Systems Design and Implementation.
Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR.
Introduction to Information System Development.
INFO425: Systems Design INFORMATION X Finalizing Scope (functions/level of automation)  Finalizing scope in terms of functions and level of.
Page 1 MODEL TEST in the small GENERALIZE PROGRAM PROCESS allocated maintenance changes management documents initial requirement project infrastructure.
Institut Experimentelles Software Engineering Fraunhofer IESE Klaus Schmid Relating Product Line Adoption Mode and Transition Process.
Architecture Session Discussion Marseilles September 1999 John Harvey CERN / LHCb.
REVIEW OF NA61 SOFTWRE UPGRADE PROPOSAL. Mandate The NA61 experiment is contemplating to rewrite its fortran software in modern technology and are requesting.
Designing a HEP Experiment Control System, Lessons to be Learned From 10 Years Evolution and Operation of the DELPHI Experiment. André Augustinus 8 February.
SWE 316: Software Design and Architecture – Dr. Khalid Aljasser Objectives Lecture 11 : Frameworks SWE 316: Software Design and Architecture  To understand.
©Ian Sommerville 2000 Software Engineering, 6th edition. Slide 1 Component-based development l Building software from reusable components l Objectives.
SOFTWARE REUSABILITY AJAYINDER SINGH CSC What is Software Reuse Software reuse is the process of implementing or updating software systems using.
LHC Computing Review Recommendations John Harvey CERN/EP March 28 th, th LHCb Software Week.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
1 Planning for Reuse (based on some ideas currently being discussed in LHCb ) m Obstacles to reuse m Process for reuse m Project organisation for reuse.
LHCb Computing Organisation and Development Strategy Presented to ATLAS Architecture WG July 16th, 1999 J.Harvey / LHCb.
Subject Slide 1 Roundtable on Software Process Input from LHCb.
19 November 98 1 Jürgen Knobloch ATLAS Computing ATLAS Computing - issues for 1999 Jürgen Knobloch Slides also on:
Direction and system changes impacting on data editing and imputation at Statistics New Zealand Paper by Emma Bentley and Felibel Zabala, presented by.
Chapter 6 – Architectural Design Lecture 1 1Chapter 6 Architectural design.
Chapter 6 CASE Tools Software Engineering Chapter 6-- CASE TOOLS
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
ANALYSIS PHASE OF BUSINESS SYSTEM DEVELOPMENT METHODOLOGY.
Lecture 21: Component-Based Software Engineering
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
Marco Cattaneo, 3-June Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
Marco Cattaneo, 20-May Event Reconstruction for LHCb  What is the scope of the project?  What are the goals (short+medium term)?  How do we organise.
1 Distributed Systems Architectures Distributed object architectures Reference: ©Ian Sommerville 2000 Software Engineering, 6th edition.
WMO WIS strategy – Life cycle data management WIS strategy – Life cycle data management Matteo Dell’Acqua.
RAMSDENTelecommunications Training RAMSDEN Telecommunications Training RTT75 Create Technical Documentation.
Advanced Software Engineering Dr. Cheng
READ ME FIRST Use this template to create your Partner datasheet for Azure Stack Foundation. The intent is that this document can be saved to PDF and provided.
Introduction to Systems Analysis and Design
Pragmatics 4 Hours.
EI Architecture Overview/Current Assessment/Technical Architecture
Chapter 1 The Systems Development Environment
Netscape Application Server
Migration of reconstruction and analysis software to C++
Chapter 18 Maintaining Information Systems
Software Life Cycle “What happens in the ‘life’ of software”
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Chapter 1 The Systems Development Environment
Distribution and components
Chapter 1 The Systems Development Environment
Analyst’s introduction to post-merger integration in telecommunications
Concepts used for Analysis and Design
LCG Operations Workshop, e-IRG Workshop
Marco Cattaneo, CERN February 2000
Tools of Software Development
Overview: Software and Software Engineering
6 6 Training Employees C H A P T E R Training Employees
WIS Strategy – WIS 2.0 Submitted by: Matteo Dell’Acqua(CBS) (Doc 5b)
Chapter 27 Software Change.
Simulation and Physics
LHCb Computing Project Organisation Manage Steering Group
Software and Software Engineering
Chapter 8, Design Patterns Introduction
Chapter 1 The Systems Development Environment
Planning next release of GAUDI
Summary of Computing Section of Technical Proposal
Logical Architecture & UML Package Diagrams
Presentation transcript:

LHC-B Computing Computing Tasks Computing Model Software Strategy Objectives Technology People Project Plan for LHC-B Computing Project organization Development phases and major milestones John Harvey - October 29, 1997 LHCB Status Report

LHC-B Computing Group Pavel Binko Olivier Callot Lola Camacho Marco Cattaneo Jean-Pierre Dufey Yuri Ermoline Markus Frank Frank Harris John Harvey Eric van Herwijnen Irakli Mandjavidze Pere Mato Hans Muller Andreu Pacheco Florence Ranjard Wolfgang Tejessy Andrei Tsaregorodtsev John Harvey - October 29, 1997 LHCB Status Report

Introduction New software for a new experiment intense use of software in triggering (Levels 1,2, and 3) many orders of magnitude more data and CPU power Need better quality Control better designs, better control procedures, more manpower intensive Resources scarce improve efficiency - use engineering practices and modern technologies strategy must encourage all members of collaboration to participate Need experienced people LHC-B staff active in current experiments - big advantage Need to close culture gap Long lead times Important to have a well-defined strategy and investment in project management and planning John Harvey - October 29, 1997 LHCB Status Report

Software Strategy Objectives Reuse put effort into building high quality components become economic by extracting more use out of components Architecture-driven approach identify basic building blocks - 3 levels : patterns, components, frameworks reuse spans across application domains event display, geometry DB, data storage models, controls, GUI Common Infrastructure standardise on a set of working principles, process, development environment minimise diversity of hardware and software Commercial software Licensing model to minimise cost and ensure collaboration-wide availability Evolution development and maintenance span ~20 years plan for changes in needs and technology John Harvey - October 29, 1997 LHCB Status Report

Software Strategy Technology Why Object Technologies (OTs) ? Evolved from sound principles of software engineering Young staff with some training in computing familiar with OTs Technical prerequisites are in place development environments (languages etc.), ODBMS, communication standards, frameworks Widespread use and support by computing industry Adoption by HEP collaborations (BaBar, STAR, LHC,…) Object modeling leads naturally to reusability encapsulation, design patterns, component-ware, frameworks John Harvey - October 29, 1997 LHCB Status Report

Software Strategy Technology - Languages John Harvey - October 29, 1997 LHCB Status Report

Software Strategy Technology - Distributed Computing OMG Application Objects Common Facilities Object Request Broker Object Services Different standards CORBA, IDL (OMG - ODMG) DCOM, OLE (Microsoft) Javabeans / RMI (Javasoft) John Harvey - October 29, 1997 LHCB Status Report

Current LHC++ components John Harvey - October 29, 1997 LHCB Status Report

Manpower - Profiles Architects Software Engineers Software Toolsmiths experienced in design of large software systems, familiar with standards. deliver architectural design documents and frameworks Software Engineers develop basic building blocks , apply quality control require formal training in software engineering practices deliver reference documents and user guides Software Toolsmiths select and maintain software tools used to build our software install software tools and give support to programmers in their use manage the codebase and production processing on real and simulated data keeping track of all LHCB datasets Application Programmers must be familiar with software development environment and follow quality procedures when appropriate trained in use of supported languages, design methods and tools John Harvey - October 29, 1997 LHCB Status Report

Migration Strategy Harvest knowledge in legacy systems - dump legacy thinking LHC-B has limited software production activity now - this will change Longer we delay the more difficult it will be to make the transition Hands-on experience best way to learn Need a framework equipped with basic tools before people can start Intensive training can start once this framework is ready Need mentors and knowledge transfer between staff Technology still evolving and must be tracked - choices at appropriate times Benefit from support groups - news services, library, seminars, in-house training, support for engineering tools, joint projects John Harvey - October 29, 1997 LHCB Status Report

Other issues addressed in report Software development process Documentation Collaborative Computing Training John Harvey - October 29, 1997 LHCB Status Report

Organization of Computing Projects Steering Group • coordination • planning • architecture • budget OFF-LINE ON-LINE Computing Recon- Analysis Simul- ation DAQ DCS OPS SEG Facilities struction • Level 2 • Framework • Framework • Event • DCS • Control Tools & methods • Computing • Level 3 • Tools • Tools Builder • LHC room Model • Prompt • Production • Interfaces • Safety • SDE • CPU farms • Full • Crates • CASE • Desktop • DAQware • Code • Storage management • Network • Quality Re-usable Components Control • Event Display • Document. • Frameworks • Data Quality • Training • CORBA,DCOM • Bookkeeping • Licenses • OS • Librarian Collab Tools • Data management (DBMS) • Controls • Event Storage (HPSS) • GEANT4 • Graphical User Interfaces • CLHEP • Histograms John Harvey - October 29, 1997 LHCB Status Report

Links to Sub-detector Groups Application Project (e.g. DAQ) RICH Computing Team Project Leader Vertex RICH Inner Tracker Outer Tracker ECAL HCAL MUON Trigger L0 Trigger L1 Trigger L2/L3 John Harvey - October 29, 1997 LHCB Status Report

Development Phases Identify phases by boundaries which correspond to major decisions Plan for technology change Move to OTs which will have major impact FORTRAN to C++ Important to prototype gain experience study behaviour and performance After prototype phase take final decisions on technology Boundary of prototype and production phase should have less major impact design review, C++ to JAVA? John Harvey - October 29, 1997 LHCB Status Report

Software Planning for Transition Phase (1) John Harvey - October 29, 1997 LHCB Status Report

Software Planning for Transition Phase (2) John Harvey - October 29, 1997 LHCB Status Report

Global Software Planning Showing Main Development Phases John Harvey - October 29, 1997 LHCB Status Report

Global Planning For DAQ System John Harvey - October 29, 1997 LHCB Status Report

Summary Immediate challenge is a change of software paradigm Plan to make transition as painless as possible Relatively good position since we start later and have less investment in legacy code We have a kernel of experienced people - to be complemented by outside help Long term strategy involves a prototyping (learning) phase and a production phase Organise all computing as one project minimise barriers between on-line and off-line maximise reuse of software components John Harvey - October 29, 1997 LHCB Status Report

Software Strategy Architecture-driven development Patterns well engineered systems are full of patterns means of leveraging expertise of experienced architects provide a common vocabulary and understanding for design principles Components systems constructed out of re-usable tested components, with known characteristics and well-defined interfaces take longer to build, cost is higher often can be commercially obtained Frameworks set of pre-fabricated building blocks used, extended or customised for a particular application. ~half code in a typical application dedicated to routine operations, that can be built once and canned for reuse…frameworks give high level of reuse e.g. framework that provides histogramming, statistical analysis, visualisation can be used for interactive analysis, data quality monitoring, …. John Harvey - October 29, 1997 LHCB Status Report