1. Clara Gaspar, March 2003 LHCb’s Experiment Control System

2. Clara Gaspar, March 2003 2 Experiment Control zIn charge of the Control and Monitoring of: yDetector Operations (ex Slow Controls) xGAS, HV, LV, temperatures... yData Acquisition and Trigger xFE Electronics, Event building, EFF, etc. yExperimental Infrastructure xCooling, ventilation, electricity distribution,... yInteraction with the outside world xMagnet, accelerator system, safety system, etc.

3. Clara Gaspar, March 2003 3 ECS Scope Detector Channels Front End Electronics Readout Network Processing/Filtering Storage Trigger Experiment Control System DAQ DCS Devices (HV, LV, GAS, Temperatures, etc.) External Systems (LHC, Technical Services, Safety, etc)

4. Clara Gaspar, March 2003 4 Experiment Control System Operator Configuration Database Detector HW DAQ DCS Trigger Conditions Database Accelerator Configuration data Event related control’s data Status Commands/ settings Display Information Commands/ Settings Infrastructure Systems Status Information Safety System ECS Context Diagram Status Information Offline Analysis Safety alarms & Settings

5. Clara Gaspar, March 2003 5 ECS Requirements yIntegrate the different activities xSuch that rules can be defined (ex: Stop DAQ when DCS in Error) yAllow stand-alone control of sub-systems xFor independent development and concurrent usage. yAutomation xAvoids human mistakes and speeds up standard procedures yEasy to operate xTwo to three operators (non-experts) should be able to run the experiment. yScalable & Flexible xAllow for the integration of new detectors yMaintainable xExperiments run for many years

6. Clara Gaspar, March 2003 6 Experiment Control zKeywords: Homogeneity & Uniformity yA common approach in the design and common tools and components for the implementation of all parts of the system: xFacilitates inter-domain integration xMakes it easier to use: Standard features throughout the system (ex: partitioning rules) Uniform Look and Feel xNeeds less manpower xAllows an easier upgrade and maintenance

7. Clara Gaspar, March 2003 7 Design Goals and Principles Influenced by experience taken from LEP experiments zIntegrated approach from design phase yAn Architecture xThat can handle all aspects of the monitoring and control of the full experiment yA Framework xAn integrated collection of guidelines, tools and components allowing the development of each sub- system coherently in view of its integration in the complete system

8. Clara Gaspar, March 2003 8 Design Goals and Principles zDistributed Hierarchical Control yDe-composition in Systems, sub-systems, …, Devices yLocal decision capabilities in sub-systems ÔScalability zSimplicity ySimple functionalities and protocols ySeparation of controls and data path ÔReliability zMain-stream technologies where possible yPC based interfaces: PCI cards/OPC (no VME bus) ÔLess effort in implementation and maintenance

9. Clara Gaspar, March 2003 9 Generic SW Architecture... To Devices (HW or SW) Commands Status & Alarms ECS DCS DAQ DetDcs1 DetDcs N SubSys 1 SubSys 2 Dev 1 Dev 2 Dev 3 DetDaq 1 SubSysN Dev N LHC T.S.... GAS DSS

10. Clara Gaspar, March 2003 10 Hierarchical control zEach node is able to: ySummarize information (for the above levels) y“Expand” actions (to the lower levels) yImplement specific behaviour & Take local decisions xSequence & Automate operations xRecover errors yUser Interfacing xPresent information and receive commands DCS Tem p Tracke r Muon HVHV GA S HVHV

11. Clara Gaspar, March 2003 11 Run Control yRun Control è Is the interface to the Root node è If the tree is partitioned there can be several Run Controls. yEach node (and its sub-tree) xCan run in stand-alone (i.e. can be partitioned) xCan be controlled independently (by an authorized User Interface)

12. Clara Gaspar, March 2003 12 Generic SW Architecture... To Devices (HW or SW) Commands Status & Alarms ECS DCS DAQ DetDcs1 DetDcs N SubSys 1 SubSys 2 Dev 1 Dev 2 Dev 3 DetDaq 1 SubSysN Dev N LHC T.S.... GAS DSS

13. Clara Gaspar, March 2003 13 DCS Devices zHigh Voltages, Low Voltages, etc. yTry to use Commercial HW (CAEN,WIENER,ISEG,etc) yInterface: OPC Servers (provided by manufacturer) zAnalog & Digital IO (temperatures, etc.) yELMBs / OPC Servers yCommercial (e.g. WAGO) zOthers: yPLCs (Siemens, Schneider) / OPC Servers yHome made / DIM or OPC Servers Experimental equipment PLC FieldBus Node FieldBus

14. Clara Gaspar, March 2003 14 Front-End Electronics Devices zIn Radiation Areas yMainly needed I 2 C and JTAG xSPECS (evolved from ATLAS SPAC) Serial Protocol 10Mb/s Slave is radiation tolerant xELMB CAN protocol (0.5Mb/s) I2C JTAG SPECS CAN I2C JTAG I2C JTAG M S S S (~1000+)

15. Clara Gaspar, March 2003 15 Electronics Boards Devices zElectronics in barracks xFront-ends, Readout Units, Timing and Fast Control components, etc. yCredit Card PC’s x66  85  12 mm 3 xPentium Compatible CPU xLinux/DIM (no PVSS) Ethernet S S S I2C JTAG Bus I2C JTAG Bus I2C JTAG Bus (~500+)

16. Clara Gaspar, March 2003 16 Control of Electronics Boards yRead/write registers yLoad FPGAs

17. Clara Gaspar, March 2003 17 Event Filter Farm Devices yCPU Infrastructure xReboot/Download xMonitoring CPU usage, memory, IO, etc. yTrigger Algorithms xConfigure xMonitor xStart/Stop Event Builder Switch SFC CPU...... SFC CPU...... SFC CPU.........

18. Clara Gaspar, March 2003 18 Control System Monitoring zThe Monitoring of the Control System itself is very similar to the Monitoring of the CPUs in the Event Filter Farm: yControls PCs, Credit Card PC’s, etc: xRemote Boot & SW download xCPU Monitoring CPU usage, memory, IO, etc. xProcesses (control processes: PVSS, OPC, etc.) Configure, Monitor, Start/Stop

19. Clara Gaspar, March 2003 19 CPU Monitoring prototype yTry to use IT developments

20. Clara Gaspar, March 2003 20 EFF Algorithm Control zFunctionality needed: (Online environment: no disk/no files, low CPU usage) yConfigure algorithm sequences and algorithm parameters yStart/Stop processing yMonitor counters, errors, histograms, etc. yAdd histograms from several nodes Ô Needed to interface offline software framework ( GAUDI ) to ECS Ô Interfaced PVSS to ROOT

21. Clara Gaspar, March 2003 21 Online Gaudi

22. Clara Gaspar, March 2003 22 Proof of Concept zTestBeam Setup: yRun Control based on JCOP framework xInterfacing to (old) Cascade DAQ yIntegrated PS/SPS information yIntegrated CPU/process monitoring yStarted integrating DCS devices: xPlatform Motors xEnvironment monitoring (ELMB) xHigh Voltages

23. Clara Gaspar, March 2003 23 Test Beam Run Control

24. Clara Gaspar, March 2003 24 LHCb view on JCOP yThe best way to achieve a homogeneous and maintainable control system (and to save manpower) is to do the maximum in common: Ô Promote standardization (for ex. HW) so that common components can be (re)used. xDevise a generic architecture which fits all four experiments and “isolate” its building bocks. xIdentify commonly needed building blocks and develop them in common once. xProvide guidelines so that other components can be developed in a re-usable way and distributed to the community.

25. Clara Gaspar, March 2003 25 LHCb and JCOP LHCb is heavily investing in JCOP LHCb’s Control System relies on the success of the following JCOP projects: yThe Control Framework (in particular): x Hierarchical control tools addressing: partitioning, automation, error recovery, etc. x Configuration tools using an external database, allowing for the storage and retrieval of all HW and SW definitions and configuration parameters for different running modes. x Interface to a conditions database for storing parameters acquired by the control system x Modules for the exchange of information with other CERN domains: LHC machine, Technical Services, Safety System, etc. x “Plug and play” modules for the monitoring and control of commonly used equipment

26. Clara Gaspar, March 2003 26 LHCb and JCOP zInfrastructure Related Projects: xPower Distribution and Rack Control xCooling and Ventilation Control xGas Control xDetector Safety System xMagnet Control ySimilar philosophy for All Services (hopefully): xImplementation, Support and Maintenance by the provider (ST/EL & EP/ESS, ST/CV, Gas WG, JCOP, EP/TA3) Including closed loop control (PLC) programming, if any. Intervention picket xHigh level operation by Experiment (Sub Detectors) Start, Stop, Set parameters