1. Overview Controls in CMS DCS Project Planning Controls in the CMS Experiment JCOP Review 10-12 March 2003 J. Varela, LIP-Lisbon

2. CMS-DCS, JCOP Review 10-03-03 J. Varela Crossing rate 40 MHz Event size~1 Mbyte DetectorChannelsControlEv. Data (bytes) Pixel600000001 GB50000 Tracker100000001 GB750000 Preshower14500010 MB50000 ECAL8500010 MB100000 HCAL14000.1 MB50000 Muon DT20000010 MB10000 Muon RPC20000010 MB5000 Muon CSC40000010 MB90000 Trigger1 GB16000 Max LV1 Trigger 100 kHz Readout network1 Terabit/s High Level Trigger~5 TeraFlop Online rejection 99.9997% System dead time~ % Detectors DAQ and Controls Requirements

3. CMS-DCS, JCOP Review 10-03-03 J. Varela Experiment Controls Run Controls (RCS): Configure and operate all local/global data taking sessions Monitor and protect the measurements and the data flow Based on the CMS online software framework (XDAQ, RCS) and commercial products (DBs, SOAP, XML, e-tools etc.) Detector Controls (DCS): Setup and monitor the detectors and the environment Monitor and protect the apparatus equipment Based on industry standards (PLC, field buses, PVSS and JCOP tools)

4. CMS-DCS, JCOP Review 10-03-03 J. Varela 8-fold DAQ system Data to Surface DAQ slice

5. CMS-DCS, JCOP Review 10-03-03 J. Varela Trigger, DAQ and Control Subsystems Data to Surface RU Builder Filter Farms Trigger & Data Flow TPGTrigger Primitive Generator RTPRegional Trigger Processor LV1Level-1 Trigger Processor GTPGlobal Trigger Processor TTCTiming, Trigger Control sTTSsynchronous Trigger Throttle System aTTSasynchronous Trigger Throttle System EVMEvent Manager RCNReadout Control Network BCNBuilder Control Network DAQ column FESFrontEnd System FEDFrontEnd Driver D2SData to Surface RUReadout Unit BDNBuilder Data Network BUBuilder Unit FUFilter Unit CSNComputing Service Network Control column FECFrontEnd Controller DCNDetector Control network DSNDAQ Service Network DCSDetector Control System RCSRun Control System

6. CMS-DCS, JCOP Review 10-03-03 J. Varela DAQ partitioning TTC and Trigger partitions: The TTC system consists of 32 partitions accessing 32 unconnected sets of FEDs The GTP can handle concurrently up to 8 different combinations of the 32 TTC partitions (DAQ partitions) Each set of FED-FRLs associated to a given TTC partition (trigger type) is programmed to send the event fragments always to the same DAQ slice. Mode 1) FED-RU builder partition Mode 2) FED-DAQ slice partition The EVM of each DAQ slice, using the trigger type contained in the GTP record, broadcasts the read command only to the RUs associated to that trigger type. All active DAQ slices result partitioned in the same way.

7. CMS-DCS, JCOP Review 10-03-03 J. Varela Trigger Fast Control Global Trigger TTCmi DAQ Event Managers Partition Control TTCrx FrontEnd Partition Control TTCrx FrontEnd Partition Control TTC sTTS TTC sTTS TTC sTTS TTCrx FrontEnd Central Control aTTS LHC GPS Local Control Local Triggers L1A Control Front-end Emulators, Trigger Rules Trigger Throttling System (sTTS and aTTS) Calibration and Test Triggers Dedicated runs, Special triggers during runs Synchronization Control Timing signals, Resync procedures Partitioning 8 independent partition groups, 8 independent triggers

8. CMS-DCS, JCOP Review 10-03-03 J. Varela SubdetectorNumber Partitions Pixels2 Barrel, Forward Si-Tracker4Disk+, Disk-, Inner barrel, Outer barrel ECAL6EB+, EB-, EE+, EE-, SE+, SE- HCAL6 HB+, HB-, HE+, HE-, HF+, HF- RPC4Endcap+, Endcap-, Barrel+, Barrel- DT2Barrel+, Barrel- CSC2Endcap+, Endcap- Calorimeter Trigger1Calorimeter trigger Muon Trigger2CSC and DT trigger Global Trigger1Global trigger + Global Muon trigger TTC/TTS Partitions

9. CMS-DCS, JCOP Review 10-03-03 J. Varela Frontend Readout Systems

10. CMS-DCS, JCOP Review 10-03-03 J. Varela LOCAL (VME) GLOBAL Slink-64 Detector Data Taking (DAQ systems) Local DAQ - VME/PCI FED data acquisition - Test beam DAQ systems - Test and Calibration readout - Online passive readout Global DAQ - Main DAQ data stream Run Control and Monitor - Supervision of all data taking operations - DAQ resource and partition handling - Readout subsystems configuration - Data flow monitoring - DCS communication

11. CMS-DCS, JCOP Review 10-03-03 J. Varela FrontEnd Configuration and Monitor Detector specific systems Access to the inner readout electronics, the power regulators, the programmable logics, the sensors to read currents, temperatures etc.. Special requirements imposed detector specific solutions. -Data links and interfaces -Programmable Logic (FPGA,..) controls -Sensors readout -Calibration and test procedures The configuration data set are often very large. The collected data (temperature and currents) are data complementary of the measurement instead of control parameters. All Detector Safety Units make use of dedicated and wired sensors

12. CMS-DCS, JCOP Review 10-03-03 J. Varela Detector Control (DCS systems) Detector subsystems -HV/LV -Fluids and environment -Cooling -Racks/Crates -Temperatures -Infrastructures -Test systems (Laser, LED, alignment camera etc..) Detector safety (DSS) -Temperature -Gas -Radiation Experiment supervision -DCS Resources handling -Alarm and loggings -History data base -External systems communication. Supervisor structure etc. TPGTrigger Primitive Generator RTPRegional Trigger Processor LV1Level-1 Trigger Processor GTPGlobal Trigger Processor TTCTiming, Trigger Control sTTSsynchronous Trigger Throttle System aTTSasynchronous Trigger Throttle System FESFrontEnd System FEDFrontEnd Driver FECFrontEnd Controller D2SData to Surface RUReadout Unit BUBuilder Unit FSFilter Subfarm EVMEvent Manager RMReadout Manager BMBuilder Manager EVBEvent Builder RCNReadout Control Network BCNBuilder Control Network CSNComputing Service Network DCNDtector Control network DSNDAQ Service Network DCSDetector Control System RCSRun Control System

13. CMS-DCS, JCOP Review 11-03-03 J. Varela Frontend Control Systems

14. CMS-DCS, JCOP Review 11-03-03 J. Varela Common FrontEnd Control Used by: Pixels, Tracker, ECAL, RPC CCU Block Diagram Front End Controller (FEC) VME module Controls and monitors frontend electronics Distributes master clock and L1A triggers Reads monitoring data Digital optical links at 40MHz Communication and Control Unit (CCU) Token ring architecture with redundancy Distribution of clock, trigger, commands and monitoring data inside detector Detector Control Unit (DCU) Interface to monitor slowly varying parameters

15. CMS-DCS, JCOP Review 11-03-03 J. Varela HCAL DCS Layout Industrial PC, Linux HV power supplies RBX Private system servers (PVSS systems) User PCs (PVSS Uis) 200m Counting room HCAL host RS422 Hub-18 RS/RS Cavern RBX FE boards, LED calibration module, Monitoring modules 18 RBXs HV, LV Laser, RBXs, Sources Hub-18 RS/RS CCM LV power supply Truncated CCM RS422 RS422 fan-out HV power supplies 14 permanent drivers PCI interface Industrial PC, Linux RS422 fan-out To sources RS485 HF radiation monitoring Drivers for tmp srcs To temporary sources

16. CMS-DCS, JCOP Review 11-03-03 J. Varela CFEB 48 peripheral crates VME DCS PC(s) DB SCADA PVSS II Low Voltage Distribution Board Anode LCT Board Cathode Front End Board DAQ Mother Board Trigger Mother Board Clock Control Board Muon Port Card Endcap Muon Chamber Dynatem DMB CCB TMB Crate PS ALCT LVDB LVMB Low Voltage Mezzanine Board Skewclear LV HV gas cooling alignment Calibration local DAQ MPC Ethernet 10-Base-FL MuonCSC DCS Layout

17. CMS-DCS, JCOP Review 11-03-03 J. Varela MuonDT DCS Layout SLOW CONTROL MASTER –Sits in the counting room –250 RS232 optical connections –Houses the DCS interface SERIAL LINKS –One direct link from each control board to counting room –One direct link from half wheel control board to counting room –One daisy chained link from sector collector to control boards (half wheel) –One local link for maintenance

18. CMS-DCS, JCOP Review 10-03-03 J. Varela RCS: Data Acquisition Systems Based on the CMS online software framework (XDAQ, RCS) and commercial products (DBs, SOAP, XML, e-tools etc.) -Run Control and Monitor -Local/Global DAQ systems -FrontEnd Electronics Configuration -Readout Electronics Configuration -PC clusters and applications control -Local/Remote Data Archive -Run Condition Data Base -Configuration Data Base DCS: Classic Contro l Based on industry standards (PLC, field buses, PVSS and JCOP tools) -Racks/Crates power -HV/LV supplies -Cooling and environment -Gas and fluids -Central supervision -Alarms, history data base -External system communication -Detector Safety Detector specific monitoring and calibration tasks User applications mainly based on XDAQ with direct interfaces with local/central DCS systems -On detector electronics sensors (temperatures, currents, …) -FrontEnd electronics test and commissioning procedures -Calibration (source, LED, Laser) sessions RCS and DCS Domains

19. CMS-DCS, JCOP Review 10-03-03 J. Varela Silicon Tracker Pedestal run Test pulse run Synchronization run Optical link special run Linearity run Alignment run MIP calibration Pixels Calibration run Preshower Pedestal run Test pulse run Synchronization run MIP calibration Calibration with electrons ECAL Calibration data Monitoring run Slow control run Test pattern run Laser run Synchronization run HCAL Radioactive source Laser calibration LED calibration Charge injection MUON DT Threshold run Relative t 0 calibration Rates Alignment run Gap tests Absolute synchronization MUON CSC Test Pulse Run Pedestals Trigger thresholds Trigger patterns Test pulse run Synchronization run Alignment run MUON RPC Test patterns runs Synchronization runs Calibration Runs

20. CMS-DCS, JCOP Review 10-03-03 J. Varela Online software framework (CMS XDAQ and RCMS) -Local/Global DAQ systems -Local/Global Run Control -Detector specific electronics system configuration and monitoring -Job&Application control -Data taking monitoring and calibration -Local/Remote mass storage and data bases DCS subsystem and supervision (PVSS and JCOP supported tools) -Classic detector slow control (Racks/Crates, HV/LV, Cooling, Gas, Security) -Generic DCS framework (exploiting industrial H/S implementations) -Experiment detector controls supervisory levels -Centralized functions (Alarms, History, Security) Common features between the two systems: -XDAQ-PVSS interface (based on native PVSS API) -Access to external data bases for run conditions and experiment configuration both from XDAQ and PVSS RCS and DCS Frameworks

21. CMS-DCS, JCOP Review 10-03-03 J. Varela A collection of packages to - Directly manipulate VME/PCI devices - Perform network communication TCP, Ethernet, HTTP, Myrinet - Execute user applications in a well controlled environment - Provide control and configuration commands for applications and devices - Provide access to configuration data XML files (disk or network) databases Executive User Application Module XDAQ Application XDAQ Framework

22. CMS-DCS, JCOP Review 10-03-03 J. Varela XDAQ Interfaces XDAQ Hardware abstraction layer (PCI to VME, direct VME, direct PCI) communication interfaces (PVSS, TCP, HTTP, Myrinet, raw Ethernet) Data store (Oracle, mySQL, XML files) user defined Application modules user defined Application modules user defined Application modules user defined Application modules

23. CMS-DCS, JCOP Review 10-03-03 J. Varela DCS Project Planning ~ 60 Subdetector Work Packages: SubDetectors: Pixels, Tracker, ECAL, HCAL, CSC, DT, RPC, Alignment Central DCS Work Packages  FSM hierarchy and JCOP framework setup  DataBases  Interface RCS-DCS  Integration with Dedicated Control Systems  Environmental Measurements  Hardware Infrastructure  Machine Interface

24. CMS-DCS, JCOP Review 10-03-03 J. Varela PixelsTrackerECALHCAL General Framework Pixels Power Supplies HV Power Supplies Control High Voltage Pixels TemperatureLV Power Supplies Control Low Voltage Pixels CoolingHV, LV and I_leak DCU Monitoring Temperature Safety System (TSS) Readout Boxes Radiation Monitoring Temperature DCU Monitoring CoolingSource Calibration Pixels Front-End Control Temperature and Humidity non DCU Monitoring Precision Temperature and Humidity Monitoring Laser Thermal screen Control Monitoring LaserHF radiation monitoring Thermal and other Interlock control DCS Subdetector Work Packages (I)

25. CMS-DCS, JCOP Review 10-03-03 J. Varela DCS Subdetector Work Packages (II) Muon CSCMuon DTMuon RPCAlignment General Framework High Voltage Front-End Control and Readout Low Voltage Temperature and Humidity Gas, Cooling and Ventilation Racks and CratesMini-Crate ControlRacks and Crates

26. CMS-DCS, JCOP Review 10-03-03 J. Varela Subdetector DCS Milestones First Prototype using PVSS framework First Integration with Central DCS Final System

27. CMS-DCS, JCOP Review 10-03-03 J. Varela DCS Conventions and InterfacesQ2 03 Naming scheme, Commands, States Data Bases Specification Q3 03 Configuration, Conditions, Assets, Archive Prototype Central DCS Q4 03 Including scaling tests First prototype of complete DCS systemQ4 04 Integration of subdetectors (Slice test) Configuration DataBase DAQ interface Integration with Dedicated Systems Gas, Cooling, Racks, DSS Q1 05 Magnet, Technical services Q1 06 Central DCS Milestones

28. CMS-DCS, JCOP Review 10-03-03 J. Varela Requirements to JCOP Hierarchy Control (2Q 2003) Configuration Tools (2Q 2003) HV Control (2Q 2003) Detector Safety System (1Q 2004) Data visualisation (1Q 2004) Crate Control (1Q 2004) Rack Control (1Q 2004) Interface to Conditions Data Base (2Q 2004) Large scale distribution system (2Q 2004) Gas Control (4Q 2004) Cooling and Ventilation Control (4Q 2004) Web Access (4Q 2005) Interface to Technical Services (1Q 2006) Interface to LHC Accelerator (2Q 2006)