Overview Controls in CMS DCS Project Planning Controls in the CMS Experiment JCOP Review March 2003 J. Varela, LIP-Lisbon

CMS-DCS, JCOP Review J. Varela Crossing rate 40 MHz Event size~1 Mbyte DetectorChannelsControlEv. Data (bytes) Pixel GB50000 Tracker GB Preshower MB50000 ECAL MB HCAL MB50000 Muon DT MB10000 Muon RPC MB5000 Muon CSC MB90000 Trigger1 GB16000 Max LV1 Trigger 100 kHz Readout network1 Terabit/s High Level Trigger~5 TeraFlop Online rejection % System dead time~ % Detectors DAQ and Controls Requirements

CMS-DCS, JCOP Review J. Varela Experiment Controls Run Controls (RCS): Configure and operate all local/global data taking sessions Monitor and protect the measurements and the data flow Based on the CMS online software framework (XDAQ, RCS) and commercial products (DBs, SOAP, XML, e-tools etc.) Detector Controls (DCS): Setup and monitor the detectors and the environment Monitor and protect the apparatus equipment Based on industry standards (PLC, field buses, PVSS and JCOP tools)

CMS-DCS, JCOP Review J. Varela 8-fold DAQ system Data to Surface DAQ slice

CMS-DCS, JCOP Review J. Varela Trigger, DAQ and Control Subsystems Data to Surface RU Builder Filter Farms Trigger & Data Flow TPGTrigger Primitive Generator RTPRegional Trigger Processor LV1Level-1 Trigger Processor GTPGlobal Trigger Processor TTCTiming, Trigger Control sTTSsynchronous Trigger Throttle System aTTSasynchronous Trigger Throttle System EVMEvent Manager RCNReadout Control Network BCNBuilder Control Network DAQ column FESFrontEnd System FEDFrontEnd Driver D2SData to Surface RUReadout Unit BDNBuilder Data Network BUBuilder Unit FUFilter Unit CSNComputing Service Network Control column FECFrontEnd Controller DCNDetector Control network DSNDAQ Service Network DCSDetector Control System RCSRun Control System

CMS-DCS, JCOP Review J. Varela DAQ partitioning TTC and Trigger partitions: The TTC system consists of 32 partitions accessing 32 unconnected sets of FEDs The GTP can handle concurrently up to 8 different combinations of the 32 TTC partitions (DAQ partitions) Each set of FED-FRLs associated to a given TTC partition (trigger type) is programmed to send the event fragments always to the same DAQ slice. Mode 1) FED-RU builder partition Mode 2) FED-DAQ slice partition The EVM of each DAQ slice, using the trigger type contained in the GTP record, broadcasts the read command only to the RUs associated to that trigger type. All active DAQ slices result partitioned in the same way.

CMS-DCS, JCOP Review J. Varela Trigger Fast Control Global Trigger TTCmi DAQ Event Managers Partition Control TTCrx FrontEnd Partition Control TTCrx FrontEnd Partition Control TTC sTTS TTC sTTS TTC sTTS TTCrx FrontEnd Central Control aTTS LHC GPS Local Control Local Triggers L1A Control Front-end Emulators, Trigger Rules Trigger Throttling System (sTTS and aTTS) Calibration and Test Triggers Dedicated runs, Special triggers during runs Synchronization Control Timing signals, Resync procedures Partitioning 8 independent partition groups, 8 independent triggers

CMS-DCS, JCOP Review J. Varela SubdetectorNumber Partitions Pixels2 Barrel, Forward Si-Tracker4Disk+, Disk-, Inner barrel, Outer barrel ECAL6EB+, EB-, EE+, EE-, SE+, SE- HCAL6 HB+, HB-, HE+, HE-, HF+, HF- RPC4Endcap+, Endcap-, Barrel+, Barrel- DT2Barrel+, Barrel- CSC2Endcap+, Endcap- Calorimeter Trigger1Calorimeter trigger Muon Trigger2CSC and DT trigger Global Trigger1Global trigger + Global Muon trigger TTC/TTS Partitions

CMS-DCS, JCOP Review J. Varela Frontend Readout Systems

CMS-DCS, JCOP Review J. Varela LOCAL (VME) GLOBAL Slink-64 Detector Data Taking (DAQ systems) Local DAQ - VME/PCI FED data acquisition - Test beam DAQ systems - Test and Calibration readout - Online passive readout Global DAQ - Main DAQ data stream Run Control and Monitor - Supervision of all data taking operations - DAQ resource and partition handling - Readout subsystems configuration - Data flow monitoring - DCS communication

CMS-DCS, JCOP Review J. Varela FrontEnd Configuration and Monitor Detector specific systems Access to the inner readout electronics, the power regulators, the programmable logics, the sensors to read currents, temperatures etc.. Special requirements imposed detector specific solutions. -Data links and interfaces -Programmable Logic (FPGA,..) controls -Sensors readout -Calibration and test procedures The configuration data set are often very large. The collected data (temperature and currents) are data complementary of the measurement instead of control parameters. All Detector Safety Units make use of dedicated and wired sensors

CMS-DCS, JCOP Review J. Varela Detector Control (DCS systems) Detector subsystems -HV/LV -Fluids and environment -Cooling -Racks/Crates -Temperatures -Infrastructures -Test systems (Laser, LED, alignment camera etc..) Detector safety (DSS) -Temperature -Gas -Radiation Experiment supervision -DCS Resources handling -Alarm and loggings -History data base -External systems communication. Supervisor structure etc. TPGTrigger Primitive Generator RTPRegional Trigger Processor LV1Level-1 Trigger Processor GTPGlobal Trigger Processor TTCTiming, Trigger Control sTTSsynchronous Trigger Throttle System aTTSasynchronous Trigger Throttle System FESFrontEnd System FEDFrontEnd Driver FECFrontEnd Controller D2SData to Surface RUReadout Unit BUBuilder Unit FSFilter Subfarm EVMEvent Manager RMReadout Manager BMBuilder Manager EVBEvent Builder RCNReadout Control Network BCNBuilder Control Network CSNComputing Service Network DCNDtector Control network DSNDAQ Service Network DCSDetector Control System RCSRun Control System

CMS-DCS, JCOP Review J. Varela Frontend Control Systems

CMS-DCS, JCOP Review J. Varela Common FrontEnd Control Used by: Pixels, Tracker, ECAL, RPC CCU Block Diagram Front End Controller (FEC) VME module Controls and monitors frontend electronics Distributes master clock and L1A triggers Reads monitoring data Digital optical links at 40MHz Communication and Control Unit (CCU) Token ring architecture with redundancy Distribution of clock, trigger, commands and monitoring data inside detector Detector Control Unit (DCU) Interface to monitor slowly varying parameters

CMS-DCS, JCOP Review J. Varela HCAL DCS Layout Industrial PC, Linux HV power supplies RBX Private system servers (PVSS systems) User PCs (PVSS Uis) 200m Counting room HCAL host RS422 Hub-18 RS/RS Cavern RBX FE boards, LED calibration module, Monitoring modules 18 RBXs HV, LV Laser, RBXs, Sources Hub-18 RS/RS CCM LV power supply Truncated CCM RS422 RS422 fan-out HV power supplies 14 permanent drivers PCI interface Industrial PC, Linux RS422 fan-out To sources RS485 HF radiation monitoring Drivers for tmp srcs To temporary sources

CMS-DCS, JCOP Review J. Varela CFEB 48 peripheral crates VME DCS PC(s) DB SCADA PVSS II Low Voltage Distribution Board Anode LCT Board Cathode Front End Board DAQ Mother Board Trigger Mother Board Clock Control Board Muon Port Card Endcap Muon Chamber Dynatem DMB CCB TMB Crate PS ALCT LVDB LVMB Low Voltage Mezzanine Board Skewclear LV HV gas cooling alignment Calibration local DAQ MPC Ethernet 10-Base-FL MuonCSC DCS Layout

CMS-DCS, JCOP Review J. Varela MuonDT DCS Layout SLOW CONTROL MASTER –Sits in the counting room –250 RS232 optical connections –Houses the DCS interface SERIAL LINKS –One direct link from each control board to counting room –One direct link from half wheel control board to counting room –One daisy chained link from sector collector to control boards (half wheel) –One local link for maintenance

CMS-DCS, JCOP Review J. Varela RCS: Data Acquisition Systems Based on the CMS online software framework (XDAQ, RCS) and commercial products (DBs, SOAP, XML, e-tools etc.) -Run Control and Monitor -Local/Global DAQ systems -FrontEnd Electronics Configuration -Readout Electronics Configuration -PC clusters and applications control -Local/Remote Data Archive -Run Condition Data Base -Configuration Data Base DCS: Classic Contro l Based on industry standards (PLC, field buses, PVSS and JCOP tools) -Racks/Crates power -HV/LV supplies -Cooling and environment -Gas and fluids -Central supervision -Alarms, history data base -External system communication -Detector Safety Detector specific monitoring and calibration tasks User applications mainly based on XDAQ with direct interfaces with local/central DCS systems -On detector electronics sensors (temperatures, currents, …) -FrontEnd electronics test and commissioning procedures -Calibration (source, LED, Laser) sessions RCS and DCS Domains

CMS-DCS, JCOP Review J. Varela Silicon Tracker Pedestal run Test pulse run Synchronization run Optical link special run Linearity run Alignment run MIP calibration Pixels Calibration run Preshower Pedestal run Test pulse run Synchronization run MIP calibration Calibration with electrons ECAL Calibration data Monitoring run Slow control run Test pattern run Laser run Synchronization run HCAL Radioactive source Laser calibration LED calibration Charge injection MUON DT Threshold run Relative t 0 calibration Rates Alignment run Gap tests Absolute synchronization MUON CSC Test Pulse Run Pedestals Trigger thresholds Trigger patterns Test pulse run Synchronization run Alignment run MUON RPC Test patterns runs Synchronization runs Calibration Runs

CMS-DCS, JCOP Review J. Varela Online software framework (CMS XDAQ and RCMS) -Local/Global DAQ systems -Local/Global Run Control -Detector specific electronics system configuration and monitoring -Job&Application control -Data taking monitoring and calibration -Local/Remote mass storage and data bases DCS subsystem and supervision (PVSS and JCOP supported tools) -Classic detector slow control (Racks/Crates, HV/LV, Cooling, Gas, Security) -Generic DCS framework (exploiting industrial H/S implementations) -Experiment detector controls supervisory levels -Centralized functions (Alarms, History, Security) Common features between the two systems: -XDAQ-PVSS interface (based on native PVSS API) -Access to external data bases for run conditions and experiment configuration both from XDAQ and PVSS RCS and DCS Frameworks

CMS-DCS, JCOP Review J. Varela A collection of packages to - Directly manipulate VME/PCI devices - Perform network communication TCP, Ethernet, HTTP, Myrinet - Execute user applications in a well controlled environment - Provide control and configuration commands for applications and devices - Provide access to configuration data XML files (disk or network) databases Executive User Application Module XDAQ Application XDAQ Framework

CMS-DCS, JCOP Review J. Varela XDAQ Interfaces XDAQ Hardware abstraction layer (PCI to VME, direct VME, direct PCI) communication interfaces (PVSS, TCP, HTTP, Myrinet, raw Ethernet) Data store (Oracle, mySQL, XML files) user defined Application modules user defined Application modules user defined Application modules user defined Application modules

CMS-DCS, JCOP Review J. Varela DCS Project Planning ~ 60 Subdetector Work Packages: SubDetectors: Pixels, Tracker, ECAL, HCAL, CSC, DT, RPC, Alignment Central DCS Work Packages  FSM hierarchy and JCOP framework setup  DataBases  Interface RCS-DCS  Integration with Dedicated Control Systems  Environmental Measurements  Hardware Infrastructure  Machine Interface

CMS-DCS, JCOP Review J. Varela PixelsTrackerECALHCAL General Framework Pixels Power Supplies HV Power Supplies Control High Voltage Pixels TemperatureLV Power Supplies Control Low Voltage Pixels CoolingHV, LV and I_leak DCU Monitoring Temperature Safety System (TSS) Readout Boxes Radiation Monitoring Temperature DCU Monitoring CoolingSource Calibration Pixels Front-End Control Temperature and Humidity non DCU Monitoring Precision Temperature and Humidity Monitoring Laser Thermal screen Control Monitoring LaserHF radiation monitoring Thermal and other Interlock control DCS Subdetector Work Packages (I)

CMS-DCS, JCOP Review J. Varela DCS Subdetector Work Packages (II) Muon CSCMuon DTMuon RPCAlignment General Framework High Voltage Front-End Control and Readout Low Voltage Temperature and Humidity Gas, Cooling and Ventilation Racks and CratesMini-Crate ControlRacks and Crates

CMS-DCS, JCOP Review J. Varela Subdetector DCS Milestones First Prototype using PVSS framework First Integration with Central DCS Final System

CMS-DCS, JCOP Review J. Varela DCS Conventions and InterfacesQ2 03 Naming scheme, Commands, States Data Bases Specification Q3 03 Configuration, Conditions, Assets, Archive Prototype Central DCS Q4 03 Including scaling tests First prototype of complete DCS systemQ4 04 Integration of subdetectors (Slice test) Configuration DataBase DAQ interface Integration with Dedicated Systems Gas, Cooling, Racks, DSS Q1 05 Magnet, Technical services Q1 06 Central DCS Milestones

CMS-DCS, JCOP Review J. Varela Requirements to JCOP Hierarchy Control (2Q 2003) Configuration Tools (2Q 2003) HV Control (2Q 2003) Detector Safety System (1Q 2004) Data visualisation (1Q 2004) Crate Control (1Q 2004) Rack Control (1Q 2004) Interface to Conditions Data Base (2Q 2004) Large scale distribution system (2Q 2004) Gas Control (4Q 2004) Cooling and Ventilation Control (4Q 2004) Web Access (4Q 2005) Interface to Technical Services (1Q 2006) Interface to LHC Accelerator (2Q 2006)