CHEP 2010 – TAIPEI Robert Gomez-Reino on behalf of CMS DAQ group

the Compact Muon Solenoid A multi-purpose Large Hadron Collider experiment The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

 Ensure safe detector operation  anticipating the Detector Safety System (DSS) actions, triggering protection mechanisms on adverse conditions (high temperatures, high humidity, overcurrents, water leaks, electrical trips…)  preventing potentially dangerous actions  issuing alert notifications (alert screen, SMS, control room voice alerts)  Provide efficient detector operation  making sure that voltages are present whenever the accelerator conditions allow for physics data taking  guaranteeing that the controlled parameters are stable within their calibrated operating ranges Responsibilities & Requirements A non sleeping 24hr/day 365d/year running system The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Control system size ~ 10 6 control system parameters The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Design & Implementation Control system blocks The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Design & Implementation The control tree structure (based on SMI++) The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Infrastructure overview Computing resources, functionality and software life cycle The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Infrastructure overview Development environment The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Infrastructure overview Computing resources management The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

Infrastructure overview Production environment The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei

 Using CMS design and implementation guidelines CMS achieved a complete sub-detector control system integration  The control system homogeneity achieved allows for common functional components (warning notification system, performance monitoring, protection mechanism...)  A central supervisor governs the sub-detector operation allowing for automated actions Control system integration The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Control system automation Driven by LHC status The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei LHC THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK CMS Detector readiness BEAM MODE: NO BEAM MACHINE MODE: ACCESS

Automation matrix Automatic commands and protection interlocks The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK Detector readiness LHC CMS BEAM MODE: SETUP MACHINE MODE: PROTON PHYSICS

LHC-CMS handshake CMS prepares for injection The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK Detector readiness LHC CMS BEAM MODE: SETUP MACHINE MODE: PROTON PHYSICS INJECTION REQUEST!

LHC-CMS handshake CMS is ready for injection The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK Detector readiness LHC CMS BEAM MODE: INJECTION PROBE BEAM MACHINE MODE: PROTON PHYSICS INJECTION REQUEST REPLY

THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei Detector readiness LHC CMS BEAM MODE: FLAT TOP MACHINE MODE: PROTON PHYSICS Automation matrix

THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei Detector readiness LHC CMS BEAM MODE: STABLE BEAMS MACHINE MODE: PROTON PHYSICS Automation matrix CMS ready for data taking

Main supervisor panel The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Main supervisor panel The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Main supervisor panel The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Main supervisor panel The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

Main supervisor panel The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

The alert screen Where all the detector problems are reflected The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

 Avoid alarm flooding  Summary alerts  Hierarchical alarm reduction  Provide useful instructions for alerts  Alert help expert database  Web interface for entering alert help by detector experts  Web interface connected to the control room to offer help to the operator for each alert  Incremental alert help definition The alert screen Making its use efficient The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

 Today  Distributed control system with no redundant peers  Infrastructure for fast recovery (<1h)  Future  Redundant distributed control system with peers running in virtual machines on different servers and different racks  No interruptions Redundant control system Maximizing reliability The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei THE EXPERIMENTDCS OVERVIEWAUTOMATION OPERATIONONGOING WORK

 A robust system architecture proving to ensure the detector protection anticipating the safety system in most of the cases  Efficient detector operation achieved automating the detector operation. Efficiency > 99%  A reliable system requiring practically no expert interventions  A high system homogeneity easing the maintenance  An intuitive control room interface allowing a single non expert operator to supervise the whole experiment control system  A computing resources management infrastructure allowing for system recovery (but ongoing work to eliminate down time!) Summary The Compact Muon Solenoid detector control system - Robert Gomez-Reino - CHEP 2010, Taipei