1. 1 ALICE Control System ready for LHC operation ICALEPCS 16 Oct 2007 L.Jirdén On behalf of the ALICE Controls Team CERN Geneva

2. 2 Outline u About ALICE u Tools & components u Typical applications u Data flow u User Interface u Integration, installation & commissioning u Conclusion New approaches or trends in experiment controls New !

3. 3 Introduction ATLAS ALICE CMS LHCb center of Geneva u ALICE experiment u 18 sub-detectors, 2 magnets u 1000 members, 90 institutes, 30 countries u Being installed & commissioned Detectors not shown FMD, V0, T0, ZDC, EMC, CPV, ACO HMPID TOF TRD PMD SPD SDD SSD TPC MUON - SPECTROMETER PHOS u ALICE Controls u Started 6 years ago u Small central team collaborating with u Detector groups & LHC experiments (JCOP) u In total ~100 people involved

4. 4 ALICE environment ~ 55m ~ 50m BEAM HLT Control DAQ racks detectors ACR Detectors Strong radiation strong magnetic field Experimental cavern Closed zone at runs radiation magnetic field Counting rooms computer farms databases ALICE Control Room operator consoles

5. 5 18 detectors ~150 sub-systems Controls context SPDPHOFMDT0V0PMDMTIMTKZDCACOSDDSSDTPCTRDTOFHMP Controls Back-end Services Gas Electricity Cooling Magnets Access Infrastructure B-field Space Frame Environment Radiation Beam Pipe On-line Trigger DAQ HLT ECS Safety CSAM DSS External Systems Accelerator Offline

6. 6 ALICE FRAMEWORK USER APPLICATIONS Tools and components New approach! FRAMEWORK SCADA SYSTEM PVSSII Modular, distributed, equipment oriented error handling file & Dbase access graphics user interface TOOLS ALARM CONFIGURAT ACCESS ARCHIVAL TRENDING Modeling operational behavior Integration of commonly used devices Standard communication & hardware access CONNECTION: OPC, DIM, DIP DEVICE COMPONENTS FINITE STATE MACHINE TOOLS

7. 7 ALICE Detectors Time Projection Chamber TPC

8. 8 TPC sub-systems to control u TPC: 15 sub-systems u ALICE:150 sub-systems Very High Voltage (100 kV) High Voltage (3 kV) Low Voltage (60 kW) Front-End Electronics Cooling 0.1 o C stability Laser Cameras Mirrors Gas (88 m 3 )Jan 07: TPC being lowered down into the cavern 510 cm

9. 9 counting room cavern ALICE Control Room Systems layout operator LV Devices Worker Node LV OPC PVSS Ethernet worker node DIM PVSS worker node DIM PVSS Worker Node DIM PVSS Ethernet DETECTOR Worker Node HV OPC PVSS HV Devices CANbus FEE Devices Operator Node PVSS Ethernet D D D D Ethernet massively used as field-bus: - 1200 devices on private LAN - devices with Single Board Computers - large bandwidth required New !

10. 10 Worker Node DIM PVSS TPC Front-End Electronics TPC Readout Partition 1 MB/s ethernet OFF-DETECTOR Data bus I 2 C bus Board Control FPGA MEMORY Comm. Control Linux SBC Bus Control RCU DETECTOR ON-DETECTOR FEC VLSI FEC FPGA VLSI 128 ch FEC VLSI FEC FPGA VLSI 128 ch FEC VLSI FEC FPGA VLSI 128 ch FPGA Linux SBC 4500 Front End Cards 0.6 million RO channels Front End Cards IROC OROC RO1 RO2 - Much control software located on detectors - Previously in VME now in custom systems - Harsh environment & no access - redundancy – Control work done by electronics engineers New !

11. 11 Operations layout Control Units Device Units Physical devices TPC FEE LVOROC IROC HV DET CH RCU CH … HV Devices FEE DevicesLV Devices RO … 36x OFF ERROR ON STAND BY GO_STANDBY GO_READY GO_STANDBY RESET Alarm GO_OFF CONFIG RAMP_UP RAMP_DW

12. 12 Operating principle CH TPC FEE LV RO OROC IROC HV DET CH RCU CH operations plane HV OPC PVSS D LV OPC PVSS D DIM PVSS D DIM PVSS D DIM PVSS D D FEE DevicesLV DevicesHV Devices systems plane operator modular & flexible operational aspects considered early & ‘built-in’ easy partitioning commands status, alarms B A operator ?

13. 13 Operating principle CH TPC FEE LV RO OROC IROC HV DET CH RCU CH operation plane HV OPC PVSS D LV OPC PVSS D DIM PVSS D DIM PVSS D DIM PVSS D D FEE DevicesLV DevicesHV Devices systems plane operator commands status, alarms operator B A New approach! modular & flexible operational aspects considered early & ‘built-in’ easy partitioning

14. 14 Conditions Physics Data offline From Detectors To Grid LHC accelerator DAQ & Trigger Technical services Main data flows Archival database Configuration database operator synchronization FEE FEE 6 Gbyte archival “on change” 100 000 change/s processing Control System Back-end 800 Single Board computers ~10 8 registers in FPGA’s, VLSI’s new trend ! Large amounts of data - more control channels - configurable electronics

15. 15 ALICE User Interface u Why needed? u Small shift crew, changing often, non-experts u Operating large set of sub-detectors u GUI’s designed by each sub-detector u Aim u Same ‘Look and Feel’ u Provide common utilities Sub-sys status General utilities Monitoring zone Login Messenger Control zone Global Control u ALICE UI u Fixed screen layout u System browser u General utilities

16. 16 LOGIN PRINTHELPALARMS MESSENGER PHONE DETECTOR STATUS HIERARCHICAL BROWSER ALICE CONTROLS USER INTERFACE Select HMPID SUB-SYSTEMS CONTROLS TOP-NODE PAGE

17. 17 ON operator TPC Systems integration central Operator Node 18 detectors, 150 applications TRD TOF 100 PVSS systems: - a large large distributed system - of distributed systems LV Devices Worker Node LV OPC PVSS Ethernet worker node DIM PVSS worker node DIM PVSS Worker Node DIM PVSS Ethernet DETECTOR Worker Node HV OPC PVSS HV Devices CANbus FEE Devices Operator Node PVSS Ethernet D D D D

18. 18 ALICE ONLINE DAQTRGHLT ECS Operations integration Detectors, infrastructure, services LHC operator DCS FSM top node TPC FEE LVOROC IROC HV DET CH RCU CH … HV Devices FEE DevicesLV Devices RO … 36x FSM is an excellent tool for integration ! TPC

19. 19 Status today u Installation u Controls Back-end is operational u 150 computers u Dedicated network for 1400 devices u User applications 90% ready, 50% installed u 150 detector applications u Originating from 20 groups in 30 countries u Conformity and quality control u Commissioning & operation u 13 of 18 detectors are installed being commissioned u 1 st Cosmic run in December 2007 u 1 st physics run in May 2008

20. 20 Conclusion u ALICE Controls System u is a new generation system u incorporates new innovative approaches u is being installed and is successfully used to commission the sub-detectors u fulfills all requirements u will be ready for operation with LHC in 2008 New !

21. 21 Posters u WPPB32 Cyber-security in ALICE u RPPB21 Finite State Machines for Integration and Control in ALICE u TPPA22 Standard Device Control via PVSS Object Libraries u RPPA36 Handling Large Amounts of Data in ALICE New !

22. 22 Backup u ALICE UI u Fixed screen layout u System browser u General utilities

23. 23 Conclusion u ALICE Controls is a new generation system u Incorporates new innovative approaches u SCADA with common Framework u Massive use of Ethernet u Important “On-detector” controls u Handles large amounts of data u Operation based on Finite State Machines u Presently used for sub-detector commissioning u Fulfills all requirements u Will be ready for operation with LHC in 2008 New !

24. 24 Control & Device units PVSS CU Behaviour (FSM) configuration archiving Partitioning Alarm handling access, ownership dB operator parent child commands states PVSS FSM interface configuration archiving Alarms device driver access, ownership dB operator parent settings readings device Partitioning OFF ERROR ON STAND BY GO_STANDBY GO_READY GO_STANDBY RESET Alarm GO_OFF CONFIG RAMP_UP RAMP_DW

25. 25 Detector Control Back-End Systems Tools, components Networks Computers On-line Services Infrastructure Integration External Systems Accelerator Offline 18 detectors ~150 sub-systems MAG GAS COO ELE ACC CSADSSLHC OFF Safety CSAM DSS SPDPHOFMDT0V0PMDMTRMTKZDCEMCSDDSSDTPCTRDTOFHMP ACO CPV TOFSPDSDDSSDTPCTRDFMDMTRPHOHMPCPV ZDC T0MTKPMDV0 ACOEMC Trigger DAQ HLT ECSGas Electricity Cooling Magnets Access B-field Space Frame Environment Radiation Beam Pipe ENV BFI BPI SFM RAD HLT DAQ TRG ECS DIP DCS FSM top node Data Interchange Protocol

26. 26 New approaches in experiment controls u System based on SCADA and framework u Limited resources u Share developments between LHC experiments u Ethernet used as field bus u devices offer Ethernet interface increasingly u Becoming robust and less expensive u Large bandwidth needed u Important dataflow u Increasing number of control channels u Configurable electronics u Much controls located on the detector u Custom chips, single board computers u Operation based on Finite State Machine modeling u Operational needs prepared in the basic system

27. 27 Front-End Electronics Front-End Electronics ALICE CONTROL ROOM PVSS console Common interface? 18 different FEE architectures ON DETECTOR VME SPD FEE JTAG HMPID FEE DDL TPC FEE PROFIBUS TRD FEE ETHERNET … MXI … Front End Device (FED) DIM server interfaces FEE H/W MXI DDL PROFIBUS ETHERNET Etc. FEE specific FEE common DIM client

28. 28 Architecture of SPD FEE Control (PVSS) DIM Client CA1 CA2MA1MA2 Pixel Multi Chip Module Router VISA PCI-MXI-VME Database DIM server Data, flags Multithread applications Control Agent reacts to commands received by server Monitoring Agent publishes data as DIM services Control and Monitoring Server Client Software JTAG Commands