1. 22 October 20151/23Fabio Vinagre -- TileCal DCS TileCal DCS Expert tutorial - DCS 22 October 2015

2. 2/23Fabio Vinagre -- TileCal DCS Summary  DCS/FSM structure  How to Login to DCS machines  Where to look after login  Critical PVSS managers  RDB, OPC and DIM common problems  How to start devices from Windows Terminal Server (WTS)  Start and Stop FSM  How to change alarms thresholds  Start a PVSS project  Documentation and Questions

3. 22 October 20153/23Fabio Vinagre -- TileCal DCS DCS/FSM Structure PCATLTILSCS PCATLTILLV00 PCATLTILLV01 PCATLTILLV02 PCATLTILLV03 Infrastructure CAN PSU COOLING PLANT RACKS LASER Partition COOLING (1) VME Crates (1) DDC 200V PS (1) AUX Boards Branch 1 Branch 2 Branch 3 Branch 4 Module 9 Module 10 …. Module 23 Module 24 LVPS 9 Drawer 9 ROD crate TTC crate EBA LBA EBC LBC XXX PCATLTIL… ► Partition ► Machine XXXXXX ► LU or DU (1) –controlled by SCS machine

4. 22 October 20154/23Fabio Vinagre -- TileCal DCS First one have to connect to the windows terminal server (point 1 gateway): If you are in CERN GPN: 1.Start the remote desktop application and connect to cerntsatldcs; 2.Introduce your NICE user name and password If you are outside of CERN GPN 1.First remote desktop to cernts.cern.ch and then to cerntsatldcs; 2.Introduce your NICE user name and password 3.Click in Ask Access and type in a Reason (be as clear as possible) 4.Wait for the Atlas Control Room response 5.When the access is granted the Ask Access button changes to Allowed and the grey buttons became active 6.Click on Remote Desktop, enter the machine name (previous slide) and your NICE credentials or choose the panel and click Run How to login to DCS machines (1)

5. 22 October 20155/23Fabio Vinagre -- TileCal DCS How to login to DCS machines (2) Possible problems : I cannot login to one machine ›Check if you typed the machine name correctly ›The login domain have to be CERN, for example: CERN\fvinagre ›Do you have the correct permissions? Check before On call shift and contact a DCS admin to obtain authorization. The DCS admins are: Giorgi Arabidze, Fabio Vinagre, Pedro Almeida and Stanislav Nemecek I am logged in but there is no project running ›The project runs as SYSTEM so you have to click on the Start Menu and open PVSS console There is a user already logged in ›Do not proceed with login before contact the user and see if he doesn’t need the machine any more. If you proceed you will log him off and he will lose all the not saved work. Advice: After login also start the Windows task manager (right click in the Windows Task Bar and click in Task Manager)

6. 22 October 20156/23Fabio Vinagre -- TileCal DCS What to do after login After login and open PVSS console the first thing one should do is to check if the critical managers are running: In LCS one should confirm if: ›1 OPC manager, number 7 ›1 RDB manager, number 99 ›2 PVSS00dim, one number 8 and the other any number In SCS one should confirm if: ›1 RDB manager, number 99 ›2 ModBus manager, number 15 and 2 ›2 OPC manager, number 7 and 14 ›6 PVSS00dim, number 2, 3, 4, 5, 9 and any number

7. 22 October 20157/23Fabio Vinagre -- TileCal DCS What each critical manager do? ManagerManager Number (machine)Description RDB99 (all machines)Oracle DB OPC7 (all except SCS)fLVPS ELMBs and AUXboard PVSS00DIMHV (all except SCS)DIM server (Drawer) PVSS00DIM8 (number 2 in SCS)DDC OPC14 (SCS)Wieners crates ModBus15 (SCS)CaV ModBus2 (SCS)200 V bulk PS

8. 22 October 20158/23Fabio Vinagre -- TileCal DCS RDB Problems How to know if there are RDB problems? ›Plots are not displaying any data ›Alarm screen with “ Disk buffer number is already 20 ” message How to solve it? ›Log in the machine with the RDB problems ›Use the Tile_DCS_RDB.PDF as a step-by-step guide If problem not fixed contact the DCS admin (first) or ATLAS central DCS

9. 22 October 20159/23Fabio Vinagre -- TileCal DCS OPC Problems How to know if there are OPC problems? ›Corresponding data is not being updated ›Alarm screen with “ TIL OPC Server Connection ” message How to solve it? ›Log in the machine with the OPC problems ›Check if all OPCs managers are running (see table in previous slide) ›Use the Tile_DCS_OPC.PDF as a step-by-step guide If problem not fixed contact the DCS admin (first) or ATLAS central DCS

10. 22 October 201510/23Fabio Vinagre -- TileCal DCS DIM Problems How to know if there are DIM problems? ›DAQ not receiving/sending information (DIM number 8) ›Drawer data is not being updated for 10 minutes the On-Call phone will receive one SMS ›Blinking red/gray drawer in FSM How to solve it? ›Log in the machine with the DIM problems ›Check if DIM managers are running (see table in previous slide) ›If manager is running: ›Use the Tile_DCS_DIM.PDF as a step-by-step guide ›If manager is not running ›Change the start mode properties to Always ›Wait ~5 minutes ›If data is not being updated use the Tile_DCS_DIM.PDF as a step-by-step guide If problem not fixed contact the DCS admin (first) or ATLAS central DCS

11. 22 October 201511/23Fabio Vinagre -- TileCal DCS Start tripped fLVPS There are 3 types of LVPS trips: 1.The MB side trip (most common) I.On call shifter should start LVPS from FSM or instruct shifter to do it II.After the operation the ACR shifter have to call DAQ expert 2.The HV side trip I.On call shifter should start HV side from WTS 3.Hole LVPS trip (rare) I.Same procedure as MB side trip Use the Tile_DCS_LVPS_Trip.PDF as a step-by-step guide

12. 22 October 201512/23Fabio Vinagre -- TileCal DCS Tripped fLVPS examples Use the Tile_DCS_LVPS_Trip.PDF as a step-by-step guide HV side trip MB side trip

13. 22 October 201513/23Fabio Vinagre -- TileCal DCS Start HV from WTS

14. 22 October 201514/23Fabio Vinagre -- TileCal DCS Start/Stop FSM (1) If you see the FSM with the STATE DEAD in a grey background it means the FSM is stopped. One can start the FSM using the WTS or doing remote desktop to the corresponding DCS machine

15. 22 October 201515/23Fabio Vinagre -- TileCal DCS Start/Stop FSM (2) To start the FSM one have to use the Device Editor Navigator. To start the Device Editor Navigator:

16. 22 October 201516/23Fabio Vinagre -- TileCal DCS Start/Stop FSM (3) How to start the FSM: 1.Stop All 2.Check in Windows task manager if any smi.exe or PVSS00smi.exe process is running, if yes, kill it 3.Start/Restart All 4.After the restart the FSM state should be with a grey background, this means the Tree is not taken by anyone. Leave it like this so the central DCS desk can take control of the Tile Tree In case the top node (TIL) is DEAD one should perform this steps in the SCS machine

17. 22 October 201517/23Fabio Vinagre -- TileCal DCS Change Drawer thresholds (1) If you have a Drawer in Warning or Error state and the shifter already reported as stable one can increase the range of the Voltage or Temperature. From WTS:

18. 22 October 201518/23Fabio Vinagre -- TileCal DCS Change Drawer thresholds (2) Confirm if you open the correct Module

19. 22 October 201519/23Fabio Vinagre -- TileCal DCS Change LVPS temp. thresholds (1) To change the LVPS alarm range one have to remote desktop to the machine in question, open the gedi (PVSS graphical editor) and click on PARA module 1 2 3

20. 22 October 201520/23Fabio Vinagre -- TileCal DCS Change LVPS temp. thresholds (2) 1 2,4 3 Check if you are working in the correct partition

21. 22 October 201521/23Fabio Vinagre -- TileCal DCS Start a PVSS project (1) After an unexpected reboot/shutdown the DCS machine and the PVSS project should start automatically If that does not happen one should see the FSM with a purple color

22. 22 October 201522/23Fabio Vinagre -- TileCal DCS Start a PVSS project (2) To start a PVSS project one have to remote desktop to the corresponding DCS machine Is VERY important to check if the PVSS00pmon.exe process is working under SYSTEM, if not go to Windows services and start it After the PVSS00pmon.exe is running as SYSTEM one can check if the there is no running process like: ›AtlTileHv.exe ›CanOpen25+.exe ›PVSS00opc.exe ›PVSS00ctr.exe ›PVSS00mod.exe ›PVSS00smi.exe ›smi.exe After all this checks is safe to start the PVSS project using the traffic lights in PVSS console When all is running, start the DIM server (AtlTileHv.exe) from the windows services. After ~5 minutes check if the HV and LV values are being updated.

23. 22 October 201523/23Fabio Vinagre -- TileCal DCS Documentation and Questions Tile DCS wiki › https://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS https://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS FSM how to ›https://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS under Attachmentshttps://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS Tile_DCS_RDB.PDF, Tile_DCS_OPC.PDF, Tile_DCS_DIM.PDF and Tile_DCS_LVPS_Trip.PDF ›https://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS under Attachmentshttps://twiki.cern.ch/twiki/bin/view/Atlas/TileCalorimeterDCS LV documentation ›http://cdsweb.cern.ch/record/1228921http://cdsweb.cern.ch/record/1228921 Questions?