1. Hot Checkout System for LERF Resuscitation
Ron Lauzé
Electrical Engineering

2. Overview PSS Status Lessons Learned The Hot Check Out (HCO) Process
Schedule
Summary

3. J. Kowal & H. Robertson, Modifications to the PSS Access Process
LERF PSS Status
PSS Certification:
All systems and interfaces were tested and certified in April 2015.
The next full Certification is scheduled for November 2015.
These tests include PSS controls and status for:
RF systems
DC Magnet Power supplies
Gun HVPS
Drive Laser
J. Kowal & H. Robertson, Modifications to the PSS Access Process

4. Change of door control paradigm for Sweep and Controlled Access
LERF PSS Status (cont.)
New features:
Change of door control paradigm for Sweep and Controlled Access
The approach is to have the default door lock state as locked rather than unlocked.
Doors are automatically relocked after specified time during Sweep and Controlled Access
Transitions up in state apply more restrictive controls on the door locks
Transitions down retain locked condition of previous state
Unlocking requires action by SSO which is validated by the logic
Feedback added to the SSO panel to indicate error in sequence

5. Hot Check Out (HCO) Definition
Hot Check Out: The process by which all required hardware and software systems are tested for proper functionality and signed off as being ready for beam operations.

6. Recovery from the 6MSAD in 2011 and commissioning of 12GeV in 2015
Lessons Learned
The present HCO system has evolved to take advantage of lessons learned:
Recovery from the 6MSAD in 2011 and commissioning of 12GeV in 2015
Findings of the YR fire event
JLab Repair Assessment Reports
Events from other labs

7. HCO Process Features Engages System Support Group Leaders
Solicit feedback for improvements early and throughout the process
Operational ‘Checks’ made by Technicians/Experts
Final signoffs made ‘Ready’ by responsible managers
LERF HCO meetings follow 0800 Daily Status meetings
Integrate with existing systems
ABIL audits (bypassed interlocks)
ATLis checks for HCO requirements
Tasks approved by LERF Work Coordinator

8. Users – Who?
Technicians – Work to verify operation of components based on HCO requirements.
System Support Group Leaders & System Experts – Determine and sign-off on system readiness.
Management – Program Deputy, LERF Run Coordinator and Geographic Integrator, Operability, and LERF Managers/Experts monitor/drive HCO progress.
Operations – Control room staff verifies status prior to establishing beam for the Program Deputy’s accelerator program.

9. Process Flowchart ABIL Verification Data Input and Verification
Sign-off

10. ABIL Verification
Same process as CEBAF

11. Data Input and verification
Generated by LERF Operations Coord. Using FEL HCO Tool
LED: plan to put in place by the Spring Run

12. Sign-off
Same process as CEBAF

13. HCO Tool with LERF LERF has been incorporated
into the existing HCO Tool:
System/Sub-System level
Shows all associated groups
Make, review and store comments
Accelerator status:
Can be filtered and displayed based on beam destination, group, etc.
Not-Ready
Checked (Technicians)
Ready (Group Leaders)
Check Mag. Sys. Status

14. Verifying Magnet Readiness
Using the HCO Tool to determine Magnet Readiness.
Box P.S. Status

15. HCO Software (Signoff)
Using the HCO Tool to signoff on system status.

16. Reports
DC magnet Box Power Supply overall status

17. Reports (cont.)
DC magnet Box Power Supply Group status

18. Justification for HCO at Sub-System Level
Significantly smaller machine
Geographic Integrator meetings with System Owners to verify accuracy of HCO tool
Visually verified every component and red-lined the songsheet accordingly
Single Laser
Many systems have software HCO scripts
Viewers
BLM’s
Valves
Operations Beam Resuscitation Run
No DownTime or Reliability goals
Readying accelerator for operator training
Not a 24/7 operation, leaving time for repairs during off hours

19. HCO Checklists
For this Run, Checklists are required from groups performing HCO tasks pertaining to machine protection.
Additional checklists can be added at the discretion of the System Owner
Once the LED is implemented (Spring Run) the need for system checklists will be evaluated system by system (as was done for CEBAF)

20. Schedule to Completion
9/16/15
LERF Operations Coordinator updates HCO tool to include LERF Systems/Sub-Systems
Meetings begin with system Group Leaders to verify tool accuracy
Geographic Integrator meetings begin
Tool updated to incorporate changes based on meetings with system Group Leaders
Call for ABIL compliance
Ensure remaining interlock bypasses are justified
All machine protection checklists are integrated into the tool
HCO begins
HCO complete
9/21/15
9/22/15
9/25/15
10/09/15
10/12/15
10/19/15

21. Summary HCO process in place
Expanded from process used on CEBAF
Leverages AOD, HCO tool, procedures, processes, and lessons learned
Integrates all levels of the organization
Uses written checklists for machine protection systems
System readiness sign-off by Group Leaders
LOD (mirrors AOD) is robust enough to handle any unforeseen off-normal event that may occur.
ABIL process in use and audit conducted.
HCO process will establish with certainty that the LERF hardware/software is ready for beam operations.

22. Questions?

23. LERF IR Accelerator - Scale

24. LERF IR Accelerator - Zones
~10.M 5F 3F 4F