Hot Checkout System for LERF Resuscitation Ron Lauzé Electrical Engineering

Overview PSS Status Lessons Learned The Hot Check Out (HCO) Process Schedule Summary

J. Kowal & H. Robertson, Modifications to the PSS Access Process LERF PSS Status PSS Certification: All systems and interfaces were tested and certified in April 2015. The next full Certification is scheduled for November 2015. These tests include PSS controls and status for: RF systems DC Magnet Power supplies Gun HVPS Drive Laser J. Kowal & H. Robertson, Modifications to the PSS Access Process

Change of door control paradigm for Sweep and Controlled Access LERF PSS Status (cont.) New features: Change of door control paradigm for Sweep and Controlled Access The approach is to have the default door lock state as locked rather than unlocked. Doors are automatically relocked after specified time during Sweep and Controlled Access Transitions up in state apply more restrictive controls on the door locks Transitions down retain locked condition of previous state Unlocking requires action by SSO which is validated by the logic Feedback added to the SSO panel to indicate error in sequence

Hot Check Out (HCO) Definition Hot Check Out: The process by which all required hardware and software systems are tested for proper functionality and signed off as being ready for beam operations.

Recovery from the 6MSAD in 2011 and commissioning of 12GeV in 2015 Lessons Learned The present HCO system has evolved to take advantage of lessons learned: Recovery from the 6MSAD in 2011 and commissioning of 12GeV in 2015 Findings of the YR fire event JLab Repair Assessment Reports Events from other labs

HCO Process Features Engages System Support Group Leaders Solicit feedback for improvements early and throughout the process Operational ‘Checks’ made by Technicians/Experts Final signoffs made ‘Ready’ by responsible managers LERF HCO meetings follow 0800 Daily Status meetings Integrate with existing systems ABIL audits (bypassed interlocks) ATLis checks for HCO requirements Tasks approved by LERF Work Coordinator

Users – Who? Technicians – Work to verify operation of components based on HCO requirements. System Support Group Leaders & System Experts – Determine and sign-off on system readiness. Management – Program Deputy, LERF Run Coordinator and Geographic Integrator, Operability, and LERF Managers/Experts monitor/drive HCO progress. Operations – Control room staff verifies status prior to establishing beam for the Program Deputy’s accelerator program.

Process Flowchart ABIL Verification Data Input and Verification Sign-off

ABIL Verification Same process as CEBAF

Data Input and verification Generated by LERF Operations Coord. Using FEL HCO Tool LED: plan to put in place by the Spring Run

Sign-off Same process as CEBAF

HCO Tool with LERF LERF has been incorporated into the existing HCO Tool: System/Sub-System level Shows all associated groups Make, review and store comments Accelerator status: Can be filtered and displayed based on beam destination, group, etc. Not-Ready Checked (Technicians) Ready (Group Leaders) Check Mag. Sys. Status

Verifying Magnet Readiness Using the HCO Tool to determine Magnet Readiness. Box P.S. Status

HCO Software (Signoff) Using the HCO Tool to signoff on system status.

Reports DC magnet Box Power Supply overall status

Reports (cont.) DC magnet Box Power Supply Group status

Justification for HCO at Sub-System Level Significantly smaller machine Geographic Integrator meetings with System Owners to verify accuracy of HCO tool Visually verified every component and red-lined the songsheet accordingly Single Laser Many systems have software HCO scripts Viewers BLM’s Valves Operations Beam Resuscitation Run No DownTime or Reliability goals Readying accelerator for operator training Not a 24/7 operation, leaving time for repairs during off hours

HCO Checklists For this Run, Checklists are required from groups performing HCO tasks pertaining to machine protection. Additional checklists can be added at the discretion of the System Owner Once the LED is implemented (Spring Run) the need for system checklists will be evaluated system by system (as was done for CEBAF)

Schedule to Completion 9/16/15 LERF Operations Coordinator updates HCO tool to include LERF Systems/Sub-Systems Meetings begin with system Group Leaders to verify tool accuracy Geographic Integrator meetings begin Tool updated to incorporate changes based on meetings with system Group Leaders Call for ABIL compliance Ensure remaining interlock bypasses are justified All machine protection checklists are integrated into the tool HCO begins HCO complete 9/21/15 9/22/15 9/25/15 10/09/15 10/12/15 10/19/15

Summary HCO process in place Expanded from process used on CEBAF Leverages AOD, HCO tool, procedures, processes, and lessons learned Integrates all levels of the organization Uses written checklists for machine protection systems System readiness sign-off by Group Leaders LOD (mirrors AOD) is robust enough to handle any unforeseen off-normal event that may occur. ABIL process in use and audit conducted. HCO process will establish with certainty that the LERF hardware/software is ready for beam operations.

Questions?

LERF IR Accelerator - Scale

LERF IR Accelerator - Zones ~10.M 5F 3F 4F