1. LCLS Cryomodule Testing in the LERF- OSP
M. Drury
Transition to Operations Review
12 Nov 2018

2. Roles and Responsibilities Training Hazards Operating Guidelines
Outline
Scope of OSP
Facility Description
Roles and Responsibilities
Training
Hazards
Operating Guidelines
Emergency Response
Transition to Operations Review 12 Nov 2018

3. Scope
Facilitate safe operation of the Low Energy Recovery Linac as a test bed for LCLS II cryomodules.
Covers activities associated with testing and operation of an installation of two connected LCLS II cryomodules.
RF Testing and operations will range from individual cavity tests up to multiple cryomodule tests.
OSP covers both local (LERF Control Room and MCC) as well as Remote Access Operations.
This OSP assumes that there will be no beam operations in conjunction with the testing of the LCLS-II cryomodules.
Transition to Operations Review 12 Nov 2018

4. Facility
Figure shows the location of the two cryomodules in the LERF Vault along with the waveguide layout.
Figure also shows the original FEL cryomodule layout (in grey).
The FEL module string has been dismantled leaving only the original ¼ cryomodule and the 1st full cryomodule.
These two modules are to be kept cold at 2K to act as a stable (~200 W) heat load to the CHL.
Transition to Operations Review 12 Nov 2018

5. Facility
A set of GHz Solid State Amplifiers (SSA’s are installed in the 2nd floor gallery.
Gallery installation includes racks containing llrf, resonance, interlock and magnet controls.
SSA’s and other racks sit in the Gallery aisle and spans Zones 3 and 4
Waveguides route through penetrations to reach cryomodules.
Liquid and gaseous Helium supplied by CHL1 to cool down and maintain cavities at 2 – 4 K. Cryomodule shield circuits at ~45K.
Transition to Operations Review 12 Nov 2018

6. Facility There are two Access points to the LERF Vault:
Personnel entrance through a labyrinth and a roll up door used for cryomodule delivery.
During LCLS II testing, concrete shielding blocks are installed outside the equipment door.
Transition to Operations Review 12 Nov 2018

7. Roles and Responsibilities
OSP follows the chain of command as laid out in the LERF Operations Directive
Several additional roles are described that are specific to cryomodule testing
The following individuals are called out specifically as having a level of authority over or responsibility for LERF Operations.
Director of Accelerator Operations
LERF Hall Leader
LERF Operations Coordinator
Crew Chief
See OSP and LOD for detailed Roles and Responsibilities
Transition to Operations Review 12 Nov 2018

8. Roles and Responsibilities: OSP Specific Roles
Test Coordinator
Overall responsibility for testing the LCLS II cryomodules that are installed in the LERF
must have understanding of the relevant systems required for the execution of the planned experiments.
is responsible for planning, scheduling and staffing tests
Communicates schedule and staffing to all stakeholders
Ensures that operations are carried out in a safe manner
Directs the activities of Test Operators on each shift
Maintains awareness of facility and cryomodule status
Approves Remote Access Ops
Communicates status of testing at daily meetings
Maintains communications with various stakeholders
Transition to Operations Review 12 Nov 2018

9. Roles and Responsibilities: OSP Specific Roles
RF Test Operators
Requires approval from the Test Coordinator before working in the LERF
Assists in execution of Test Plans by operating RF systems associated with LCLS II cryomodules
Must have good understanding of the PSS, MPS, and RF systems.
Must have an understanding of the interaction of RF testing with cryogenic systems
Including safe boundary conditions for helium pressure, liquid level and various temperatures.
Monitors all remote access operations
Maintain communications with MCC (Crew Chief) and with Test Coordinator
Responsible for documenting shift activities and preliminary results in both the paper and electronic logbooks
Transition to Operations Review 12 Nov 2018

10. Roles and Responsibilities: OSP Specific Roles
Cryogenic Test Operators
Requires approval from the Test Coordinator before working in the LERF
Assists in execution of Test Plans by controlling setup of cryogenic valves to ensure stable configuration.
Must have good understanding of cryogenic systems
Must have an understanding of the interaction of RF testing with cryogenic systems
Including safe boundary conditions for helium pressure, liquid level and various temperatures.
Monitors all remote access operations
Maintain communications with Cryo Group (Cryo Coordinator, etc) and with Test Coordinator
Communicate potential cryo problems that may affect CEBAF operations to MCC (Crew Chief)
Transition to Operations Review 12 Nov 2018

11. Roles and Responsibilities: OSP Specific Roles
Test Coordinator and Test Operators
Responsible for safe operation of the facility.
Have routine Channel Access write permission
Have authority to stop any activity that has potential for damage to equipment or a potential risk of injury.
Must read, understand and sign the OSP, read and understand the LOD and any of the documentation attached to the OSP.
Transition to Operations Review 12 Nov 2018

12. Roles and Responsibilities: OSP Specific Roles
Visiting Operators
Example: SLAC personnel that participate on site in cryomodule testing
Requires approval from the Test Coordinator before working in the LERF
Must complete all Safety Training before working in the LERF Bldg.
Will be granted Channel Access write permissions on a shift by shift basis.
Must undergo a period of on the job training before gaining approval to work unsupervised.
Until approved, must work under supervision of Test Operators or TC.
Must read, understand and sign the OSP, read and understand the LOD and any of the documentation attached to the OSP.
Transition to Operations Review 12 Nov 2018

13. Roles and Responsibilities: OSP Specific Roles
Remote Operators
Must have approval of Test Coordinator to gain Channel Access write permission
Must follow required steps to set up remote access account. (see )
Remote Operators will be monitored by on-site Test Operators at all times.
Remote operators must participate in on-site testing as a Visiting Operator prior to engaging in Remote Access Operations
Must read, understand and sign the OSP, read and understand the LOD and any of the documentation attached to the OSP.
Transition to Operations Review 12 Nov 2018

14. Training
Test Operators are initially selected from a list of personnel that have experience testing cryomodules in both the CMTF and in the CEBAF accelerator.
Training sessions will be held to familiarize the initial group of Test Operators with the new hardware and software interfaces.
This initial group will train additional Test Operators as necessary and any Visiting Operators.
This training will be on the job training
Trainee will at first sit and observe the Test Operator
After some time spent observing (1- 2 shifts), trainee will begin to take over the operator role under supervision
Once trainee has become familiar with the various standard tests, can be approved as Test Operator
Transition to Operations Review 12 Nov 2018

15. Identified Hazards See Task Hazard Analysis for details Electric Shock
Cold Cryomodule ODH Hazards
ODH Hazard from warm Nitrogen line
480 V Electrical Hazards associated with 1.3 GHz SSA electrical panels
Arc Flash from Disconnect
Non–Ionizing Radiation from waveguide leakage
Prompt Ionizing Radiation (Cavity Operation)
Material Handling
Transition to Operations Review 12 Nov 2018

16. Prompt Ionizing Radiation
The LERF vault shielding and associated prompt radiation mitigations were designed to maintain radiation levels outside the vault to less than 0.1 mrem/hour at maximum beam power
Associated mitigations:
Concrete blocks in place at the roll up door
Shielding of penetrations
Radiation monitoring
Associated administrative controls.
There will be no beam operation in conjunction with the testing of the LCLS- II cryomodules.
The shielding configuration, designed for beam operations, is deemed to be sufficient for LCLS II testing.
No High Power RF operations will take place without the shielding blocks in place.
Transition to Operations Review 12 Nov 2018

17. Prompt Ionizing Radiation
Radiation monitoring is accomplished by a set of CARM’s located at key points in the LERF building.
CARM alarm in the LERF will change the PSS state from Beam Permit to Power Permit.
LCLS II tests only at Power Permit.
CARM alarms do not interrupt RF.
CARM alarms will be set up in the Alarm Handler to ensure that any alarms are brought to the attention of the operators in the Control Room.
In the event of CARM alarm:
Notify RadCon first, then TC
Follow any direction from RadCon before continuing with Testing
CARM User Guide has locations of CARM units in LERF
Radiation Worker I training required for accessing Radiologically Controlled Areas.
General Employee Radiation Training is the minimum required for Visiting Operators.
Transition to Operations Review 12 Nov 2018

18. ODH
ODH monitoring is accomplished by a set of ODH detectors located at key points in the LERF Bldg
Connected to a central monitoring system that alarms in LERF Bldg, Vault and Control Room
In the event of an alarm:
Cease Operations
Personnel in the Vault must leave the area and assemble outside of the Bldg. (Avoiding plumes)
Notify Cryogenics Coordinator
Follow the ODH Alarm Response described in MCC-PR
ODH Rating for the LERF Vault is ODH 0.
ODH Rating for the 2nd Floor is ODH 0 (assumes sealed penetrations).
ODH postings in the Vault may change under certain circumstances related to cryomodule testing (see SRF OSP RT Valve Cabling Activities)
ODH training required for accessing the vault (LERF Bldg?).
ODH 2 medical required for accessing ODH 2 areas.
Transition to Operations Review 12 Nov 2018

19. Operating Guidelines : General Operating Protocols
RF Test Operator and Cryo Test Operator must be on-site in the Control Room during all HPRF operations. (See Staffing Requirements next slide)
Only authorized personnel are permitted to enter the LERF vault to make changes to cryomodules.
Authorization comes from TC
RF Test Operator is responsible for ensuring safe operation in accordance with the OSP during HPRF operations.
All personnel entering any Radiologically Controlled Areas must carry Personal Dosimetry
Any staff member has the responsibility to report any unsafe activity or situation to the Test Coordinator or a Test Operator.
Procedures or tests involving operation of cryogenic controls such as cool downs, temperature cycles, etc., may be controlled and monitored from the LERF, the MCC or from the Test Lab (Bldg 58). These operations must at least be monitored by an approved Cryogenics Test Operator
Transition to Operations Review 12 Nov 2018

20. Operating Guidelines : General Operating Protocols
Minimum Staffing Requirements
LERF Operating Condition
LERF PSS State
Minimum Staffing Required
Beam OFF
Restricted Access
Crew Chief (on-call)
Accelerator Site Security Guard (on-site)
Controlled Access
Sweep Mode
Sweep Complete Mode
LERF SSO (MCC)
Power Permit
RF Test Operator in LERF
NOTE: The RF Test Operator is not required if the Crew Chief is in the designated control room (MCC or LERF).
Power Permit and RF On to any cavities
Transition to Operations Review 12 Nov 2018

21. Operating Guidelines : Sweep Procedures
PSS Sweep Procedure:
Required to change the state of the PSS from Restricted Access to Power Permit.
Power Permit required to perform HPRF testing of the LCLS-II cryomodules.
The sweep procedure for the LERF vault is described in the “PSS Sweep Procedure”, MCC-PR , Section 13.0.
Sections 1.0 – 2.0 describe the personnel requirements for executing the sweep procedure.
Controlled Access Procedure
Accommodates brief entries into the Vault to perform maintenance or monitoring functions.
Controlled Access procedure facilitates movement of personnel in and out of the vault.
Requires that radiation-producing operations cease before any personnel can enter the vault and that all personnel have exited before such operations are restarted.
The Controlled Access Procedure is described in “PSS Controlled Access Procedures”, MCC-PR
Document also describes the conditions under which a radiation survey is required before entry into the vault.
Transition to Operations Review 12 Nov 2018

22. Operating Guidelines 1.3 GHz SSA Operation
Power Permit required before energizing SSA’s
Locate associated 480 VAC breaker panel
To energize:
Remove Admin Locks from individual breakers for SSA’s required for shift plan
Close breakers
Use proper PPE when operating breakers:
Use safety glasses,
Heavy Duty Leather Gloves
A Long Sleeve Natural Fiber or Fire Retardant Long Sleeve Shirt
Long Pants (made of natural fibers)
At shift turnover, inventory needed SSA’s.
Energize or de-energize as needed
Before opening breakers: Change state of SSA to “RF Off” and “HV Off” (in software)
Apply Admin lock to breaker for any de-energized SSA.
Transition to Operations Review 12 Nov 2018

23. Operating Guidelines Cryo Procedures:
Cryo procedures include cool-downs, warm-ups and partial cryocycles to facilitate fast cool-downs.
Cryo procedures must be scheduled in advance with input and approval from the Cryo Group.
The Cryo Group point of contact for these operations is Joe Wilson Jr. or his designee.
CEBAF Operations must also be made aware in advance of any planned Cryo procedures.
These activities will be communicated and approved through ATLis entries.
The Cryo group must be aware in advance of any test procedure that requires the enabling and/or closing of the RT valves on either LCLS II cryomodule.
The Cryo Group must also receive advance warning of any test plan that involves the operation of multiple cavities or multiple cryomodules due the increased dynamic heat load. These activities will be communicated and approved through ATLis entries.
Transition to Operations Review 12 Nov 2018

24. Operating Guidelines Remote Access Operations
Personnel at remote locations must have a CUE user account. (Note: the user account cannot be a group account).
Requirements for accessing LCLS epics – see
Advance notice must be provided to RF Test Operator and TC.
Test Plan that includes description of work to be performed and systems affected must be documented in an ATLis entry (Accelerator Task List).
After ATLis approval, work will be scheduled by TC.
Channel Access write permissions for the appropriate systems can then be authorized for the remote operator by the Test Coordinator and enabled by the Crew Chief.
An RF Test Operator and Cryo Test Operator must be on-site, in the LERF Control Room or MCC, to monitor remote access operations.
The on-site Operator has authority to terminate any remote access operation if they believe there is potential for damage to equipment or harm to personnel.
Transition to Operations Review 12 Nov 2018

25. Operating Guidelines Waveguide Installation / Removal
Before working on open waveguide, the AC Supply Power to the 1300 MHz SSA’s must be locked out and tagged out:
Locate associated 480 VAC breaker panel.
When closing or opening a disconnect breaker and disconnecting the power plug, use proper PPE (see Slide 22)
Open the main breaker for the 480 VAC panel that controls the SSA’s associated with the set of waveguides to be worked on.
Check the Voltage Presence Indicator on the breaker panel. A green light indicates that voltage has been removed from the breaker panel.
Each worker must apply a personal lock to a hasp on the main breaker.
Transition to Operations Review 12 Nov 2018

26. Activities Outside Scope of OSP
Cryomodule Installation
Cryomodule Removal
Cryomodule Degaussing
Operation of Cryomodule Return Valve
Beam operations in conjunction with the testing of the LCLS-II cryomodules.
Simultaneous operation of the LERF cryomodules (1/4 cryomodule and FL02) and LCLS-II cryomodules
Transition to Operations Review 12 Nov 2018

27. Required Training
MED13 – ODH-2 & Respirator medical certification SAF103 – Oxygen Deficiency hazards. SAF104 – Lock, Tag, Try SAF210 – 5-Minute Escape Pack use SAF603A – Electrical Safety Awareness SAF603N – Basic NFPA-70E Training SAF800 – General Employee Radiation Knowledge SAF801 – Radiation Worker I Training
LCLS-II FAC Review, Sept 26-28, 2017

28. References and Attachments
ES&H Manual Sections:
6140 Cranes and Hoists
6210 General Electrical Safety
6310 Ionizing Radiation Protection
6315, Environmental Monitoring of Ionizing Radiation
6420 Radio Frequency and Microwave Radiation
6540 Oxygen Deficiency Hazard
Attachments:
SRF OSP Cryomodule Installation
SRF OSP Cryomodule Removal
SRF OSP RT Valve Cabling Activities
MCC-PR PSS Sweep Procedures
MCC-PR PSS Controlled Access Procedures
JLAB-TN ODH Risk Assessment, LERF
RCD-DEP-18 #002 LERF Shielding Requirements for LCLS II Cryomodule Commissioning
Transition to Operations Review 12 Nov 2018

29. Emergency Response
Crew Chiefs and operators (including Test Operators within the scope of this OSP) are first responders for a variety of emergency situations within the accelerator site safety fence and also play a critical role in emergency communication and coordination. When responding to emergencies on the accelerator site, the Crew Chief assumes the role of Internal Incident Commander (IIC) until relieved. Emergency response is guided by written procedures, which are located in the Emergency Response Binder in the MCC Control Room. The Test Coordinator or his designee must be notified as part of the emergency response.
Transition to Operations Review 12 Nov 2018

30. Emergency Response Possible Excessive Radiation Exposure RF Emergency
Immediately call RadCon for assistance:
Turn off the high power RF by crashing the PSS system.
RF Emergency
Contact Rick Nelson (?) at or Andrew Kimber for assistance.
Failure of Personnel Safety System
In the event the interlock system or radiation-monitoring system operate improperly or suffer a hardware failure, the Test Operator will immediately:
Terminate RF operations
Notify PSS on call personnel, and Radiation Control Group on-call personnel
Contact Information:
Industrial Hygiene Group (EH&S Cell Phone)
On-call Cryogenic Coordinator contact through Guard House ext 5822
Contact the Guard House ext 5822 for off hours number
ESH&Q Emergency Manager Tina Menefee –ext 5490
Transition to Operations Review 12 Nov 2018

31. OSP covers hazards as outlined in the THA and mitigations.
Summary
OSP covers hazards as outlined in the THA and mitigations.
Covers Roles and Responsibilities and aligns with those outlined in the LOD.
Covers Staffing Requirements in line with LOD.
Provides an administrative protocol to govern Remote Ops and Cryo Procedures
Provides instructions to cover general safe operations.
Covers Training and defines scope
References documentation for procedures outside the scope.
LCLS-II FAC Review, Sept 26-28, 2017