TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Upgrade, IST and Powering tests of the WIC systems Richard Mompo for the WIC team 1

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Outline o Overview of projects foreseen during LS1 o Overview of non-foreseen projects o Resources for WIC activities o IST/HWC: Experiences in a few machines o Conclusions

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo WIC systems in operation before LS Controllers & ~ 310 I/O modules ~ 1000 magnets are protected WIC  LHC (2007)  TT60 & Ti2 TT66 (Hi Rad Mat.) 4 c.  TT40 & Ti8 (2004) 2 c. WIC  TT41 (CNGS) 1 c. WIC  LEIR (2005) 1 c. (2009) 1 c. WIC 8 controllers  LINAC3WIC (2005) (2010) After LS1 32 Controllers & > 1000 I/O modules > 2500 magnets are protected

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Projects foreseen during LS1 o WIC upgrade in Ti2, Ti8, TT40, TT41 and TT60 (non-safety PLCs) o New WIC deployments in LHC injectors and Cern facilities (safety PLCs) o BOOSTER (4 controllers, 50 deported crates) o SPS (7 controllers, 13 deported crates) o LINAC 4 (2 controllers) … still on-going o HIE-ISOLDE (2 controllers) … still on-going o IST on non-modified WIC systems: LHC, LEIR, LINAC3, TT66, BA80 One important objective during LS1 was to spread knowledge on the existing WIC systems in operation to the whole team Upcoming departure of Pierre for retirement 4

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Projects not foreseen during LS1 o PS: Full re-commissioning of the existing interlock system (Not a WIC) o Following the departure of R. Brown for retirement o AD: Full re-commissioning of the existing interlock system (Not a WIC) o Internal resources allocated to other MPE projects o Help on 13kA & 600A switches (Yan): 4 weeks o Help on QPS deployment (Yan): 2 weeks, (Richard): 4 weeks o Construction of 4 racks to automatise testing of 600A E.E. Switches (Yan, Christophe, Chantal): 6 weeks (x3) o R2E: Removal, re-installation, re-commissioning of current leads heating systems for 3 DFBXs (Richard): 6 weeks 5 Total: 34 weeks

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo The resources o Markus Zerlauth - 10% o Pierre Dahlen - 100% o Richard Mompo - 100% o Yan Bastian - 100% o Jean-Louis Vo Duy (now retired) -> August 2014 o Christophe De Siebenthal (Fellow) – 100 % o FSU: Alain Cauphy replaced by Chantal Chervet (since Sept. 2014) o Ivan Romera Ramirez (software) – 10% o Geza Csendes (Since Feb. 2015) ≈ Estimated whole MP ≈ 4 FTE EN/ICE: Jeronimo -20% ? + Jonas – 10% ? 6

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo The boundaries o Injectors restarted much before the LHC ! o As an interlock system, we come after the others have finished their work (MSC and EPC). o For the final commissioning step with EPC, we need the PCs “déconsigné”, covers in place and cooling water circulating. o Start-up of injectors are close to each other. 7 At the end… The LHC: IST + displacement of the WIC in P7 (R2E) BA HIE-ISOLDE LINAC 4 Very short time in-between

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo WIC upgrade in Ti2, Ti8, TT40, TT41 and TT60 o Goal: Add remote testing feature: o Aim is to gain efficiency during periodic check of all installations (Xmas breaks). o Work involved: o A lot of cabling work o 41 Crates to be modified (addition of a PLC module). o patches + control cables to be modified. o 900 Interlock boxes produced in advance, and to install. o Modify the PLC programs (5 PLC). o Re-commissioning o Work was correctly estimated to 4 months o Low dependencies on other teams 8 First LS1 objective: Successful !

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Booster 9 o Biggest WIC installation to date o Installation started several years before LS1 o Remaining work wrongly estimated to 3 months o It took us the double. o The reasons: o Renovation project: o Lack of information, last minutes discoveries o We discovered limitation of our WIC system (Matrix size, Passivation pb. when using safety modules, Unique matrix for FA + BD) o Integration problems with covers and BLMs o MSC were late to renovate their part (Installation of new thermo-switches) -> Multipole commissioning stages o Misunderstanding, change of strategy => Some work had to be redone several times Lesson learnt: Importance to have a detailed Engineering Specifications APPROVED with a clear definition of the responsibilities of each team involved before starting the job!

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo SPS o Partial renovation: o Old electro-mechanical interlock crates replaced by WIC PLCs. o Re-use of existing interlock boxes and most of the control cables. o Each sextant delivered by EL/EL according to a well defined planning (Thanks to G. Gros) o Important for us to organize our work o Very efficient machine coordinator: David Mcfarlane o Water circulation (EN/CV) was restored with 1 month delay… with a lot of leaks... Signals from CV still not clear ?!? Lesson learnt: Perform a maximum of tests independently from the client 10

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo AD o Due to the construction of a new bld. for the ELENA project, a cable tray had to be displaced o Neither MSC nor EPC want to assume responsibility for interlock cables between magnets & legacy interlock system o We were asked to commission the new cables o It turned out to be impossible to do it without having a global understanding of the layout of the machine + its interlock system (split over 4 buildings) o Yan and Christophe spent several weeks on this activity and did a fantastic job! o Responsibility for the interlock system remains with EPC until renovation by MPE 11 Magnet Interlock system MSCEPC ? Responsible

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo PS o After the retirement of R. Brown, we took over the responsibility of the interlock system of the PS (mains + auxiliary circuits) o We found: o Cabling document not up to date o Spare crates cannibalized o Hot areas  o Difficult access time (6 am) o Modifications to the interlock system expected from us (change of optics, some cables were removed by mistake during LS1) o We spend quite some time to understand how the auxiliary magnets were routed from the tunnel to the surface and from the interlock systems to the PCs. PS + AD: Useful investment for MPE in view of future renovation 12

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Software part o Many changes done to the generic code for safety PLCs o Documentation being completed (also pending EN/ICE contribution for generic code) o Excellent cooperation with EN/ICE on all our projects o PLC: Jeronimo Ortola Vidal took over from David Willeman at the start of LS1 but did an impressive work for us o WinCC: Jonas Arroyo Garcia took over from Giulio Morpurgo who took over from Marco Boccioli. Situation seems more stable now. o Excellent cooperation with BE/CO in the migration of all WIC projects in CCDB: o Many thanks to Nikolay Tsetkov and Eve Fortescue-beck 13

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Conclusions (1/2) o We were on time for the start up of each injectors… even if the first 6 months of 2014 were stressful o Attending coordination meetings for some 10 machines + doing the job is impossible. o IMPACT (x10): The rule of NOT having permanent IMPACT valid for the whole duration of LS1 for a given machine is a nightmare for us (fortunately was not applied in the SPS). o We need some flexibility in case we are blocked in a machine to be able to switch rapidly to another machine. Use of standard IMPACT we could clone? o ACCESS: some injectors are split over several sites: o LEIR: LEIR + PS o LINAC3: LINAC3 + PS o Ti2 & Ti8: LHC + SPS o TT40: SPS + CNGS 14 PS closed much before the Linac 3 and LEIR !

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Conclusions (2/2) o Renovation projects are much more demanding than new projects: o Each machine is different (layout, persons, circuits, naming convention etc…) o Lack of interlocutors that know the machines and relations b/w sub-systems o Involves a lot of reverse engineering o Integration service are now working also on injectors o Training objectives partially attained because of too many // activities  o Standard HW allow production to be anticipated (independent of final install.) o Investment in ASSET management. o Key point: The success of a LS relies on a solid preparation work… done well ahead in time… because we have more and more installations. o To finish on a positive note: After LS1 (4 big projects), the WIC system has gained coherence and vision between us and other teams with a clear share of responsibilities 15

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Thank you for your attention

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Reserved slides 17

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo Outlook towards LS2 On-going o WIC for EPC test station (bld. 287) o Completion Hie-Isolde stage 1 (June 2015) and stage 2 (2017) o Radiation tests in the new CHARM facility o AWAKE stage 1 (Oct. 2015) then stage 2 (2017) o ELENA (2017) o Upgrade of LEIR and LINAC 3 (Feb ?) o Completion of Linac 4 + TL (2018) In the pipeline but not fully approved: o Transfer lines between LINAC 4/Booster & Booster/PS o Renovation of PS o Renovation of TT2, TT10 o SM18, FAIR 18

TE-MPE- Post LS1 Review: 02 & 03/06/2015, Richard Mompo ASSET management o Project started by Geza (New recruit since Feb. 2015) o The aim is to have a DB with exact references of all Siemens components deployed in all machines. o So far 32 PLCs: > 1000 modules deployed in various machines. o Useful for mid-term and long term maintenance taking into account that some installation are already > 10 years. 19