1. 15 Sep 2007 ICALEPCS'07 - P.Charrue - CERN1 The Status of the LHC Controls System Shortly Before Injection of Beam Pierre Charrue on behalf of CERN Accelerator and Beams Controls Group

2. 15 Sep 2007 ICALEPCS'07 - P.Charrue - CERN2 Motivation of this talk Present the controls challenges of the LHC machine Give an overview of the LHC Controls Infrastructure Propose links to further ICALEPCS’07 presentations

3. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN3 Relativity “ ” Albert Einstein “When you sit with a nice girl for two hours, you think it's only a minute. But when you sit on a hot stove for a minute, you think it's two hours. That's relativity” Albert Einstein Hence the title “LHC controls “shortly” before beam injection” for us means: Hence the title “LHC controls “shortly” before beam injection” for us means: a few months before LHC Beam Commissioning a few months before LHC Beam Commissioning 9 months after start of LHC Hardware Commissioning 9 months after start of LHC Hardware Commissioning “ ” Albert Einstein “When you sit with a nice girl for two hours, you think it's only a minute. But when you sit on a hot stove for a minute, you think it's two hours. That's relativity” Albert Einstein Hence the title “LHC controls “shortly” before beam injection” for us means: Hence the title “LHC controls “shortly” before beam injection” for us means: a few months before LHC Beam Commissioning a few months before LHC Beam Commissioning 9 months after start of LHC Hardware Commissioning 9 months after start of LHC Hardware Commissioning

4. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN4 Outline LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Technical Solutions to the LHC challenges Technical Solutions to the LHC challenges Results Results Summary Summary LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Technical Solutions to the LHC challenges Technical Solutions to the LHC challenges Results Results Summary Summary

5. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN5 The LHC Controls Infrastructure Based on the classical 3-tier model Based on the classical 3-tier model The LHC Controls Infrastructure is a new software and hardware architecture built with the experience of controlling the CERN injector chainThe LHC Controls Infrastructure is a new software and hardware architecture built with the experience of controlling the CERN injector chain Level of effort: 300 my, 21 MSFRLevel of effort: 300 my, 21 MSFR The LHC Controls Infrastructure is a new software and hardware architecture built with the experience of controlling the CERN injector chainThe LHC Controls Infrastructure is a new software and hardware architecture built with the experience of controlling the CERN injector chain Level of effort: 300 my, 21 MSFRLevel of effort: 300 my, 21 MSFR

6. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN6 The 3-tier LHC Controls Infrastructure

7. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN7 The Resource Tier VME crates dealing with high performance acquisitions and real- time processing VME crates dealing with high performance acquisitions and real- time processing e.g. the LHC beam instrumentation and the LHC beam interlock systems use VME front-ends e.g. the LHC beam instrumentation and the LHC beam interlock systems use VME front-ends VME crates dealing with high performance acquisitions and real- time processing VME crates dealing with high performance acquisitions and real- time processing e.g. the LHC beam instrumentation and the LHC beam interlock systems use VME front-ends e.g. the LHC beam instrumentation and the LHC beam interlock systems use VME front-ends PC based gateways interfacing systems where a large quantity of identical equipment is controlled through fieldbuses e.g. LHC power converters and LHC Quench Protection System Programmable Logic Controllers (PLCs) driving various sorts of industrials actuators and sensors for systems e.g. LHC Cryogenics systems or the LHC vacuum system. Supported FieldBuses for local connections e.g. Mil1553, WorldFIP, Profibus PC based gateways interfacing systems where a large quantity of identical equipment is controlled through fieldbuses e.g. LHC power converters and LHC Quench Protection System Programmable Logic Controllers (PLCs) driving various sorts of industrials actuators and sensors for systems e.g. LHC Cryogenics systems or the LHC vacuum system. Supported FieldBuses for local connections e.g. Mil1553, WorldFIP, Profibus

8. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN8 The Middle Tier Application Application servers hosting the software required to operate the LHC beams and running the Supervisory Control and Data Acquisition (SCADA) systems – –HP ProLiant dual CPU with 3Gbyte RAM running LINUX. – –Dual hot pluggable RAID-1 system disks – –Redundant dual hot pluggable power supplies. Data servers containing the LHC layout and the controls configuration as well as all the machine settings needed to operate the machine or to diagnose machine behaviors. Data servers containing the LHC layout and the controls configuration as well as all the machine settings needed to operate the machine or to diagnose machine behaviors. File servers containing the operational applications File servers containing the operational applications Central timing which provides the cycling information of the whole complex of machines involved in the production of the LHC beam and the timestamp reference Central timing which provides the cycling information of the whole complex of machines involved in the production of the LHC beam and the timestamp reference Data servers containing the LHC layout and the controls configuration as well as all the machine settings needed to operate the machine or to diagnose machine behaviors. Data servers containing the LHC layout and the controls configuration as well as all the machine settings needed to operate the machine or to diagnose machine behaviors. File servers containing the operational applications File servers containing the operational applications Central timing which provides the cycling information of the whole complex of machines involved in the production of the LHC beam and the timestamp reference Central timing which provides the cycling information of the whole complex of machines involved in the production of the LHC beam and the timestamp reference

9. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN9 The Presentation Tier At the control room level, consoles running the Graphical User Interfaces (GUI) will allow machine operators to control and optimize the LHC beams and to supervise the state of key industrial systems. At the control room level, consoles running the Graphical User Interfaces (GUI) will allow machine operators to control and optimize the LHC beams and to supervise the state of key industrial systems. Dedicated fixed displays will also provide real-time summaries of key machine parameters Operational consoles specifications : PCs with 2 Gbyte RAM running either LINUX or WINDOWS One PC, one keyboard, one mouse, and up to 3 screens Console capable of running any type of GUI software for LHC (and PS and SPS) such as JAVA, WEB, SCADA or X-MOTIF. Dedicated fixed displays will also provide real-time summaries of key machine parameters Operational consoles specifications : PCs with 2 Gbyte RAM running either LINUX or WINDOWS One PC, one keyboard, one mouse, and up to 3 screens Console capable of running any type of GUI software for LHC (and PS and SPS) such as JAVA, WEB, SCADA or X-MOTIF.

10. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN10 Inside CCC General Purpose Fixed Display Operator Console

11. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN11 A typical Operator Console Interactive Consoles Local Fixed Displays

12. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN12 Communications Technical Network (TN) For operational equipment Formal connection and access restrictions Limited services available (e.g. no mail server, no external web browsing) Authorization based on MAC addresses Network monitored by CERN IT Department General Purpose Network (GPN) For office, mail, www, development No formal connection restrictions General Purpose Network (GPN) For office, mail, www, development No formal connection restrictions

13. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN13 Outline LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Technical Solutions to the LHC challenges Technical Solutions to the LHC challenges Results Results Summary Summary

14. The LHC Challenges (1/3) The LHC is the largest accelerator in the world number of components diversity of systems The complexity of operation will be extreme: very critical technical subsystems large parameter space need for online magnetic and beam measurements real time feedback loops. Some 500 objects are capable of moving into the aperture of either the LHC Ring, or the transfer lines, ranging from passive valves up to very complex experimental detectors P. Collier - AB/CO LHC Workshop January, 2005 The complexity of the accelerator is unprecedented and repair of damaged equipment would take long, for example, the exchange of a superconducting magnet takes about 30 days R. Schmidt - http://cern.ch/rudi/docs/VisitLHCWuppertal2006.ppt

15. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN15 1232 main dipoles + 3700 multipole corrector magnets 392 main quadrupoles + 2500 corrector magnets Regular arc: Magnets

16. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN16 Regular arc: Cryogenics Supply and recovery of helium with 26 km long cryogenic distribution line Static bath of superfluid helium at 1.9 K in cooling loops of 110 m length Connection via service module and jumper

17. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN17 Insulation vacuum for the cryogenic distribution line Regular arc: Vacuum Insulation vacuum for the magnet cryostats Beam vacuum for Beam 1 + Beam 2

18. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN18 Regular arc: Electronics Along the arc about several thousand electronic crates (radiation tolerant) for: quench protection, power converters for orbit correctors and instrumentation (beam, vacuum + cryogenics)

19. The LHC Challenges (2/3) The stored beam energy and the stored energy in the magnets exceeds present machines by more than 2 orders of magnitude The LHC machine must be protected at all costs In the case of an operational incident operation should be able to analyze what has happened and trace the cause. Moreover no operation can be resumed if the machine is not back in a good state The stored beam energy and the stored energy in the magnets exceeds present machines by more than 2 orders of magnitude The LHC machine must be protected at all costs In the case of an operational incident operation should be able to analyze what has happened and trace the cause. Moreover no operation can be resumed if the machine is not back in a good state

20. Energy stored in one beam at 7 TeV: 362 MJoule The energy of one shot (5 kg) at 800 km/hour corresponds to the energy stored in one bunch at 7 TeV. There are 2808 bunches. Factor 200 compared to HERA, TEVATRON and SPS. * shot Energy Stored in the Beam *Rüdiger Schmidt

21. Energy stored in the magnets The energy of an AirBus A380 at 700km/hr corresponds to the energy stored in the LHC magnet system* AirBus A380 *Rüdiger Schmidt MAC 9 December 2005 **Mike Harrison HCP2006 Kinetic Energy One bunch out of 2808 carries the equivalent of a 5kg shot travelling at 800 km/h* 1 small aircraft carrier of 104 tons going 30 km/h 450 automobiles of 2 tons going 100 km/h** Thermal Energy** melt 500 kg of copper raise 1 cubic meter of water 85ºC: “One ton of tea” Chemical Energy** 80 kg of TNT

22. The LHC Challenges (3/3) The LHC is the first superconducting accelerator built at CERN 4 large scale cryoplants with 1.8 K refrigeration capability The LHC is the first superconducting accelerator built at CERN 4 large scale cryoplants with 1.8 K refrigeration capability

23. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN23 Outline LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Technical Solutions to the LHC challenges Technical Solutions to the LHC challenges Results Results Summary Summary

24. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN24 Technical solutions (1/3) Network security (CNIC) and equipment access control (RBAC, Machine Critical Settings) Specific tools for the monitoring of the controls infrastructure LASER: general alarm system TIM: monitoring of technical infrastructure DIAMON (in development): monitoring and diagnostics of controls infrastructure Post mortem data storage and analysis Logging system

25. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN25 Security : Computing and Network Infrastructure for Controls (CNIC) CERN-wide Working group setup in 2004 for the definition of : CERN wide security policy CERN wide networking aspects Operating systems configuration (Windows and Linux) Services and support Main outcome are : Main outcome are : Network Security Policy document Network Security Policy document Formal isolation between General Purpose Network (GPN) and Technical Network (TN) Formal isolation between General Purpose Network (GPN) and Technical Network (TN) Connection to the TN requires formal authorization Connection to the TN requires formal authorization MAC address authentication MAC address authentication Windows and LINUX OS and patches deployment and management centrally managed Windows and LINUX OS and patches deployment and management centrally managed CERN-wide Working group setup in 2004 for the definition of : CERN wide security policy CERN wide networking aspects Operating systems configuration (Windows and Linux) Services and support Main outcome are : Main outcome are : Network Security Policy document Network Security Policy document Formal isolation between General Purpose Network (GPN) and Technical Network (TN) Formal isolation between General Purpose Network (GPN) and Technical Network (TN) Connection to the TN requires formal authorization Connection to the TN requires formal authorization MAC address authentication MAC address authentication Windows and LINUX OS and patches deployment and management centrally managed Windows and LINUX OS and patches deployment and management centrally managed

26. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN26 Security : RBAC Implement a ‘role-based’ access to equipment in the communication infrastructure Implement a ‘role-based’ access to equipment in the communication infrastructure Depending on WHICH action is made, on WHO is making the call, from WHERE the call is issued and WHEN it is executed, the access will be granted or denied Depending on WHICH action is made, on WHO is making the call, from WHERE the call is issued and WHEN it is executed, the access will be granted or denied This allows for filtering, for control and for traceability on the settings modifications to the equipment This allows for filtering, for control and for traceability on the settings modifications to the equipment Implement a ‘role-based’ access to equipment in the communication infrastructure Implement a ‘role-based’ access to equipment in the communication infrastructure Depending on WHICH action is made, on WHO is making the call, from WHERE the call is issued and WHEN it is executed, the access will be granted or denied Depending on WHICH action is made, on WHO is making the call, from WHERE the call is issued and WHEN it is executed, the access will be granted or denied This allows for filtering, for control and for traceability on the settings modifications to the equipment This allows for filtering, for control and for traceability on the settings modifications to the equipment TPPA04 TPPA12 WPPB08

27. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN27 Technical solutions (2/3) Integrated suite of control room applications LSA (LHC Software Application) Integrated suite of control room applications LSA (LHC Software Application) FESA framework for front-end computers FESA framework for front-end computers UNICOS framework for industrial controls UNICOS framework for industrial controls Integrated suite of control room applications LSA (LHC Software Application) Integrated suite of control room applications LSA (LHC Software Application) FESA framework for front-end computers FESA framework for front-end computers UNICOS framework for industrial controls UNICOS framework for industrial controls

28. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN28 UNICOS Framework

29. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN29 Technical solutions (3/3) Specific hardware developments (high SIL levels) for machine protection (PIC, BIC…) Specific hardware developments (high SIL levels) for machine protection (PIC, BIC…) LHC Software Interlocks System (SIS) LHC Software Interlocks System (SIS) Fully integrated asset, layout, configuration database system Fully integrated asset, layout, configuration database system Extension to the Injector timing system Extension to the Injector timing system

30. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN30 Beam Permit and Powering Interlock Systems

31. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN31 Outline LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Technical Solutions to the LHC challenges Technical Solutions to the LHC challenges Results Results Summary Summary

32. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN32 Some Results Successful Cooldown of LHC sector 7-8 Successful Cooldown of LHC sector 7-8 Primary cause of the 2004 TI8 accident identified Primary cause of the 2004 TI8 accident identified Hole in the vacuum chamber of LHC transfer line TI8 Hole in the vacuum chamber of LHC transfer line TI8 SPS at 450 GeV (some 10^13 protons) SPS at 450 GeV (some 10^13 protons) For the LHC Hardware Commissioning : For the LHC Hardware Commissioning : LSA function generation for MB and QF and QD LSA function generation for MB and QF and QD post mortem view of PC tracking post mortem view of PC tracking Automation and parallelism of all the HWC tasks Automation and parallelism of all the HWC tasks HWC fixed displays HWC fixed displays Specific development of hardware for Specific development of hardware for Fast Magnet Current Management Fast Magnet Current Management Machine Protection System for Powering, Quench Protection System and Warm magnets Machine Protection System for Powering, Quench Protection System and Warm magnets Successful Cooldown of LHC sector 7-8 Successful Cooldown of LHC sector 7-8 Primary cause of the 2004 TI8 accident identified Primary cause of the 2004 TI8 accident identified Hole in the vacuum chamber of LHC transfer line TI8 Hole in the vacuum chamber of LHC transfer line TI8 SPS at 450 GeV (some 10^13 protons) SPS at 450 GeV (some 10^13 protons) For the LHC Hardware Commissioning : For the LHC Hardware Commissioning : LSA function generation for MB and QF and QD LSA function generation for MB and QF and QD post mortem view of PC tracking post mortem view of PC tracking Automation and parallelism of all the HWC tasks Automation and parallelism of all the HWC tasks HWC fixed displays HWC fixed displays Specific development of hardware for Specific development of hardware for Fast Magnet Current Management Fast Magnet Current Management Machine Protection System for Powering, Quench Protection System and Warm magnets Machine Protection System for Powering, Quench Protection System and Warm magnets

33. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN33 LHC sector 7-8 : 1st cooldown

34. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN34 Reconstruction of beam incident from logged data Conclusion : MSE current appears to be ~2.5% low at extraction (Note: ~8 MSE trips previous to the accident)

35. Courtesy F.Bordry

36. Tracking between the three main circuits of sector 78 Courtesy F.Bordry 2ppm

37. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN37 Oulook LHC Hardware Commissioning in the coming months, with massive parallelism early 2008 First LHC beam commissioning for summer 2008 LHC Hardware Commissioning in the coming months, with massive parallelism early 2008 First LHC beam commissioning for summer 2008 LHC Transfer Lines commissioning in the coming weeks

38. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN38 Outline LHC controls infrastructure LHC controls infrastructure The major LHC challenges The major LHC challenges Controls Answers to the challenges Controls Answers to the challenges Results Results Summary Summary

39. 15 Sep 2007ICALEPCS'07 - P.Charrue - CERN39 Summary We have addressed the LHC challenges and appropriate solutions have been deployed The LHC infrastructure has been tested almost completely on previous milestones (LEIR, TI2/8 Transfer Lines, CNGS, SPS, LHC HWC) we are confident that we can meet the LHC challenges Part of the enormous human resource effort invested for LHC comes from international collaborations Their contribution is highly appreciated Looking forward to more fruitful collaborations We have scheduled our efforts for the 450 GeV engineering run in November 2007 We are now ready and eager to see beam in the LHC We have addressed the LHC challenges and appropriate solutions have been deployed The LHC infrastructure has been tested almost completely on previous milestones (LEIR, TI2/8 Transfer Lines, CNGS, SPS, LHC HWC) we are confident that we can meet the LHC challenges Part of the enormous human resource effort invested for LHC comes from international collaborations Their contribution is highly appreciated Looking forward to more fruitful collaborations We have scheduled our efforts for the 450 GeV engineering run in November 2007 We are now ready and eager to see beam in the LHC