1. 0v1

2. 1. ARW Overview 2. Relevant Outcomes 3. Personal Opinion Who? Where?
What
2. Relevant Outcomes
Accelerator Community
CERN
Machine Protection
3. Personal Opinion
Accelerator Reliability Workshop 2009

3. 1. ARW Overview 2. Relevant Outcomes 3. Personal Opinion Who? Where?
What
2. Relevant Outcomes
Accelerator Community
CERN
Machine Protection
3. Personal Opinion
Accelerator Reliability Workshop 2009

4. Accelerator Reliability Workshop 2009

5. Attendees Accelerator Eng. Corp. (Japan) x4
AccSys Technology, Inc . (USA) 1
Australian Synchrotron
Brookhaven National Lab (USA) x3
Canadian Light Source
CERN x2
CNSC (CANADA)
DESY (Germany)
Diamond Light Source (UK)
Euro. Synch. Radiation Facility (Fra.)
Fermi Lab (USA)
Indiana Univ. Cyclotron Facility
Institut Curie (Fra.)
Instrumentation Tech. (Slovenia)
ISIS, RAL (UK)
JASRI/SPring-8 (Japan)
Jefferson Lab (USA)
KEK (Japan) 1
Lawrence Berkeley National Lab
LNL-INFN (Italy)
National Inst. of Radiological (Japan) x3
Michigan State University x2
NSRRC (Taiwan)
Paul Scherrer Institut (Switz.)
Pohang Accelerator Lab. (Korea)
Sincrotrone Trieste S.C.p.A. (Italy)
SLAC National Accelerator Lab. x5
SNS/Oak Ridge National Laboratory
Spallation Neutron Source / ORNL
St James Software (S.A.)
Synchrotron SOLEIL (France)
UPC (Spain)
Uppsala University (Sweden)
TRIUMPH (Canada) 31
Accelerator Reliability Workshop 2009

6. Program Monday: Experience/Achievements to Date (4 talks)
Refurbishments and Up-grades (4)
Quality Assurance (2)
Tuesday:
Engineering & Design for Reliability (6)
Hardware Reliability - System Expert Reports (4)
Poster session
Wednesday:
Software Reliability - Automated Routines (8)
Tour of TRIUMF
Thursday:
Failure Analysis (4) / Human Factors (4)
Operations Management (4) / Maintenance (3)
Friday:
How Radiation affects Reliability (3)
Closing session
Accelerator Reliability Workshop 2009

7. Program Monday: Experience/Achievements to Date (4 talks)
Refurbishments and Up-grades (4)
Quality Assurance (2)
Tuesday:
Engineering & Design for Reliability (6)
Hardware Reliability - System Expert Reports (4)
Poster session
Wednesday:
Software Reliability - Automated Routines (8)
Tour of TRIUMF
Thursday:
Failure Analysis (4) / Human Factors (4)
Operations Management (4) / Maintenance (3)
Friday:
How Radiation affects Reliability (3)
Closing session
Accelerator Reliability Workshop 2009

8. 1. ARW Overview 2. Relevant Outcomes 3. Personal Opinion Who? Where?
What
2. Relevant Outcomes
Accelerator Community
CERN
Machine Protection
3. Personal Opinion
Accelerator Reliability Workshop 2009

9. Reliability Definition
Actual operating hours divided by expected operating hours
Doug Preddy, Triumf
Availability = Time_Operational / Total_Time
Reliability = Time_Operational / Total_Time + Down_Time
Reda Tafirout, Triumf
Time is a very important part of the reliability definition:
Expected uptime, repair and maintenance times, idle time, and unplanned occurrences all [contribute]
Experience is one of the main influences [in improving reliability]
Accelerator Reliability Workshop 2009

10. Other Talks BASIC RELIABILITY THEORY
… ~ 50% relevant to CERN = interesting points ….
… Two / Three sentence of each …
BASIC RELIABILITY THEORY
FAULTS and RELIABILITY in the OPERATION of PLS
JLAB / NSCL EXPERIENCE to DATE & AVAILABILITY
LESSONS LEARNED from 16 YEARS HERA OPERATION
JEFFERSON LAB REFURBISHMENTS and UPGRADES
GENERAL RELIABILITY at RHIC
ADAPTIVE MAINTENANCE based on RELIABILITY
POST-MORTEM DIAGNOSIS for TAIWAN LIGHT SOURCE
HUMAN PERFORMANCE
MAINTAINING RELIABILITY : TRIUMF POWER INTERRUPTIONS
SNS MAINTENANCE MANAGEMENT at SNS
TRIUMF RADAITION RELIABILITY ISSUES
Etc…
Accelerator Reliability Workshop 2009

11. LHC Reliability Quantify Baseline LHC reliability?
hours of machine operation expected in a year.
Physics? physics? Lum. + Energy + Time?
Assign $ value to unforeseen stoppages?
institutes assign k$ lost per hour of unforeseen stoppages.
Risk of sudden floor fracture?
LHC dipoles masses = LEP? floor designed to hold weight?
Root Cause Analysis for every failure?
complete understanding (mitigations) for all faults. TAPROOT.
Reliability DB for failure tracking?
Weibull mechanism = very good scope for failure tracking.
CERN repository of proven design practices?
influence future designs – at CERN – beyond LHC.
Accelerator Reliability Workshop 2009

12. Hot-Swappable Equipment?
RF / PCs / Cooling
RF, Powering and Cooling Reliability = weaknesses everyone is fighting.
How reliable are these in LHC?
Documents / FMEA / Calculations made?
Built for ‘Maintainability’?
Preventive Maintenance Scheduled?
N.B. Running through a shutdown = NO preventive maintenance…
Hot-Swappable Equipment?
Environmental Monitoring?
Of buildings which house PCs and Heavy Machinery
Air Flow Models?
Model air flow? Or trial-and-error? Or rule-of-thumb?
Diversity of Staff?
For all equipment = more than one expert = several experts.
Accelerator Reliability Workshop 2009

13. work done by CERN duplicated in other labs, and vice versa
Collaborations
work done by CERN duplicated in other labs, and vice versa
SLAC Hot Swap Power Converter technology?
involved in ATCA?
VME replacement bus architecture reliable
Considering RIOC?
redundant IO channel for RIOC and others
Certified ‘logbook’ software SJ Soft?
10/9 logbook erased…
ORNL should see MTF and EDMS
CERN should advertise the RADMON
CERN could help TRIUMF with cables for radiation
Accelerator Reliability Workshop 2009

14. 1. ARW Overview 2. Relevant Outcomes 3. Personal Opinion Who? Where?
What
2. Relevant Outcomes
Accelerator Community
CERN
Machine Protection
3. Personal Opinion
Accelerator Reliability Workshop 2009

15. Operator Screens for example, should be considering ‘Human Factors’
Personal Opinion
subjective!
LHC MPS Dependability Analysis beyond anyone else’s
No-one showed anything close
No-one mentioned anything after my talks
Right people may not have been there
Next Gen (ILC etc) starting with reliability specification
CERN’s work = very relevant
Extend LHC MPS Study = beyond safety
let’s figure out what LHC reliability could be
Human Factor’s = Very Interesting
Humans Operating – Man-Machine Interface
Humans Designing – team-work, design is always subjective
Operator Screens for example, should be considering ‘Human Factors’
Accelerator Reliability Workshop 2009

16. More Personal Opinion VERY subjective! September 10th
Quite a few questions in coffee times
Cost of repair > some institute’s annual budget…
Some knew more than me about what happened…
N.B Lessons learned are THE method for improving systems.
One thing which troubles me:
US = Department of Energy is there…
CAN = Nuclear Regulation for everything…
we are lucky… So far… No hands on regulation…
Accelerator Reliability Workshop 2009

17. Next Steps
Much higher CERN involvement in next Accelerator Reliability Workshop?
In taking account of many aspects such as:
Software Interlocks,
Post-Mortem,
EDH, EDMS, MTF,
Powering, Cooling,
Radiation Management,
Personnel Safety,
Logging, Analysis,
Human Interface …
Dedicated session to safety systems should be foreseen
rest of industry fighting same battles => future projects (ILC, CLIC, ITER) need the same / similar systems.
Workshop partnered with Workshop on Accelerator Operations (WAO)
WAO 2010 is next
ARW 2011? Could be organised by CERN?
Accelerator Reliability Workshop 2009

18. And then…
\\cern.ch\dfs\Users\b\btodd\Public\ARW2009\ARW2009_ROC_0v2.doc
Accelerator Reliability Workshop 2009

19. FIN
Accelerator Reliability Workshop 2009