Beam dump on 07. Sept 2012, Caused by RTQX2.R5 (SEU?)

Slides:

Advertisements

Similar presentations

6 th April 2010 MP3 weekly summary – issues and follow-up 0v1 M. Zerlauth for the MP3-CCC shift crew.

Advertisements

2 pcs6 pcs 10 pcs 13 pcs Zone 1Zone 1 Zone 3 -1Zone 3 -1Zone 3 -2Zone 3 -2Zone 3 -1Zone 3 -1Zone 3 -2Zone 3 -2Zone 3 -3Zone 3 -3 Zone 2 Origin_Zones 2.

Sat 17/9 – Sun 18/9 07:00 Cryo problem in point 4 From E. Blanco: First beam dump caused by a cryo PLC not reachable anymore (UX45_QUI) and then 14 minutes.

Answers/considerations to the questions raised on the last ASSRC meeting on Sept. 24, 2013 The following is my summary from s, private communication.

PIC configuration (maskable/unmaskable circuits) I. Romera MPP meeting –

A. Castañeda 07 th September 2009 Generators and Detectors Permit Loop / CIBG / CIBO 0v0.

Operational tools Laurette Ponce BE-OP 1. 2 Powering tests and Safety 23 July 2009  After the 19 th September, a re-enforcement of access control during.

Chamonix Risks due to UPS malfunctioning Impact on the Superconducting Circuit Protection System Hugues Thiesen Acknowledgments:K. Dahlerup-Petersen,

Premature Dumps in 2011 Acknowledgements: A.Macpherson, G.Papotti, M.Zerlauth M.Albert LHC Beam Operation Workshop December 2011.

:30 meetingEBH 1  7:53 start VdM scans LHCb  8:18 beam dump: RF M2B1 crowbar (3 rd time within 24 hours)  Access for RF  Changed thyratron.

Friday morning Dump fill due to the trip of the RQF.A78  intervention had been just planned for the morning on the circuit Access, interventions:  RQF.A56/78,

Fri – Sat - Sunday 30 Sept - 2 nd October Friday  06:00 Operator dump fill #2171, integrated lumi 75 pb-1.  90 m  * optics Optics ok, collisions at.

08h15: Injection.  Correction injection oscillations.  Transfer line steering.  Losses at 30% of dump threshold, limited by SPS scraping. 12h35: Start.

MP3 List of main Issues during March 2010 MP3 - Team.

From yesterday LHC status Wednesday 26 th Welcome Verena back on shift 07:08 Access in PM85 for piquet EPC (O.Fournier).  Fuse on RD2.R8 circuit.

LHC Fri 6 & Sat 7 Nov :00 End instabilities MD, dump to refresh air at dump TDE cavern 08:00 Access for vacuum team at the TDE starting 10:30 Access.

Tue 9/8 – Wed 10/8 Stable beams # :18 RQT12.R7B1 trip. End of STABLE BEAMS # ~86 pb -1 in ~19 hours 20:30 No beam from PSB (RF problem in ring.

Interfacing the FMCM for additional protection in the LHC and the SPS- LHC/CNGS Transfer Lines to the CERN controls system Cristina Gabriel Casado, Interlock.

Another typical LHC day. 06:15 Fill 2000 dumped 08:44 Stable beams – fill 2001  1.675e14  1.21e11  ~2 microns normalized emittance 11:34 Beams dump.

MPE Workshop 14/12/2010 Post Mortem Project Status and Plans Arkadiusz Gorzawski (on behalf of the PMA team)

CERN Marc Magrans de Abril MPP – RBI DCCT Incident Beam Lost in TI2 Event Analysis and Proposed Mitigations SPS and LHC MPP

Machine Protection Review, Markus Zerlauth, 12 th April Magnet powering system and beam dump requests Markus Zerlauth, AB-CO-IN.

LHC Beam Commissioning Meeting V. Kain & R. Alemany

Beam Interlock System SPS CIBU Connection Review

Dependability Requirements of the LBDS and their Design Implications

Saturday Coordinators weekend: Mike Lamont, Eva Barbara Holzer

Markus, Mathieu, Enrique, Rudiger, Serge

Second look at the results of the 2012 analysis of triplet thresholds

SPS extraction, transfer lines, injection

B.Todd, M. Zerlauth, I. Romera, A. Castaneda

Friday 15th June 01:11 Injection.

ATLAS-AFP interlock validation

Friday 30th September 06:00 Operator dump fill #2171, int. lumi about 75 pb-1 Previous operator dump from physics was on 14 September ! 07:00 Start of.

Beam dump on LHC beams dumped on 08:20:04 by SIS, following a failing BLM HV check in IR7.

Commissioning and Testing the LHC Beam Interlock System

Wednesday 17th August Rocky, short fills, initial luminosities are good LHCb polarity change to negative seems ok 18/08/2011 LHC 8:30 meeting.

Saturday 12:00 Fill 1992 in stable beams.

Thursday morning – optics correction

Fri 29/7 – Sat 30/7 09:00 End of fill 1990, PC trip RCBXV3.R1 (likely SEU on QPS). Integrated Luminosity: 41 pb-1. Access for MKI2 main switch replacement.

Machine Protection Xu Hongliang.

Electrical Glitch 06:02 Electrical glitch is seen on all circuits connected to the 18kV (RD1.LR1, RD1.LR5, RD34.LR3, RD34.LR7)

Alice solenoid – orbit distortion

Interlocking of CNGS (and other high intensity beams) at the SPS

Thursday morning 09:30 Dump of pPb fill.

M. Zerlauth, I. Romera 0v1.

Friday 31st August & night

Thursday 10th May - morning

Week 35 – Technical Stop and Restart

Tuesday Loss maps in the night:

Planning at 5 o’clock meeting Friday

Global Post Mortem Event Event Timestamp: 15/06/12 15:54:

Yesterday morning Held 1647 for a while – SPS kicker problem

Tuesday Access for RF & QPS (others in the shadow) until ~18:00.

Sunday/Monday & :30 Stable beams. Fill #1851.

Tuesday 17/5 10: TeV - colliding. Start roman pot alignment ...

Monday 8th December Morning used for RF work (IP z, injection), damper noise checks. Stable beams period with LHCb spectrometer OFF – lost beam after.

R2E LMC Update (Weeks 32/33) Post-Mortem database: SEE analysis and link to existing RadWG list in preparation Shielding block delivery crisis solved:

07/08/2010 Fill #1264 dump at 02:14:38.

Thursday 22 September 2011.

Saturday 06/11 Triplet R8 tripped during ramp for collision setup.

Coordination: Eva Barbara Holzer, Mike Lamont

Monday 26th September 7:30 Beam dump, QSP on RQX.R1, lost cryo in ITR1, 91 pb-1. Cryo recovery, needed about 1.5 h. Setting of TI2 collimators to 5 sigma.

Friday h55 Stable beams. Fill #1841. Lumi ~1.2e33.

Saturday Luminosity production 1380 bunches

Thursday 10:00 Fill 1986 in stable beams.

SPS Injection BIS - Draft requirements

Presentation transcript:

Beam dump on 07. Sept 2012, Caused by RTQX2.R5 (SEU?)

Beam dump @ 11:28:47 Beams were dumped while in STABLE_BEAMS at 11:28:47 on 7th of September due to Beam Losses in IR7

Beam dump @ 11:28:47 First BLM channel to trigger was TCLA.A6R7.B1in the short RS! Fast change of orbit ~ 100um in last 100 turns

Beam dump @ 11:28:47 Actual cause was converter trip of RQX.R5, which however was reported to the interlock systems only 2.06s later!

Converter logs Beam dump by BLM Powering Failure V_MEAS, I_MEAS from sent from RTQX1 (due to VS_FAULT), Remove Power Permit to all 3 converters V_MEAS, I_MEAS from RTQX2 (No data for ~ 1 sec)

FGC Error log from RTQX2 and RTQX1 RTQX1 finally trips 2 sec later with a VS_FAULT + generates POWERING_FAILURE to PIC FGC Log from RTQX2 misses entries for ~ 1 second, then shows CONFIG, DSP_FLT.. errors, but no POWERING_FAILURE generated

Summary Origin of beam dump seems to originate in the loss of the FGC for RTQX2 (maybe due to an SEU seen as it is located in UJ56)? Failure seems to occur around 11:28:46.700, followed by a period of ~ 900ms without PM data Consequent movement of orbit created beam losses and dumped beams at 11:28:47.545 by a BLM in IR7 Powering Failure reported by the triplet circuit R5 around 11:28:49.600, due to RTQX1 tripping on a VS_FAULT Question to EPC expert: Why did the FGC of RTQX2 not remove the Powering Failure signal when it initially failed?