Problems encountered at P4: 1st episode

Slides:



Advertisements
Similar presentations
Status of Cryogenics at point 4 following the power cut L. Tavian 20 August 2011.
Advertisements

4th July Two physics fill during the day Smooth data taking LHC plans changed: 90m run postponed to tomorrow (24h) OT FE still excluded, to be looked at.
Friday 23 rd November - morning Coming out of loss maps over night Thu – Fri  in shadow of MKD problem in SPS (and CMS cryo recovery) 07:35 Start pre-cycle.
Sat 18/6 – Sun 19/6 07:48 Beam dump due to spurious interlock from BIS 08:30 access BIC repair. RF intervention in parallel. 13:00 Intervention on BIC.
LHC 8:30 meetingEBH 1  Cryogenics recovery in point 8  Meanwhile a couple of accesses:  MKI investigation on noise in IP2  Insulation Vacuum.
LHC 1 st August :34 Dump on TDI.B2 jaw position while filling –Checks and change TDI.B2 reference position by 0.1 mm outwards 09:40 Lost cryo in.
RBAC Content: LHC Operational Mode Piquet Roles RBAC Strict LHC Operational mode and CMW Acknowledgements: Pierre C., Wojtek S., Stephen P., Lars J., Verena.
LHC-YETS Coordination meeting #9 24 th November, 2015.
Luigi Serio CRYOGENICS PERFORMANCE AND OPERATION L. Serio, on behalf of the LHC Cryogenics Operation and Cryogenics Performance Panel.
08:30 Machines in stand-by 12:30 Access in LHC for QPS and PC:  QPS quench heater power supply RB.A12  EPC for RSF2.A67B2 and RQ9.R8B1.  RCBH27.L1B2.
Conclusions on UPS powering test and procedure I. Romera Acknowledgements: V. Chareyre, M. Zerlauth 86 th MPP meeting –
Thursday 20 th April 01:53 RCBV17.R7B2 tripped as happened few days ago: SIS intercepted. 05:54 Stable beams, 1380b, still RF problems B1, abort gap cleaning.
Summary of the technical stop activities on collimators (w17, 2012) O. Aberle – 07/05/12.
Another typical LHC day. 06:15 Fill 2000 dumped 08:44 Stable beams – fill 2001  1.675e14  1.21e11  ~2 microns normalized emittance 11:34 Beams dump.
Thursday 27 th October 00:57 fill 2257 dumped during squeeze (RQTF.A67B1) 03:52 stable beams fill #2258 4:33 Dumped, problem of LBDS dilution kicker power.
07:00 Dump fil #2219, 123 pb -1 delivered. Trim TDI parking position to +/- 55 mm in the collimator BP trimmed the temperature kicker limit to 62 degrees.
Tuesday 3 rd October STABLE BEAMS until 12:25 when we switched to ADJUST for a EOF test for Tobias  dump B2 first and then B1.  Dump at EOF test because.
European Organization for Nuclear Research - Organisation européenne pour la recherche nucléaire CO 2 IBL plant failures 16/06/ /06/2016 O.Crespo-Lopez.
LHC status Friday 11 th September 2015 Coordination: Mike Lamont, Jorg Wenninger.
Artificial Intelligence In Power System Author Doshi Pratik H.Darakh Bharat P.
Monday – Morning L. Drosdal: Injection line TI8: IQC threshold for BPM H from 2mm to 2.5mm to avoid unnecessary latches due to variations.
Wednesday :06 Dump fill 3533: interlock BPMS in IP6
Wed 27/7 – Thu 28/7 09:00 LHC Controls problems
Last 24 hours RQ4.L1 Lost going into collision Test ramp Storm
Wednesday September 14th
Summary Friday h38: Ramp down and pre-cycle.
Use Cases - Cryo Services Speaker: Klaus Barth on behalf of TE/CRG
Tuesday Fill lost #1855 at 7:28 due to the trip of RQX.R1. This was traced to a software bug in the FGC… The Class 51 (LHC_PC) FGC software has been upgraded.
Tuesday Nov 16th Fill 1492 into physics around 07.30
Monday 11/07: Recovery Plenty of accesses.
Coordination: G. Arduini, E.B. Holzer, J. Jowett
Week 46 Week 46: Machine coordinators: Roger Bailey – Gianluigi Arduini Main aims of the week: Stable beams with ions Scheduled stop for ion source refill.
Tue :25 Beams dumped due to RF vacuum interlock
LHC Morning Meeting - G. Arduini
Thursday morning 09:30 Dump of pPb fill.
Welcome To My Student Led Conference
Scrubbing progress - 09/12/2012
LHC Morning Meeting - G. Arduini
Thursday 10th May - morning
Thursday 10th January 9:30 Network routers restart, all went fine, but only just. 12:00 All power converters from the arcs on at standby 12:00 ELQA test.
Sunday morning Recovering from 400 kV disturbance.
LHC Morning Meeting - G. Arduini
Finally.... We had to wait a long time.... We had many problems....
Not the most productive 24 hours on record
Friday Morning 7:30 injection for fill 2908
Context at P8 Last slide presented at LMC early May 2012
Tuesday morning 09:30 Beam dump, SIS dump due to lost connections with FCG FECs. Coincides with starting a development SIS server to test new interlocks.
Wednesday 10/5 Cryo recovery until 18:30
Aims for the week Recover from technical stop and precycle at 10A/s
November technical stop activities:
Monday 24 October hours of 25ns MD
LHC Morning Meeting - G. Arduini
Tuesday morning 08:30-09:00 Squeeze with probe.
Cold compressor speed S45
Monday, Janaury 1st No School – Christmas Break.
Monday, January 22nd Fill in Agenda with: Turn in Menu Projects
Tuesday In the morning test cycle with probe for Q’ measurement.
Thursday 22nd March 00:20 – 02:40 on longer squeeze function, orbit and chroma correction at 4 TeV 2:40 – 5:30 second cycle with long squeeze 5:46 – 7:00.
Tuesday 20 September 2011.
Guidelines defined early Dec 2012
Thursday
Coordination: Eva Barbara Holzer, Mike Lamont
Friday 15th February - morning

Studio & AP.
Thu :00 Dumped beams, refill for Pb-Pb physics. No more protons in 2011… Some changes: Increase of flat top total voltage to 14 MV. Feed-forward.
Tuesday
Friday 1st October : Van der Meer scans
Tuesday
Presentation transcript:

Problems encountered at P4: 1st episode Tuesday 15th :Stable Cryogenics conditions ~ 17:00: start of having erratic losses of communication between QUI-QURCx, RM,QSRB, QURA ~ 21:00: call NetOp that sends a piquet Firstline to check the switch S2475-R-IP14 ~ 23:30: Difficulties to localized the problematic switch because not possible to make a diagnostic remotely -> Decision to postpone it for next day “Cryo Maintain was OK “ Wednesday 16th : communication became worse ~04:00: com. totally lost -> cryo op block interlocks.. ~06:00: call NetOp for intervention ~10:30: ready on site With help of expert switch is localized Even with the switch changed, problem still present? -> further investigations ~ 12:00: every that looks fine, we decide to stop the intervention First diagnostic from NetOP: the problem could have been related to a number of VME access processes that wrongly started with an automatic script(killed this morning ~11:00) A. Suraci CCC - 8:30 Meeting January 17th 2013

Problems encountered at P4: 2nd episode Wednesday 16th:In order to avoid Full stop of our Cryo plant -> Many devices have been taken in manual mode, interlocks blocked,… “Cryo Maintain conditions recovered” ~ 13:00: start releasing devices in Auto mode -> during , we lost our QURCA (machine that allows to cooldown/maintain S34 @ 1.9K) ~ 13:15: fast recovery started Not an easy one because of Reconnection at low pressure Hydraulic instabilities at the inlet of CC1 Thursday 17th: ~ 06:00: Finally back on track A. Suraci CCC - 8:30 Meeting January 17th 2013