Until Sat 3:30: Stable beams.  Stopped by collimator temperature interlock. Sat 7:00 – Sun 8:30: Cryo stop IR4 and recovery.  PLC problem due to SEU.

Slides:



Advertisements
Similar presentations
Sat 17/9 – Sun 18/9 07:00 Cryo problem in point 4 From E. Blanco: First beam dump caused by a cryo PLC not reachable anymore (UX45_QUI) and then 14 minutes.
Advertisements

8:16 SB 25ns dumped by RF; integrated lumi 0.6 nb-1. 9:14 BIC problem in TI8 and CMS recovering their tracker 10:09 Abort gap cleaning commissioning. 16:29.
Beam commissioning strategy Global machine checkout Essential 450 GeV commissioning System/beam commissioning Machine protection commissioning.
LHC progress Saturday 2 nd May 2015 Coordination: Mike Lamont, Wolfgang Hofle.
Sat/Sun 26/27 th March Sat 18h20: Stable beams. Fill #1653. Sun 10h02: Stable beams continued. vdM scans. Length calibrations. 16h59: Beam dump. Delivered.
21/05/2012LHC 8:30 meeting Overview Week 20 Injectors, LHCb polarity, Beam-Beam Coordinators: Bernhard Holzer, Jan Uythoven.
Weekly summary Summary Week /19.07 M. Lamont & J. Wenninger for the OP team and for all colleagues from the various groups 8:30 meeting 1.
● 08:30 Loaded by mistake squeeze function to 2 m  Dumped beams ● 10:30-13:00 Test of new algorithm for long. Emittance blow-up to minimize oscillations.
Summary of Week 30 G. Arduini, J. Wenninger Main aims: “Adiabatically” increase peak luminosity by emittance reduction Luminosity production.
Nominal intensity bunches ● First ramp with nominal intensity bunches suffered from an instability appearing around 1.8 TeV. ● Nominal intensity bunches.
Tuesday 17 th April 04:00 Prepare second fill for v/d Meer scans. 06:22 Stable beams, v/d Meer scans for Alice and LHCb. 13:20 End v/d Meer scans.Dump.
LHC 8:30 meetingEBH 11 Thursday 24 November 2011.
Monday h34: beam (1020b) lost after 10 Hz RF trim. Fill h56: XPOC to be reset by expert. 08h18: Masked QPS_STATE SIS interlocks for RB.A12.
09:25 Operator dump fill #2178, integrated lumi 107/108/18 nb-1. Trip of RQ4.R6 (fire heaters discharged) just after the beam dump but the QPS gave no.
Monday 12 th November 04:50 Beam dump, trip of RF line 4B, integrated L ~120 pb-1. Access for RF. 07:00 Injecting. FBCT phasing. Line steering. 09:59 Beam.
04:01 Injection kicker timing problems B2  Injection pre-pulse shifted, causing BETS to inhibit beam injection. 144 bunches on TDI.  Run without ROF.A81B2.
Injection and protection W.Bartmann, C.Bracco, B.Goddard, V.Kain, M.Meddahi, V.Mertens, A.Nord, J.Uythoven, J.Wenninger, OP, BI, CO, ABP, collimation,
06:00 – Ongoing injection problems on beam 2  07:42 – Start of injection investigations  11:11 – Injection problem fixed. Resteering of transfer line.
Saturday 11.9 ● From Friday – Minimum required crossing angle is 100  rad in 2010 – Plenty of aperture at triplets: > 13  (n1 > 10) – Can stay with 170.
Injection status W. Bartmann, C. Bracco, B. Goddard, V. Kain, A. Macpherson, M. Meddahi, S. Redaelli, J. Uythoven, J. Wenninger LIBD Meeting, 20 th Sept.
Thursday 20 th April 01:53 RCBV17.R7B2 tripped as happened few days ago: SIS intercepted. 05:54 Stable beams, 1380b, still RF problems B1, abort gap cleaning.
04h36: Cryo problem in arc 81. Access. 09h14: Injection.  TI8 injection collimator setup.  Testing new sequence.  New version of vacuum application.
:00 meetingEBH 1  6:39 beam dump by BLM 655ms RS on BLMEI.05L4.B2E10_MBRB (which is downstream of BSRT B2).  The losses increased during.
07:00 Dump fil #2219, 123 pb -1 delivered. Trim TDI parking position to +/- 55 mm in the collimator BP trimmed the temperature kicker limit to 62 degrees.
Tuesday 3 rd October STABLE BEAMS until 12:25 when we switched to ADJUST for a EOF test for Tobias  dump B2 first and then B1.  Dump at EOF test because.
Ralph Assmann, Giulia Papotti, Frank Zimmermann 25 August 2011
MD Planning Fri – Sat (26. – 27.8.)
Wednesday 8.9 External crossing angles:
Cryo Problem MD Planning Tue (1.11.) C B Day Time MD MP Tue 01:00
Machine Coordinators: G. Arduini, J. Wenninger
Saturday 24 March 2012.
Friday 15th June 01:11 Injection.
Wednesday September 14th
Saturday 21st April 00:33 Interlock during ramp on BLM HV
Summary Friday h38: Ramp down and pre-cycle.
Monday h00: Ramp 10 A/s (chromaticity, crossing angle non-closure, beta-beating): At 7m and 3.5m, put in one by one crossing angles, calculated.
Last 24 hours RQ5.L1 RQ4.L1 RF trip Line4B LHC status.
02/08/ :35: Lost access chain in point 2 (PX24 PAD)  Dump after ~14.5 hours ~100 nb-1.
Tue :25 Beams dumped due to RF vacuum interlock
Thursday morning – optics correction
Wednesday Morning 8: :30 end of fill study - octupole polarity inversion (Elias, Tatiana, Alexey, Georges, …): Goal: study the effect of the.
Thursday 17th May 01:11 Fill #2633 dump in squeeze arc circulator load channel Ad1B 03:16 Fill #2644 Stable beams, lumi 5.2e33 cm-2s-1 04:38 Dumped by.
Summary of Week 16 G. Arduini, J. Wenninger
Mon 22/8 – Tue 23/8 00:07 stable beams #2040. Initial luminosities: 2.1x1033 cm-2s-1 18:00 Programmed dump. End of physics #2040. ~83 pb-1 in ~18 hours.
Wed :40 Lost S78 - QPS controller.
Saturday 2/4/ :00-09:00 Problems with SPS:
Monday February 28th 8h00: Injection
Thu 15/9 – Fri 16/9 09:30 Controls network problem fixed The network problems have been fixed since 9:30am when the network switch for the Service IP57.
Friday AM Some oscillations of the cryo conditions in MSR8 perturbed the setup for injection. RF frequency interlock fixed – required a reset of RF controls.
Yesterday morning Held 1647 for a while – SPS kicker problem
Sunday
Programme for Saturday 10 July
Summary Thursday h21: Stable beams fill #1303.
Summary of week 19 Machine Coordinators: G. Arduini, M. Lamont Main aim: Luminosity production.
Monday 24 October hours of 25ns MD
MD#2 News & Plan Tue – Wed (19. – 20.6.)
Thursday 26th July 13:21 Fill 2880 beam dumped
Thu 04:00 Fill #2729 Stable Beams. Initial lumi 6.5e33 cm-2 s-1.
Summary Tuesday h23: Machine closed. Precycle started.
Tuesday 20 September 2011.
Wednesday 23/2 Thanks CRYO!!!.
Fri :52 Stable beams fill #2536
Coordination: Eva Barbara Holzer, Mike Lamont
Wednesday h18: 228b fill lost just before start of ramp.
Monday 26th September 7:30 Beam dump, QSP on RQX.R1, lost cryo in ITR1, 91 pb-1. Cryo recovery, needed about 1.5 h. Setting of TI2 collimators to 5 sigma.
Thursday - setup 10:00 Starting pre-cycle. 11:30 Injection.
Tuesday – Morning and Evening
Another Immortal Fill….
Wednesday 26 October 2011.
Tuesday
Presentation transcript:

Until Sat 3:30: Stable beams.  Stopped by collimator temperature interlock. Sat 7:00 – Sun 8:30: Cryo stop IR4 and recovery.  PLC problem due to SEU. Had this before in IR4, but now a different PLC. Need redundancy (being prepared). Sun 10:00 – Sun 22:00: Repeated trip of ion pump and close-by RF module.  Change of power supply did not fix problem.  Found broken HV link between two ion pumps. Fixed. Mon 01:44: Stable beams  Ongoing Sat/Sun 17/18 Sep , RA LHC morning report

Highest stored energy:107 MJ Highest average bunch int:1.39 ×10 11 Highest peak luminosity:3.3 ×10 33 cm -2 s -1 Most productive fill:117 pb -1 in 16.5 h Highest pile up for the experiments... Above average efficiency:31% in stable beams Week production:433 pb -1 But could have been better: many problems, almost all weekend lost...  Cryo PLC problem in IR4  Vacuum pump in IR4  Injection issues ... Report Week 37 (R. Assmann & G. Arduini) , RA LHC morning report

Statistics Fill (nb)L (10 33 cm -2 s -1 ) Length (h) Int. L (pb-1) Dump cause CL temperature sensor (RB.A56) SEU candidate Doors pt CL temperature sensor (RQ6.R5) SEU candidate Programmed dump nQPS (DQAMGS.RB.A78.B9L8) Temperature interlock on collimator TCP.B6.B >5.5>50 ongoing Total Integrated luminosity >433 pb -1 in  1 week Stable beams: >51.6 h out of 168 h ~31% of time in stable beams Red = potentially intensity/luminosity related , RA LHC morning report

Intensity and luminosity: Best LHC fill , RA LHC morning report Instantaneous luminosity B1/B2 intensities Beam energy

Losses & Lifetime at Start of Physics , RA LHC morning report

Week 37 seen from CMS , RA LHC morning report The best LHC fill 3.3 × cm -2 s -1 Tevatron LHC 2010 CMS missed initial lumi...

Seen from ATLAS , RA LHC morning report

Peak luminosity (ATLAS) , RA LHC morning report

Integrated luminosity: 3.14 pb , RA LHC morning report

2011 Efficiency , RA LHC morning report Week 37 with 31% of time in stable beams was above average (but felt much worse)

Installation of anti e-cloud solenoid right of Pt 2 (V. Baglin). ADT gain changed for high bunch intensity (D. Valuch). Beta* limits put on the tertiary collimators (S. Redaelli). Collimator temperature interlock raised from 50 deg C to 55 deg C on skew primary collimators in IR7. Cooling capacity increased to maximum for primary collimators and first two secondary collimators in IR7 (O. Aberle). Cryo deployed R5 improved handling of cryo T sensor. Access given for CMS pump problem: faulty cable on a temperature measurement. Resolved. Changes/improvements , RA LHC morning report

Anti e-cloud solenoids for IR2 (R) Installation of anti-ecloud solenoid right of Pt 2  500 m of cables installed and solenoid powered (V. Baglin and team)

Beta* limits Beta* limits on new TCT functions (before physics) implemented S. Redaelli

Problems (week ended Friday night) Beam-related issues  Vacuum in point 8  Background in ALICE  Heating of collimator Problems encountered with time lost:  Cryo PLC problem  25 h  Vacuum pump in IR4  >12 h (until Sun 22:00)  Injection tuning  10.5 h  Controls network  8.5 h  Collimator controls  5 h  Access system  4 h  BPM interlock limits  1.5 h  Total:66.5 h , RA LHC morning report

Vacuum & Temperature IR , RA LHC morning report

IR8 Losses , RA LHC morning report

IR8 MKI Vacuum Spikes Vacuum pressure spike on MKI in point 8 during the squeeze (e-cloud solenoids are on). Local orbit drift during the squeeze leading to e-cloud build-up in the magnet?

MKI Heating , RA LHC morning report

Collimator jaw temperature (TCP) , RA LHC morning report

Collimators temperature and vacuum

RF noise issue? , RA LHC morning report Ph.Baudrenghien:  "We could not investigate the RF with circulating beam (phase noise analyzer needed 30 min to warm-up and it was urgent to dump...). Without beam the RF noise was checked at 3.5 TeV conditions and then at 450 GeV. It was normal.  The loss of B1 around 14:00 in the last fill shows the clear signature of debunching: we had ~ 5E11 drop in FastBCT, with an increase to 2E10 in abort gap population (5E11 uniformly spread around the ring gives ~ 2E10 in the 3 microsec long abort gap), followed by the same drop in DC-BCT and cleaning of the abort gap ~ 15 min later (= time for debunched beam to reach the inner momentum collimator jaw). See picture attached. If it comes back during the night with a large amplitude (check same signals on timber, abort gap population should not exceed 5E10), call both LLRF piquet and me. We keep investigating with next fill in any case.

RF noise issue? , RA LHC morning report

RF noise issue? , RA LHC morning report

Problems (week ended Friday night) Beam-related issues  Vacuum in point 8  Background in ALICE  Heating of collimator Problems encountered with time lost:  Cryo PLC problem  25 h  Vacuum pump in IR4  >12 h (until Sun 22:00)  Injection tuning  10.5 h  Controls network  8.5 h  Collimator controls  5 h  Access system  4 h  BPM interlock limits  1.5 h  Total:66.5 h , RA LHC morning report

Cryo stop in IR4 Sat 07:00 Cryo problem in point 4 From E. Blanco: First beam dump caused by a cryo PLC not reachable anymore (UX45_QUI) and then 14 minutes later a WFip segment with problems:  We intervened in the tunnel (UX45) and replaced the PLC and let the cryo operators recover as soon as possible. The diagnose is to confirm by Schneider once they analyze the dump, but it seems that a SEU can be likely the cause.  Second the WFip problem was caused by an electrical problem (circuit- breaker down). As it was in UX45 I’ve rearmed the breaker and everything went fine. By contrary ½ later it seems that breaker has gone down again. To diagnose by TE/CRG. Recovery of sector 34 – 45 started at ~11:00

Ion pump in IR4 switches off, interlocking RF module M2B2  10:00 switch off w/o beam  10:52 switch off with beam  power supply exchanged  17:30 switch off with beam  Ion pump is diagnosed OK. Vacuum controls looking for cable/connector/rack issues  access Intervention sur un boitier local de pompe ionique:  22:00 fixed… la liason HT entre les deux pompes ioniques VPIA.7.5L4.R et 44.5L4.R etait cassee. Apres avoir refait la soudure de la HT de la pompe ionique VPIA.7.5L4.R une legere remontee de pression lors de son redemarrage est apparue sur la VGP.1.5L4.R. Vannes re-ouvertes. Vacuum pump problem , RA LHC morning report

Controls network problem The network problems have been fixed since 9:30am when the network switch for the Service IP57 feeding various important servers such as CS-CCR-LSA1, CS-CCR-CMW1 and CS-CCR-JAS5 was powered off then on. Enzo Genuardi was first called around 2:30am and came in at around 3:30am. He shutdown any machines on Service IP57 that he suspected were sending too much traffic or bad traffic. However this did not fix the problem. All that is known for the moment is that many machines on Service IP57 worked perfectly (e.g. DIAM1, JAS5) however many others could only send a few kilobytes before a TCP connection blocked (e.g. LSA1, DIAM2, Q4DS7). We have not seen a switch working partially before so it took some time to make the decision with Edoardo Martelli of IT/CS to power off / on the switch. Alastair Bland, BE/CO.

TCTVA.4R1.B2 Issue: PXI Crate Stuck... Normal that LSA settings U & D are identical if no tilt requested The LVDT readings were correct. Discrepancy occurred while collimator was moving to injection. Collimator movement should stop Jaw moved from parking to the injection position according to LVDT and resolver  no active interlock.  Published information on the motor step was corrupted: likely occurred occurred during physics (SEU?). Improvements on the sequence to detect such events before injecting being considered , RA LHC morning report

TDI controls problem OK after repeating the sequence twice!! Due to noise in the measurement of jaw positions leading to gap opening outside limits. TDI.4L2 gap interlocks were changed by 100 um to avoid an interlock due to a drift of the position reading. S. Redaelli

YCPS03=US450,YCPS04=US45 0 not well closed after access on 11/9 + technology of XX(?) - century Access Door Opening…

Tue 13/9 – Wed 14/ , RA LHC morning report

nQPS trip M. Zerlauth Fri 02:15 trip of Sector 78 – due to sudden jump of U_MAG signal on nQPS DQAMGS.RB.A78.B9L8 (SEU?). End of physics # pb -1 in 6.5 h. Fri 04:02 second trip of Sector 78 during pre-cycle  power-cycle DQAMGS.RB.A78.B9L , RA LHC morning report

Sorting out injection problems with 144b  injection for B2 appeared fine for 12 b but had already offset of 600 um at the MSI; loss shower from TL dumped while injecting 144b  checked if recently seen bunch dependent injection oscillations causes the dump --> pattern visible but not strong  steered trajectory focusing around horizontal collimators  situation improved, but seems to be for two reasons:  ion cycle in the SPS was put in again which resumed the same cycle conditions as for yesterday's trajectory steering --> dependency of trajectory on cycles which are before the LHC cycle to be checked  careful steering around collimators in the horizontal plane brought further loss reduction  injected 3 x 144 b with losses OK  B1 steering more tricky because one BPM reading needed to be flipped in sign --> to be checked with kick response  B1 losses improved finally by ~50% and checked with 2 x 144b being OK  sticking to one dedicated filling super cycle with always the same cycle composition could avoid these problems  for both transfer lines we see big shot to shot variations of the trajectory, B1 more sensitive --> MSE stability to be followed up SUMMARY OF INJECTION STUDIES - Chiara, Wolfgang, … , RA LHC morning report

Checking trajectory drift in TI2  Checks only for B1. TI 2 trajectory corrected. Settings copied to pilot cycle. Masks: maskable ring BLMs, BPM.P6, TI 2 BLMs, opened TCDI thresholds.  Check TCDI center for 3 collimators in I&D mode with pilot, moving full gap. Removed masks. Check TCDI center for 2 collimators with 12 b, moving only one jaw at a time.  RESULTS: Values in [um] show measured beam centre wrt to the actual coll. centre: beam ctr shift beam ctr shift pilot 12b TCDIH (-0.3 sig) --- TCDIH (0.03 sig) + 20 (0.03 sig) TCDIV (-0.3 sig) -200 (-0.15 sig)  measured beam centre for 12 b is consistent with BPM readings from trajectory  maximum shift of 0.3 sigma measured  trajectory correction before the measurement did not deteriorate injection oscillations  the shot to shot trajectory variation in TI 2 horizontal is in average ~330 um (max 1mm), so centre shifts of todayare of the same order as shot to shot variations  a full re-setup of the TL with new trajectory and collimator centering will probably not improve the situation significantly on the long term  TCDI setup with pilot cycle is appropriate, critical TCDIs potentially tbc with 12b  since no significant trajectory drift at the critical TCDIs has been measured, opening the TCDIs from 4.5 to 5 sig remains valid (last validation done beginning of March) SUMMARY OF INJECTION STUDIES - Chiara, Wolfgang, … , RA LHC morning report

Centering Transfer Line Collimator , RA LHC morning report

Go for physics To be considered:  Proper setup of transverse damper for high bunch intensity.  Open TCDI gaps from ± 4.5  to ± 5.0 . Plans , RA LHC morning report