Machine coordinators: R. Assmann & J. Uythoven MD coordination: R. Assmann, G. Papotti, F. Zimmermann Highlights:  v/d Meer scans:ALICE, ATLAS, CMS, LHCb.

Slides:



Advertisements
Similar presentations
8:16 SB 25ns dumped by RF; integrated lumi 0.6 nb-1. 9:14 BIC problem in TI8 and CMS recovering their tracker 10:09 Abort gap cleaning commissioning. 16:29.
Advertisements

Beam commissioning strategy Global machine checkout Essential 450 GeV commissioning System/beam commissioning Machine protection commissioning.
LHC progress Saturday 2 nd May 2015 Coordination: Mike Lamont, Wolfgang Hofle.
LHC progress Thursday 30 th April 2015 Coordination: Mike Lamont, Wolfgang Hofle.
Sat/Sun 26/27 th March Sat 18h20: Stable beams. Fill #1653. Sun 10h02: Stable beams continued. vdM scans. Length calibrations. 16h59: Beam dump. Delivered.
21/05/2012LHC 8:30 meeting Overview Week 20 Injectors, LHCb polarity, Beam-Beam Coordinators: Bernhard Holzer, Jan Uythoven.
LHC Wed 16 Sept 2015 Struggling with cryo o-night Tuesday - Wednesday 07:11 Injecting again 09:00 Dump on injection of train of 144 bunches, losses IP7.
● 08:30 Loaded by mistake squeeze function to 2 m  Dumped beams ● 10:30-13:00 Test of new algorithm for long. Emittance blow-up to minimize oscillations.
Nominal intensity bunches ● First ramp with nominal intensity bunches suffered from an instability appearing around 1.8 TeV. ● Nominal intensity bunches.
Tuesday 17 th April 04:00 Prepare second fill for v/d Meer scans. 06:22 Stable beams, v/d Meer scans for Alice and LHCb. 13:20 End v/d Meer scans.Dump.
1 CC & MP - CC10 - CERN Crab LHC J. Wenninger CERN Beams Department for the LHC Machine Protection Panel.
LHC Progress Thursday 29 th October 2015 Coordination Week 44: Massimo Giovannozzi, Wolfgang Hofle, Jorg Wenninger.
Shortened program (2 days), as decided in LMC. MD program worked very well  all MD’s on plan with ~foreseen beam time. LHC in very good shape with excellent.
04:01 Injection kicker timing problems B2  Injection pre-pulse shifted, causing BETS to inhibit beam injection. 144 bunches on TDI.  Run without ROF.A81B2.
Tuesday 24 th July - morning 10:15 Operator dump of fill 2873  Initial luminosity: 5.83e33 cm-2s-1  12 hours stable beams  151 pb-1 delivered  Initial.
06:00 – Ongoing injection problems on beam 2  07:42 – Start of injection investigations  11:11 – Injection problem fixed. Resteering of transfer line.
– Machine closed. Ramp for powering tests & pre-cycle – Pilots through nominal cycle up to collisions. Measure chroma during squeeze. Check dump of pilots.
Cryo back at 17:30 Beam back at 19:00 IR2 aperture until ~03:00 Since then no beam from the SPS:  Connector problem on MKD  Connector eroded, needs to.
Injection status W. Bartmann, C. Bracco, B. Goddard, V. Kain, A. Macpherson, M. Meddahi, S. Redaelli, J. Uythoven, J. Wenninger LIBD Meeting, 20 th Sept.
Progress with Beam Report to LMC, Machine Coordination W10: Mike Lamont – Ralph Assmann Thanks to other machine coordinators, EIC’s, operators,
Thursday 20 th April 01:53 RCBV17.R7B2 tripped as happened few days ago: SIS intercepted. 05:54 Stable beams, 1380b, still RF problems B1, abort gap cleaning.
Summary of the technical stop activities on collimators (w17, 2012) O. Aberle – 07/05/12.
04h36: Cryo problem in arc 81. Access. 09h14: Injection.  TI8 injection collimator setup.  Testing new sequence.  New version of vacuum application.
Monday 19 th March 07:33 Lost (another) beam in the squeeze, beyond 2 m, B2 hits 1/3 resonance. 08:30 Start (another) ramp  Try to correct coupling and.
LHC Status Sat Morning 30-June Bernhard Holzer, Jan Uythoven Status Friday Late: preparing restart some issues... LHCb dipole tripped / router problem.
:30 meetingEBH 1  No beam during the morning:  4:15 – 9: V distributor: Recovery after electrical interruption  access for TI services.
Ralph Assmann, Giulia Papotti, Frank Zimmermann 25 August 2011
Cryo Problem MD Planning Tue (1.11.) C B Day Time MD MP Tue 01:00
Machine Coordinators: G. Arduini, J. Wenninger
Friday 15th June 01:11 Injection.
Wednesday September 14th
Saturday 21st April 00:33 Interlock during ramp on BLM HV
Saturday 30th June - Sunday: Rocky !
Saturday 09:40 Stable beams #1369 (56 bunch scheme)
Week 46 Week 46: Machine coordinators: Roger Bailey – Gianluigi Arduini Main aims of the week: Stable beams with ions Scheduled stop for ion source refill.
Fill 1410 revisited Peak luminosity 1.4e32 Beam current 2.68/2.65 e13
Tue :25 Beams dumped due to RF vacuum interlock
Thursday morning – optics correction
Monday – recovery from MKI flashover
Wednesday Morning 8: :30 end of fill study - octupole polarity inversion (Elias, Tatiana, Alexey, Georges, …): Goal: study the effect of the.
Thursday 17th May 01:11 Fill #2633 dump in squeeze arc circulator load channel Ad1B 03:16 Fill #2644 Stable beams, lumi 5.2e33 cm-2s-1 04:38 Dumped by.
Summary of Week 16 G. Arduini, J. Wenninger
Note: squeeze in Atlas, CMS, LHCb and Alice on going
Mon 22/8 – Tue 23/8 00:07 stable beams #2040. Initial luminosities: 2.1x1033 cm-2s-1 18:00 Programmed dump. End of physics #2040. ~83 pb-1 in ~18 hours.
Wed :40 Lost S78 - QPS controller.
Saturday 2/4/ :00-09:00 Problems with SPS:
Week 35 – Technical Stop and Restart
Monday February 28th 8h00: Injection
Friday morning 10:30 Optics measurements and corrections.
Yesterday’s morning’s controls issues
Friday AM Some oscillations of the cryo conditions in MSR8 perturbed the setup for injection. RF frequency interlock fixed – required a reset of RF controls.
Yesterday morning Held 1647 for a while – SPS kicker problem
Sunday
Saturday 7th May Sat – Sun night
Summary Thursday h21: Stable beams fill #1303.
Sunday/Monday & :30 Stable beams. Fill #1851.
Summary of week 19 Machine Coordinators: G. Arduini, M. Lamont Main aim: Luminosity production.
MD#2 News & Plan Tue – Wed (19. – 20.6.)
LHC Morning Meeting - G. Arduini
Monday 8th December Morning used for RF work (IP z, injection), damper noise checks. Stable beams period with LHCb spectrometer OFF – lost beam after.
Thu 04:00 Fill #2729 Stable Beams. Initial lumi 6.5e33 cm-2 s-1.
Summary Tuesday h23: Machine closed. Precycle started.
Thursday 22nd March 00:20 – 02:40 on longer squeeze function, orbit and chroma correction at 4 TeV 2:40 – 5:30 second cycle with long squeeze 5:46 – 7:00.
Wednesday 23/2 Thanks CRYO!!!.
Fri :52 Stable beams fill #2536
Tuesday – Morning and Evening
Another Immortal Fill….
Tuesday 24/5 Fill # :00 Stable beam fill # bunches
Monday 10th December - morning
Tuesday
Presentation transcript:

Machine coordinators: R. Assmann & J. Uythoven MD coordination: R. Assmann, G. Papotti, F. Zimmermann Highlights:  v/d Meer scans:ALICE, ATLAS, CMS, LHCb  Improvements LHC orbit (Joerg)  Commissioning abort gap cleaning at 4 TeV  Injection 144b  Completion intensity ramp:1380b  Increase bunch intensity:1.4e11 p/bunch  New highest LHC luminosity: × 33 cm -2 s -1 (average ATLAS, CMS)  New highest stored energy:120 MJ  First LHC MD in 2012 Summary Week 16 & MD Report LHC morning report

Intensity Ramp (& Vac L2): 1380 bunches LHC morning report v/d Meer scans

Fill #2536 LHC morning report Average lumi 5.6e33 cm-2s-1

Luminosity Fill Friday (Last Before MD) LHC morning report

Peak Luminosity LHC morning report

Integrated Lumi: almost reaching 1 fb LHC morning report

ATLAS 2012 Records LHC morning report ?

v/d Meer Scans: to be analysed LHC morning report ATLAS scans

Orbit change in IR7 during collision BP LHC morning report  m Before feed-forward B1 B2 J. Wenninger

Orbit change in IR7 during collision BP LHC morning report  m After feed-forward J. Wenninger

Orbit spikes during squeeze (3  2 m) LHC morning report Amplitude of beam excursion spikes at B2 TCP (V plane) have been reduced by ~30-40%. Tricky to correct – may try to flatten all corrections between 3m and 1.5m and restart on new basis (after TS1). J. Wenninger

Abort gap population up to 9e10 p+ for B1 LHC morning report During ‘normal’ physics, see RF problem later

Cleaning the Abort Gap LHC morning report

Atlas and CMS lumi’s Effect of cleaning on luminosity – as in 2011 Strategy: only clean when required but then clean strong LHC morning report Cleaning off

Abort Gap Cleaning Allowed to keep the fill in during RF problems. Gained in efficiency! Prevented from potentially dangerous situation of having to dump the beam with a “full” abort gap LHC morning report With RF problem on B1 Switched on cleaning for 1 min DUMP No RF problem

Injection kicker pre-pulse problem b2. Disabled ROF.A81B2 until TS.  The current of other octupoles increased to compensate. Overload problem on COLSA. Debunching problem for b1. Instability when separating beams for length scale calibration. World FIP problem Injection steering (MSI) ADT amplifier – 1 oo 4 off B1 vertical TDI problem HV interlock from BLM system Issues Encountered LHC morning report

Injection kicker pre-pulse problem B2 Injection pre-pulse shifted, causing injection BETS to inhibit beam injection 144 bunches on the TDI  As beam to the core of TDI, not grazing, no magnet quenches During tests the inhibition re-appeared once Lengthened kicker resonant charging by 100 µs to prevent problem occurring  Continue investigations to understand cause of shift LHC morning report

COLSA Problem (Report A. Bland) Occurred on The CPU load and memory use on CS-CCR-COLSA (Concentrator for BPMs and BLMs providing data to the YASP steering program) rose a lot from 11:30. Marek Misiowiec restarted the Injection Oscillation programs on this machine at 11:37. A few minutes later the CPU load (perhaps due to lack of memory) rose for BUNCHORBIT processes. From 11:45 to 11:48, nineteen of the Beam1 BPM Front End Fesa servers crashed and restarted after 20 seconds. At 11:48 Verena dumped the beam as she could not see Beam1 any more LHC morning report

COLSA Problem II (Report A. Bland) A similar scenario occurred from 13:45 to 13:48 when ten of the Beam2 BPM Front End FESA servers crashed. Verena dumped the beam at 13:47. Note that there was an unrelated event at 13:52 when the General Purpose Network Router of IT/CS for the CCC and Prevessin site crashed. Later in the afternoon there were more problems with missing BPM data and unusual BPM response times in YASP so I rebooted CS- CCR-COLSA at 17:54 to clean up the memory. The machine was swapping again, but less, during the injection around 18: LHC morning report

COLSA Problem III (Report A. Bland) Upgrade to a more powerful machine. Marek says that the amount of memory used by the CS-CCR- COLSA processes is proportional to the number of bunches requested. The reason that the BPM Fesa servers on the Front Ends crash when there is a slow client like CS-CCR-COLSA needs to be investigated LHC morning report 2 fills dumped

Sat: In YASP we again see (only at injection) momentarily missing BPM readings (crate by crate).  Checked the BPMs in daimon and all appeared OK.  However, we checked cs-ccr-colsa for CPU load and memory use, and observe that after the intervention on Thursday at 11:00, the memory use has again grown to ~95%, which does not seem normal. COLSA Issue Coming Back? LHC morning report

B1 Issue (Debunching  RF?) LHC morning report

Luminosity Dropping Quickly LHC morning report

RF With the measurements at SR4, we were able to correlate the debunching issues to abnormal noise levels in the RF reference signal of beam 1. The RF reference is distributed from the surface at point 4 to the beam phase loop, all RF cavities, ADT, etc. The measurements without beam after the dump, helped us isolate the issue to the cables and modules distributing the reference signal to module 1-beam 1 in UX45. Unfortunately, by the time we accessed the cavern, the issue disappeared. We preemptively replaced a few components, but not all modules to avoid introducing additional sources of error. We will continue monitoring over the next few fills. LHC morning report However: it did the job !!!

... resulting difference after fixing RF LHC morning report Beam currents Abort gap population

Length scale calibration... Apparent instability when separating the beams by 2.5sigma in Pt 1. This then caused a loss in RS_08 of BLM at the TCLA_D_L7B2. The instability was in both beams an both planes. LHC morning report Length scale calibration postponed until after TS (during intensity ramp-up)

World FIP problem Cryo FIP communication problem S34: mask during injection. Pierre Charrue:  We are aware of the WFip repeater in RE38 problem and we are ready to exchange it if ever this decision is taken by Cryo this morning.  I will be in the CCC to organize this with the Cryo people if this will take place.  For the record, please note that this is the 6th repeater breaking since the last 3 years. LHC morning report

Injection steering problem B1 (W.Bartmann) LHC morning report = what is needed to steer the line at the MSI PC to be checked

Currently one amplifier for beam 1, vertical (ADT) down.  There is one bad tetrode in there and the amplifier has been put in an idle state by blocking both tubes with the Ug1 voltage. The result is that we have with a loss of this amplifier 25% less gain and kick strength for vertical beam 1. For me this is acceptable. The intervention has been done by Gino Cipolla on the surface in SR4 (to take out the amplifier). Ahead of the MD and the technical stop:  we from the LLRF (Daniel and myself) would like to go through all amplifiers of ADT with a test signal when there is no beam to check if there are other weak tubes that need attention before the MD or during the technical stop.  The matter is not so urgent, but still can you contact us at the earliest tomorrow a.m. for such a check when there are slots of 1 hour without beam ? ADT Issue (Wolfgang H.) LHC morning report

TDI Interlock Issue LHC morning report

Problem:  drift of the LVDTs of TDI in point 8 outside position thresholds Suspect deformation of the jaw induced by heating during injection:  the two LVDTs located at the 2 sides of each motor measure a symmetric offset corresponding to a tilt of the rod connecting the motor to the jaw. LVDT reading jumping by up to 400 um when moving to parking and back to injection again  understood: motors stop driving the collimator to injection position when there is an error on the inner limit TDI Problem LHC morning report

TDI LVDT Variations LHC morning report Movement of about 150 µm

TDI LVDT Variations LHC morning report  Same LVDT feature in 2011 and However, not seen in 2011, as limits were twice larger (0.5  ) than in 2012 (0.25  ).

Check position of the TDI jaws with respect to the beam (nominally at 6.8 sigma) with pilot bunch  Opened vertical TCSG in point 7 in order not to intercept the beam  Used the transverse damper to blow up the beam until seeing losses at the vertical TCP in point 7 (losses at the TCP before than at the TDI ==> hierarchy still respected)  Moved the TCP away from the beam with 0.1 sigma steps (continuous beam blowup with damper)  Monitored losses at the TCP and TDI  Position of the TDI in sigma corresponds to the TCP position (in sigma) when losses at the 2 collimators are at the same level (then TDI losses higher than at the TCP) We found:  B2 both jaws at 6.4 sigma instead of 6.8 sigma  B1 left (upper jaw) at 6.2 sigma and right (lower) jaw at 6.8 sigma Small difference can possibly be explained by using a different method than used for the original set-up TDI – check position LHC morning report

Check angle of the TDI:  We repeated the same measurements we did on March 26th (see logbook of that date) to verify if any change in the angle occurred as a consequence of the warm-up  We found the same values within the measurement error (see plots in attachment)  By time of measurements jaws most likely cooled down again Conclusion on position and angle:  We believe that there is a deformation of the jaws towards (safer side) the beam as a consequence of warm-up during injection (max. 0.6 sigma), we do not measure any significant variation in the angle and centre. TDI – check angle LHC morning report

TDI Angular Alignment LHC morning report

If the problem reoccurs:  cycle the TDI to parking  if doesn't move anymore (hit inner limits) load the parking thresholds for TDI and cycle again  repeat several times and wait for possible cool down. Problem not solved for the longer term  Especially have to understand situation when TDI is heated up and LVDT’s are drifting  Protection functionality guaranteed or not? TDI – OK? LHC morning report

Fri 00h33 Interlock during ramp  IR7 HV interlock from BLM system (HV overload due to beam losses)  No BLM at dump threshold  Christos looked and found that the HV drop lasted for more than 1 minute and is certainly due to high losses in IR7.  Losses starting at 00:28 and continuously increasing until the dump. Not very high losses but lasting long enough. Fri 01h46 Injection. Reduced intensity. Fri 02h46 Interlock during ramp  IR7 HV interlock from BLM system (HV overload due to beam losses)  No BLM at dump threshold  Same as above HV Interlock from BLM System LHC morning report

IR7 Modest Losses  HV Interlock LHC morning report

Ahead Technical stop… LHC morning report