Download presentation
Presentation is loading. Please wait.
Published byBennett Weaver Modified over 9 years ago
1
MDI meeting, March 19, 2004 Categorizing radiation aborts Livio Piemontese When something really bad happens to the beams, they are aborted. An optimized beam abort procedure is in place, which is activated by various possible detectors. The source (sources) of beam aborts are recorded by the abort procedure. Beam aborts are recorded in MCC operations. Operators have tools to determine the source of the abort request, and other tools to perform a post-mortem. The main conditions which cause a beam abort are: --- SvtRad aborts --- dI/dt of a beam --- Klystron trip, or other RF problem --- Power Supply trip
2
MDI meeting, March 19, 2004 MCC operators write in their logbook the cause of the aborts. The abort category gets then mentioned in the 24-hour report presented at the 8:00 meeting, and can be looked at online. https://www-internal.slac.stanford.edu/ad/ One of their tools is the ERRLOG file, where all error messages from the machine are recorded. ----------------------------------------------------------------------------------------------------------------------- /WARNING, /NOLOG, /FORMATTED, /OUTPUT=ESEMPIO, /BEFORE=15-MAR-2004 09:33:00, /SINCE=15-MAR-2004 09:20:00, /SOURCE=ALL, /DESTINATION=ALL, /FACILITY=ALL, /SEVERITY=ALL, /ERRCODE=ALL, /FORMAT=ALL, /MATCH=AND, /STRING=(LATCH), /BINSIZE=FULL, /SLICES=SUMS, /PRIMARY=NONE, /MICRO=NONE, /UNIT=NONE, /SECONDARY=NONE, /ITEM=ALL, /OPER=NONE ----------------------------------------------------------------------------------------------------------------------- 15-MAR-2004 09:27:06 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR10, 15,LERdI/dt&Sng,LATCHED,LATCHED,ERROR,, 15-MAR-2004 09:27:06 %SIP-W-ACTION, V040 SIPMAIN - ACTION: LER_BATS Started! BATS PR10 15 LATCHED 15-MAR-2004 09:27:17 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR08, 5,KICKER#2,LATCHED,LATCHED,ERROR,,$MPS 15-MAR-2004 09:27:17 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR08, 6,KICK2 Failng,LATCHED,LATCHED,ERROR,,$MPS 15-MAR-2004 09:27:36 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR02, 3,HER BaBarRad,LATCHED,LATCHED,ERROR,, 15-MAR-2004 09:27:36 %SIP-W-ACTION, V040 SIPMAIN - ACTION: HER_BATS Started! BATS PR02 3 LATCHED 15-MAR-2004 09:27:47 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR10, 5,KICKER#2,LATCHED,LATCHED,ERROR,,$MPS 15-MAR-2004 09:27:47 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR10, 6,KICK2 Failng,LATCHED,LATCHED,ERROR,,$MPS 15-MAR-2004 09:28:31 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR02, 13,LER BaBarRad,LATCHED,LATCHED,ERROR,, 15-MAR-2004 09:28:31 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR04, 14,LER Kly4Trip,LATCHED,LATCHED,ERROR,, 15-MAR-2004 09:28:31 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR04, 15,LER Kly5Trip,LATCHED,LATCHED,ERROR,, 15-MAR-2004 09:28:31 %SIP-I-INFOMSG, V040 SIPMAIN - BATS,PR10, 15,LERdI/dt&Sng,LATCHED,OK,OK,, 15-MAR-2004 09:28:32 %SIP-I-INFOMSG, V040 SIPMAIN - BATI,PR08, 5,KICKER#2,LATCHED,OK,OK,
3
MDI meeting, March 19, 2004 Selecting SvtRad aborts To identify and select SvtRad aborts, we use typically the FAL (Fast Abort List), automatically generated by the SvtRad software. In such list are all types of aborts in which also SvtRad triggered. Last year it was recognized that only ~a half of the “Stable Beam” aborts present in that list were “SvtRad_only” aborts. The others were dubbed “sympathetic”. To understand the causes of SvtRad (or “radiation”) aborts, we want the list of those aborts which only SvtRad triggered. Best place to look for them is the MCC logbook (go to the MCC and read their log: long, boring, and discouraging). Or, the set of daily MCC reports at the 8:00 meeting. What I usually do, when selecting aborts – for the purpose of weekly statistics – is to start with the FAL, and check for each of them what is in the online MCC daily report. Then, I run the errlog for each abort in the FAL. That is usually sufficient for finding the SvtRad only ones. In case of doubt, I check on the MCC log.
4
MDI meeting, March 19, 2004 SVTRAD hardware aborts and injection inhibits Click on a link to see the radiation at the time of the incident 03/11-2004 12:30: Test 03/11-2004 08:59: BW:MID aborted stable beams at HER=1307.3 mA and LER=2103.1 mA 03/10-2004 08:35: FW:MID aborted stable beams at HER=1285.8 mA and LER=2209.7 mA 03/10-2004 02:33: BW:MID aborted stable beams at HER=1161.9 mA and LER=2198.7 mA 03/09-2004 23:55: BW:MID aborted injection at HER=1115.1 mA and LER=1878.0 mA 03/09-2004 10:14: BW:MID aborted stable beams at HER=1351.0 mA and LER=2185.3 mA 03/09-2004 05:42: BW:MID aborted stable beams at HER=1330.4 mA and LER=2093.0 mA 03/09-2004 05:08: FW:MID aborted injection at HER=1073.4 mA and LER=0 mA 03/09-2004 04:49: BW:MID aborted stable beams at HER=1323.9 mA and LER=2119.4 mA 03/09-2004 04:05: BW:MID aborted stable beams at HER=1277.8 mA and LER=2149.2 mA 03/09-2004 03:12: FW:MID aborted injection at HER=1320.1 mA and LER=1650.0 mA 03/09-2004 02:51: FW:MID aborted injection at HER=1344.9 mA and LER=1963.8 mA 03/09-2004 01:44: FW:MID aborted injection at HER=1101.4 mA and LER=0 mA 03/09-2004 00:15: BW:MID aborted stable beams at HER=1242.8 mA and LER=2150.1 mA The Fast Abort List
5
MDI meeting, March 19, 2004 24 Hour Operations Report Search Past 30 DaysSearch All DataAccelerator HomeSLACData Input (access restricted)Report Date:3/15/2004 - Program(s):BaBar E164 Day Shift 1 Collisions for BaBar: 2200 mA LER on 1330 mA HER, dual trickle with typical luminosities of 7.8e33/cm^2s. HER currents limited by IP thermal outgassing associated deadtime and HER bellows thermocouple PR08 T6032BLW.2 Replaced HER RF station 12-5 clock module. Module was generating station reference phase jumps responsible for a recent rash of aborts, two aborts this shift. (1.0)3 CAMAC glitch in EP01 faulted positron system MPS. (0.1)4 E164 delivery and emittance tuning.5 NDR QFI tripped on ground current. Reset. (.2) DeliveredMDTuningDownOff BaBar600.71.30163Pb(-1)E1646.900.80.300 Swing Shift 1 Collisions for BaBar: 2200mA LER on 1300-1330mA HER, dual trickle with typical luminosities of 7.6e33/(cm^2s). 2 Aborts: (1) BaBar radiation with BSOIC Trip (1) HER RF 12-6 RE and LER dI/dt (1) HER RF 12-6 klystron arc/crowbar and LER dI/dt3 Loaded new timing and calibrations for HER BPMs. (Yesterday same for LER). Turned on auto BPM calibration slow feedback for PEP BPMs.4 E164: Delivered e- and tuned emittance. Some LION 5200 and 5201 trips with plasma oven in, despite raised trip thresholds. DeliveredMDTuningDownOff BaBar6.701.300187.7Pb(- 1)E164502010 Owl Shift 1 Collisions for BaBar: peak trickle currents 1350mA HER, 2200mA LER, L=7.91e33/(cm^2s).2 Aborts:(1)LER 4-3RE (1)BaBar radiation abort (1) HER 12-5 Klystron ARC and crowbar. 3 E164: short access and beam to FFTB. DeliveredMDTuningDownOff BaBar70100179Pb(-1)E1647.80000.20 Report Totals DeliveredMDTuningDownOffHoursBaBar19.7031.3024529.7Pb(-1)E16419.702.80.31.2240 Last Update: 24 Oct 2002 01:51:12 PM by McDunn The MCC 24-hr Report
6
MDI meeting, March 19, 2004 A sympathetic abort Signals recorded by two CsI counters for a sympathetic abort: abscissa is in milliseconds. Abort takes place at time 10.000, but only one beam is aborted: the other dies 50 ms after. The abort was caused by LER RF trip, which only aborted LER. HER, left without HER, died 50ms later.
7
MDI meeting, March 19, 2004 ----------------------------------------------------------------------------------------------------------------------- /WARNING, /NOLOG, /FORMATTED, /OUTPUT=ES2, /BEFORE= 4-JUN-2003 04:40:00, /SINCE= 4-JUN-2003 04:34:00, /SOURCE=ALL, /DESTINATION=ALL, /FACILITY=ALL, /SEVERITY=ALL, /ERRCODE=ALL, /FORMAT=ALL, /MATCH=AND, /STRING=(LATCH), /BINSIZE=FULL, /SLICES=SUMS, /PRIMARY=NONE, /MICRO=NONE, /UNIT=NONE, /SECONDARY=NONE, /ITEM=ALL, /OPER=NONE ----------------------------------------------------------------------------------------------------------------------- 4-JUN-2003 04:34:59 %CAU-E-EPICS_ERROR, RFS00NTA01 TRS1:AS1:INPREFL:PLATCH changed to OK, NO_ALARM 4-JUN-2003 04:35:18 %CAU-E-EPICS_ERROR, RFS00NTA01 TRS1:AS1:INPREFL:PLATCH changed to ERROR, MAJOR 4-JUN-2003 04:35:45 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR04, 15,LER Kly5Trip,LATCHED,LATCHED,ERROR,, 4-JUN-2003 04:35:45 %SIP-W-ACTION, V040 SIPMAIN - LER_BATS SUBMITTED! 0435 PR04 LER Kly5 LATCHED LATCHED 4-JUN-2003 04:35:48 %SIP-E-ERRMSG, V040 SIPMAIN - BATS,PR02, 3,HER BaBarRad,LATCHED,LATCHED,ERROR,,$MPS 4-JUN-2003 04:35:48 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR10, 5,KICKER#2,LATCHED,LATCHED,ERROR,,$MPS 4-JUN-2003 04:35:48 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR10, 6,KICK2 Failng,LATCHED,LATCHED,ERROR,,$MPS 4-JUN-2003 04:35:48 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR08, 5,KICKER#2,LATCHED,LATCHED,ERROR,,$MPS 4-JUN-2003 04:35:48 %SIP-E-ERRMSG, V040 SIPMAIN - BATI,PR08, 6,KICK2 Failng,LATCHED,LATCHED,ERROR,,$MPS 4-JUN-2003 04:36:18 %CAU-E-EPICS_ERROR, RFS00NTA01 TRS1:AS1:INPREFL:PLATCH changed to OK, NO_ALARM 4-JUN-2003 04:39:33 %SIP-I-INFOMSG, V040 SIPMAIN - BATS,PR02, 3,HER BaBarRad,LATCHED,OK,OK,,$MPS 4-JUN-2003 04:39:33 %SIP-I-INFOMSG, V040 SIPMAIN - BATI,PR10, 5,KICKER#2,LATCHED,OK,OK,,$MPS 4-JUN-2003 04:39:33 %SIP-I-INFOMSG, V040 SIPMAIN - BATI,PR10, 6,KICK2 Failng,LATCHED,OK,OK,,$MPS 4-JUN-2003 04:39:35 %SIP-I-INFOMSG, V040 SIPMAIN - BATS,PR04, 15,LER Kly5Trip,LATCHED,OK,OK,, 4-JUN-2003 04:39:48 %SIP-I-INFOMSG, V040 SIPMAIN - BATI,PR08, 5,KICKER#2,LATCHED,OK,OK,,$MPS 4-JUN-2003 04:39:48 %SIP-I-INFOMSG, V040 SIPMAIN - BATI,PR08, 6,KICK2 Failng,LATCHED,OK,OK,,$MPS ERRLOG for the event of the previous slide
8
MDI meeting, March 19, 2004 A little statistics Since when we started recording, we have had, in four weeks of running: 49 aborts during “StableBeam” conditions. Of these, 28 were: SvtRad_only. That makes exactly one per day. Assuming 30 minutes as the average lost time per abort (from Guy Wormser’s measurement last year), SvtRad_only aborts have caused a loss of 14 hours of stable beam in 28 days. Adding the numbers of stable beam time during those 28 days (figures taken from the MCC 24_hours report) we get 438 hr: 14 hours add up to a 3.2% loss. Last remark: not all SvtRad aborts are a mystery. In some cases, the operators write in their logbook: “Radiation abort while moving tunes”, “while jumping a resonance”,” while setting a collimator”, “while a physicist is tuning”,…….
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.