Controls Issues Injection beam2 test meeting 28 th Aug 2008 Eugenia Hatziangeli Input from J. Lewis, M. Sobzak, JJ Gras, C. Roderick, M.Pace, N. Stapley,

Slides:



Advertisements
Similar presentations
BE/CO Changes in LS1 to the Software Development Infrastructure and Widely Used Libraries Chris Roderick, Greg Kruk, Katarina Sigerud, Luigi Gallerani,
Advertisements

TDPS Wireless v Enhancements E1 - Multi load E2 - Driver time scheduler.
Post Mortem Workshop - discussion1 17/1/2007 HWC Requirements GMPMA  Concentrate on pre-beam requirements Post-quench analysis ([semi-] automatic) Integrity.
1 LSA Overview 06/11/2007 Grzegorz Kruk on behalf of the LSA Team.
Beam commissioning strategy Global machine checkout Essential 450 GeV commissioning System/beam commissioning Machine protection commissioning.
BE-CO work for the TS Nov 8 Nov 11P.Charrue - BE/CO - LBOC1.
RF de-bunching problem  The Beam Phase module measures the phase of each individual bunch and makes an average that is passed to the Low Level for updating.
V4 – Executive Summary 1.Provide online add/delete of I/O to support continuous operation. 2.Provide redundant control of remote I/O to support improved.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 11 Managing and Monitoring a Windows Server 2008 Network.
Event Viewer Was of getting to event viewer Go to –Start –Control Panel, –Administrative Tools –Event Viewer Go to –Start.
Wojciech Sliwinski for BE-CO group Special thanks to: E.Hatziangeli, K.Sigerud, P.Charrue, V.Baggiolini, M.Sobczak, M.Arruat, F.Ehm LHC Beam Commissioning.
E. Hatziangeli – LHC Beam Commissioning meeting - 17th March 2009.
A. Dworak BE-CO-IN, CERN. Agenda 228th June 2012  Sum up of the previous report  Middleware prototyping  Transport  Serialization  Design concepts.
W. Sliwinski – eLTC – 7March08 1 LSA & Safety – Integration of RBAC and MCS in the LHC control system.
© Cisco Systems, Inc. All rights reserved. Cisco Public ITE PC v4.1 Chapter 4 1 Chapter 12: Advanced Troubleshooting IT Essentials v5.0.
Eugenia Hatziangeli Beams Department Controls Group CERN, Accelerators and Technology Sector E.Hatziangeli - CERN-Greece Industry day, Athens 31st March.
T HE BE/CO T ESTBED AND ITS USE FOR TIMING AND SOFTWARE VALIDATION 22 June BE-CO-HT Jean-Claude BAU.
Friday March 4 th LHC morning report the short story: from a global point of view we had basically only one access !!!
LHC BLM Software revue June BLM Software components Handled by BI Software section –Expert GUIs  Not discussed today –Real-Time software  Topic.
Session 1 Introduction  What is RADE  Technology  Palette  Tools  Template  Combined Example  How to get RADE  Questions? RADE Applications EN-ICE-MTA.
Monday h00: End of fill #1640: 3.7 pb h14: RB S12 and S23 tripped before loading rampdown table, active filter. MPE piquet. Fip_Com_Lost.
Wojciech Sliwinski BE/CO for the RBAC team 25/04/2013.
FGC Upgrades in the SPS V. Kain, S. Cettour Cave, S. Page, J.C. Bau, OP/SPS April
1 LTC Timing AB/CO/HT Central timing hardware layout Telegrams and events Postmortem, XPOC LHC Central Timing API Fill the LHC Use Case Julian Lewis.
Eva Barbara Holzer MPP, CERN July 31, Eva Barbara Holzer, CERN MPP CERN, July 31, 2009 PROCEDURES FOR CHANGES TO BLM SYSTEM SETTINGS DURING LHC.
Nominal intensity bunches ● First ramp with nominal intensity bunches suffered from an instability appearing around 1.8 TeV. ● Nominal intensity bunches.
00:15: Stable beams fill 1883, 1.1E33 cm-2s-1.  Seems the 144 bunches beam 1 doe not fit properly on the injection kicker waveform. Systematically the.
RBAC Content: LHC Operational Mode Piquet Roles RBAC Strict LHC Operational mode and CMW Acknowledgements: Pierre C., Wojtek S., Stephen P., Lars J., Verena.
Nominal Workflow = Outline of my Talk Monitor Installation HWC Procedure Documentation Manufacturing & Test Folder Instantiation – NC Handling Getting.
© 2001 By Default! A Free sample background from Slide 1 Shot by Shot Logging Status Report of Ti8 Tests AB/CO Technical.
Post ACCOR until LS2: End of Life for CMW products CO3 meeting, 25th June 2015 Wojciech Sliwinski for the BE-CO Middleware team.
LHC Collimation Working Group – 02 April 2012 Results from Beam-Based Collimator Alignment G. Valentino, R. W. Assmann, R. Bruce, F. Burkart, M. Cauchi,
08h15: Injection.  Correction injection oscillations.  Transfer line steering.  Losses at 30% of dump threshold, limited by SPS scraping. 12h35: Start.
LHC Injection Sequencing MD 16/23/2009 Injection sequencing / BCM R, Giachino, B. Goddard, (D. Jacquet), V. Kain, M. Meddahi, J. Wenninger.
MA PM performance, Adriaan Rijllart Post Mortem data handling and performance Adriaan Rijllart, Beno î t Pannetier, Boris Khomenko, Greg Kruk,
Last night Lhc closed 15:00 Beam on Ti 8 /Ti2 Prepulse check synchronisation ok with LHCb /RF 17:00 Open Point 4 PC’s and RF 19:00 LBDS energy tracking.
Technical Stop feed-down P.Charrue on behalf of the BE Controls Group 5th September 2011P.Charrue - 8h30 meeting1.
CMW status 6 Feb CMW status February 2002 Kris Kostro.
Issues concerning Device Access (JAPC / CMW / FESA) With input from: A.Butterworth, E.Carlier, A. Guerrero, JJ. Gras, St. Page, S. Deghaye, R. Gorbonosov,
DIAMON Project Project Definition and Specifications Based on input from the AB/CO Section leaders.
V. Kain – eLTC – 7March08 1 V.Kain, S. Gysin, G. Kruk, M. Lamont, J. Netzel, A. Rey, W. Sliwinski, M. Sobczak, J. Wenninger LSA & Safety - RBAC, MCS Roled.
Outline of 2014/2015 plans V. Kain, M. Lamont, J. Wenninger 6/18/2013Optics Measurement and Correction Review
06:00 – Ongoing injection problems on beam 2  07:42 – Start of injection investigations  11:11 – Injection problem fixed. Resteering of transfer line.
PC Current Interlocking for the SPS Fast Extractions. 1 J. Wenninger July 2009.
Industrial Control Engineering Session 1 Introduction  What is RADE  Technology  Palette  Tools  Template  Combined Example  How to get RADE 
E. Hatziangeli – LHC Beam Commissioning meeting - 3 rd March 2009.
LHC RT feedback(s) CO Viewpoint Kris Kostro, AB/CO/FC.
BE-CO work for the TS Outcome of the actions 23 – 28 Apr May 12P.Charrue - BE/CO - LBOC1.
MPE Workshop 14/12/2010 Post Mortem Project Status and Plans Arkadiusz Gorzawski (on behalf of the PMA team)
Access system LHC-SPS M. Gruwé and J. Ridewood OP days March 18 th 2008.
AWAKE p+ beam line HWC C. Bracco, J. Schmidt Acknowledgment: MCS, EPC, MPE, SPS-OP, BI, ABP (survey),STI, EA, ACE, RP.
H2LC The Hitchhiker's guide to LSA Core Rule #1 Don’t panic.
LHC Beam Commissioning Meeting V. Kain & R. Alemany
Introduction to RBAC Wojciech Sliwinski BE/CO for the CMW/RBAC team
Injectors BLM system: PS Ring installation at EYETS
Computing infrastructure for accelerator controls and security-related aspects BE/CO Day – 22.June.2010 The first part of this talk gives an overview of.
What did we learn with beam in 2008
Saturday 30th June - Sunday: Rocky !
Predictive Performance
CMW infrastructure Status report
Thu 19/5 06: :00 Investigations from vacuum and cryogenics
BLM settings management in LSA
Dry Run 0 Week 13: BI test of...everything circulating beam: all fixed displays and BI applications OP directories for 2009, concentrators running Need.
Yesterday’s morning’s controls issues
Friday AM Some oscillations of the cryo conditions in MSR8 perturbed the setup for injection. RF frequency interlock fixed – required a reset of RF controls.
First Level Incident Handling FAQ (For EAL)
LHC BLM Software audit June 2008.
New page for summary of test status
LHC Systems Providing Post-Mortem Data
QlikView for use with SAP Netweaver Version 5.8 New Features
Presentation transcript:

Controls Issues Injection beam2 test meeting 28 th Aug 2008 Eugenia Hatziangeli Input from J. Lewis, M. Sobzak, JJ Gras, C. Roderick, M.Pace, N. Stapley, P. Charrue, G. Kruk, A. Bland, M. Arruat, E. Hatziangeli

Timing  Several problems at the same time  Mismatch between the tables loaded in the master LHC MTG and the ones in the Operational application  Unable to load injection timing table  Error possibly due to timeout  Julian is working on a fix on the task server on the MTGS to avoid incoherent tables being loaded  CRT LTIM was disabled  Timing events were not coming out  Test LTIM that triggers every SPS extraction was enabled by mistake  Test LTIM is now suppressed which was killing the TI8/TI2 LTIMs output  Payload was set to 0xFFFF  Timing events were coming out on every cycle not just LHC  Test LTIM that triggers every SPS extraction was enabled by mistake forcing the payload to 0xFFFF E. Hatziangeli Injection beam2 test meeting report 28 th Aug 2008

FESA Servers  Several bugs on CMW (RDA) and FESA were corrected prior to the Beam 2 test  Servers reporting crashes, [BI servers (BLM, BPM), XTIM] were relinked with the new version 1 week prior to test and were put under automatic restart if crash  No crash was observed during that week [BI made several stress tests and crashes were not induced]  Friday PM # of clients increased => XTIM server unable to serve  Increase buffer resolved situation  XTIM Instability was recorded during the weekend (crash/blockage)  BLM, BPM instabilities (several crashes) during the weekend recorded  Investigation into RDA revealed a weakness which can lead to server crash  Fix was released. XTIM is being tested with this now, BI follows E. Hatziangeli Injection beam2 test meeting report 28 th Aug 2008

Logging  General logging was stable no holes in data  LHC Collimators logging restricted to sectors 7-8 and 2-3  Full LHC collimator logging load was tested during the days before => no problem but WITHOUT the full data load from other parameters (all XPOC- event triggered data) enabled  BPM logging - small hickups but nothing major  BLM logging  Started with logging sectors 7-8 and 2-3 together  Several holes of data were observed  Bottleneck in the database client API  Switched to sector 7-8 on Saturday  An improved version of the API was delivered on Sunday AM (parallelization in place)  Sectors 7-8 and 2-3 were logged since then with no interruption/data loss  Stress tests with all BLMs logged will be started tomorrow  New version of the API will be used in all our logging clients E. Hatziangeli Injection beam2 test meeting report 28 th Aug 2008

Some Numbers JMS  client connections  CCC consoles  CCR servers  office or cernts  subscriptions  Network traffic  Input: 2-4MB/s  Output 10-30MB/s  Both input and output were highest evening and overnight Sunday-Monday (24th-25th).  Message counts < 3 million per day Disk Usage – SDDS Logging Size Used Avail Use%  sps_data 493G 242G 226G 52%  lhc_data 493G 149G 319G 32%  The beam2 test produced  15Gbytes on SPS (33 GBytes beam1)  3Gbytes on LHC (17 GBytes beam1)  Remaining 500G + 500G on order Meas DB in MBytes

RBAC  RBAC settings during the test:  RBAC-enable = true  RBAC-policy = no check (lenient, strict)  FESA servers 2.10 and PO  RBACed client applications sending RBAC token to the server, the token will be ignored, the call will work as before  NonRBACed client applications will work as before  FESA servers 2.9 with RBAC rules applied the previous default policy (lenient) => correct role is needed  New FESA 2.9 framework with present RBAC functionality is now available  BT will move to this  RF, collimators to be decided  OP-RBAC responsible has provided a list of all OP applications to be RBAC enabled  Component to manage RBAC token in GUIs is available  10 th Sept proposal  All required application should be RBAC enabled  RBAC-policy = lenient  No token - grant  Get without rules - grant  Get with rules - check rules  Set without rules - grant  Set with rules - check rule  Slot in dry runs before the 10 th September E. Hatziangeli Injection beam2 test meeting report 28 th Aug 2008

Summary  Several Issues with the Timing on Friday  Once understood the recovery was quick  Fixes are on the way  FESA/CMW servers for BI and XTIM became unstable during the weekend (high # of clients connections?)  CMW fix is already deployed – under test  Logging - no loss of data, also for the BLM once the improved API was deployed  Testing for all the ring and use new API everywhere  RBAC behaved as expected => no interference with the test  RBAC enable all appropriate applications, dry tests and go for the lenient policy for the 10 th September E. Hatziangeli Injection beam2 test meeting report 28 th Aug 2008