Offline Analysis Framework STATUS

Slides:



Advertisements
Similar presentations
IEFC Workshop – 22/03/2011 JJ Gras on behalf of BE-BI 1.
Advertisements

Chapter Apache Installation in Linux- Mandrake. Acknowledgment The following information has been obtained directly from
WLCG Nagios and the NGS. We have a plan NGS is using a highly customised version of the (SDSC written) INCA monitoring framework. It was became too complicated.
1 Control Software (CAT) Introduction USB Interface implementation Calorimeter Electronics Upgrade Meeting Frédéric Machefert Wednesday 5 th May, 2010.
Creating Graphical User Interfaces (GUI’s) with MATLAB By Jeffrey A. Webb OSU Gateway Coalition Member.
Offline A nalysis F ramework OAF Jean-Jacques Gras, Stephen Jackson, Blazej Kolad.
Analysis, & future direction A FRAMEWORK FOR OFFLINE VERIFICATION OF BEAM INSTRUMENTATION SYSTEMS.
LHC BLM Software revue June BLM Software components Handled by BI Software section –Expert GUIs  Not discussed today –Real-Time software  Topic.
View and Manage corporate files from within Baan and ERP Ln Baan Hot Link Ver 6.2.
Monday h00: End of fill #1640: 3.7 pb h14: RB S12 and S23 tripped before loading rampdown table, active filter. MPE piquet. Fip_Com_Lost.
Nov, F. Di Maio, M.Vanden Eynden1 CO Proposal concerning AB Front-End Software Responsibilities First detailed proposal based on the global Front-end.
Proposal for a Global Network for Beam Instrumentation [BIGNET] BI Group Meeting – 08/06/2012 J-J Gras CERN-BE-BI.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Ops Portal New Requirements.
BI Offline Algorithm Framework Some Examples of What It Can Do for Us.
Software testing techniques Software testing techniques REGRESSION TESTING Presentation on the seminar Kaunas University of Technology.
HWC Review – Sequencer Vito Baggiolini AB/CO, with the team: Carlos Castillo, Daniele Raffo, Roman Gorbonosov.
CO Timing Review: The OP Requirements R. Steerenberg on behalf of AB/OP Prepared with the help of: M. Albert, R. Alemany-Fernandez, T. Eriksson, G. Metral,
The Dashboard The Working Conditions The Common Chapters State What’s Next.
Some topics for discussion 31/03/2016 P. Hristov 1.
REGRESSION TESTING Audrius Čėsna IFM-0/2. Regression testing is any type of software testing that seeks to uncover new errors, or regressions, in existing.
BIT 285: ( Web) Application Programming Lecture 07 : Tuesday, January 27, 2015 Git.
Sergi Rubio Manrique “Archiving System at ALBA”. Tango Meeting. ALBA. October 16 th, MMVIII 1 Archiving ALBA Sergi Rubio Manrique.
7/8/2016 OAF Jean-Jacques Gras Stephen Jackson Blazej Kolad 1.
Manage your projects efficiently and on a high level PROJECT MANAGEMENT SYSTEM Enovatio Projects Efficient project management Creating project plans Increasing.
Accounting Review Summary and action list from the (pre)GDB Julia Andreeva CERN-IT WLCG MB 19th April
The Minimum Workable LHC : Providers’ Commitments Summing-Up the following presentations: 1.ATB commitments and major issues [O. Aberle] 2.BI commitments.
Fabio Follin Delphine Jacquet For the LHC operation team
Stress Free Deployments with Octopus Deploy
How to Contribute to System Testing and Extract Results
SQL Replication for RCSQL 4.5
Experience with beam instrumentation at Linac4
Status and Plans for InCA
CMS Calibration Management System
L1Calo Joint Meeting The beginning…
LIU Wire Scanner Milestones June 2017
Run Control (and Other) Work
Online Control Program: a summary of recent discussions
QlikView Licensing.
LCGAA nightlies infrastructure
Make Links from your Baan System
Kanban Task Manager SharePoint Editions ‒ Introduction
Remaining Online SW Tasks
AMMS-WG BE-BI and PPE 9/12/2018.
An introduction to version control systems with Git
Prepared by Kimberly Sayre and Jinbo Bi
An introduction to version control systems with Git
Microsoft Technical Support Number Microsoft Technical Support Number Call Now : Toll Free Call Now : Toll Free
An introduction to version control systems with Git
Teaching slides Chapter 1.
Fill 1410 revisited Peak luminosity 1.4e32 Beam current 2.68/2.65 e13
LHC Morning Meeting - G. Arduini
Effective Programming
Continuous Improvement/eProve Regional Trainings
Wire almost entirely through beam before BLM triggers dump
Effective Programming
Diving into a large, legacy code::base as a youngster
EECS 473 Advanced Embedded Systems
Please use speaker notes for additional information!
Inside a PMI Online Course
NAVIGATING THE MINEFIELD
LHC BLM Software audit June 2008.
Reporting 101 Keenan & Mona.
Data Analytics & Machine Learning in BI
LHC Systems Providing Post-Mortem Data
Daniel, Gianluca and Belen (for the Collimator team)
Taking competencies to the next level
Saturday Morning used to complete the loss maps and asynch dumps (with RPs). All loss maps OK (B. Salvachua), but the off-p cleaning for B1 (Lead) was.
Advanced Tips and Tricks
Kanban Task Manager SharePoint Editions ‒ Introduction
Presentation transcript:

Offline Analysis Framework Status & Plans BI TB 21/02/2016 Blaze – JJ – Stephen BE-BI

Offline Analysis Framework STATUS BI OAF

An OAF GUI has been developed as command line alternative

GUI: Easy Snapshot easy selection All BI related Public snapshots now automatically appear here as a possible choice. Just create one in Timber and it will appear in the list, ready to ‘report’.

GUI: ‘Old’ reports easy production This option will trigger generation of the report that would have been produced at this date and time. For instance, a dynamic report could be configured for data between ‘now’ and one hour before. Then, selecting this snapshot with ‘15/09/2015 10:00:00’ as date selection will produce the report for data from ‘15/09/2015 09:00:00 ’ to ‘15/09/2015 10:00:00 ’.

GUI: Ready for (but not yet Open to) dedicated expert extra code, including expert alarms This window allows specifying the name of a special expert function to execute at the end of the standard process. Corresponding code stays in a separate file (one per instrument, editable by the expert) and cannot impact other OAF functions. We do not plan to open this door before Stage 1 is fully in use (see Plan chapter)…

GUI: Lower Resolution Report Production This option will trigger the generation of a lower (but still proper) resolution report file for quick viewing and printing

GUI: Allows you to tune your report’s name This window allows you to tune your report’s name (instead of the standard one)

OAF: Now supports ‘long term’ history

OAF: Now supports interactive plots for DB VECTOR (not in OAF: Now supports interactive plots for DB VECTOR (not in .pdf reports of course)

Daily Machine (PSB, CPS, SPS, LHC) Status Reports are now produced

Some Extra Instrument Daily Status Reports have been added too… For BSRA For BSRT For BOFSU … We’ll have the occasion to see them during next TBs …

Offline Analysis Framework PLANS BI OAF

Recall from previous TB: Coming Next New stuff, so expect bugs, missing features… but let give it a try and chance as is to cover correctly its first purpose (status and aging) before seeking for more (absolute perf assessment). JJ is available to discuss and implement your wishes for status/aging reports for this first stage. Probably a lot of useful things can already be done there. Possible complains from CO/DM due to our new activity on their DB. We spoke to them. They are aware ...

Recall from previous TB: The Next Steps Missing and foreseen features: History features for easy long term monitoring on NUMERICS and VECTORNUMERICS Handling of images (especially with dynamic dimensions) Low resolution reports. When aging/status reports will be properly covered, open the door (via a maintainable/efficient solution) to the configurable introduction of dedicated code by <instr/dataset> developed by expert…

Offline Analysis Framework PLANS 1/2 Thanks to Blaze and Stephen, Python 3 installation, including major libs (matplotlib, numpy, scipy, pandas…) is deployed and available for all BI on bdidev2. OAF is ready to cover its full purpose with its GUI But: No one ( apart BOFSU team) contacted any of us 3 to know what we could do for their instrument or even where we were standing with our developments No one showed concrete interest in the existing report follow-up People are still developping such tools in the group. They never contacted us on the subject and are probably not even aware of our development and objectives. So, stage 1 (i.e. basic and common ‘good shape’ check and survey) is not yet properly covered

Offline Analysis Framework PLANS 2/2 Despite OAF is now potentially ready to go to Stage 2, we will: Keep supporting a common Python 3 (and libs) for the group usage on a powerful Linux machine, i.e. bdidev2 Not open the door towards expert/individual adds-on until we feel that Stage 1 has been honestly considered and evaluated as a first option for each individual cases. In order to help you know, understand and appreciate what stage 1 OAF can or could already do for you (for free): JJ Gras will remain available to discuss, prepare and configure new reports JJ Gras will also monitor all these reports and extract and present any interesting observations as a recurrent topic of our future TBs (strange, bad and also hopefully good observations. See next slides).

LAST but not LEAST: OAF reports as recurrent TB topic The Technical Board Mandate covers 2 main subjects: Avoid duplicated or similar developments. Help and promote the adoption of standards. Assess instrument performance with respect to requirements.

OAF reports as recurrent TB topic In the context of this second point, a regular topic will be added to each TB where JJ Gras will: Extract and show from OAF reports done since previous TB any strange, bad or good observations. Report on any improvement or explanations found on previous TB observations tagged as priority issues by the TB. Inform on new reports created or OAF features added (if any).

OAF reports: What I could show for instance… Glitch on LHC BWS position reading

OAF reports: What I could show for instance… Heavy use on PS BWS

OAF reports: What I could show for instance… Differences between SYNC and IIR in BOFSU

OAF reports: What I could show for instance… Comparison of BCTs in LHC over a full day (good but rare unfortunately)

OAF reports: What I could show for instance… Evolution ‘history’ of BCTDCA/BCTDCB measurements (nice!)

OAF reports: What I could show for instance… Evolution ‘history’ of BCT06 to BCT10 transmission in LIN2 Is this step due to OP improvement or just new BI calibration values?

OAF reports: What I could show for instance… Differences between BCTFR and BQM bunch relative intensity measures

OAF reports: What I could show for instance… Wrong setting of BCTFRB B1 bunch phasing

OAF reports: What I could show for instance… BSRA abort gap population on B1 during stable beam

OAF reports: What I could show for instance… Evolution of the sum of BLMS monitors during a ramp

OAF reports: What I could show for instance… … See You Next Time