Online Database Work Overview Work needed for OKS database

Slides:



Advertisements
Similar presentations
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Advertisements

Chapter 9 Chapter 9: Managing Groups, Folders, Files, and Object Security.
CSC Online and Offline DQA Status Ken Johns, Venkat Kaushik, Xiaowen Lei (U. Arizona)
Trigger and online software Simon George & Reiner Hauser T/DAQ Phase 1 IDR.
Working with SharePoint Document Libraries. What are document libraries? Document libraries are collections of files that you can share with team members.
Overview of Mini-Edit and other Tools Access DB Oracle DB You Need to Send Entries From Your Std To the Registry You Need to Get Back Updated Entries From.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
INFSOM-RI Juelich, 10 June 2008 ETICS - Maven From competition, to collaboration.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Netbeans 6.0 version control configuration for AUV Workbench & various XMSF projects TODO: check changes in all Netbeans 5 screens Don Brutzman
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Gnam Monitoring Overview M. Della Pietra, D. della Volpe (Napoli), A. Di Girolamo (Roma1), R. Ferrari, G. Gaudio, W. Vandelli (Pavia) D. Salvatore, P.
Svtsim status Bill Ashmanskas, CDF simulation meeting, Main authors: Ashmanskas, Belforte, Cerri, Nakaya, Punzi Design goals/features: –main.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
Multistep Runs with ROD Crate DAQ Murrough Landon, QMUL Outline: Overview Implementation Comparison with existing setup Readout Status ModuleServices API.
Ideas about Tests and Sequencing C.N.P.Gee Rutherford Appleton Laboratory 3rd March 2001.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
Databases in CMS Conditions DB workshop 8 th /9 th December 2003 Frank Glege.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
October Test Beam DAQ. Framework sketch Only DAQs subprograms works during spills Each subprogram produces an output each spill Each dependant subprogram.
L1Calo Installation Status Murrough Landon, QMUL Level-1 Calorimeter Trigger (University of Birmingham, University of Heidelberg, University of Mainz,
UK LVL1 Meeting, RAL, 31/01/00Alan Watson 1 ATLAS Trigger Simulations Present & Future? What tools exist? What are they good for? What are the limitations?
June 27-29, DC2 Software Workshop - 1 Tom Stephens GSSC Database Programmer GSSC Data Servers for DC2.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
GLAST Large Area Telescope Instrument Flight Software Flight Unit Design Review 16 September 2004 Instrument Configuration by File James Swain Stanford.
9 Copyright © 2004, Oracle. All rights reserved. Getting Started with Oracle Migration Workbench.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
GUIDO VOLPI – UNIVERSITY DI PISA FTK-IAPP Mid-Term Review 07/10/ Brussels.
ATLAS Detector Resources & Lumi Blocks Enrico & Nicoletta.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
Schedule ● External Links ● Calorimeter Signals ● Internal Tests ● System Tests ● Combined Runs ● Schedule Murrough Landon 19 April 2007 A brief update.
CT-PPS DB Info (Preliminary) DB design will be the same as currently used for CMS Pixels, HCAL, GEM, HGCAL databases DB is Oracle based A DB for a sub-detector.
L1Calo DBs: Status and Plans ● Overview of L1Calo databases ● Present status ● Plans Murrough Landon 20 November 2006.
DB and Information Flow Issues ● Selecting types of run ● L1Calo databases ● Archiving run parameters ● Tools Murrough Landon 28 April 2009.
Online Software Status ● Overview ● Recent Changes ● Required Changes ● Desirable Changes ● Upgrade ● Summary Murrough Landon 1 July 2009.
L1Calo Databases ● Overview ● Recent Activitity ● To Do List ● Run types Murrough Landon 4 June 2007.
Online Database Developments ● Overview ● OKS database status and plans ● COOL database developments ● Validating calibrations ● Tools ● Summary Murrough.
L1 Technical Proposal: Phase 2 ● Slow progress on writing TP phase 2 – Distractions with beam and calibration – Also some things are still unclear ● Hence.
1 April 2, Software Packaging and Releasing Best Practices William Cohen NCSU CSC 591W April 2, 2008.
M4 Operations ● Operational model for M4 ● Shifts and Experts ● Documentation and Checklists ● Control Room(s) ● AOB Murrough Landon 24 July 2007.
Calibration Operations ● Recent Changes ● Required Changes ● Calibration by Shifters Murrough Landon 23 March 2011.
Multi-step Runs – an L1Calo Perspective
Rainer Stamen, Norman Gee
CMS DCS: WinCC OA Installation Strategy
CLAS12 DAQ & Trigger Status
Working in the Forms Developer Environment
CMS High Level Trigger Configuration Management
Run Control (and Other) Work
Online Control Program: a summary of recent discussions
Online Database Status
Online Software Status
Conditions Database Current conditions folders Proposed new folders
Online Software Status
Recent Online SW/DB Changes
Online SW Readiness (or not)
Online SW, DB & Calibration
Online Software Status
Remaining Online SW Tasks
Level 1 (Calo) Databases
Online SW and Database Status
Test-rigs outside CERN
Cabling Lengths and Timing
Online Software “To Do” List
TriggerDB copy in TriggerTool
LHCb Conditions Database TEG Workshop 7 November 2011 Marco Clemencic
ATLAS: Level-1 Calorimeter Trigger
CPM plans: the short, the medium and the long
Rational Publishing Engine RQM Multi Level Report Tutorial
Presentation transcript:

Online Database Work Overview Work needed for OKS database Murrough Landon 27 June 2007 Overview Work needed for OKS database Work needed for COOL database

Overview: online databases OKS Configuration of the TDAQ and online system Description of partition, segments, SW, applications, HW Hardware includes crates, modules and cables connecting them Presently also includes “static” module settings, run types, test vector specifications (so called “DataGenRecipes”) Also has old style calibration data and trigger menu COOL/CORAL New trigger configuration DB (CORAL) Calibration data (in progress) Definition of run actions May (partly) replace OKS run types? Would also need specification of test vectors Should also have configuration choices for modules

OKS Database Work Done Completed a few actions from the last “to do” list: Database installed at point 1 in the proper place /db/tdaq-nn-nn-nn/l1calo (01-07-00 at present) Includes ROS segments (data collection and ROS event building) Database edited in place (no buildpkg) Can then be synchronised (dbsync.sh) to /det/l1calo/db This is a link to /det/l1calo/LVL1/l1calo/dbAtlas This directory is archived to new CVS package dbAtlas Script to generate (ideal) complete L1Calo DB Still a work in progress, but used for system simulation Also used for LVDS cables in recent USA15 slice test Now using OKS style configuration of GNAM Still some issues to be resolved? Still need to think about segment organisation...

OKS Database Work To Do (1) OKS has a long term future within TDAQ Improve what we will continue to use of it Run types cleanup Remove everything we never used Remove sequence definitions (take from COOL) Keep “data gen recipes” for the moment... Use “Resources” Make modules (and crates?) inherit from Resource class Can persistently enable/disable them from the IGUI (without IS) Is it worth making groups of cables a Resource? Helpful for a small set of readout configurations to a few RODs But more work and little help if readout configurations remain very fluid Investigate if (groups of) applications can be a resource Eg to enable/disable calibration applications

OKS Database Work To Do (2) Cabling description tdaq-01-08-00 introduces Cables to official OKS schema Migrate our old cable classes to inherit from these Cable database OKS cable database maintained by hand up to now New script to generation ideal cabling (algorithm) Useful for LVDS, but not Glinks/Slinks at the moment TDAQ and LAr both working on tools to extract cabling description from TC database for use in OKS They may converge on a single tool We might use this to generate our OKS cables from the TC DB Tools exist for equipment “owner” to update MTF database via the web Not sure if cabling database is included yet

OKS Database Work To Do (3) Software description OKS objects describing software can be generated Need to add macros to requirements files in each package Done for my packages, would like to extend to all packages Then SW description comes automatically with the release Firmware description Would also like to distribute firmware description with the release, not as a separate database file Not easy to do with the same SW generation script Could just move it to another package, eg L1CaloRelease? NB release size is dominated by firmware binaries Remove any files (PPM, CPM) that are not required! Completely remove those now done via System ACE (CMM, JEM) But still keep descriptions of the expected versions

COOL Database Overview We already have several different categories of data Folders of results from each calibration run One (or more) folder for each different type of run May have module and submodule level results from one run Folders of validated calibrations Validation process may combine results from several different types of calibration run One folder for the complete set of calibration data for a particular module type Folders of run parameters One folder per type of calibration (or test, or physics) run Definition of multistep run sequence Analysis parameters (eg desired pedestal, quality thresholds, etc)

COOL Database Work To Do (1) Calibration run results folders In use for PPM Default values for configuration parameters Pedestals, readout pointer, PHOS4 timing Code for PPM “RegValMaker” which puts it all together Nothing yet for FIR coefficients or energy calibration Coming from offline work? In development for CPM Still needed for JEM Need to complete the original CMM prototype Can use KTIDBExplorer to browse folders No other custom tools to show trends yet though

COOL Database Work To Do (2) Validated calibration folders Defined and tested for PPM However need all calibration runs before you get final results Validation procedure still required for regular use Also need “Physics” run parameter set for RegValMaker Defined (mostly?) for other modules Not yet even tested (I think?) Validation procedure Can we have a common framework for this? Or is it too specific to each module/calibration? Even basic copy functionality is still missing! In principle simple, just no time yet

COOL Database Work To Do (3) Run parameters Folders defined and in use for PPM calibration runs Skeleton placeholders for other module calibrations Main problem is lack of tools Run parameter folder contents only defined (for PPM only) by running a program from Florian Need a simpler and quicker way of doing this Online Oracle DB So far all tests with local SQLite file Need to start using Oracle database Module configuration parameters Longer term aim: move configuration parameters for modules from OKS to COOL

(Lack of Our) COOL Tools COOL_IO Simple uploading/downloading into ROOT/text files However not supported yet for COOL2 Richard Hawkings has an alternative tool (to/from ROOT) AtlCoolCopy.exe from offline release 13.0.10 KTIDBExplorer Now part of TDAQ release, works OK Not sure if it supports SQLite though PixelDataViewer Generic tool for viewing DCS (and other?) data from COOL Custom L1Calo (use of) tools Needs work! Extracting results, comparing, plotting trend Also simple way up viewing/editing/adding run parameters

Miscellaneous Archiving OKS/IS Tools existing to archive OKS and IS to COOL/CORAL OKS archiving is automatic at point 1 Need to arrange to archive our IS variables (what we keep of them)