Calibration Infrastructure Design

Slides:



Advertisements
Similar presentations
EventStore Managing Event Versioning and Data Partitioning using Legacy Data Formats Chris Jones Valentin Kuznetsov Dan Riley Greg Sharp CLEO Collaboration.
Advertisements

GLAST CHEP 03 March J. Bogart1/26 Calibration Infrastructure for the GLAST LAT Joanne Bogart Stanford Linear Accelerator Center
SAS Calibration Infrastructure J. Bogart 7 June 2004 What it is, what it does.
Calibration Infrastructure & Gaudi Design and Status.
Software Development, Programming, Testing & Implementation.
CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.
M.Frank LHCb/CERN - In behalf of the LHCb GAUDI team Data Persistency Solution for LHCb ã Motivation ã Data access ã Generic model ã Experience & Conclusions.
FUNCTIONS AND STORED PROCEDURES & FUNCTIONS AND PROTECTING A DB AND PHP (Chapters 9, 15, 18)
Chapter 2: Operating-System Structures. 2.2 Silberschatz, Galvin and Gagne ©2005 Operating System Concepts Chapter 2: Operating-System Structures Operating.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
C++ Implementation ( Version 1 – Text Interface ) Elimination of services of our system. Elimination of services of our system. General Flow of the program.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Marianne BargiottiBK Workshop – CERN - 6/12/ Bookkeeping Meta Data catalogue: present status Marianne Bargiotti CERN.
GLAST CHEP 03 March R.Dubois1/17 GLAST Large Area Telescope: Overview of GLAST Offline Software Richard Dubois Stanford Linear Accelerator Center.
Nick Brook Current status Future Collaboration Plans Future UK plans.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
File Systems (1). Readings r Reading: Disks, disk scheduling (3.7 of textbook; “How Stuff Works”) r Reading: File System Implementation ( of textbook)
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Event Data History David Adams BNL Atlas Software Week December 2001.
The european ITM Task Force data structure F. Imbeaux.
CHEP /21/03 Detector Description Framework in LHCb Sébastien Ponce CERN.
Dale E. Gary Professor, Physics, Center for Solar-Terrestrial Research New Jersey Institute of Technology 1 9/25/2012Prototype Review Meeting.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
CHEP /21/03 Detector Description Framework in LHCb Sébastien Ponce CERN.
Detector Description in LHCb Detector Description Workshop 13 June 2002 S. Ponce, P. Mato / CERN.
GAUDI Muon Software  Algorithms : Muon Digitization MuonL0Trigger MuonIdentification  Detector Description Database  Transient Detector Store  Detector.
New COOL Tag Browser Release 10 Giorgi BATIASHVILI Georgian Engineering Center 23/10/2012
© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
Andrea Valassi (CERN IT-DB)CHEP 2004 Poster Session (Thursday, 30 September 2004) 1 HARP DATA AND SOFTWARE MIGRATION FROM TO ORACLE Authors: A.Valassi,
John MarshallPandora Development1 J.S. Marshall University of Cambridge.
刻度框架概况及进展 黄彬 内容 刻度框架的设计功能 刻度框架的结构与流程 刻度框架的应用 目前的进展和下一步的工作.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
19 Copyright © 2004, Oracle. All rights reserved. Coding PL/SQL Triggers.
David Adams ATLAS Hybrid Event Store Integration with Athena/StoreGate David Adams BNL March 5, 2002 ATLAS Software Week Event Data Model and Detector.
Introduction to DBMS Purpose of Database Systems View of Data
Instrument Teams to SOC Test Specifications
Root I/O and the Gaudi Framework
Database Replication and Monitoring
MXFComponentSuite Version 2.0 Technical Overview
(on behalf of the POOL team)
Examining the Cluster Log
Migration of reconstruction and analysis software to C++
Chapter 11: File-System Interface
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
OGSA Data Architecture Scenarios
Test Case Structure Test Case Module(depend on framework) MocoServer
LCG Monte-Carlo Events Data Base: current status and plans
Ch > 28.4.
Introduction to Database Systems
LHCb Detector Description Framework Radovan Chytracek CERN Switzerland
Data Persistency Solution for LHCb
Detector Description in LHCb
Overview of the SCIRun/BioPSE Software Systems
A Simulator to Study Virtual Memory Manager Behavior
GlobalMMCS Entry Portlets
Introduction to DBMS Purpose of Database Systems View of Data
Raw Event Conversion Service in BOSS framework
Simulation and Physics
Module 5 Getting Help.
Chapter 2: Operating-System Structures
Major Design Criteria Clear separation between “data” and “algorithms”
Event Storage GAUDI - Data access/storage Framework related issues
Andrea Valassi Pere Mato
Planning next release of GAUDI
Classes and Objects Systems Programming.
Accessing Event Data Schedule: Timing Topic 20 minutes Lecture
LHCb Detector Description Framework Radovan Chytracek CERN Switzerland
Presentation transcript:

Calibration Infrastructure Design J. Bogart 10 May 2002

Metadata (persistent) Overview I & T Client Gaudi Client Calibrator Gaudi services calibUtil Services Register, write Search Read reference uses, accesses executable library Metadata (persistent) Data (persistent) MySQL rdbms bad strips (XML) CAL calibs (ROOT)

Bad Strips (persistent form) Uses XML because it's human-readable; convenient for variable-length data Includes a "generic" section which will be part of all calib. data sets (analog for ROOT): conditions, input data description Goal is to indicate which strips are bad in unambiguous hardware terms. http://www.slac.stanford.edu/exp/glast/ground/software/calibration/test_badStrips_xml.html (sample file) http://www.slac.stanford.edu/exp/glast/ground/software/calibration/badStrips_dtd.html (specification of xml format)

What's in the Metadata dbs http://www.slac.stanford.edu/exp/glast/ground/software/calibration/CalibSvcSpec.shtml#metadata describes the per-calibration data set information we expect to keep in the database. http://www.slac.stanford.edu/exp/glast/ground/software/calibration/metadata_columns.html is a dump from the actual MySQL database installed on centaurusa.

calibUtil Services Write a calibration data file Separate services for each calibration data type (e.g. TKR bad strips, CAL absolute energy calibration, ...) Caller is isolated from details of persistent form Register a calibration Identical for all calibration types Adds new entry to metadata database.

calibUtil Services (cont'd) Search for a calibration data file Inputs will include calib type, timestamp (during which calib must be valid), ... Return is sufficient info so that appl can find and use data set. Read Per-calib-type services extract data into per-calib-type classes. Classes must support typical use cases.

Interface to Gaudi Gaudi algorithms should be able to access calibration data transparently. In particular, the "right" set of constants should be available as each event is processed. TDS classes (not for the Event TDS, but for the Transient Detector Store associated with the Gaudi Detector Data Service) will be defined for each calibration type. Some of the metadata associated with the calibration, such as validity interval, would also be stored. The converters for these classes would use validity interval to determine if the current version of the data was appropriate. If not, calibUtil search and read services would be invoked.