Calibration Infrastructure & Gaudi Design and Status.

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

WHAT IS AN OPERATING SYSTEM? An interface between users and hardware - an environment "architecture ” Allows convenient usage; hides the tedious stuff.
OOAD Using the UML - Use-Case Analysis, v 4.2 Copyright  Rational Software, all rights reserved 1/18 Use Case Analysis – continued Control Classes.
OPERATING SYSTEM OVERVIEW
GLAST CHEP 03 March J. Bogart1/26 Calibration Infrastructure for the GLAST LAT Joanne Bogart Stanford Linear Accelerator Center
SAS Calibration Infrastructure J. Bogart 7 June 2004 What it is, what it does.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
Identifiers for Everyone J. Bogart Core Software Workshop April
CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.
Linux Operations and Administration
Database testing Prepared by Saurabh sinha. Database testing mainly focus on: Data integrity test Data integrity test Stored procedures test Stored procedures.
M.Frank LHCb/CERN - In behalf of the LHCb GAUDI team Data Persistency Solution for LHCb ã Motivation ã Data access ã Generic model ã Experience & Conclusions.
M1G Introduction to Database Development 6. Building Applications.
LiveCycle Data Services Introduction Part 2. Part 2? This is the second in our series on LiveCycle Data Services. If you missed our first presentation,
October 8, 2015 University of Tulsa - Center for Information Security Microsoft Windows 2000 DNS October 8, 2015.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
GLAST CHEP 03 March R.Dubois1/17 GLAST Large Area Telescope: Overview of GLAST Offline Software Richard Dubois Stanford Linear Accelerator Center.
1 Advanced Topics in Access How to create forms and reports Andrew Yu 03/04/2002.
Software Solutions for Variable ATLAS Detector Description J. Boudreau, V. Tsulaia University of Pittsburgh R. Hawkings, A. Valassi CERN A. Schaffer LAL,
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Event Data History David Adams BNL Atlas Software Week December 2001.
Andrew S. Budarevsky Adaptive Application Data Management Overview.
The Glance Project ATLAS Management January 2012.
Plant Accession Application Maintenance Manual. Accession Application Website Environment Overview WinHost.com ASP Pages VBScript Procs Constants Style.
GLAST Gaudi Code Review, 10 Sept. 2002, H. Kelly, 2-1 GLAST Event Data Model and Persistency.
CHEP 2003 March 22-28, 2003 POOL Data Storage, Cache and Conversion Mechanism Motivation Data access Generic model Experience & Conclusions D.Düllmann,
ALICE, ATLAS, CMS & LHCb joint workshop on
AIDA Tuple Service Manuel Domenech Wednesday
A university for the world real R © 2009, Chapter 9 The Runtime Environment Michael Adams.
1.Registration block send request of registration to super peer via PRP. Process re-registration will be done at specific period to info availability of.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
1: Operating Systems Overview 1 Jerry Breecher Fall, 2004 CLARK UNIVERSITY CS215 OPERATING SYSTEMS OVERVIEW.
API Crash Course CWU Startup Club. OUTLINE What is an API? Why are API’s useful? What is HTTP? JSON? XML? What is a RESTful API? How do we consume an.
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Session 1 Module 1: Introduction to Data Integrity
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Pool Project and ROOT I/O Dirk Duellmann What is Pool? Component Breakdown Status and Plans.
Web Services An Introduction Copyright © Curt Hill.
NUMI MINOS GDM meeting 9 August 2005 MINOS Database Software Support Requirements MINOS Database Software Support Requirements D. Box, E. Buckley-Geer,
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
LCG Distributed Databases Deployment – Kickoff Workshop Dec Database Lookup Service Kuba Zajączkowski Chi-Wei Wang.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
1 Process Description and Control Chapter 3. 2 Process A program in execution An instance of a program running on a computer The entity that can be assigned.
刻度框架概况及进展 黄彬 内容 刻度框架的设计功能 刻度框架的结构与流程 刻度框架的应用 目前的进展和下一步的工作.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
Module 5: Managing Content. Overview Publishing Content Executing Reports Creating Cached Instances Creating Snapshots and Report History Creating Subscriptions.
Basics of the Domain Name System (DNS) By : AMMY- DRISS Mohamed Amine KADDARI Zakaria MAHMOUDI Soufiane Oujda Med I University National College of Applied.
DEVELOPING WEB SERVICES WITH JAVA DESIGN WEB SERVICE ENDPOINT.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
GLAST ACD Status. GLAST Overview McPositionHitCol AcdDigiCol AcdRecon AcdDigiAlg AcdReconAlg TkrFitTrackCol TDS Gaudi Algorithms.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
David Adams ATLAS Hybrid Event Store Integration with Athena/StoreGate David Adams BNL March 5, 2002 ATLAS Software Week Event Data Model and Detector.
LHCb Software Week 25/11/99 Gonzalo Gracia Abril 1 r Status of Geant4 in LHCb. r Ideas on how to populate the LHCb Detector Description Data Base (LHCb.
GLAST LAT ProjectNovember 18, 2004 I&T Two Tower IRR 1 GLAST Large Area Telescope: Integration and Test Two Tower Integration Readiness Review SVAC Elliott.
Data Integrity & Indexes / Session 1/ 1 of 37 Session 1 Module 1: Introduction to Data Integrity Module 2: Introduction to Indexes.
The Holmes Platform and Applications
Product Training Program
Architecture Review 10/11/2004
Collectd 101.
GLAST Gaudi Review T. Burnett H.Kelly 10 Sept 02 Gaudi code review
A C++ generic model for the GLAST Geometric Description
LHCb Detector Description Framework Radovan Chytracek CERN Switzerland
Data Persistency Solution for LHCb
Raw Event Conversion Service in BOSS framework
Andrea Valassi Pere Mato
Use Of GAUDI framework in Online Environment
LHCb Detector Description Framework Radovan Chytracek CERN Switzerland
Calibration Infrastructure Design
Presentation transcript:

Calibration Infrastructure & Gaudi Design and Status

10 Sept. 2002J. Bogart2 Review Calibration data comes in two pieces –Metadata, stored in MySQL database –Bulk data, probably XML or ROOT file Support 2 levels of access –Via Gaudi TDDS* for event analysis, recon. –Sans Gaudi for hardware evaluation, writing calibrations, browsing for more docs. *Transient Detector Data Store

10 Sept. 2002J. Bogart3 calibUtil interface Data (persistent)Metadata (persistent) Underpinnings bad strips (XML) CAL calibs (ROOT) MySQL rdbms Write/register Search Read I & T Client Gaudi ClientCalibrator Signifies “uses” or “accesses”

10 Sept. 2002J. Bogart4 Gaudi Interface Reqs Provide read access to calibration data in a form suitable for event analysis apps. Updates to acquire constants appropriate for current event happen automatically, without client intervention. –“appropriate” means valid for timestamp of this event, for correct instrument of acceptable quality

10 Sept. 2002J. Bogart5 Non-requirements Don’t support conversion from TDDS to PDS –Calibration writers may choose to run in Gaudi environment, but will use calibUtil services directly to write & register data Don’t require TDDS form to correspond closely to persistent form Don’t require “leaf” TDDS classes to have simple structure. –Not convenient for bad strips –Consequence is that clients might need local cache, hence mechanism to be informed when TDDS class has been updated. All of the above would be reasonably natural requirements, or at least expectations, for event TDS.

10 Sept. 2002J. Bogart6 Inputs Event time must be accessible from event data. Identification of instrument should also come from event data. Other inputs fall under category of configuration, could be job options –Requirements on calibration quality –Host of calibration metadata database –Table name for metadata –Probably more I haven’t thought of

10 Sept. 2002J. Bogart7 Classes Detector data service [DetDataSvc] –Base class DataSvc handles object registry, internal org. of TDDS. IDetDataSvc interface to manage event time. Detector persistency service [DetPersistencySvc] –Finds “right” conversion service – we’ll have only one Calibration conversion service(s) [ConversionSvc base handles converter registry] –One per “physical” format, but we consider all calibration data to be of one “physical” type. Finds right converter for particular DataObject. May also provide other services used by one or more converters. Here will maintain metadata database configuration, connection (instance of calibUtil::Metadata)

10 Sept. 2002J. Bogart8 Data Service DataSvc IDataProviderSvc DetDataSvc IDetDataSvc IIncidentListener IDataManagerSvc Gaudi Class Gaudi Interface GLAST Class GLAST Interface

10 Sept. 2002J. Bogart9 Persistency Service PersistencySvc IPersistencySvc DetPersistencySvc IAddressCreator IConversionSvc Delegated to appropriate ConversionSvc

10 Sept. 2002J. Bogart10 Conversion Service CalibCnvSvc ConversionSvc ICalibCnvSvc IAddressCreator IConversionSvc IConverter Delegated to appropriate converter

10 Sept. 2002J. Bogart11 Classes (cont’d) Calibration converters (one per TDDS class) TDDS classes –DataObjects which also satisfy IValidity interface Opaque address –Can get by with Gaudi-supplied implementation GenericAddress of IOpaqueAddress interface

10 Sept. 2002J. Bogart12 Converters BadStripCnv Converter IConverter LightAttCnvTestCnv … (more)

10 Sept. 2002J. Bogart13 TDDS Classes BadStripObj DataObject IValidity LightAttObj … IValidity (more)

10 Sept. 2002J. Bogart14 Status, to do (non-Gaudi) Collaborate with CAL to design ROOT format for calibrations (ideally will be essentially identical to TDDS representation). Similarly for ACD? Provide ROOT services as needed in calibUtil Provide visitor for metadata database (Xin Chen request). Add new or modify existing Metadata class constructor so that configuration can be passed in.

10 Sept. 2002J. Bogart15 Status, to do (Gaudi-related) Configuration of DetDataSvc, DetPersistencySvc (through job options?) Finish writing CalibCnvSvc –First pass is mostly done Design individual TDS classes Write individual converters. –Most should be straightforward; BadStrips is not. Callback mechanism? –Some clients of some TDDS classes might need to know if TDDS data has been updated so they can update caches.

10 Sept. 2002J. Bogart16 To do (cont’d) Test! Many pieces have to be written and integrated before anything at all can be tested.

10 Sept. 2002J. Bogart17 References Web accessible documents on related topics can found at –See especially link labeled “Calibration infrastructure and Gaudi”, which covers most of the same material as this presentation, but in more depth. Code. –Package calibUtil contains those classes which are independent of Gaudi. –Coming soon: two new packages for Gaudi-related code. CalibCnv will contain calibration conversion service and individual converters. CalibData will contain TDDS classes.