Kay Graf Timecalibration Meeting Vidyo, 12/03/2015 Database and Calibration.

Slides:



Advertisements
Similar presentations
CNES implementation of the ISO standard An extension of the current CNES implementation of the ISO metadata standard.
Advertisements

New tools for MIAPE Generation Emilio Salazar Doñate Bioinformatics Group CNB – CSIC.
Overview QW Gateway is a new front-end to QuipWare
High Availability for IBM Power i.
Yevgeny Petrilin Shay Dan Shadi Ibrahim. GUI : Graphical User Interface DAQ :Data Acquisition Data Acquisition device  a self-powered system that communicated.
Peoplesoft Fundamentals David Lewis 10/18/02 (adapted from Psoft Training Materials)
Databases and Processing Modes. Fundamental Data Storage Concepts and Definitions What is an entity? An entity is something about which information is.
WELL-DESIGNED DATABASES Process faster Easy to develop and maintain Easy to read and write code.
Information Storage and Retrieval CS French Chapter 3.
ACAT 2008 Erice, Sicily WebDat: Bridging the Gap between Unstructured and Structured Data Jerzy M. Nogiec, Kelley Trombly-Freytag, Ruben Carcagno Fermilab,
Service-Oriented Programming
Databases. Objectives Define what a database is. Understand the difference between a flat and relational database Design and create a relational database.
Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.
Resources – MS Access Free Online Training Resources  Using an Access database to store and information (2 min)
Architecture of Enterprise Systems: Domain Model and Database layer
Classroom User Training June 29, 2005 Presented by:
DATABASE MANAGEMENT SYSTEMS BASIC CONCEPTS 1. What is a database? A database is a collection of data which can be used: alone, or alone, or combined /
Research paper: Web Mining Research: A survey SIGKDD Explorations, June Volume 2, Issue 1 Author: R. Kosala and H. Blockeel.
Admin Tool June 11, Admin Tool Overview Architecture Implementation Dependencies Futures 2.
1 PHP and MySQL. 2 Topics  Querying Data with PHP  User-Driven Querying  Writing Data with PHP and MySQL PHP and MySQL.
Calculation BIM Curriculum 07. Topics  Calculation with BIM  List Types  Output.
Tutorial 121 Creating a New Web Forms Page You will find that creating Web Forms is similar to creating traditional Windows applications in Visual Basic.
Stored Procedures (dynamic Order By + Web Assistant Wizard) Kevin Penny, MMCP
Programming for Geographical Information Analysis: Advanced Skills Lecture 1: Introduction Programming Arc Dr Andy Evans.
Using XML for Test Case Definition, Storage and Presentation Michael Ensminger
1 CS 430 Database Theory Winter 2005 Lecture 17: Objects, XML, and DBMSs.
The Glance Project ATLAS Management January 2012.
Performance monitoring -- Nicolas Simar Performance monitoring TF-NGN meeting, Rome (Italy), Nicolas Simar, Network.
ALICE, ATLAS, CMS & LHCb joint workshop on
Lecture 22: Client-Server Software Engineering
Metadata Management of Terabyte Datasets from an IP Backbone Network: Experience and Challenges Sue B. Moon and Timothy Roscoe.
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER Charles Leggett Interval of Validity Service IOVSvc ATLAS Software Week May Architecture.
Welcome to BAC344! Business Applications using COBOL Andre Berns.
Nfs or ftp server Server 1 Server 2 ClinCapture web app SAS script SAS REST notification service [SAS RNS] (can be run as standalone app) upload / download.
ALICE Condition DataBase Magali Gruwé CERN PH/AIP Alice Offline week May 31 st 2005.
Relational Databases. Relational database  data stored in tables  must put data into the correct tables  define relationship between tables  primary.
Why do we need a database?
1.Launch from PeopleSoft (7 or 8) Panels Plug-and-play Perfect fit for PeopleSoft 8.X No modification needed 2.Launch from CS Link Anywhere, anytime Good.
Database Management Supplement 1. 2 I. The Hierarchy of Data Database File (Entity, Table) Record (info for a specific entity, Row) Field (Attribute,
06-1L ASTRO-E2 ASTRO-E2 User Group - 14 February, 2005 Astro-E2 Archive Lorella Angelini/HEASARC.
RPC DQM status Cimmino, M. Maggi, P. Noli, D. Lomidze, P. Paolucci, G. Roselli, C. Carillo.
IST 220 – Intro to Databases Lecture 2 Touring Microsoft Access.
Status of Control Unit Software Cristiano Bozza – 26/8/2015.
Nov 1, 2002D0 DB Taking Stock1 Trigger Database Status and Plans Elizabeth Gallas – FNAL CD (with recent help from Jeremy Simmons, John Weigand, and Adam.
Pixel DQM Status R.Casagrande, P.Merkel, J.Zablocki (Purdue University) D.Duggan, D.Hidas, K.Rose (Rutgers University) L.Wehrli (ETH Zuerich) A.York (University.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
WebDat: A Web-based Test Data Management System J.M.Nogiec January 2007 Overview.
Help – Manual for Uploading the Documents in Online Briefcase.
Channel Archiver Overview Jan Channel Archiver Channel Access client Stores samples in disk files Design target: handle values/sec Documentation,
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
EOVSA Data and Database System J. McTiernan EOVSA Technical DesignMeeting 7-Nov-2011.
DAQ & ConfDB Configuration DB workshop CERN September 21 st, 2005 Artur Barczyk & Niko Neufeld.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
The Database Project a starting work by Arnauld Albert, Cristiano Bozza.
BBmSAM SLA Reporting. Calculating statuses per serviceinstance and keeping all teststatusids (e.g. not just up/down/degraded) and storing in DB SLA –
Module 6 ********* Data Loading Workforce Information Database Training Last update November 2006.
MESA A Simple Microarray Data Management Server. General MESA is a prototype web-based database solution for the massive amounts of initial data generated.
1 Integration of the LCP Reporting Into the E-PRTR Current status and Technical proposal August 4th.
ACCESS FROM C++ CODE TO DATA FROM VALIDATION DB Dmitri Konstantinov, CERN.
L1Calo Databases ● Overview ● Recent Activitity ● To Do List ● Run types Murrough Landon 4 June 2007.
Relational DB for KM3NeT Cristiano Bozza – University of Salerno – Sept 5 th, 2012 Items that should have full documentation Identification of each PMT.
Computing and Software – Calibration Flow Overview
Simulation Production System
IST 220 – Intro to Databases
EIN 6133 Enterprise Engineering
X AND R CHART EXAMPLE IN-CLASS EXERCISE
The DAQ and IT infrastructures of KM3NeT
The Database Environment
Presentation transcript:

Kay Graf Timecalibration Meeting Vidyo, 12/03/2015 Database and Calibration

Storage of Calibration Data in the Database ●See: arameters arameters ●distinction: ● "data streams“ vs. ● "data sets of unique values to be applied for a finite timespan (e.g. structures/objects)“. ●for calibration: mostly second needed ●fits into the already defined „TEST/CALIBRATION/MONITORING“ ●needed information: ● parameters to store (name, SI unit, range, needed accuracy) ● associated products (if any) ● validity span of parameters/update rate (e.g. measured once per year or once per second) ● what are the parameters necessary for (online calibration, offline calibration, information storage) 2

●Product data+calibration tests description ● Basic entity: the «parameter» ● Name ● Type ● Allowed values ● Array/Scalar ● Array dependency ● Basic entity: the «test/calibration/monitoring» (includes factory datasheets) ● Name ● Description ● PBS/Variant of eligible products ● List of parameters ● Parameter list: links a test to the parameters THE KM3NET DATABASE A. Albert, C. Bozza – Valencia, Feb 2015 PRODUCT TESTING AND INFO From: Valencia Coll. Meeting:

●Product data+calibration tests documentation ● Testing operation ● What ● Where ● When ● Who ● How ● OK/FAIL ● Parameter values ● Linked to the «parameter list» ● Linked to the «testing operation» ● NOTICE: Always use International System units (e.g., not mA but A) – can be defined THE KM3NET DATABASE A. Albert, C. Bozza – Valencia, Feb 2015 PRODUCT TESTING AND INFO

●Product data+calibration tests documentation ● Internal test results ● ASCII format for manual upload ● XML/JSON format for automatic upload, see: ● Automatically generated from test definition ● Upload by cURL / wget or other webclients ● Used for DarkBox/GreenBox THE KM3NET DATABASE A. Albert, C. Bozza – Valencia, Feb 2015 PRODUCT TESTING AND INFO

●Product data+calibration tests retrieval ● GUI interface representation ● Automatically generated from parameter definition ● Plots ● Formerly automatically generated ● Now switching to plot definition tables in the DB ● Plot definition retrieval OK ● Javascript/SVG plots OK ● Need some sample data to complete/develop HTML interface ● Programmatic representation ● XML/JSON format identical to the one used for upload ● Direct retrieval of test results for specific UPI ● Use by cURL/wget or other web clients: see THE KM3NET DATABASE A. Albert, C. Bozza – Valencia, Feb 2015 PRODUCT TESTING AND INFO

What needs to be done ●Timecalibration (Mieke’s tables) are in place ● Need to establish the writing/reading ●Other calibration is also partly done - an example (use case) would be needed for everything to be stored ● Definition document is there (but that is not so helpful if you want to implement something) ● C&S group can help but not do the job 7