IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut 6.6.06.

Slides:



Advertisements
Similar presentations
JQuery MessageBoard. Lets use jQuery and AJAX in combination with a database to update and retrieve information without refreshing the page. Here we will.
Advertisements

PHP and MySQL Database. Connecting to MySQL Note: you need to make sure that you have MySQL software properly installed on your computer before you attempt.
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Software Bootcamp.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Workshops Oxford September 23rd, 2005.
Reconstruction and Analysis on Demand: A Success Story Christopher D. Jones Cornell University, USA.
1 Configuration Database David Forrest University of Glasgow MICO Meeting 13/10/2008
1 Configuration Database Review David Forrest University of Glasgow RAL :: 1 st June 2009.
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
Structure Commander Technical Presentation. Copyright (C) MCS 2013, All rights reserved. 2 STRUCTURE COMMANDER Introduction Product Overview.
Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.
CVSQL 2 The Design. System Overview System Components CVSQL Server –Three network interfaces –Modular data source provider framework –Decoupled SQL parsing.
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: “DOM MB to Event Builder”
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Computing in IceCube Georges Kohnen, Université de Mons-Hainaut, Belgium for the IceCube Collaboration The IceCube neutrino telescope.
Gnam Monitoring Overview M. Della Pietra, D. della Volpe (Napoli), A. Di Girolamo (Roma1), R. Ferrari, G. Gaudio, W. Vandelli (Pavia) D. Salvatore, P.
Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
ALICE, ATLAS, CMS & LHCb joint workshop on
ATLAS Detector Description Database Vakho Tsulaia University of Pittsburgh 3D workshop, CERN 14-Dec-2004.
A Brief Documentation.  Provides basic information about connection, server, and client.
LAV Software Status Emanuele Leonardi – Tommaso Spadaro Photon Veto WG meeting – 2015/03/24.
V.Sirotenko, July Status of Online Databases Currently there are 2 online Oracle Databases running on d0online cluster: 1.Production DB, d0onprd,
17-Aug-00 L.RistoriCDF Trigger Workshop1 SVT: current hardware status CRNowFinal Hit Finders64242 Mergers31616 Sequencers2312 AMboards4624 Hit Buffers21212.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
STAR Collaboration Meeting, BNL, Feb 2005 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software update L3 display 200 GeV February.
DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.
TRT Offline Software DOE Visit, August 21 st 2008 Outline: oTRT Commissioning oTRT Offline Software Activities oTRT Alignment oTRT Efficiency and Noise.
Tracker Visualization Tool: integration in ORCA Maria S. Mennea, Giuseppe Zito University & INFN Bari, Italy Tracker b-tau Cosmic Challenge preparation.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
Jan 28, 2005Elizabeth_Gallas D0_Trigger_Database 1 D0 Trigger Database Status Elizabeth Gallas Fermilab CD/D0CA Margherita Vittone, Vijay Murthi, and Steve.
Online System Status LHCb Week Beat Jost / Cern 9 June 2015.
RPC DQM status Cimmino, M. Maggi, P. Noli, D. Lomidze, P. Paolucci, G. Roselli, C. Carillo.
IceCube Calibration Overview Kurt Woschnagg University of California, Berkeley MANTS 2009 Berlin, 25 September identical sensors in ultraclean,
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Nov 1, 2002D0 DB Taking Stock1 Trigger Database Status and Plans Elizabeth Gallas – FNAL CD (with recent help from Jeremy Simmons, John Weigand, and Adam.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Configuration database status report Eric van Herwijnen September 29 th 2004 work done by: Lana Abadie Felix Schmidt-Eisenlohr.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut Zeuthen Collaboration Meeting.
LHCb Configuration Database Lana Abadie, PhD student (CERN & University of Pierre et Marie Curie (Paris VI), LIP6.
1 Chapter Overview Monitoring Access to Shared Folders Creating and Sharing Local and Remote Folders Monitoring Network Users Using Offline Folders and.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
14 th IEEE-NPSS Real Time Stockholm - June 9 th 2005 P. F. Zema The GNAM monitoring system and the OHP histogram presenter for ATLAS 14 th IEEE-NPSS Real.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: Implementation Plan.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
The Database Project a starting work by Arnauld Albert, Cristiano Bozza.
 Project Team: Suzana Vaserman David Fleish Moran Zafir Tzvika Stein  Academic adviser: Dr. Mayer Goldberg  Technical adviser: Mr. Guy Wiener.
Status of Detector Characterization a.k.a. Calibration & Monitoring Project Year 2 objectives ( → Mar ‘04) 1. Calibration plan (first draft in March.
D. Elia (INFN Bari)ALICE Offline week / CERN Update on the SPD Offline Domenico Elia in collaboration with H. Tydesjo, A. Mastroserio Overview:
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Distribution of ATLAS Software and configuration data Costin Caramarcu on behalf of ATLAS TDAQ SysAdmins.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
L1Calo Databases ● Overview ● Recent Activitity ● To Do List ● Run types Murrough Landon 4 June 2007.
Online Software Status
Remaining Online SW Tasks
AWS DevOps Engineer - Professional dumps.html Exam Code Exam Name.
Presentation transcript:

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut

Today’s ride… Introduction Database contents Filling the Database, now and in the future Reading from the Database, interaction with offline-software Practical information 2

Introduction MySQL Database, “I3OmDb” Contains / will contain all the non -physics information needed by offline -software, on the SouthPole, on a cluster or on your laptop: –Detector Geometry / Calibration / Status / Run / Monitoring / Trigger… information –Ice Properties –AMANDA information –Different “lookup” tables 3

Introduction The stored information is time -based Records are “stacked” on each other Example: Geometry 4 Time Planned Geometry, whole detector Drilling: only string 21 Better calibrations: only string 21 Drilling: lots of strings 01/200401/200501/2006 “Qualifier” Drilling01/2006 Corr02/2005 Drilling01/2005 Initial D e m o n s t r a t i o n

Geometry tables 5 AMANDA Geometry (recently corrected…) Planned geometry (IceCube + IceTop) Drilling/Installation Season 1 (string 21 and stations 21, 29, 30 and 39) Corrections to these coordinates (from Kurt) Drilling/Installation Season 2 (strings 29, 30, 38, 39, 40, 49, 50, 59 and stations 38, 40, 47, 48, 49, 50, 57, 58, 59, 66, 67, 74) (= most “real” geometry presently available)

IceTop tables 6

AMANDA tables 7 Contents of “old” AMANDA omdb used by Sieglinde

Charge (Calibration) tables 8 from domcal.xml files Updated every few weeks

DOM Configuration tables 9 Updated once per run

DOM Configuration tables There are 64 variables in these table: for 5000 DOMs and 1 run = 1 day, there are 117 million entries for just one year → waaaaaay too much! → Split this table up according to the frequency at which the variables change (once a run, once a year,…) This is one of the cases where input / documentation / coordination is still needed! A

DOM Monitoring table B from Ignacio’s Monitoring files

Trigger tables C Different design: triggers do not all have the same parameters New! Being tested right now…

“Lookup” tables D OMId ↔ (string,tube) for AMANDA DOM Serial number ↔ DOM location (string,tube) DOM Serial number ↔ DOM name/nickname RunId ↔ Run start date/time

Independent tables E IceProperties: Effective Scattering length and Absorption length for different wavelengths (in 10 nm bins), for cos θ = 0.80 and 0.94, and for different depths: Z in 10 m bins (X and Y not (yet) available)

Filling the Database Until recently: filled from (text/.xml) files, database created from scratch each time Since this past Pole season: automatic update of Detector Calibration/Status from DAQ for online use Then, regular synchronization of SouthPole I3OmDb with a reference Database in the northern hemisphere, and overall synchronization with this reference DB F

Using the I3OmDb Database at SouthPole 10 DAQ Offline chain of modules SouthPole version SouthPole I3OmDb fill calibration and detector status information automatically Source modules Other modules … Reference I3OmDb I3Db services To be done: automatic synchronization of Pole and reference DBs (c.f. RevisionId)

Using the Database in offline-software I3Db project in offline-software: new design: not one monolithic piece of code anymore, but –one service for each stream (geometry, calibration, detector status,…) –one database service, responsible for connecting to the Database, retrieving/caching the data,… IceProperties are currently not used in offline-software, thus I3Db does not retrieve this information (yet) 11 I3OmDb Source modules Other modules … I3Db services Physics input I3Db retrieves the information according to the date of the event Offline chain of modules “hot-pluggable” Offline-software V2 soon available!

Practical Information Primary Database server: icedb.umh.ac.be (containing information about the content of the Database and about the I3Db services) Secondary Database Servers: ppemons.umh.ac.be, dbs2.icecube.wisc.edu Database Name: "I3OmDb" Read-only login: username "www“ (> mysql -h "server" -u www) Recommended tools: –MySql Query Browser –MySql Control Center 12

To be done 13 On the database side: –Need to store monitoring information from “human” detector monitoring –Need to store precise status information about the DOMs –Finalize complete DB synchronization –Implement “Garbage” or “Temporary” database? On the software side: –Need to rethink caching process in I3Db –New database services?

This is the end 14