IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut 07.09.2006 Zeuthen Collaboration Meeting.

Slides:



Advertisements
Similar presentations
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
Advertisements

Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Software Bootcamp.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Workshops Oxford September 23rd, 2005.
HLT & Calibration.
Reconstruction and Analysis on Demand: A Success Story Christopher D. Jones Cornell University, USA.
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
Structure Commander Technical Presentation. Copyright (C) MCS 2013, All rights reserved. 2 STRUCTURE COMMANDER Introduction Product Overview.
Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.
Overview SQL Server 2008 Overview Presented by Tarek Ghazali IT Technical Specialist Microsoft SQL Server MVP, MCTS Microsoft Web Development MCP ITIL.
Sys Prog & Scripting - HW Univ1 Systems Programming & Scripting Lecture 15: PHP Introduction.
Upcoming Enhancements to the HST Archive Mark Kyprianou Operations and Engineering Division Data System Branch.
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
HBase A column-centered database 1. Overview An Apache project Influenced by Google’s BigTable Built on Hadoop ▫A distributed file system ▫Supports Map-Reduce.
06/03/06Calice TB preparation1 HCAL test beam monitoring - online plots & fast analysis - - what do we want to monitor - how do we want to store & communicate.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
STAR COLLABORATION MEETING July 2004 Michael DePhillips 1 STAR DBs Near And Long Term Plans.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: “DOM MB to Event Builder”
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.
Andrew S. Budarevsky Adaptive Application Data Management Overview.
Computing in IceCube Georges Kohnen, Université de Mons-Hainaut, Belgium for the IceCube Collaboration The IceCube neutrino telescope.
Gnam Monitoring Overview M. Della Pietra, D. della Volpe (Napoli), A. Di Girolamo (Roma1), R. Ferrari, G. Gaudio, W. Vandelli (Pavia) D. Salvatore, P.
Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
ALICE, ATLAS, CMS & LHCb joint workshop on
ATLAS Detector Description Database Vakho Tsulaia University of Pittsburgh 3D workshop, CERN 14-Dec-2004.
LAV Software Status Emanuele Leonardi – Tommaso Spadaro Photon Veto WG meeting – 2015/03/24.
V.Sirotenko, July Status of Online Databases Currently there are 2 online Oracle Databases running on d0online cluster: 1.Production DB, d0onprd,
17-Aug-00 L.RistoriCDF Trigger Workshop1 SVT: current hardware status CRNowFinal Hit Finders64242 Mergers31616 Sequencers2312 AMboards4624 Hit Buffers21212.
Clara Gaspar, March 2005 LHCb Online & the Conditions DB.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
3 Copyright © 2004, Oracle. All rights reserved. Working in the Forms Developer Environment.
Standard Candle, Flasher, and Cascade Simulations in IceCube Michelangelo D’Agostino UC Berkeley PSU Analysis Meeting June 21-24, 2006.
Calibrating the first four IceCube strings Kurt Woschnagg, UCB L3 Detector Characterization IceCube Collaboration Meeting, Bartol, March 2004.
David Seckel, IceTop Baseline Review, Madison, Dec. 4, 2003 IceTop Baseline Review Dec. 4, Madison WI.
IceCube Calibration Overview Kurt Woschnagg University of California, Berkeley MANTS 2009 Berlin, 25 September identical sensors in ultraclean,
Development of the CMS Databases and Interfaces for CMS Experiment: Current Status and Future Plans D.A Oleinik, A.Sh. Petrosyan, R.N.Semenov, I.A. Filozova,
Nov 1, 2002D0 DB Taking Stock1 Trigger Database Status and Plans Elizabeth Gallas – FNAL CD (with recent help from Jeremy Simmons, John Weigand, and Adam.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut
Database David Forrest. What database? DBMS: PostgreSQL. Run on dedicated Database server at RAL Need to store information on conditions of detector as.
LHCb Configuration Database Lana Abadie, PhD student (CERN & University of Pierre et Marie Curie (Paris VI), LIP6.
1 Configuration Database David Forrest University of Glasgow RAL :: 31 May 2009.
Module 5: Managing Content. Overview Publishing Content Executing Reports Creating Cached Instances Creating Snapshots and Report History Creating Subscriptions.
Database Issues Peter Chochula 7 th DCS Workshop, June 16, 2003.
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: Implementation Plan.
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
Log Shipping, Mirroring, Replication and Clustering Which should I use? That depends on a few questions we must ask the user. We will go over these questions.
ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.
E-Soft Hotel Management System Everise Technology Sdn. Bhd.
The Database Project a starting work by Arnauld Albert, Cristiano Bozza.
Retele de senzori Curs 1 - 1st edition UNIVERSITATEA „ TRANSILVANIA ” DIN BRAŞOV FACULTATEA DE INGINERIE ELECTRICĂ ŞI ŞTIINŢA CALCULATOARELOR.
Status of Detector Characterization a.k.a. Calibration & Monitoring Project Year 2 objectives ( → Mar ‘04) 1. Calibration plan (first draft in March.
D. Elia (INFN Bari)ALICE Offline week / CERN Update on the SPD Offline Domenico Elia in collaboration with H. Tydesjo, A. Mastroserio Overview:
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
L1Calo Databases ● Overview ● Recent Activitity ● To Do List ● Run types Murrough Landon 4 June 2007.
15 May 2012NA61 Collaboration Meeting, Budapest1 Shine: status and plans András László, for the Shine Group.
Computing and Software – Calibration Flow Overview
Working in the Forms Developer Environment
Remaining Online SW Tasks
HLT & Calibration.
Tapping the Power of Your Historical Data
Presentation transcript:

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut Zeuthen Collaboration Meeting

Today’s ride… Introduction Database contents Filling/Updating the Database, now and in the future Reading from the Database, interaction with offline-software Practical information New features this year To do 2

Introduction MySQL Database, “I3OmDb” Contains / will contain most of the non-physics information needed by offline-software, on the SouthPole, on a cluster or on your laptop: –Detector Geometry / Calibration / Status / Run / Monitoring / Trigger… information –Ice Properties –AMANDA information –Different “lookup” tables 3

Introduction The stored information is time -based Records are “stacked” on each other Example: Geometry 4 Time Planned Geometry, whole detector Drilling: only string 21 Better calibrations: only string 21 Drilling: lots of strings 01/200401/200501/2006 “Qualifier” Drilling01/2006 Corr02/2005 Drilling01/2005 Initial

Geometry tables 5 AMANDA Geometry (recently corrected…) Planned geometry (IceCube + IceTop) Drilling/Installation Season 1 (string 21 and stations 21, 29, 30 and 39) Corrections to these coordinates (from Kurt) Drilling/Installation Season 2 (strings 29, 30, 38, 39, 40, 49, 50, 59 and stations 38, 40, 47, 48, 49, 50, 57, 58, 59, 66, 67, 74) (= most “real” geometry presently available)

IceTop tables 6

AMANDA tables 7 Contents of “old” AMANDA omdb used by Sieglinde

Charge (Calibration) tables 8 from domcal.xml files Updated after domcal runs every few weeks/months Very large sets of data (~100 MB per run for 9 strings)!

DOM Configuration (Detector Status) tables 9 Updated once per run Indexed by ConfigId

DOM Monitoring table A Under work, need to include post-monitoring results

Trigger tables B Different design: triggers do not all have the same parameters NEW!

“Lookup” tables C OMId ↔ (string,tube) for AMANDA DOM Serial number ↔ DOM location (string,tube) DOM Serial number ↔ DOM name/nickname RunId ↔ Run start date/time

Independent tables D IceProperties: Effective Scattering length and Absorption length for different wavelengths (in 10 nm bins), for cos θ = 0.80 and 0.94, and for different depths: Z in 10 m bins (X and Y not (yet) available)

Internal tables E Set of tables that keep track of Updates / Revisions Start and End dates of records Comments

Filling the Database Until recently: filled from (text/.xml) data files, database created from scratch each time Since this year: automatic update of Run details, Trigger data and Detector Configuration/Status from DAQ on Pole DB for online use Then, regular synchronization of SouthPole I3OmDb with a reference Database in the northern hemisphere, and overall synchronization with this reference DB Manual updates/filling of non-regular data: Geometry, Domcal,... F

Using the I3OmDb Database at SouthPole 10 DAQ PnF / Offline Software on SouthPole SouthPole I3OmDb Fill run, trigger and detector status information automatically Source modules Other modules … Reference I3OmDb I3Db services In testing now: automatic synchronization of Pole and reference DBs (c.f. RevisionId)

Using the Database in offline-software I3Db project in offline-software: new design: not one monolithic piece of code anymore, but –one service for each stream (geometry, calibration, detector status,…) –one database service, responsible for connecting to the Database, retrieving/caching the data,… IceProperties are currently not used in offline-software, thus I3Db does not retrieve this information (yet) 11 I3OmDb Source modules Other modules … I3Db services Physics input I3Db retrieves the information according to the date of the event Offline chain of modules “hot-pluggable” I3Db Parameters

Practical Information Primary redundant Database server: icedb.umh.ac.be (also containing information about the content of the Database and about the I3Db services, as well as a public web-interface  DEMONSTRATION ) Mirrors: ppemons.umh.ac.be, dbs2.icecube.wisc.edu (should be used from the USA) Database Name: "I3OmDb" Read-only login: username "www“ (> mysql -h "server" -u www) Recommended tools for “brute” access: –MySql Query Browser –MySql Control Center 12

New features this year 13 On the database side: –Trigger storage tables –Continuous update of detector and trigger on SouthPole (each run) On the software side: –I3Db turned into a set of services –Reconnection to DB in case of problem

To be done 14 On the database side: –Store monitoring information from “human” detector monitoring –Store precise status information about the DOMs –Store TWR data –Store Flasher data –Finalize complete DB synchronization –Implement “Garbage” or “Temporary” database? On the software side: –Need to rethink caching process in I3Db –New database services?

This is the end 15 Questions?...?