IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut 15.08.2007 IceCube Software Bootcamp.

Slides:

Advertisements

Similar presentations

T2 PowerPark and SCT Banner

Advertisements

PHP SQL. Connection code:- mysql_connect("server", "username", "password"); Connect to the Database Server with the authorised user and password. Eg $connect.

PHP and MySQL Database. Connecting to MySQL Note: you need to make sure that you have MySQL software properly installed on your computer before you attempt.

1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Workshops Oxford September 23rd, 2005.

Reconstruction and Analysis on Demand: A Success Story Christopher D. Jones Cornell University, USA.

Integrating Learning Resources in to a MLE Paul Hudson Learning Technology Development Unit Learning and Information Services University of Hertfordshire.

Jonathan Voigt University of Michigan Soar Workshop 25

TYPO3 Content Management System College of Natural & Social Sciences Webpage TYPO3 Content Management System College of Natural & Social Sciences Webpage.

Multiple Tiers in Action

Robofest 2001 Online Management System Jim Needham MCS 4833/01 Senior Project Dr. Chan-Jin Chung, Ph.D.

Structure Commander Technical Presentation. Copyright (C) MCS 2013, All rights reserved. 2 STRUCTURE COMMANDER Introduction Product Overview.

Star (Traditional) Database Tasks & MySQL 1. Database Types & Operation Issues 2. Server & Database deployments 3. Tools with MySQL 4. Data definition.

7/19/2004FTPC Review - J. Seyboth1 FTPC Review - Software Janet Seyboth for the FTPC group DAQ Online Calibration Databases Offline Documentation FTPC.

Sys Prog & Scripting - HW Univ1 Systems Programming & Scripting Lecture 15: PHP Introduction.

{ Code Injection Cable Johnson.  Overview  Common Injection Types  Developer Prevention Code Injection.

October 30, 2008 Extensible Workflow Management for Simmod ESUG32, Frankfurt, Oct 30, 2008 Alexander Scharnweber (DLR) October 30, 2008 Slide 1 > Extensible.

AJAX Chat Analysis and Design Rui Zhao CS SPG UCCS.

SOFTWARE & COMPUTING Durga Rajaram MICE PROJECT BOARD Nov 24, 2014.

CLAS12 CalCom Activity CLAS Collaboration Meeting, March 6 th 2014.

SVX Software Overview Sasha Lebedev VTX meeting 09/07/ SVX Software web page:

Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.

M1G Introduction to Database Development 6. Building Applications.

PHP and MySQL by Example COMP YL Professor Mattos.

HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.

Statistics Monitor of SPMSII Warrior Team Pu Su Heng Tan Kening Zhang.

IceCube DAQ Mtg. 10,28-30 IceCube DAQ: “DOM MB to Event Builder”

Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.

MultiLearn toby Escarez ethan Faust jacob Mrozek ji Mun chris Patterson anirudh Srinivas calder Thami.

Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.

Root based event display Dmitry Romanov October 19, 2010.

Computing in IceCube Georges Kohnen, Université de Mons-Hainaut, Belgium for the IceCube Collaboration The IceCube neutrino telescope.

IPortal Bringing your company and your business partners together through customized WEB-based portal software. SanSueB Software Presents iPortal.

Gnam Monitoring Overview M. Della Pietra, D. della Volpe (Napoli), A. Di Girolamo (Roma1), R. Ferrari, G. Gaudio, W. Vandelli (Pavia) D. Salvatore, P.

Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.

ALICE, ATLAS, CMS & LHCb joint workshop on

V.Sirotenko, July Status of Online Databases Currently there are 2 online Oracle Databases running on d0online cluster: 1.Production DB, d0onprd,

17-Aug-00 L.RistoriCDF Trigger Workshop1 SVT: current hardware status CRNowFinal Hit Finders64242 Mergers31616 Sequencers2312 AMboards4624 Hit Buffers21212.

3 Copyright © 2004, Oracle. All rights reserved. Working in the Forms Developer Environment.

Calibrating the first four IceCube strings Kurt Woschnagg, UCB L3 Detector Characterization IceCube Collaboration Meeting, Bartol, March 2004.

Creating a simple database This shows you how to set up a database using PHPMyAdmin (installed with WAMP)

Web Security Lesson Summary ●Overview of Web and security vulnerabilities ●Cross Site Scripting ●Cross Site Request Forgery ●SQL Injection.

Calibrations Accomplishments in PY03 Plans for PY04 Kurt Woschnagg, UCB L3 lead – Detector Characterization.

IceCube Calibration Overview Kurt Woschnagg University of California, Berkeley MANTS 2009 Berlin, 25 September identical sensors in ultraclean,

Online (GNAM) and offline (Express Stream and Tier0) monitoring produced results during cosmic/collision runs (Oct-Dec 2009) Shifter and expert level monitoring.

Nov 1, 2002D0 DB Taking Stock1 Trigger Database Status and Plans Elizabeth Gallas – FNAL CD (with recent help from Jeremy Simmons, John Weigand, and Adam.

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut

TDAQ Experience in the BNL Liquid Argon Calorimeter Test Facility Denis Oliveira Damazio (BNL), George Redlinger (BNL).

Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)

LIGO-G Z Detector Characterization Software Tools K. Riles - University of Michigan 1 Introduction to Detector Characterization Sessions.

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut Zeuthen Collaboration Meeting.

Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.

2.0 PROJECT INITIATION AND PLANNING The initiating and planning are the phase where process or workflow to develop the system will identify and planning.

Overview Web Technologies Computing Science Thompson Rivers University.

IceCube DAQ Mtg. 10,28-30 IceCube DAQ: Implementation Plan.

Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.

ATLAS The ConditionDB is accessed by the offline reconstruction framework (ATHENA). COOLCOnditions Objects for LHC The interface is provided by COOL (COnditions.

The Database Project a starting work by Arnauld Albert, Cristiano Bozza.

Status of Detector Characterization a.k.a. Calibration & Monitoring Project Year 2 objectives ( → Mar ‘04) 1. Calibration plan (first draft in March.

Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.

Luz GUEVARA - Simon CHOLLET INGRID Database Proposal for Database.

MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.

AstroGrid-D Host Monitoring in AstroGrid-D with GRAM-Audit or SGAS based on Usage Records Format S. Braune, F. Breitling, H. Enke AIP.

Web Technologies Computing Science Thompson Rivers University

Working in the Forms Developer Environment

CMS High Level Trigger Configuration Management

PHP / MySQL Introduction

Database Driven Websites

Web Technologies Computing Science Thompson Rivers University

Presentation transcript:

IceCube Offline Database Overview Georges Kohnen Université de Mons-Hainaut IceCube Software Bootcamp

Introduction MySQL Database, “I3OmDb” Contains most of the non-physics information needed by offline- software, on the SouthPole, on a cluster or on your laptop: –Detector Geometry –InIce/IceTopCalibration –Detector/DOM Status and Trigger –Run Information – Monitoring information –Ice Properties –AMANDA and TWR information –Different “lookup” tables –Internal (bookkeeping) tables that keep track of Updates and Revisions Start and End times of records Comments 2

To be done 14 Store monitoring information from “human” detector monitoring Store Verification information (Bad DOM lists,...) Store Flasher data? Implement “Garbage” or “Temporary” database?...

Introduction The stored information is time -based Records are “stacked” on each other Example: Geometry 4 Time Planned Geometry, whole detector Drilling: only string 21 Better calibrations: only string 21 Drilling: lots of strings 01/200401/200501/2006 “Qualifier” Drilling01/2006 Corr02/2005 Drilling01/2005 Initial

Geometry tables 5 AMANDA Geometry Planned geometry (IceCube80 with IceTop) Drilling/Installation Season 1 (string 21 and stations 21, 29, 30 and 39) Corrections to these coordinates (from Kurt) Drilling/Installation Season 2 (strings 29, 30, 38, 39, 40, 49, 50, 59 and stations 38, 40, 47, 48, 49, 50, 57, 58, 59, 66, 67, 74) and Corrections Drilling/Installation Season 3...

Filling the Database Since this Pole Season: automatic update of Run details, Trigger data and Detector Configuration/Status from DAQ on Pole DB for online use Then, regular synchronization of SouthPole I3OmDb with a reference Database in the northern hemisphere, and overall synchronization with this reference DB Manual updates/filling of non-regular data: Geometry, Domcal,... F

Using the I3OmDb Database at SouthPole 10 DAQ PnF / Offline Software on SouthPole SouthPole I3OmDb Fill run, trigger and detector status information automatically Source modules Other modules … Reference I3OmDb I3Db services Automatic synchronization of Pole and reference DBs (c.f. RevisionId)

Using the Database in offline-software I3Db project in offline-software (~11000 lines of code): new design: not one monolithic piece of code anymore, but –one service for each stream (geometry, calibration, detector status,…) –Conversion services (OMKey2MBId, OMNumber2OMKey,...) –one database service, responsible for connecting to the Database, retrieving/caching the data,… 11 I3OmDb Muxer / Modules Other modules … I3Db services Physics input I3Db retrieves the information according to the date of the event Offline chain of modules “hot-pluggable”

Practical Information Primary redundant Database server: icedb.umh.ac.be (also containing information about the content of the Database and about the I3Db services, as well as a public web-interface) Mirrors: ppemons.umh.ac.be, dbs2.icecube.wisc.edu (should be used from the USA) Database Name: "I3OmDb" Read-only login: username "www“ (> mysql -h "server" -u www) Recommended tools for “brute” access: –MySql Query Browser –MySql Control Center 12

Demonstrations 15 4 ways to get info from the database  Python script in IceTray  Stand-alone program (MySQL Query Browser)  Database browser (web interface)  Terminal access (see bootcamp website for small tutorial) Database website with documentation, web interface, status page and this.ppt presentation: