LOGO The unified database for the fixed target experiment Gertsenberger K. V. Laboratory of High Energy Physics, JINR for collaboration 30 September.

Slides:



Advertisements
Similar presentations
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
Advertisements

March 24-28, 2003Computing for High-Energy Physics Configuration Database for BaBar On-line Rainer Bartoldus, Gregory Dubois-Felsmann, Yury Kolomensky,
Introduction to Databases
Prentice Hall, Database Systems Week 1 Introduction By Zekrullah Popal.
1 Databases in ALICE L.Betev LCG Database Deployment and Persistency Workshop Geneva, October 17, 2005.
File Systems and Databases
1 Introduction The Database Environment. 2 Web Links Google General Database Search Database News Access Forums Google Database Books O’Reilly Books Oracle.
©Silberschatz, Korth and Sudarshan1.1Database System Concepts Chapter 1: Introduction Purpose of Database Systems View of Data Data Models Data Definition.
Attribute databases. GIS Definition Diagram Output Query Results.
Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Databases Chapter 11.
Dr. Kalpakis CMSC 461, Database Management Systems Introduction.
Chapter 1 Introduction to Databases
Information systems and databases Database information systems Read the textbook: Chapter 2: Information systems and databases FOR MORE INFO...
Chapter 4 Database Management Systems. Chapter 4Slide 2 What is a Database Management System (DBMS)?  Database An organized collection of related data.
Database Management Systems (DBMS)
Database Administration Chapter 16. Need for Databases  Data is used by different people, in different departments, for different reasons  Interpretation.
Introduction to Databases and Database Languages
Database Systems: Design, Implementation, and Management Ninth Edition
Chapter 1 Database Systems. Good decisions require good information derived from raw facts Data is managed most efficiently when stored in a database.
October 30, 2008 Extensible Workflow Management for Simmod ESUG32, Frankfurt, Oct 30, 2008 Alexander Scharnweber (DLR) October 30, 2008 Slide 1 > Extensible.
Week 1 Lecture MSCD 600 Database Architecture Samuel ConnSamuel Conn, Asst. Professor Suggestions for using the Lecture Slides.
Database Design - Lecture 1
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
AL-MAAREFA COLLEGE FOR SCIENCE AND TECHNOLOGY INFO 232: DATABASE SYSTEMS CHAPTER 1 DATABASE SYSTEMS (Cont’d) Instructor Ms. Arwa Binsaleh.
IFluka : a C++ interface between Fairroot and Fluka Motivations Design The CBM case: –Geometry implementation –Settings for radiation studies –Global diagnosis.
LOGO Scheduling system for distributed MPD data processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
Introduction: Databases and Database Users
Next Back MAP 3-1 Management Information Systems for the Information Age Copyright 2002 The McGraw-Hill Companies, Inc. All rights reserved Chapter 3 Database.
Chapter 7: Database Systems Succeeding with Technology: Second Edition.
CHAPTER 8: MANAGING DATA RESOURCES. File Organization Terms Field: group of characters that represent something Record: group of related fields File:
1 Welcome: To the second learning sequence “ Data Base (DB) and Data Base Management System (DBMS) “ Recap : In the previous learning sequence, we discussed.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
IFluka : a C++ interface between Fairroot and Fluka Motivations Design The CBM case: –Geometry implementation –Settings for radiation studies –Global diagnosis.
NMED 3850 A Advanced Online Design January 12, 2010 V. Mahadevan.
DATABASE DEVELOPMENT Overview. Definitions A Database is a structured collection of related data (not necessarily electronic) A Relational database is.
Discovering Computers Fundamentals Fifth Edition Chapter 9 Database Management.
DB-based DAQ monitoring and Physics analysis tools Emiliano Barbuto European Emulsion Group (LNGS May 2003)
The european ITM Task Force data structure F. Imbeaux.
Hibernate 3.0. What is Hibernate Hibernate is a free, open source Java package that makes it easy to work with relational databases. Hibernate makes it.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
LOGO PROOF system for parallel MPD event processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
G.Corti, P.Robbe LHCb Software Week - 19 June 2009 FSR in Gauss: Generator’s statistics - What type of object is going in the FSR ? - How are the objects.
Advantage of File-oriented system: it provides useful historical information about how data are managed earlier. File-oriented systems create many problems.
IS 325 Notes for Wednesday August 28, Data is the Core of the Enterprise.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 1 Database Systems.
LOGO Development of the distributed computing system for the MPD at the NICA collider, analytical estimations Mathematical Modeling and Computational Physics.
Database Administration
Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.
Database Systems Database Systems: Design, Implementation, and Management, Rob and Coronel.
Object storage and object interoperability
Copyright (c) 2014 Pearson Education, Inc. Introduction to DBMS.
Database David Forrest. What database? DBMS: PostgreSQL. Run on dedicated Database server at RAL Need to store information on conditions of detector as.
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
MPD Slow Control System historical background, present status and plans D.S. Egorov, R.V. Nagdasev, V.B. Shutov V.B.Shutov /21.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 1 Database Systems.
Level 1-2 Trigger Data Base development Current status and overview Myron Campbell, Alexei Varganov, Stephen Miller University of Michigan August 17, 2000.
Vasilisa Lenivenko Vladimir Palichik (LHEP, JINR ) Alushta, June 2016.
PROOF system for parallel NICA event processing
Current Status of the Geometry Database for the CBM Experiment
CMS High Level Trigger Configuration Management
Database Management System
Database Systems: Design, Implementation, and Management Tenth Edition
Introduction to Database Management System
File Systems and Databases
Metadata The metadata contains
Database Management Systems
Terms: Data: Database: Database Management System: INTRODUCTION
MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management
Presentation transcript:

LOGO The unified database for the fixed target experiment Gertsenberger K. V. Laboratory of High Energy Physics, JINR for collaboration 30 September 2015 NEC’2015 XXV Symposium on Nuclear Electronics and Computing

LOGO experiment 30 September 2015Gertsenberger K.V.2 Baryonic Matter at Nuclotron at extracted Nuclotron beam

LOGO setup The physics program: study of elementary reactions and ‚cold‘ nuclear matter study of the properties of dense nuclear matter with strangeness, in-medium effects hypermatter production hadron femtoscopy 30 September 2015Gertsenberger K.V.3

LOGO facility (technical runs: 22 Feb-15 Mar 2015) 30 September 2015Gertsenberger K.V.4 ToF-400 DCH-1,2 ToF-700 ZDC DCH-1,2 Beams: deuteron (Run 1 and Run 2), carbon (Run 3) Energy: 3.5 GeV/nucleon Targets: carbon, copper, none Detectors: DCH 1, DCH 2, 3 MWPC-MPD, T0+Tr(BC1+BC2+CD+BC3), ToF-400, ToF-700, ZDC, ECAL

LOGO Multiple data of the experiment raw data files, *.root files, parameter data 30 September 2015Gertsenberger K.V. noise channels HTML Text Excel

LOGO The main problems of data storing 6  the data of the experiment is distributed between many subdivisions – it’s difficult to find necessary absent information for the other subdivisions  required information is stored in a lot of files of different types (binary, html, excel, txt and other)  detector mapping (text files) can be corrected but you won’t know about changes and will continue to work with old data  geometry scheme is hand-drawn and can be varied from run to run 30 September 2015Gertsenberger K.V.

LOGO Why should a database system be used? 7 The lacks of the file storing approach:  the usage of multiple files and arbitrary formats (imposed by author), duplication of information in different files lead to data isolation, redundancy and inconsistency  sequential, non-indexed access and search (not efficient)  no mechanism exists for relating data between these files  it’s difficult to access and manipulate the data: one needs some dedicated programs  uncontrolled concurrent access by multiple users often leads to inconsistencies 30 September 2015Gertsenberger K.V.

LOGO The purposes of the unified database for 8  central data storage of the experiment  unified access and data management for all members  correct multi-user data processing  ensuring the actuality of the information being accessed (run parameters, detector geometry and position, technical and calibration data, etc.), data consistency and integrity  excluding the multiple duplication and use of outdated data  automatic backup of the stored data  merging the existing databases to simplify access and administration 30 September 2015Gertsenberger K.V.

LOGO The Simulation database (MySQL) 930 September 2015Gertsenberger K.V. Web interface by Ivan Slepov Event generator: UrQMD, QGSM … File location: NICA cluster

LOGO The Geometry database (PostgreSQL) 1030 September 2015Gertsenberger K.V. The database worked in testing mode with manual data insertion

LOGO Unified database ER-diagram 1130 September 2015Gertsenberger K.V. PostgreSQL implementation

LOGO The data being stored in the database 12  Configuration data is concerned with detector running mode, i.e. voltage settings as well as some programmable parameters for frontends electronics.  Calibration data describes the calibration and the alignment of the different subdetectors. Usually quantities are evaluated by running dedicated offline algorithms.  Parameter data presents the state of detector subsystems. They include a variety of detector settings including the geometry and material definitions.  Algorithm data is used to control the way an algorithm operates. It includes, for example, cuts for selection and production files’ paths. 30 September 2015Gertsenberger K.V.

LOGO BMNRoot software 13  developed for the event simulation, reconstruction and physical analysis of particle collisions with a fixed target registered by the facility  implemented in the programming language C++ based on ROOT and FairRoot environments  has a runtime parameter manager which writes and initializes parameters to (from) ASCII or ROOT files: ASCII file mode is intended for an easy and convenient access to parameters ROOT file mode is a convenient way to have local copies of the parameter data using the binary object streaming mechanism automatically provided by the ROOT  converts the facility geometry from *.geo and *.root subdetector files to result ROOT file used to visualize on the screen 30 September 2015Gertsenberger K.V.

LOGO C++ class database interface (BMNRoot) September 2015 Gertsenberger K.V. Class wrappers for all database tables with many specific functions allow to access and manage the data without SQL statements in the BMNRoot software DbSession – describes sessions (a set of runs) DbShift – contains information about session’s shifts DbRun – run parameters (number, date&time, energy, beam, target, magnet field, file path, etc.) DbDetector – detector dictionary DbMapping, DbMap1dim, DbMap2dim – store detector mapping data DbSessionDetector – the list of detectors in session with link to the mapping DbParameter – parameter dictionary (presented on the previous slide) DbDetectorParameter – values of detector parameters for experiment runs DbRunGeometry – contains geometry as ROOT files in binary format DbSimulationFile – describes a set of generated simulation files The main functions: static: Create[Entity], Get[Entity], Delete[Entity], PrintAll. non-static: Getters and Setters functions, Print.

LOGO “Noise channels” parameter (example) 1530 September 2015Gertsenberger K.V. slot channel run IIStructure* pValues = new IIStructure[32]; AssignIIStructure(pValues, 0, 15, 33, 48); // slot:15, channel:33-48 AssignIIStructure(pValues, 16, 16, 49, 64); // slot:16, channel:49-64 DbDetectorParameter::CreateDetectorParameter(run_number, "DCH", "noise", pValues, 32); DbDetectorParameter* pDetectorParameter = DbDetectorParameter::GetDetectorParameter(run_number, "DCH1", "noise"); if (pDetectorParameter != NULL) { IIStructure* pValues; int element_count = 0; pDetectorParameter->GetIIArray(pValues, element_count); // e.g. print values (slot:channel) for (int i = 0; i < element_count; i++) cout<<pValues[i].int_1<<":"<<pValues[i].int_2<<endl; }

LOGO Additional classes of the database interface September 2015 Gertsenberger K.V. DbConnection serves to open and close connections to the database DbGenerateClasses generates skeleton classes for all tables of the database DbParser parses existing data of the experiment from HTML, Excel and text files, and writes it to the unified database DbGeoConverter converts ROOT files with geometry to the alternative database view DbTangoData gets hardware data from the “slow” control system (Tango) for selected time range (run number), detector and parameter defined by name It includes the following directories: macro/* - ROOT macros for executing the tasks presented by the classes above examples/* - numerous examples of using the class wrappers to work with the database docs/* - database interface documentation

LOGO Using Tango (hardware) data September 2015 Gertsenberger K.V. DbTangoData class gets hardware data from the Tango control system based on MySQL DBMS Main functions of the class: Tango_Data* GetTangoParameter(char* detector_name, char* parameter_name, char* date_start, char* date_end); void PrintData(Tango_Data* parameter, bool isGraphicPresentation = false); (“ZDC”, “PosY”, “ :20”, “ :40”);(“ZDC”, “Vset”, “ :40”, “ :00”); time coordina te time counter ZDC tower number voltage GetTangoParameter

LOGO Web interface of the developed database 1830 September 2015Gertsenberger K.V. Web interface by Ivan Slepov

LOGO The unified database 1930 September 2015Gertsenberger K.V. existing configuration, calibration, parameter and algorithm data (HTML, Excel, TXT) central database simulation database geometry database TSQLServer C++ database interface (connect, SQL I/O) Web interface PHP slow control system Tango DbTangoData class users BMNRoot Postgres, SQL automatic backup raw data processing event reconstruction physical analysis reading and changing data

LOGO  The database was developed based on Postgres DBMS and deployed on the NICA cluster.  The unified database merged the existing databases and included existing data of the first runs from multiple files (HTML, Excel, text).  C++ database interface was implemented as a part of the BMNRoot environment to use it for raw data processing, event reconstruction and physical analysis tasks. It provides the classes and tools to store and access data without SQL statements.  DbTangoData class was developed to get hardware data from the control system – Tango.  Web interface of the database was implemented to simplify reading and changing the data by users.  The developed database is the central data storage of the experiment allowing unified access and data management for all members and correct multi-user data processing, ensuring the actuality, data consistency and integrity of the information, and excluding the multiple duplication.  A future version of the unified database will be used for MPD/NICA experiment Conclusions 2030 September 2015Gertsenberger K.V.

LOGO NEC’2015 XXV Symposium on Nuclear Electronics and Computing