Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna
Outline Introduction Introduction CMS MCDB – pros and cons CMS MCDB – pros and cons Main features of LCG MCDB Main features of LCG MCDB Main interfaces Main interfaces Technical implementation Technical implementation Current project status Current project status Future plans Future plans
Introduction Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertise Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertise Different physics groups often are in need of the same MC samples Different physics groups often are in need of the same MC samples Public availability of the event files speeds up their validation Public availability of the event files speeds up their validation Central and public location where well- documented event files can be found would be very useful Central and public location where well- documented event files can be found would be very useful
CMS MCDB Advantages Based on web technologies Based on web technologies Stores detailed documentation for each set of event samples Stores detailed documentation for each set of event samples Storing data on AFS let make its easy of access Storing data on AFS let make its easy of access Provide rapid communication between users and experts Provide rapid communication between users and experts Problems Stores parton level events only Stores parton level events only The expected number of physics processes in the database is several hundred (data are stored on AFS so there is a space limitation) The expected number of physics processes in the database is several hundred (data are stored on AFS so there is a space limitation) Cannot serve sophisticated queries owing to it isn’t SQL based Cannot serve sophisticated queries owing to it isn’t SQL based
Main features of LCG MCDB The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDB An SQL-based database An SQL-based database Wide search abilities Wide search abilities Possibility to keep the events at particle level as well as at partonic level Possibility to keep the events at particle level as well as at partonic level Direct programming interface from LCG collaboration software Direct programming interface from LCG collaboration software Inheritance of all the advantages of the predecessor - CMS MCDB Inheritance of all the advantages of the predecessor - CMS MCDB
General conceptions and terms Event file (sample) – the file containing particle or partonic events Event file (sample) – the file containing particle or partonic events Article – a document describing the set of samples Article – a document describing the set of samples Event data – the events themselves, all the data are stored into event files Event data – the events themselves, all the data are stored into event files Event metadata – information which describes all events in a sample in general (beam description, physics parameters, applied cuts, etc.) Event metadata – information which describes all events in a sample in general (beam description, physics parameters, applied cuts, etc.)
MCDB interfaces Search form Search form Article management (creating, changing, removing) Article management (creating, changing, removing) Downloading sample files Downloading sample files User management (registration, editing profiles, removing) User management (registration, editing profiles, removing) Editing metadata on physical models and parameters Editing metadata on physical models and parameters Moderating articles and user comments on them Moderating articles and user comments on them Application programming interface to allow program- based article creation Application programming interface to allow program- based article creation Comment the articles Comment the articles
Access ways to LCG MCDB End-User Read articles, comments, news Read articles, comments, news Download event files Download event filesAuthor Post articles and upload event files Post articles and upload event files Post news and answer the comments Post news and answer the commentsModerator Manage users profiles Manage users profiles Moderate articles and comments Moderate articles and commentsAdministrator Control the system Control the system Technical database management Technical database management Application software Automatic articles posting and samples upload Automatic articles posting and samples upload
The most common operations with MCDB Users in general 1) Browses articles via the tree view of physics categories 2) Searches by author, title, keywords, physical processes, parameters values, etc. 3) Downloads desired sample after agreement on MCDB License Articles’ authors 1) Uploading event files 2) Completing article with the information that wasn’t not included in the description of an event file
Software selection MySQL (DB management system) + Supported as a standard software in CERN LCG collaboration + Free and open source software + Very fast database operations + Reliable and stable - Doesn’t have good developed DB consistency support Perl (programming language) Stable, cross platform programming language Stable, cross platform programming language Powerful and easy-to-develop Powerful and easy-to-develop Open source software Open source software Has wide choice of free modules for many purposes Has wide choice of free modules for many purposes Apache (web server) Powerful and flexible HTTP server Powerful and flexible HTTP server Highly configurable and extensible with third-part modules Highly configurable and extensible with third-part modules
SQL tables in MCDB Authors Authors Articles Articles Categories Categories Generators and their parameters Generators and their parameters Models and parameters names Models and parameters names Model parameters’ values Model parameters’ values Processes, initial and final states Processes, initial and final states Applied cuts Applied cuts Event files, graph files Event files, graph files and a few other tables
SQL tables structure
Current status of LCG MCDB By now was developed as a preliminary: 1) Design of MCDB web site (available at 1) SQL tables structure 2) Articles and authors management system 3) Users privileges schema
Main Perl modules to create/modify Raw DB access (connection, queries) Raw DB access (connection, queries) Operating with tables (managing users, articles, models, etc.) Operating with tables (managing users, articles, models, etc.) Article authors helper Article authors helper Security check for man-written texts (articles body, user comments, news) Security check for man-written texts (articles body, user comments, news) Logging module Logging module
Further plans for next two months Create or amend all base Perl modules described above Create or amend all base Perl modules described above Make the following interfaces: article posting, articles management and users management Make the following interfaces: article posting, articles management and users management Write detailed documentation and database consistency rules for develores Write detailed documentation and database consistency rules for develores Develop the site mailing system Develop the site mailing system