Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.

Slides:



Advertisements
Similar presentations
Business Development Suit Presented by Thomas Mathews.
Advertisements

July 2010 D2.1 Upgrading strategy Javier Soto Catalog Release 3. Communities.
A Presentation Management System for Collaborative Meetings Krzysztof Wrona (ZEUS) DESY Hamburg 24 March, 2003 ZEUS Electronic Meeting Management System.
SOFTWARE PRESENTATION ODMS (OPEN SOURCE DOCUMENT MANAGEMENT SYSTEM)
Requirements Specification
Web Server Administration
REMODECE MEETING January, the 29th ENERTECH REMODECE Web server Query analyzer Data base software WEB USER Browser Query Answer Database Design.
11 3 / 12 CHAPTER Databases MIS105 Lec14 Irfan Ahmed Ilyas.
EE-Video Yossi Biton Nir Yakobovski Outline  The concept  Main functionality  Challenges & Solutions  Design considerations Layers Class diagram.
How Clients and Servers Work Together. Objectives Learn about the interaction of clients and servers Explore the features and functions of Web servers.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
ACAT 2008 Erice, Sicily WebDat: Bridging the Gap between Unstructured and Structured Data Jerzy M. Nogiec, Kelley Trombly-Freytag, Ruben Carcagno Fermilab,
Tutorial Introduction Fidelity NTSConnect is an innovative Web-based software solution designed for use by customers of Fidelity National Title Insurance.
Drupal Workshop Introduction to Drupal Part 1: Web Content Management, Advantages/Disadvantages of Drupal, Drupal terminology, Drupal technology, directories.
Linux Operations and Administration
Portal and AQAS-Philadelphia University 21-22/6/2011 AVCI Platform in PU Dr. Abdel-Rahman Al-Qawasmi Philadelphia University Director of Computer Center.
A Scalable Application Architecture for composing News Portals on the Internet Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta Famagusta.
Ihr Logo Data Explorer - A data profiling tool. Your Logo Agenda  Introduction  Existing System  Limitations of Existing System  Proposed Solution.
The purpose of this Software Requirements Specification document is to clearly define the system under development, that is, the International Etruscan.
EXtensible Neuroimaging Archive Toolkit (XNAT) Washington University Neuroinformatics Group.
Avalanche Internet Data Management System. Presentation plan 1. The problem to be solved 2. Description of the software needed 3. The solution 4. Avalanche.
Database Technical Session By: Prof. Adarsh Patel.
BZUPAGES.COM Presentation on Content Management System (CMS) Presented to. Sir Ahmad Kareem.
Fundamentals of Database Chapter 7 Database Technologies.
Tutorial 121 Creating a New Web Forms Page You will find that creating Web Forms is similar to creating traditional Windows applications in Visual Basic.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
Public Domain/Open Source Software Evaluation Photo Organizer.
Software Engineering Project: Research Expert Prabhavathi Kumarasamy Joshua Thompson Paul Varcholik University of Central Florida.
SQL Queries Relational database and SQL MySQL LAMP SQL queries A MySQL Tutorial and applications Database Building Assignment.
BEN Architecture Isovera Consulting Feb Internet consulting for non-profits 2 BEN Architecture Diagram.
Online Translation Service Capstone Design Eunyoung Ku Jason Roberts Jennifer Pitts Gregory Woodburn Kim Tran.
LOGO 2 nd Project Design for Library Programs Supervised By Dr: Mohammed Mikii.
AUTOMATION OF WEB-FORM CREATION - KINNERA ANGADI – MS FINAL DEFENSE GUIDANCE BY – DR. DANIEL ANDRESEN.
University of Palestine Faculty of Engineering and Urban planning Software Engineering department Software Engineering Group Project Requirements Project.
CERN - IT Department CH-1211 Genève 23 Switzerland t DB Development Tools Benthic SQL Developer Application Express WLCG Service Reliability.
FlexElink Winter presentation 26 February 2002 Flexible linking (and formatting) management software Hector Sanchez Universitat Jaume I Ing. Informatica.
The Glance Project ATLAS Management January 2012.
Copenhagen, 7 June 2006 Toolkit update and maintenance Anton Cupcea Finsiel Romania.
Department of computer science and engineering Two Layer Mapping from Database to RDF Martin Švihla Research Group Webing Department.
Experts Workshop on the IPT, v. 2, Copenhagen, Denmark The Pathway to the Integrated Publishing Toolkit version 2 Tim Robertson Systems Architect Global.
Okalo Daniel Ikhena Dr. V. Z. Këpuska December 7, 2007.
Relational Database vs. Data Files By Willa Zhu JISAO/UW - PMEL/NOAA March 25, 2005.
A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.
Module 8 : Configuration II Jong S. Bok
12/5/2015 Open Source Technology Toolkit Workshop 1 MediaWiki Pavan Kishore V EnhanceEdu.
1 © Xchanging 2010 no part of this document may be circulated, quoted or reproduced without prior written approval of Xchanging. MOSS Training – UI customization.
Introduction and Principles Web Server Scripting.
Jean-Roch Vlimant, CERN Physics Performance and Dataset Project Physics Data & MC Validation Group McM : The Evolution of PREP. The CMS tool for Monte-Carlo.
MySQL An Introduction Databases 101.
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
8 th Semester, Batch 2009 Department Of Computer Science SSUET.
Sergey Belov, Joint Institute for Nuclear Research, Dubna, Russia Status of the LCG Monte Carlo Data Base(MCDB)
“COLLEGE MANAGEMENT SYSTEM” Presented by: BCA VI SEMESTER.
The Database Project a starting work by Arnauld Albert, Cristiano Bozza.
5/29/2001Y. D. Wu & M. Liu1 Content Management for Digital Library May 29, 2001.
Hydroinformatics Lecture 15: HydroServer and HydroServer Lite The CUAHSI HIS is Supported by NSF Grant# EAR CUAHSI HIS Sharing hydrologic data.
Introduction of Wget. Wget Wget is a package for retrieving files using HTTP and FTP, the most widely-used Internet protocols. Wget is non-interactive,
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
JACoW / SPMS Joint Accelerator Conference Web (JACoW) Site Scientific Program Management System (SPMS) Conference Database Management Software Matt Arena,
EnhanceEdu IIIT-Hyderabad. Agenda What’s a wiki? Comparison with a website Wiki Formatting ‘My’ Page Fun with wiki 2EnhanceEdu, IIIT-Hyderabad.
Database System Concepts and Architecture
Introduction This seminar is intended to give people an overall view of the capabilities of the Scientific Programme Management System (SPMS), to explain.
LCG Monte-Carlo Events Data Base: current status and plans
PHP / MySQL Introduction
Template library tool and Kestrel training
HW7: Database Application
The Re3gistry software and the INSPIRE Registry
Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta
Tutorial 6 PHP & MySQL Li Xu
Presentation transcript:

Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna

Outline Introduction Introduction CMS MCDB – pros and cons CMS MCDB – pros and cons Main features of LCG MCDB Main features of LCG MCDB Main interfaces Main interfaces Technical implementation Technical implementation Current project status Current project status Future plans Future plans

Introduction Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertise Correct Monte Carlo simulation of complicated processes requires rather sophisticated expertise Different physics groups often are in need of the same MC samples Different physics groups often are in need of the same MC samples Public availability of the event files speeds up their validation Public availability of the event files speeds up their validation Central and public location where well- documented event files can be found would be very useful Central and public location where well- documented event files can be found would be very useful

CMS MCDB Advantages Based on web technologies Based on web technologies Stores detailed documentation for each set of event samples Stores detailed documentation for each set of event samples Storing data on AFS let make its easy of access Storing data on AFS let make its easy of access Provide rapid communication between users and experts Provide rapid communication between users and experts Problems Stores parton level events only Stores parton level events only The expected number of physics processes in the database is several hundred (data are stored on AFS so there is a space limitation) The expected number of physics processes in the database is several hundred (data are stored on AFS so there is a space limitation) Cannot serve sophisticated queries owing to it isn’t SQL based Cannot serve sophisticated queries owing to it isn’t SQL based

Main features of LCG MCDB The most important reason to develop LCG MCDB is to expel the restrictions of CMS MCDB An SQL-based database An SQL-based database Wide search abilities Wide search abilities Possibility to keep the events at particle level as well as at partonic level Possibility to keep the events at particle level as well as at partonic level Direct programming interface from LCG collaboration software Direct programming interface from LCG collaboration software Inheritance of all the advantages of the predecessor - CMS MCDB Inheritance of all the advantages of the predecessor - CMS MCDB

General conceptions and terms Event file (sample) – the file containing particle or partonic events Event file (sample) – the file containing particle or partonic events Article – a document describing the set of samples Article – a document describing the set of samples Event data – the events themselves, all the data are stored into event files Event data – the events themselves, all the data are stored into event files Event metadata – information which describes all events in a sample in general (beam description, physics parameters, applied cuts, etc.) Event metadata – information which describes all events in a sample in general (beam description, physics parameters, applied cuts, etc.)

MCDB interfaces Search form Search form Article management (creating, changing, removing) Article management (creating, changing, removing) Downloading sample files Downloading sample files User management (registration, editing profiles, removing) User management (registration, editing profiles, removing) Editing metadata on physical models and parameters Editing metadata on physical models and parameters Moderating articles and user comments on them Moderating articles and user comments on them Application programming interface to allow program- based article creation Application programming interface to allow program- based article creation Comment the articles Comment the articles

Access ways to LCG MCDB End-User Read articles, comments, news Read articles, comments, news Download event files Download event filesAuthor Post articles and upload event files Post articles and upload event files Post news and answer the comments Post news and answer the commentsModerator Manage users profiles Manage users profiles Moderate articles and comments Moderate articles and commentsAdministrator Control the system Control the system Technical database management Technical database management Application software Automatic articles posting and samples upload Automatic articles posting and samples upload

The most common operations with MCDB Users in general 1) Browses articles via the tree view of physics categories 2) Searches by author, title, keywords, physical processes, parameters values, etc. 3) Downloads desired sample after agreement on MCDB License Articles’ authors 1) Uploading event files 2) Completing article with the information that wasn’t not included in the description of an event file

Software selection MySQL (DB management system) + Supported as a standard software in CERN LCG collaboration + Free and open source software + Very fast database operations + Reliable and stable - Doesn’t have good developed DB consistency support Perl (programming language) Stable, cross platform programming language Stable, cross platform programming language Powerful and easy-to-develop Powerful and easy-to-develop Open source software Open source software Has wide choice of free modules for many purposes Has wide choice of free modules for many purposes Apache (web server) Powerful and flexible HTTP server Powerful and flexible HTTP server Highly configurable and extensible with third-part modules Highly configurable and extensible with third-part modules

SQL tables in MCDB Authors Authors Articles Articles Categories Categories Generators and their parameters Generators and their parameters Models and parameters names Models and parameters names Model parameters’ values Model parameters’ values Processes, initial and final states Processes, initial and final states Applied cuts Applied cuts Event files, graph files Event files, graph files and a few other tables

SQL tables structure

Current status of LCG MCDB By now was developed as a preliminary: 1) Design of MCDB web site (available at 1) SQL tables structure 2) Articles and authors management system 3) Users privileges schema

Main Perl modules to create/modify Raw DB access (connection, queries) Raw DB access (connection, queries) Operating with tables (managing users, articles, models, etc.) Operating with tables (managing users, articles, models, etc.) Article authors helper Article authors helper Security check for man-written texts (articles body, user comments, news) Security check for man-written texts (articles body, user comments, news) Logging module Logging module

Further plans for next two months Create or amend all base Perl modules described above Create or amend all base Perl modules described above Make the following interfaces: article posting, articles management and users management Make the following interfaces: article posting, articles management and users management Write detailed documentation and database consistency rules for develores Write detailed documentation and database consistency rules for develores Develop the site mailing system Develop the site mailing system