Event display monitoring Giuseppe Zito : Infn Bari Italy Beliy Nikita : University of Mons-Hainaut Belgium.

Slides:



Advertisements
Similar presentations
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
Advertisements

O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Usage of the Python Programming Language in the CMS Experiment Rick Wilkinson (Caltech), Benedikt Hegner (CERN) On behalf of CMS Offline & Computing 1.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
Data Quality Monitoring for CMS RPC A. Cimmino, D. Lomidze P. Noli, M. Maggi, P. Paolucci.
Chapter 13 Auditing Information Technology
New Features of APV-SRS-LabVIEW Data Acquisition Program Eraldo Oliveri on behalf of Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer] NYC,
MuonDPG/RPC M. Maggi INFN Bari. DQM tool for the DCS data Control Analysis Tool (CAT) by Cimmino, Lomidze, Paolucci, Polese To 1.Make custom DCS data.
Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
AICT5 – eProject Project Planning for ICT. Process Centre receives Scenario Group Work Scenario on website in October Assessment Window Individual Work.
Data Quality Monitoring of the CMS Tracker
2/10/2000 CHEP2000 Padova Italy The BaBar Online Databases George Zioulas SLAC For the BaBar Computing Group.
CFT Offline Monitoring Michael Friedman. Contents Procedure  About the executable  Notes on how to run Results  What output there is and how to access.
14th IEEE-NPSS Real Time Conference 2005, 8 June Stockholm.
WORK ON CLUSTER HYBRILIT E. Aleksandrov 1, D. Belyakov 1, M. Matveev 1, M. Vala 1,2 1 Joint Institute for nuclear research, LIT, Russia 2 Institute for.
Introduction To Computer System
Craft09 Visual Summary and Efficiency Trackermaps Giuseppe Zito : Infn Bari Italy Giuseppe Zito, Infn Bari.
Offline Tracker DQM Shift Tutorial. 29/19/20152 Tracker Shifts Overview Online Shifts at P5 (3/day for 24 hours coverage) – One Pixel shifter and one.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Multimedia Teaching Tool SimArch V1.0 Faculty of Electronic Engineering University of Nis Serbia.
1 Research Groups : KEEL: A Software Tool to Assess Evolutionary Algorithms for Data Mining Problems SCI 2 SMetrology and Models Intelligent.
Chapter 4 Initial Configuration Tasks. Understanding the Initial Configuration Tasks window Microsoft now provides a new feature, the Initial Configuration.
STAR Analysis Meeting, BNL, Dec 2004 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software and calibration L3 display 200 GeV February.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
Root based event display Dmitry Romanov October 19, 2010.
Tracker data quality monitoring based on event display M.S. Mennea – G. Zito University & INFN Bari - Italy.
Update on the new reconstruction software F. Noferini E. Fermi center INFN CNAF EEE Analysis Meeting - 15/06/20151.
Monitoring of background events in 2010 run Giuseppe Zito 06/11/2015 PFG/MIG Topical meeting on beam background.
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
Commissioning and Operation of the CMS Tracker analogue optical link system at TIF with CMSSW: R.Bainbridge, A.Dos Santos Assis Jesus, K.A.Gill, V. Radicci.
October 8, 2002P. Nilsson, SPD General Meeting1 Paul Nilsson, SPD General Meeting, Oct. 8, 2002 New tools and software updates Test beam analysis Software.
System Construction System Construction is the development, installation and testing of system components.
4 th Workshop on ALICE Installation and Commissioning January 16 th & 17 th, CERN Muon Tracking (MUON_TRK, MCH, MTRK) Conclusion of the first ALICE COSMIC.
VICOMTECH VISIT AT CERN CERN 2013, October 3 rd & 4 th O.COUET CERN/PH/SFT DATA VISUALIZATION IN HIGH ENERGY PHYSICS THE ROOT SYSTEM.
All rights reserved, property and © CAD Computer GmbH & Co.KG 2009.
The CMS Simulation Software Julia Yarba, Fermilab on behalf of CMS Collaboration 22 m long, 15 m in diameter Over a million geometrical volumes Many complex.
Tracker Visualization Tool: integration in ORCA Maria S. Mennea, Giuseppe Zito University & INFN Bari, Italy Tracker b-tau Cosmic Challenge preparation.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
Pixel DQM Status R.Casagrande, P.Merkel, J.Zablocki (Purdue University) D.Duggan, D.Hidas, K.Rose (Rutgers University) L.Wehrli (ETH Zuerich) A.York (University.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Validating CMS event display tools with real data Giuseppe Zito : Infn Bari Italy Beliy Nikita : University of Mons-Hainaut Belgium CHEP'09 17th International.
Notes in preparation by the Torino group Sara BolognesiDT Cosmic Meeting 01/11/2007  MTCC note:  calibration section  DQM section  Internal note about.
Alignment in real-time in current detector and upgrade 6th LHCb Computing Workshop 18 November 2015 Beat Jost / Cern.
DQM for the RPC subdetector M. Maggi and P. Paolucci.
1 Chapter Overview Monitoring Access to Shared Folders Creating and Sharing Local and Remote Folders Monitoring Network Users Using Offline Folders and.
Analysis experience at GSIAF Marian Ivanov. HEP data analysis ● Typical HEP data analysis (physic analysis, calibration, alignment) and any statistical.
1 G4UIRoot Isidro González ALICE ROOT /10/2002.
Testing Physics Examine at D0 FNAL/Univ. of Illinois Soojin Kwon Advisor: Pushpa Bhat (FNAL) 3 July 2002.
Thomas Ruf, CERN EP Experience with C++ and ROOT used in the VX Beam Test Thomas Ruf, CERN, EP  Why? Event structure for VX-data rather complex: raw hits.
CMS TRACKER VISUALISATION TOOLS M.S. MENNEA, a G. ZITO, a A. REGANO a AND I. OSBORNE b a Dipartimento Interateneo di fisica di Bari & INFN sezione di Bari,
Current Status of the Tracking Trigger Software Andrew W. Rose.
OPERATING SYSTEMS (OS) By the end of this lesson you will be able to explain: 1. What an OS is 2. The relationship between the OS & application programs.
TRTViewer: the ATLAS TRT detector monitoring and diagnostics tool 4 th Workshop on Advanced Transition Radiation Detectors for Accelerator and Space Applications.
MONITORING CMS TRACKER CONSTRUCTION AND DATA QUALITY USING A GRID/WEB SERVICE BASED ON A VISUALIZATION TOOL G. ZITO, M.S. MENNEA, A. REGANO Dipartimento.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
RPC Data Certification
MICE event viewer status - Mihailo Savic - CM 45
Tree based validation tool for track reconstruction
Pixel DQM Status & Plans
Maintaining software solutions
Data Quality Monitoring of the CMS Silicon Strip Tracker Detector
Introduction to Operating Systems
CMS Pixel Data Quality Monitoring
DQM for the RPC subdetector
CMS Pixel Data Quality Monitoring
AICT5 – eProject Project Planning for ICT
Information Retrieval and Web Design
Presentation transcript:

Event display monitoring Giuseppe Zito : Infn Bari Italy Beliy Nikita : University of Mons-Hainaut Belgium

Index - Which programs will be available for next CRAFT - Creating a visual report of each run : a procedure to better exploit all available programs. - Apply the procedure to run How fast is this procedure? - Who can do this?

Which programs will be available for next CRAFT There will be three general purpose event display tools available to CMS users: Iguana, Firework and Frog. 1)Iguana has two versions: fully embedded in CMSSW and a light (outside CMSSW) version iSpy(*) 2)Fireworks uses FWLite to optimize event access 3)Frog works completely outside CMSSW like iSpy (*) We will use also the trackermap (a synoptic view of tracker) implemented both in iguana(fully embedded) and outside iguana as a class created, filled and printed without using other CMSSW services, as a root histogram. *In order to work outside CMSSW Frog and iSpy work in parallel with a normal CMSSW task (the Analyzer) that provides the events in a special format.In fact Frog and iSpy are light-weight graphics clients. We will refer to them as “Visualizer”.

General purpose event display tools performance Iguana embedded8 min 30 sec iSpy(*)30 sec Fireworks2 min Frog 30 sec Time to scan 551 events on the same computer with local access from disc to events. For each event we look at a minimum of 3 windows included a 3D window iSpy tested only as a prototype: not yet available in CMS software

Iguana

Fireworks

Frog

Trackermap

Creating a visual report of each run What ? A procedure to systematically study with available programs every run Who? I will start to perform it myself during next CRAFT to validate it. When and where : offline when RECO and DQM T1 results are available Why offline? – online not all events available and resources are scarce How : 4 phases 1)Look to trackermaps and other DQM results to see if unusual features are present that need to be explained. 2)Fast and interactive event selection with a root macro on all files of run. 3)Look at selected events with all three available programs. 4)Write a report

Applying the procedure to run Phase 1) Cluster occupancy shows some strange pattern in barrel: try to explain looking at events.

Phase 2:Selection of interesting events from root files using frogFilter.sh Retrieve file list (using get_files.py) Initialization Processing files Root script applied to each file Run (and dataset)

Phase 2:Selection of interesting events from root files using frogFilter.sh

Phase 3:Looking at selected events

Phase 4) The report :Cluster occupancy completely biased by monster events produced by random electronic noise

Phase 4) The report 1)Pattern in TIB1 and TOB cluster occupancy explained by single monster events. 2)Selection of events with more than 1 tracks OR number of hit modules > 100 shows around 10 "monster events“ per file that completely fill TOB or TIB+TEC+TID 3)These few monster events completely bias cluster occupancy trackermap. If a pattern is present in one of this, it will show up in total trackermap. 4) there are also around (per file) small size "monster events“(a few hundreds of modules interested): the event with maximum number of reconstructed tracks(26) is one of this. These seem to have a random pattern of clusters that doesn’t create any pattern in cluster occupancy.

How fast is this procedure? Running in parallel Selection script,Analyzer and Visualizer, you can look at first events after a few minutes How does it scale to million events runs? Selection script, Analyzer and Visualizer can run in parallel on different computers. The selection script is the bottleneck. Until 1 million events, one or two hours are sufficient. During this time you are in any case busy looking at events. For 10 million events runs it should still be kept to a reasonable time by exploiting parallelism of multicore machines in lxplus (i.e. running more than one selection script on different files of the same dataset). Taking in account that the script uses limited resources this shouldn’t create problems to other users).

Who can do this? Anyone on his graphics enabled computer with a good network connection to lxplus. I can describe the installation and prepare a public installation in Meyrin Control Centre.