LHCb Data Quality Check web. cern

Slides:



Advertisements
Similar presentations
31/03/00 CMS(UK)Glenn Patrick What is the CMS(UK) Data Model? Assume that CMS software is available at every UK institute connected by some infrastructure.
Advertisements

Status of SICB and Monte Carlo productions Eric van Herwijnen Friday, 2 march 2001.
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
Production Planning Eric van Herwijnen Thursday, 20 june 2002.
Workload Management Massimo Sgaravatto INFN Padova.
Introduction to the workshop LHCb Generators Tuning Mini Workshop Bucharest 22 nd & 23 rd November 2012 LHCb Generators Tuning Mini Workshop Bucharest.
Marco Cattaneo, 23rd February Status of the software migration  Migration strategy: Where we should be  Status: Where we are  Plans.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
LHCb Applications and GRID Integration Domenico Galli Catania, April 9, st INFN-GRID Workshop.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
Tracking at LHCb Introduction: Tracking Performance at LHCb Kalman Filter Technique Speed Optimization Status & Plans.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001.
G.Corti, P.Robbe LHCb Software Week - 19 June 2009 FSR in Gauss: Generator’s statistics - What type of object is going in the FSR ? - How are the objects.
LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)
LHCb Lausanne Workshop, 21st March /12 Tracking Software for DC’06 E. Rodrigues, NIKHEF LHCb Tracking and Alignment Workshop  To do list, and done.
LHCb-ATLAS GANGA Workshop, 21 April 2004, CERN 1 DIRAC Software distribution A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
Refitting Tracks from DST E. Rodrigues, NIKHEF LHCb Tracking and Alignment Workshop, Lausanne, 8-9th November 2006  Motivations  Step-by-step …  Current.
Simulation Commissioning, Validation, Data Quality A brain dump to prompt discussion Many points applicable to any of LHCb software but some simulation.
Online System Status LHCb Week Beat Jost / Cern 9 June 2015.
Louis Nicolas – LPHE-EPFL T-Alignment: Track Selection December 11, 2006 Track Selection for T-Alignment studies Louis Nicolas EPFL Monday Seminar December.
Root – LHCb Online meeting Eric van Herwijnen Thursday June 14, 2006.
1 SICBDST and Brunel Migration status and plans. 2 Migration Step 1: SICBMC/SICBDST split  Last LHCb week: Split done but not tested  Software week.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
Web Data Quality Analysis 1 WEB DATA QUALITY ANALYSIS Jonathan Levell (Summer Student) Working with:
DIRAC Project A.Tsaregorodtsev (CPPM) on behalf of the LHCb DIRAC team A Community Grid Solution The DIRAC (Distributed Infrastructure with Remote Agent.
Pavel Nevski DDM Workshop BNL, September 27, 2006 JOB DEFINITION as a part of Production.
1 LHCb computing for the analysis : a naive user point of view Workshop analyse cc-in2p3 17 avril 2008 Marie-Hélène Schune, LAL-Orsay for LHCb-France Framework,
CLRC Grid Team Glenn Patrick LHCb GRID Plans Glenn Patrick LHCb has formed a GRID technical working group to co-ordinate practical Grid.
11/01/2012B.Couturier - Core Software Workshop 1 Software Development Infrastructure Main Topics Development tools Build and Release tools Tracking/Management.
Marco Cattaneo, 6-Apr Issues identified in sub-detector OO software reviews Calorimeters:18th February Tracking:24th March Rich:31st March.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
Ghost Identification M. Needham EPFL. Outline Embedding data Matching study  2 /dof study.
Eduardo RodriguesLHCb Collaboration Week, 26th November Studies of Generator-level Selection Eduardo Rodrigues, CERN I. Proposal II. Procedure III.
LHCb Alignment Strategy 26 th September 2007 S. Viret 1. Introduction 2. The alignment challenge 3. Conclusions.
Joe Foster 1 Two questions about datasets: –How do you find datasets with the processes, cuts, conditions you need for your analysis? –How do.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
LHCb Computing 2015 Q3 Report Stefan Roiser LHCC Referees Meeting 1 December 2015.
LHCb Simulation LHCC Computing Manpower Review 3 September 2003 F.Ranjard / CERN.
LHCb computing model and the planned exploitation of the GRID Eric van Herwijnen, Frank Harris Monday, 17 July 2000.
Workload Management Workpackage
MICE Computing and Software
Moving the LHCb Monte Carlo production system to the GRID
DIRAC Production Manager Tools
Migration of reconstruction and analysis software to C++
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Gridifying the LHCb Monte Carlo simulation system
Savannah to Jira Migration
Physical Units Event Data Model Access to MonteCarlo truth
LHCb Software Tutorial
QA tools – introduction and summary of activities
The LHC collider in Geneva
VELO systematics and physics LHCb VELO meeting, CERN, 28 March 2008
Gridifying the LHCb Monte Carlo production system
Simulation and Physics
LHCb Alignment Strategy
Muon Group Software Report
Eric van Herwijnen March 10th 2005
Summary Computing Model SICb Event Model Detector Description
Agenda SICb Session Status of SICb software migration F.Ranjard
First attempt at using WIRED
Status and plans for bookkeeping system and production tools
MC production plans : 1/08/ /03/2001
Joel Closier Eric van Herwijnen Agnieszka Jacholkowska
Production Manager Tools (New Architecture)
Production client status
The LHCb Computing Data Challenge DC06
Presentation transcript:

LHCb Data Quality Check http://lhcb-comp. web. cern

Procedures and Tools for Miriam Gandelman, IF-UFRJ Eric van Herwijnen, CERN

Monte Carlo Production

Distributed Infrastructure with Remote Agent Control DIRAC Distributed Infrastructure with Remote Agent Control Distributed MC production system Production task definition Software installation Job scheduling and monitoring Data Quality checking (with versioning) Automates tasks for local production managers Implemented with software agents

MC production architecture Data Quality service Bookkeeping service Production service Bookkeeping data Data Quality info Get jobs Agent CERN Agent Etc… RIO UFRJ Lyon

Data challenge 1 (59 days during feb – may 2003) Distributed system Data to be checked in different places More than 3 Tbytes produced

Python tools Python tools Checked log files Checked log files Checked log files Checked log files Python tools Production log file (to be checked) Reference tables Rich: Velo 98.09 0.18 Forward 91.57 0.36 Seed 5.49 0.31 Match 1.94 0.17 Upstream 3.3 0.21 Velott 2.38 0.18 Final 98.84 0.13 Number of Events Processed: 49912.0 Number of Ks Selected: 46121.0 Number of Ks per event: 0.924 VeloMonitor INFO Number of VeloClusters / Event VeloMonitor INFO ------------------------------------- TrAnalyse INFO Type Ghosts Bad Chi2 TrAnalyse INFO MC TrAnalyse INFO Velo 556 3.9% 0 0.0% TrAnalyse INFO TrAnalyse INFO Forward 322 6.7% 0 0.0% TrAnalyse INFO Seed 480 11.6% 59 1.4% TrAnalyse INFO Match 66 29.6% 0 0.0% TrAnalyse INFO Upstream 1612 69.5% 9 0.4% TrAnalyse INFO Unique Fwd 322 6.7% 0 0.0% Trigger: Velo 98.09 0.18 Forward 91.57 0.36 Seed 5.49 0.31 Match 1.94 0.17 Upstream 3.3 0.21 Velott 2.38 0.18 Final 98.84 0.13 Number of Events Processed: 49912.0 Number of Ks Selected: 46121.0 Number of Ks per event: 0.924 Tracking: Velo 98.09 0.18 Forward 91.57 0.36 Seed 5.49 0.31 Match 1.94 0.17 Upstream 3.3 0.21 Velott 2.38 0.18 Final 98.84 0.13 Number of Events Processed: 49912.0 Number of Ks Selected: 46121.0 Number of Ks per event: 0.924 Python tools

Production checks: of digitization (Boole) and reconstruction (Brunel) programs identified quality quantities (efficiencies, occupancies) results printed on web page (3 sigma deviations in red) for local managers to check locally produced data for software managers to do basic checks of new versions for physicists in case problems are found during analysis negative results of tests could give an alarm first tests done in production

Hbooks of Checked data Python, C++ New Hbook file To be checked ROOT reference file Reference Web pages Python, C++

Detailed check of new versions of programs: of generation (SICBMC), digitization (Boole) and reconstruction (Brunel) programs check e.g. multiplicities, efficiencies, particle identification use Kolmogorov test to compare (1=good, 0=bad) works (wait for something better) for 1d histograms Geant 4 team developing new tools, will use them when available first (minimal) set of histograms in production need more experience with these comparisons