Web Data Quality Analysis 1 WEB DATA QUALITY ANALYSIS Jonathan Levell (Summer Student) Working with:

Slides:



Advertisements
Similar presentations
Configuration management
Advertisements

Michigan State University 4/15/ Simulation for Level 2 James T. Linnemann Michigan State University NIU Triggering Workshop October 17, 1997.
Why ROOT?. ROOT ROOT: is an object_oriented frame work aimed at solving the data analysis challenges of high energy physics Object _oriented: by encapsulation,
The FDET DQM System Ian C. Brock FDET Review 13/6/2002.
Status of SICB and Monte Carlo productions Eric van Herwijnen Friday, 2 march 2001.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Online Reconstruction Update Linda R. Coney UCR Mar 25, 2010.
Production Planning Eric van Herwijnen Thursday, 20 june 2002.
Patrick Robbe, LAL Orsay, for the LHCb Collaboration, 16 December 2014
Geant4 Documentation and User Support Geant4 Users Workshop February 2002 Dennis Wright (SLAC)
SYST Web Technologies SYST Web Technologies Installing a Web Server (XAMPP)
Linux Operations and Administration
Zeus Monday Meeting, DESY, The ZEUS Event Store (ZES) How to make the most efficient data selection in ZEUS Ulrich Fricke, DESY, Hamburg.
Managing Software using RPM. ♦ Overview In Linux, Red Hat Package Manager referred as RPM is a tool used for managing software packages and its main function.
Chapter 11-Multimedia Authoring Tools. Overview Introduction to multimedia authoring tools. Types of authoring tools. Cross-platform authoring notes.
ROOT Graphics Release planning – June 2006 See also the Graphics Work Package Program of Work on the web.Graphics Work Package Program of Work.
Zubanov Alexei, 2006 Aug 07 – Sep 28 QtROOT package extension with Coin3D lib.
Marco Cattaneo, 23rd February Status of the software migration  Migration strategy: Where we should be  Status: Where we are  Plans.
JAS3 + AIDA LC Simulations Workshop SLAC 19 th May 2003.
CVS Version Tree Display Richard Thomas Benedict College Supervisor Dr. David J Ritchie Computing Division Fermilab Summer 2003.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Java Root IO Part of the FreeHEP Java Library Tony Johnson Mark Dönszelmann
LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001.
Using JAS3 for LCD Analysis Tony Johnson 20 th May 2003.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
Installation Objectives –to be aware of Unix installation issues Contents –installing the system –options and packages –disk layout –the swapfile –third.
1 Control Software (CAT) Introduction USB Interface implementation Calorimeter Electronics Upgrade Meeting Frédéric Machefert Wednesday 5 th May, 2010.
1 Overview of XSL. 2 Outline We will use Roger Costello’s tutorial The purpose of this presentation is  To give a quick overview of XSL  To describe.
GRID Event display for the HRD D. Protopopescu University of Glasgow, U.K. DESY, Hamburg, May 2005 This presentation will probably involve audience discussion,
Reconstruction Configuration with Python Chris Jones University of Cambridge.
CEBAF The Continuous Electron Beam Accelerating Facility(CEBAF) is the central particle accelerator at JLab. CEBAF is capable of producing electron beams.
CHEP 2013, Amsterdam Reading ROOT files in a browser ROOT I/O IN JAVASCRIPT B. Bellenot, CERN, PH-SFT B. Linev, GSI, CS-EE.
ASP (Active Server Pages) by Bülent & Resul. Presentation Outline Introduction What is an ASP file? How does ASP work? What can ASP do? Differences Between.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
Status of the Bologna Computing Farm and GRID related activities Vincenzo M. Vagnoni Thursday, 7 March 2002.
1 SICBDST and Brunel Migration status and plans. 2 Migration Step 1: SICBMC/SICBDST split  Last LHCb week: Split done but not tested  Software week.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
Postgraduate Computing Lectures PAW 1 PAW: Physicist Analysis Workstation What is PAW? –A tool to display and manipulate data. Learning PAW –See ref. in.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES Andrea Sciabà Hammercloud and Nagios Dan Van Der Ster Nicolò Magini.
JAS and JACO – Status Report Atlas Graphics Group August 2000 Tony Johnson.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
Features of JAS Plots Plots update in real time. Data for plots can be local or remote (use Java RMI to connect to JAS Data Server). Rich variety of styles.
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 13 l Report Writing: Communicating the Results of a Multiple Regression.
1 G4UIRoot Isidro González ALICE ROOT /10/2002.
Evaluation of the Ralice/IcePack Data Analysis Functionality - TWR Feature Extraction as a Test case 1 IceCube Collaboration Meeting March 19-23, 2005.
Thomas Ruf, CERN EP Experience with C++ and ROOT used in the VX Beam Test Thomas Ruf, CERN, EP  Why? Event structure for VX-data rather complex: raw hits.
Online Data Monitoring Framework Based on Histogram Packaging in Network Distributed Data Acquisition Systems Tomoyuki Konno 1, Anatael Cabrera 2, Masaki.
Maite Barroso – WP4 Workshop – 10/12/ n° 1 -WP4 Workshop- Developers’ Guide Maite Barroso 10/12/2002
Analysis Model Zhengyun You University of California Irvine Mu2e Computing Review March 5-6, 2015 Mu2e-doc-5227.
Photon purity measurement on JF17 Di jet sample using Direct photon working Group ntuple Z.Liang (Academia Sinica,TaiWan) 6/24/20161.
1 SLAC simulation workshop, May 2003 Ties Behnke Mokka and LCDG4 Ties Behnke, DESY and SLAC MOKKA: european (france) developed GEANT4 based simulation.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
LHCb Simulation LHCC Computing Manpower Review 3 September 2003 F.Ranjard / CERN.
WEB 434 Week 1 DQ 1 And DQ 2, Summary Check this A+ tutorial guideline at Week-1-DQ-1-and-DQ-2 For more.
Migration of reconstruction and analysis software to C++
Tree based validation tool for track reconstruction
Local database Local testing database seems necessary in current situation A common solution for UCSB/FNAL would be optimal Based in root, ascii file summaries,
CLAS Simulations for the E5 Data Set
And plan for SICBDST retirement
Summary Computing Model SICb Event Model Detector Description
Java Analysis Studio and the hep.lcd classes
LHCb Data Quality Check web. cern
Agenda SICb Session Status of SICb software migration F.Ranjard
Status and plans for bookkeeping system and production tools
MC production plans : 1/08/ /03/2001
Joel Closier Eric van Herwijnen Agnieszka Jacholkowska
Modifications in Gaudi v5 release:
Presentation transcript:

Web Data Quality Analysis 1 WEB DATA QUALITY ANALYSIS Jonathan Levell (Summer Student) Working with: Eric van Herwijnen (EvH) Agnieszka Jacholkowska (AJ)

Web Data Quality Analysis 2 TALK OUTLINE Introduction How is the Data Quality Checking done? What is SICBCHK? What is WDQA? Results Typical Data CERN/MAP Summary

Web Data Quality Analysis 3 Check Data Quality (DQ): During MC and DST production of test data After each detector modification Produce a standalone DQ program which calls checking routines supplied by subdetector groups Provide WDQA package to display and compare sets of histograms for each subdetector

Web Data Quality Analysis 4 SICBMC SICBDST SICBCHK WDQA RAWH DST1/DST2 PostScriptGIFS NTUPLE HTML

Web Data Quality Analysis 5 Fortran Program Separate from SICBMC/SICBDST (package called: SICBCHK) Split into branches for each subdetector Branches maintained individually Latest version installed in September

Web Data Quality Analysis 6 * = JL leaves on 15th September

Web Data Quality Analysis 7 SICBCHK.F UGINIT.FCHKRUN.FUGLAST.F CHKTRIG.F SUANAL.F For each event Initialisation Tidy Up SUCHECK.F Subdetector Routines Miscellaneous Checks

Web Data Quality Analysis 8 Package controlled by.lmac scripts similar to PAW’s.kumac scripts Small Interpreter written in C++ Based on ROOT Converts ntuple files to ROOT files LMAC scripts can call ROOT macros Easy to use Manual currently being written Eventually details in Computing meeting

Web Data Quality Analysis 9 // Conversion to ROOT files. hbookin ~/work/data/ >.hbook file 1 hbookin ~/work/data2/ >.hbook opt nowait outputdir velo ps velo.ps outputdir velo/gifs settitle Event Type: > (Vertex) zone 1 2 set style default plot 1001 set ymax 250 set fillcolor 5 file 1 overlay 1001 // Call standard ROOT macro rootpad fit2gauss.c gifs page1 wait ps close close file 1 close An Example.LMAC script

Web Data Quality Analysis 10

Web Data Quality Analysis 11

Web Data Quality Analysis 12

Web Data Quality Analysis 13

Web Data Quality Analysis 14

Web Data Quality Analysis 15

Web Data Quality Analysis 16

Web Data Quality Analysis 17

Web Data Quality Analysis 18

Web Data Quality Analysis 19

Web Data Quality Analysis 20

Web Data Quality Analysis 21

Web Data Quality Analysis 22

Web Data Quality Analysis 23

Web Data Quality Analysis 24 Are the differences significant?

Web Data Quality Analysis 25 Bigger sample required before real conclusions can be drawn. Differences currently at 3  level Larger sample (500 events) will be requested, if possible with same random seeds. SICBCHK/WDQA still require more work but a new version will be released in mid-September