(I) MINOS Data Quality Software. Andy Blake Cambridge University Thursday December 7 th 2006.

Slides:



Advertisements
Similar presentations
Online Monitoring and plane checkout Online monitoring is used at the mine for: –sanity checks - “is everything working” –diagnostics - rates, hot/dead.
Advertisements

Line Efficiency     Percentage Month Today’s Date
Atmospheric Neutrino Software Update Andy Blake Cambridge University Thursday December 7 th 2006.
MDC-II LVL-1 Trigger Khaled Teilab for the MDC Trigger Team.
Data Quality Update. Andy Blake Cambridge University Friday February 23 rd 2007.
Andy Blake Cambridge University Wednesday June 13 th 2007 Combined Atmospheric Analysis: Study of 6 Month’s Data.
Far Detector Data Quality Andy Blake Cambridge University.
Low Level Processing of MINOS Data. Andy Blake Cambridge University Friday March 31 st 2006.
SpillServer and FD neutrino events As part of my CC analysis studies, I have been attempting to isolate beam neutrino candidates in the FD using both scanning.
Atmospheric Neutrino Event Reconstruction Andy Blake Cambridge University June 2004.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
Far Detector Fiducial Volume Studies Andy Blake Cambridge University Saturday February 24 th 2007.
Partially Contained Atmospheric Neutrino Analysis Andy Blake Cambridge University March 2004.
Multiple Muons at the Far Detector Andy Blake Cambridge University Fermilab, December 2006.
CC/NC SEPARATION STUDY Andy Blake Cambridge University Friday February 23 rd 2007.
FD Timing Calibration Status Guardians of the FD timing calibration: –John Chapman, graduation in ~3-6 months. –Andy Blake, renewal of contract (or redundancy!)
Jianchun (JC) Wang, 08/21/99 RICH Electronics and DAQ Chip Carrier Short Cable Transition Board Long Cable Data Board Crate J.C.Wang Syracuse University.
Low Level Processing of MINOS Data. Andy Blake Cambridge University Tuesday June 6 th 2006.
Andy Blake Cambridge University Thursday April 12 th 2007 Towards a Combined Atmospheric Analysis.
CC ANALYSIS STUDIES Andy Blake Cambridge University Fermilab, September 2006.
CFT Calibration Calibration Workshop Calibration Requirements Calibration Scheme Online Calibration databases.
1 ND Online Monitoring Contents: –What is Online Monitoring? –How does it work? –What does it provide? –What are its limitations? –What is the status of.
Reports from DESY Satoru Uozumi (Staying at DESY during Nov 11 – 25) Nov-21 GLDCAL Japan-Korea meeting.
1 HBD Commissioning (II) Itzhak Tserruya HBD group meeting November 28, 2006 Progress from October 3 to November 28, 2006.
Real data reconstruction A. De Caro (University and INFN of Salerno) CERN Building 29, December 9th, 2009ALICE TOF General meeting.
ATLAS Liquid Argon Calorimeter Monitoring & Data Quality Jessica Levêque Centre de Physique des Particules de Marseille ATLAS Liquid Argon Calorimeter.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
17-Aug-00 L.RistoriCDF Trigger Workshop1 SVT: current hardware status CRNowFinal Hit Finders64242 Mergers31616 Sequencers2312 AMboards4624 Hit Buffers21212.
Ckov status David Lange, Doug Wright LLNL May 4, 2004.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
Online (GNAM) and offline (Express Stream and Tier0) monitoring produced results during cosmic/collision runs (Oct-Dec 2009) Shifter and expert level monitoring.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Cross-checking Beam Monitoring Records. Andy Blake, Cambridge University. Data Validation, July minos-doc-7463.
ProjectImpactResourcesDeadlineResourcesDeadline Forecast Plan Time Resources Risk 001xx 002xx 003xx 004xx 005xx 006xx 007xx TotalXX Example 1: Portfolio.
1 MICE Tracker Readout Update Introduction/Overview TriP-t hardware tests AFE IIt firmware development VLSB firmware development Hardware progress Summary.
Online Consumers produce histograms (from a limited sample of events) which provide information about the status of the different sub-detectors. The DQM.
1 HBD Update Itzhak Tserruya DC meeting, May 7, 2008 May7, 2008.
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
Валидация TRT DCS CONDITIONS SERVICE Евгений Солдатов, НИЯУ МИФИ “Physics&Computing in ATLAS” – 22/09/2010.
 offline code: changes/updates, open items, readiness  1 st data taking plans and readiness.
1M. Ellis - MICE Tracker PC - 1st October 2007 Station QA Analysis (G4MICE)  Looking at the same data as Hideyuki, but using G4MICE.  Have not yet had.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Sep14, 2015.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Oct 14, 2013.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Feb 8, 2016.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Dec 9, 2013.
Calorimeter Status Electronics Installation and Commissioning
Jan 2016 Solar Lunar Data.
IT Strategy Roadmap Template
ASPOC Presentation for the CAA Operations Review-1 Klaus Torkar and Harald Jeszenszky IWF/OAW Graz ESTEC, May 2006.
Remaining Online SW Tasks
X5 quasi offline Analysis
Average Monthly Temperature and Rainfall

CMS Pixel Data Quality Monitoring
Gantt Chart Enter Year Here Activities Jan Feb Mar Apr May Jun Jul Aug
Q1 Q2 Q3 Q4 PRODUCT ROADMAP TITLE Roadmap Tagline MILESTONE MILESTONE


Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Q1 Q2 Q3 Q4 PRODUCT ROADMAP TITLE Roadmap Tagline MILESTONE MILESTONE
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Text for section 1 1 Text for section 2 2 Text for section 3 3
Q1 Q2 Q3 Q4 PRODUCT ROADMAP TITLE Roadmap Tagline MILESTONE MILESTONE
Presentation transcript:

(I) MINOS Data Quality Software. Andy Blake Cambridge University Thursday December 7 th 2006

Data Quality Software Andy Blake, Cambridge UniversityData Quality Talk, slide 2 Run selection. – good run lists. CandMorgue package. – “DataQualityReader” module. – “CandDataQuality”, “CandDeadChip” candidates. – “NtpSRDataQuality”, “NtpSRDeadChip” ntuple classes. Detector status (HV/COIL). – “DbuHvFromSingles”, “BfldDbiCoilState” database tables. – “NtpSRDetStatus” ntuple class. Spill server monitoring. – “SpillServerMon” database table. – “NtpSRDataQuality” ntuple class. Summary of Current Data Quality Software:

Run Selection Andy Blake, Cambridge UniversityData Quality Talk, slide 3 Selection of far detector physics data. – Run types 0x301 (physics), 0x4031 (modified physics). – Run must contain >5 minutes data. Data quality checks. – Data should contain one or more “physics-like” events. – Require complete ROP mask (all 16 crates reading out). – Require some period of data with < 20 dead chips. – Check for anomalous snarl or event rates. – Keep track of CRL logs and end of week reports. – Use feedback from physics analyses to refine run lists. [N.B: only remove runs that are entirely bad]. Results currently collated in doc-db #2067. – lists of good runs compiled for Aug 1 st 2003 → Aug 31 st Still working on developing and automating code. – this would be an interesting training ground to learn about the far detector and data, if anybody’s interested in working on this!

Run Selection Results Andy Blake, Cambridge UniversityData Quality Talk, slide 4 ALL RUNS GOOD RUNS RED = some physics runs are rejected after data quality checks. May740 Jun715 Jul Aug742 Sep723 Oct Nov Dec747 Jan Feb621 Mar Apr May Jun742 Jul Aug … ALL RUNS = ALL PHYSICS SUBRUNS (run type 0x301,0x4031, >5 minutes). GOOD RUNS = GOOD PHYSICS SUBRUNS (after all data quality checks). crate 15 out of readout crate 12 out of readout crate 0 out of readout + HV trips many HV trips (a.k.a “long weekend”) (N.B: majority of bad runs occurred with beam off.)

CandMorgue Package Andy Blake, Cambridge UniversityData Quality Talk, slide 5 CandMorgue package contains “DataQualityReader” module which extracts detector and data monitoring information from the raw data. – Module runs at beginning of reconstruction chain. – Watches raw data blocks, stores detector and data monitoring information, and packages it up in “CandDataQualityHandles” (monitoring information includes status of readout, Light Injection info, Spill Server info etc…). – Produces list of “CandDeadChipHandles” detailing each bad channel (channels might be too hot, too cold, busy, in readout error etc…). – Assesses overall data quality for each event. This information is copied to “NtpSRDataQuality” and “NtpSRDeadChip” classes of SR ntuples (these classes are available in the cedar ntuples).

SR Ntuples (I) NtpSRDataQuality Andy Blake, Cambridge UniversityData Quality Talk, slide 6 class NtpSRDataQuality : public TObject { public: Int_t trigsource; // trigger word Int_t trigtime; // trigger time Int_t errorcode; // snarl error code from RawDigitDataBlock Int_t cratemask; // number of crates enabled Int_t pretrigdigits; // number of pre-trigger digits Int_t posttrigdigits; // number of post-trigger digits Int_t snarlmultiplicity; // number of post-trigger digits in detector Int_t spillstatus; // state of SpillServer Int_t spilltype; // type of spill (real, fake etc...) Int_t spilltimeerror; // GPS error from SpillServer Int_t litrigger; // was there a nearby TMPT hit Int_t litime; // time of the TMPT hit Int_t lisubtractedtime; // (TMPT hit time) - (Trigger Time) Int_t lirelativetime; // Abs(LiSubTime) Int_t licalibpoint; // Current LI point Int_t licalibtype; // type of LI Int_t libox; // pulser box number Int_t liled; // LED number Int_t lipulseheight; // pulse height Int_t lipulsewidth; // pulse width Int_t coldchips; // number of cold chips Int_t hotchips; // number of hot chips Int_t busychips; // number of busy chips Int_t readouterrors; // number of readout errors from RawDigits Int_t dataqualityword; // overall quality (CandDataQuality::EDataQuality) ClassDef(NtpSRDataQuality,1) }; LI Info Spill Info Readout Info Raw Digits Trigger Info NtpSRDataQuality ntuple class stores information recorded in CandDataQualityHandles.

SR Ntuples (II) NtpSRDeadChip Andy Blake, Cambridge UniversityData Quality Talk, slide 7 class NtpSRDeadChip : public TObject { public: Int_t channelid; // Channel ID // FarDet: 108*crate+36*varc+6*vmm+3*vaadc+vachip // NearDet: 2560*crate+128*master+16*minder+menu Int_t plane0; // 1st associated plane Int_t plane1; // 2nd associated plane Int_t shield; // veto shield plane (Far Detector) Int_t errorcode; // Error Code Int_t status; // Status (CandDeadChip::EChipStatus) ClassDef(NtpSRDeadChip,1) }; Problem Error Code Plane Number Channel ID NtpSRDeadChip class stores information recorded in CandDeadChipHandles.

HV Status Andy Blake, Cambridge UniversityData Quality Talk, slide 8 DcsUser package contains “DbuHvFromSingles” table definition and “HvStatusFinder” tool to store and look up the HV status. – Summaries of TpSinglesSummaryBlocks contained in raw data. – Filled using FillHvFromSingles module (CandMorgue package). Each database entry contains : – Supermodule. – Number of cold chips. – High Voltage status. Table currently filled for Far Detector up to 1 st September HV status is also stored in “NtpSRDetStatus” branch of SR ntuples, or can be inferred from “NtpSRDataQuality” branch of SR ntuples.

Coil Status [A. Habig] Andy Blake, Cambridge UniversityData Quality Talk, slide 9 DcsUser package contains “BfldDbiCoilState” table definition and “CoilTools” tool to store and look up the coil status. – Summaries of the much larger DCS_MAG_FAR database table. Each database entry contains : – Supermodule. – Coil current – Coil status. Table is filled automatically every night from the raw DCS table. Coil status is also stored in “NtpSRDetStatus” branch of SR ntuples.

Spill Server Status Andy Blake, Cambridge UniversityData Quality Talk, slide 10 SpillTiming package contains “SpillServerMon” table definition and “SpillServerMonFinder” tool to store and look up spill server status. – summaries of SpillServerMonitorBlocks contained in raw data. Each database entry contains: – Spill server status (has spill info been received?). – Spill type (“reported spill” or “fake spill”). – Spill times in Near and Far detector. – GPS error (Near/Far GPS errors combined in quadrature). – Spill window open/close times. SpillServerMon Table currently filled up to 1 st September Important spill server info also stored in NtpSRDataQuality class.

SR Ntuples (III) NtpSRDetStatus Andy Blake, Cambridge UniversityData Quality Talk, slide 11 class NtpSRDetStatus : public TObject { public: // coilstatus is deprecated, used to be filled from BFieldCoilCurrent Short_t coilstatus; //magnetic coil status: -1(rev),0(off/unknown),1(forward) // dcscoilstatus is filled from BfldDbiCoilState, set to // ECoilStatus::kUnknown if table is unavailable for a given validity. Short_t dcscoilstatus; // mag coil status: enum'ed as DcsUser::ECoilStatus Float_t coilcurrent1; // coil current in supermodule 1 Float_t coilcurrent2; // coil current in supermodule 2 // HV status using TP singles info Short_t dbuhvstatus; // -1(unknown), 0(bad), 1(good) Int_t coldchips1; // cold chips in supermodule 1 Int_t coldchips2; // cold chips in supermodule 2 ClassDef(NtpSRDetStatus,3) }; NtpSRDetStatus class stores information from DbuHvFromSingles and BfldDbiCoilState db tables. COIL STATUS HV STATUS

Data Quality Software Model Raw Data Database HV Status from Singles SR Ntupleslive time calculator Spill Server Monitoring Fill DB Coil Status access tools CandMorgue CandDataQualityHandle CandDeadChipHandles Reconstruction Implemented Future Work Andy Blake, Cambridge UniversityData Quality Talk, slide 12 HWDB automation

Summary Andy Blake, Cambridge UniversityData Quality Talk, slide 19 Substantial amount of data quality software now in place. – CandMorgue package extracts information from raw data. – Detector status database tables now created and filled. – Data quality information stored in cedar ntuples. Future Work: – A few refinements will probably be needed as code is exercised. – Need to develop and document run selection code. – Need to automate much of my code. Near detector data. – The data quality code works okay for near detector data but often doesn’t do much – could use input from a near detector expert.

(II) Far Detector Performance Plots Andy Blake Cambridge University Thursday December 7 th 2006

(1) Snarl Rates Andy Blake, Cambridge UniversityData Quality Talk, slide

(2) Hot Chips Andy Blake, Cambridge UniversityData Quality Talk, slide (N.B: Hot Chip = VA chip with singles >2,500 Hz)

(3) Cold Chips Andy Blake, Cambridge UniversityData Quality Talk, slide 17 SM1 SM

(4) GPS Timing Errors Andy Blake, Cambridge UniversityData Quality Talk, slide

Far Detector Live Time (I) Andy Blake, Cambridge UniversityData Quality Talk, slide 19 Calculate total live time by counting up timeframes in selected data. – Do include: all physics data that passes run selection. – Don’t include: any pedestal/cal-inject/special/test data any HV/COIL trips in either super-module. reported spill triggers with GPS error >1  s. – Note: unfortunately this calculation isn’t correlated with beam spills.

Far Detector Live Time (II) Andy Blake, Cambridge UniversityData Quality Talk, slide 20 May 1 st 2005 Jan 1 st 2006Sep 1 st 2006 shutdown beam off “long weekend” HV trips readout, GPS error, HV trips.