Low Level Processing of MINOS Data. Andy Blake Cambridge University Friday March 31 st 2006.

Slides:



Advertisements
Similar presentations
Kondo GNANVO Florida Institute of Technology, Melbourne FL.
Advertisements

Online Monitoring and plane checkout Online monitoring is used at the mine for: –sanity checks - “is everything working” –diagnostics - rates, hot/dead.
CDF CDF Operations Steve Hahn February 7, 2005 All Experimenters ’ Meeting.
Atmospheric Neutrino Software Update Andy Blake Cambridge University Thursday December 7 th 2006.
Data Quality Update. Andy Blake Cambridge University Friday February 23 rd 2007.
Andy Blake Cambridge University Wednesday June 13 th 2007 Combined Atmospheric Analysis: Study of 6 Month’s Data.
Far Detector Data Quality Andy Blake Cambridge University.
(I) MINOS Data Quality Software. Andy Blake Cambridge University Thursday December 7 th 2006.
SpillServer and FD neutrino events As part of my CC analysis studies, I have been attempting to isolate beam neutrino candidates in the FD using both scanning.
DSP online algorithms for the ATLAS TileCal Read Out Drivers Cristobal Cuenca Almenar IFIC (University of Valencia-CSIC)
Atmospheric Neutrino Event Reconstruction Andy Blake Cambridge University June 2004.
Target Monitoring and Control Current status DAQ card – NI 6254 Analog/Digital card Problems with Linux version drivers Currently reading up to 12 channels.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
Far Detector Fiducial Volume Studies Andy Blake Cambridge University Saturday February 24 th 2007.
Partially Contained Atmospheric Neutrino Analysis Andy Blake Cambridge University March 2004.
Linda R. Coney – 24th April 2009 Online Monitoring and Reconstruction Linda R. Coney 4 June, 2009.
LarTPC Electronics Meeting Current Work at MSU Fermilab Dan Edmunds 23-February-2010.
CC/NC SEPARATION STUDY Andy Blake Cambridge University Friday February 23 rd 2007.
Jianchun (JC) Wang, 08/21/99 RICH Electronics and DAQ Chip Carrier Short Cable Transition Board Long Cable Data Board Crate J.C.Wang Syracuse University.
Low Level Processing of MINOS Data. Andy Blake Cambridge University Tuesday June 6 th 2006.
Andy Blake Cambridge University Thursday April 12 th 2007 Towards a Combined Atmospheric Analysis.
CC ANALYSIS STUDIES Andy Blake Cambridge University Fermilab, September 2006.
CFT Calibration Calibration Workshop Calibration Requirements Calibration Scheme Online Calibration databases.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
L3 Filtering: status and plans D  Computing Review Meeting: 9 th May 2002 Terry Wyatt, on behalf of the L3 Algorithms group. For more details of current.
1 ND Online Monitoring Contents: –What is Online Monitoring? –How does it work? –What does it provide? –What are its limitations? –What is the status of.
PAT-driven Efficiency Measurements and Calculations A. Singh, Amandeep Singh, S. Beri, Pb. University(Chd.)‏ J. Berryhill, K. Misra FermiLab (U.S)
1 S. E. Tzamarias Hellenic Open University N eutrino E xtended S ubmarine T elescope with O ceanographic R esearch Readout Electronics DAQ & Calibration.
Reports from DESY Satoru Uozumi (Staying at DESY during Nov 11 – 25) Nov-21 GLDCAL Japan-Korea meeting.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester April 1, 2013.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester July 8, 2013.
Framework for Raw Data Thomas Kuhr Offline Week 29/06/2004.
1 Online Calibration of Calorimeter Mrinmoy Bhattacharjee SUNY, Stony Brook Thanks to: D. Schamberger, L. Groer, U. Bassler, B. Olivier, M. Thioye Institutions:
ATLAS Liquid Argon Calorimeter Monitoring & Data Quality Jessica Levêque Centre de Physique des Particules de Marseille ATLAS Liquid Argon Calorimeter.
Erik Blaufuss University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
July 19, 2006VLCW-06 Vancouver1 Scint/MAPMT Muon Prototype Operation Robert Abrams Indiana University.
Multistep Runs with ROD Crate DAQ Murrough Landon, QMUL Outline: Overview Implementation Comparison with existing setup Readout Status ModuleServices API.
Dec.11, 2008 ECL parallel session, Super B1 Results of the run with the new electronics A.Kuzmin, Yu.Usov, V.Shebalin, B.Shwartz 1.New electronics configuration.
DAQ Status for cosmic-ray test in RAL Hideyuki Sakamoto MICE Phone meeting 12 th July 2007 Contents Status Setup for cosmic-ray test bench Schedule.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
P. Shanahan Nov 15, 2003 Page 1 MINOS WBS 2.3: Electronics, DAQ and Database Status Accomplishments since May review Near Detector Electronics production.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
Cross-checking Beam Monitoring Records. Andy Blake, Cambridge University. Data Validation, July minos-doc-7463.
1 Calorimeters LED control LHCb CALO meeting Anatoli Konoplyannikov /ITEP/ Status of the calorimeters LV power supply and ECS control Status of.
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
October Test Beam DAQ. Framework sketch Only DAQs subprograms works during spills Each subprogram produces an output each spill Each dependant subprogram.
Event Management. EMU Graham Heyes April Overview Background Requirements Solution Status.
Calorimeter global commissioning: progress and plans Patrick Robbe, LAL Orsay & CERN, 25 jun 2008.
Overview of EMU Software Rick Wilkinson. Slice Test DAQ We succeeded in using Slice Test DAQ code to take test beam data, combining chamber and trigger.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Sep14, 2015.
1 Calice TB Review DESY 15/6/06D.R. Ward David Ward Post mortem on May’06 DESY running. What’s still needed for DESY analysis? What’s needed for CERN data.
The MINER A Operations Report All Experimenters Meeting Howard Budd, University of Rochester Oct 14, 2013.
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
David Lawrence JLab May 11, /11/101Reconstruction Framework -- GlueX Collab. meeting -- D. Lawrence.
SVD FADC Status Markus Friedl (HEPHY Vienna) Wetzlar SVD-PXD Meeting, 5 February 2013.
THIS MORNING (Start an) informal discussion to -Clearly identify all open issues, categorize them and build an action plan -Possibly identify (new) contributing.
Skimming in Zztop Ricardo – SLT meeting.
Rainer Stamen, Norman Gee
CLAS12 Commissioning with Cosmincs
Trigger, DAQ, & Online: Perspectives on Electronics
Bonn Test Station data analysis with PandaRoot
Online Software Status
Remaining Online SW Tasks
CMS Pixel Data Quality Monitoring
ACO & AD DCS Mario Iván Martínez H..
Status of the Calibration
Presentation transcript:

Low Level Processing of MINOS Data. Andy Blake Cambridge University Friday March 31 st 2006

Overview Andy Blake, Cambridge UniversityCandMorgue Package, slide 2 The atmospheric analysis has been using data quality software: – “DcsFilter” package vetoes bad Far Detector data (HV or Coil trips). – “FarDetDataQuality” package calculates detector live time by counting the number of timeframes processed. This package also collates data quality information from raw data and passes it through the framework. This software seems to have performed well! – Analysed >1 year of Far Detector data and published the results! I wanted to develop (+ tidy up!) the software for wider use. – e.g. make it work on the Near Detector + useable for other analyses. I have now committed some new and improved software. – “CandDataQuality” and “CandDeadChip” classes in “CandMorgue” package. – “DataQualityFilter” module in “Filtration” package.

Overview Andy Blake, Cambridge UniversityCandMorgue Package, slide 3 RAW DATA GLOBAL FILTER MODULE DATA QUALITY MODULE LIVE TIME RAW DIGIT DATA BLOCK DATA QUALITY CANDIDATE DATABASE CAND DIGITS DAQSNARL LIGHT INJECTION DAQ MONITOR Design of New Data Quality Software: GLOBAL FILTER MODULE: Pass/Fail data each second based on status of detectors, beam etc… Calculate live time by counting number of timeframes that pass these conditions. DATA QUALITY MODULE: Extract information from raw data blocks and package into a new candidate.

Global Filter Andy Blake, Cambridge UniversityCandMorgue Package, slide 4 Global filter: pass events if a specified set of data quality tests are satisfied (e.g. require that both beam and detector are in a good state). PHYSICS DATA BEAM DETECTOR GOOD PASS / FAIL BAD PASS

Global Filter Andy Blake, Cambridge UniversityCandMorgue Package, slide 5 Filter=0; if( ( !CheckBeam || this->GetBeamStatus(vldc)==1 ) && ( !CheckDetector || this->GetDetectorStatus(vldc)==1 ) ){ Filter=1; } Check the Coil / HV tables: Check the BeamMonSpill table: const BeamMonSpill& BMspill =...; BMSpillAna BMana; BMana.SetSpill(BMspill); BMana.SetTimeDiff(...); return BMana.SelectSpill(); // waiting to be filled (1) Pass or fail events depending on outcome of specified data quality tests:

Live Time Calculation Andy Blake, Cambridge UniversityCandMorgue Package, slide 6 (2) Write out detector and beam status after each second to calculate live time: currentTime=vldc.GetTimeStamp().GetSec(); If( currentTime>Time){ Time=currentTime; this->WriteOutResults(); } ************************************************************************************************************* * TimeFrame * DetectorStatus * BeamStatus * LiveTime * ProtonsOnTarget * CheckBeam * CheckDetector * Filter * ************************************************************************************************************* * 1 * 1 * 1 * 1 * * 0 * 1 * 1 * * 2 * 1 * -1 * 1 * 0 * 0 * 1 * 1 * * 3 * 1 * 1 * 1 * * 0 * 1 * 1 * * 4 * 1 * -1 * 1 * 0 * 0 * 1 * 1 * * 5 * 1 * 1 * 1 * * 0 * 1 * 1 * * 6 * 1 * -1 * 1 * 0 * 0 * 1 * 1 * Output File (Live time = number of entries that pass specified data quality tests) :

Running the Global Filter Andy Blake, Cambridge UniversityCandMorgue Package, slide 7 { gSystem->Load(“libFiltration”); JobC j; j.Path.Create( “reco”, “DataQualityFilter::Ana “ // REST OF RECONSTRUCTION CHAIN // GOES HERE ); j.Path(reco).Mod(“DataQualityFilter”).Set(“FilterOnOff=1”); j.Path(reco).Mod(“DataQualityFilter”).Set(“FilterBadDetector=1”); } Configure filter to veto events when detector is bad Run filter at start of reconstruction

Data Quality Module Andy Blake, Cambridge UniversityCandMorgue Package, slide 8 The “DataQualityModule” runs at beginning of reconstruction chain. The module watches the raw data blocks, extracts the monitoring information, and packages up this information as a new candidate. – It outputs a “CandDataQualityHandle” with each RawDigitDataBlock. A collection of data quality classes are used to process each of the different types of raw data block and extract the useful information. – The data quality objects are member variables of DataQualityModule. – The data quality objects are passed in CandContext to AlgDataQuality which collates all the data quality information. The overall data quality is assessed and a list of “CandDeadChipHandles” is produced detailing each bad chip (hot, cold, busy, in error etc…).

DataQualityModule Andy Blake, Cambridge UniversityCandMorgue Package, slide 9 TIter momitr(mom->GetFragmentIter()); while( momobject = momitr() ){ RawRecord* rawrec = dyanamic_cast (momobject); this->ProcessRawHeader( rawrec->GetRawHeader() ); TIter rawitr = rawrec->GetRawBlockIter(); while( rawobject = rawitr() ){ this->ProcessRawBlock( rawobject ); } These methods pass the raw headers and data blocks to internal data quality objects which extract the data quality information. (1) The Data Quality Module processes the Raw Data Blocks:

DataQualityModule Andy Blake, Cambridge UniversityCandMorgue Package, slide 10 Header Raw Digits Light Injection Hot/Cold Electronics Spill Server DaqSnarlHeader DaqHeaderBlock SnarlHeaderBlock RawDigitDataBlock RawLIAdcSummaryBlock RawLiTpmtDigitsBlock RawTpSinglesSummaryBlock RawSpillServerMonitorBlock Time, Run, Snarl, Timeframe number, Trigger source, Trigger time etc… Number of pre-trigger digits, Number of post-trigger digits, Busy chips, Readout errors. LI time, LI Pulser Box, LED, LI calib type, pulse height etc… Number of crates in readout, Cold chips, Hot chips. Spill type, status etc… Spill GPS error. RAW DATA BLOCKSDATA QUALITY INFO INTERNAL DATA QUALITY OBJECTS

CandDataQuality Andy Blake, Cambridge UniversityCandMorgue Package, slide 11 HeaderRaw Digits Light Injection Hot/Cold Electronics Spill Server AlgDataQuality CandDataQuality (2) Use internal data quality objects to make a CandDataQualityHandle: Collate the data quality info (N.B: some quantities need to be calculated using more than one of the internal data quality objects e.g. the LI time requires the TPMT times along with the snarl trigger time + some chips can be simultaneously hot, busy and in error!)

Int_t GetTime() const; Int_t GetRun() const; Int_t GetSnarl() const; Int_t GetTriggerSource() const; Int_t GetErrorCode() const; // etc... Int_t GetPreTriggerDigits() const; Int_t GetPostTriggerDigits() const; // etc... Int_t GetSpillStatus() const; Int_t GetSpillType() const; Int_t GetSpillTimeError() const; // etc... Int_t GetLiTime() const; Int_t GetLiPulserBox() const; Int_t GetPulserLed() const; // etc... Int_t GetColdChips() const; Int_t GetHotChips() const; Int_t GetBusyChips() const; // etc... CandDataQuality Andy Blake, Cambridge UniversityCandMorgue Package, slide 12 Information from header Information from raw digits Monitoring of spills Monitoring of light injection Monitoring of data quality (3) Here is some information available from the CandDataQualityHandle:

CandDataQuality Andy Blake, Cambridge UniversityCandMorgue Package, slide 13 typedef enum EDataQuality { kOkay = 0x00, kBad = 0x01, kLowMultiplicity = 0x02, kHighMultiplicity = 0x04, kLightInjection = 0x08, kTimeFrameBoundary = 0x10, kManyColdChips = 0x20, kManyHotChips = 0x40, kManyBusyChips = 0x80, kManyReadoutErrors = 0x100 } DataQuality_t < 10 raw digits > 1000 raw digits < 100 microsecs from TPMT hit < 100 microsecs from TF boundary > 20 cold chips > 20 busy chips Only the events with many cold chips, hot chips, busy chips or readout errors are considered bad. (4) The CandDataQuality contains an assessment of the overall data quality:

CandDeadChips Andy Blake, Cambridge UniversityCandMorgue Package, slide 14 typedef enum EChipStatus { kOkay = 0x00, kBad = 0x01, kCold = 0x02, kHot = 0x04, kBusy = 0x08, kError = 0x10 } ChipStatus_t (5) Each CandDataQuality contains a list of “CandDeadChipHandles” These record the details of any bad chips in the detector at the time of the event. < 50 Hz singles > 5000 Hz singles analyse pre-trigger. FAR DETECTORNEAR DETECTOR no definitions yet! stored in raw digits (6) Can ask the CandDataQualityHandle about its CandDeadChipHandles: How many bad chips are there? cdh->GetColdChips(), cdh->GetHotChips() etc. Is a given channel good or bad? cdh->GetChipStatus(RawChannelId rawch) etc.

Running the Data Quality Module Andy Blake, Cambridge UniversityCandMorgue Package, slide 15 { gSystem->Load(“libFiltration”); gSystem->Load(“libCandMorgue”); JobC j; j.Path.Create( “reco”, “DataQualityFilter::Ana “ “DataQualityModule::Reco “ // REST OF RECONSTRUCTION CHAIN // GOES HERE ); j.Path(reco).Mod(“DataQualityFilter”).Set(“FilterOnOff=1”); j.Path(reco).Mod(“DataQualityFilter”).Set(“FilterBadDetector=1”); } run the global filter and data quality module at the start of the reconstruction

Summary Andy Blake, Cambridge UniversityCandMorgue Package, slide 16 The first versions of data quality software are now in CVS. – Supercedes previous software used for the atmospheric analysis. The code will probably require further development. – Design and implementation may need a little tweaking (or a lot!) – Assessment of Near Detector data quality needs work. – Need to add in HV and Coil checks. Hopefully software has now been developed for more wider use.