Offline and Monitoring Software for the EMEC+HEC Combined Run Combined Test Beam and LArg Software and Performance 11 September 2002 Rob McPherson University.

Slides:



Advertisements
Similar presentations
MAUS Update Adam Dobbs, MICE Project Board, 16 th April 2015.
Advertisements

June 19, 2002 A Software Skeleton for the Full Front-End Crate Test at BNL Goal: to provide a working data acquisition (DAQ) system for the coming full.
Peter Chochula, January 31, 2006  Motivation for this meeting: Get together experts from different fields See what do we know See what is missing See.
20 Feb LVL1 muon trigger simulation meeting1 the OO codes for endcap muon trigger simulation Hisaya Kurashige KOBE Univ.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Linda R. Coney – 24th April 2009 Online Reconstruction & a little about Online Monitoring Linda R. Coney 18 August, 2009.
1 Analysis code for KEK Test-Beam M. Ellis Daresbury Tracker Meeting 30 th August 2005.
25 July 2005Michel Lefebvre 1 Noise file for EMEC-HEC 2002 data Michel Lefebvre Physics and Astronomy University of Victoria British Columbia, Canada 25.
Overview We succeeded in using Slice Test DAQ code to take test beam data, combining chamber and trigger trackfinder data through an XDAQ Event Builder.
Event Phase Reconstruction Raw TDC Event time used for monitoring Event phase  TBPhaseRec  TBPhase Michel Lefebvre Rob McPherson University of Victoria.
1 G4MICE Malcolm Ellis SciFi Tracker Meeting, KEK Thursday 31st March 2005.
FMS review, Sep FPD/FMS: calibrations and offline reconstruction Measurements of inclusive  0 production Reconstruction algorithm - clustering.
Shuei MEG review meeting, 2 July MEG Software Status MEG Software Group Framework Large Prototype software updates Database ROME Monte Carlo.
Online and offline software overview, status and plans Status and Integration to STAR : Trigger DAQ Monitoring Slow Controls Online Databases Online/Offline/MC.
06/03/06Calice TB preparation1 HCAL test beam monitoring - online plots & fast analysis - - what do we want to monitor - how do we want to store & communicate.
HPS Online Software Discussion Jeremy McCormick, SLAC Status and Plans.
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER Charles Leggett The Athena Control Framework in Production, New Developments and Lessons Learned.
STAR Analysis Meeting, BNL, Dec 2004 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software and calibration L3 display 200 GeV February.
DC12 Commissioning Status GOALS: establish operating conditions, determine initial calibration parameters and measure operating characteristics for the.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
1 Online Calibration of Calorimeter Mrinmoy Bhattacharjee SUNY, Stony Brook Thanks to: D. Schamberger, L. Groer, U. Bassler, B. Olivier, M. Thioye Institutions:
Offline shifter training tutorial L. Betev February 19, 2009.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
JANA and Raw Data David Lawrence, JLab Oct. 5, 2012.
To make ByteStream Data There is a plan that the High Level Trigger (HLT) software uses the offline framework (Athena). HLT group wants to read in ByteStream.
1 xCAL monitoring Yu. Guz, IHEP, Protvino I.Machikhiliyan, ITEP, Moscow.
24/06/03 ATLAS WeekAlexandre Solodkov1 Status of TileCal software.
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
STAR Collaboration Meeting, BNL, Feb 2005 Alexandre A. P. Suaide University of Sao Paulo Slide 1 BEMC software update L3 display 200 GeV February.
October 8, 2002P. Nilsson, SPD General Meeting1 Paul Nilsson, SPD General Meeting, Oct. 8, 2002 New tools and software updates Test beam analysis Software.
Hall-D/GlueX Software Status 12 GeV Software Review III February 11[?], 2015 Mark Ito.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
Slides for Xiaoping. LBNL -- 10/9/09STAR Collaboration Meeting2 STAR TOF Offline Analysis Layout STAR/TOF DAQ GSTAR geant hits GSTAR geant hits geometry.
TB1: Data analysis Antonio Bulgheroni on behalf of the TB24 team.
Results from particle beam tests of the ATLAS liquid argon endcap calorimeters Beam test setup Signal reconstruction Response to electrons  Electromagnetic.
LM Feb SSD status and Plans for Year 5 Lilian Martin - SUBATECH STAR Collaboration Meeting BNL - February 2005.
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
Paul Scherrer Institut 5232 Villigen PSI ROME / / Matthias Schneebeli ROME Collaboration Meeting in Pisa Presented by Matthias Schneebeli.
12 October 2001, M. LefebvreHEC-Athena Tutorial: HEC beam test primer1 HEC Beam Test Primer Production modules of the HEC have been tested in particle.
Why A Software Review? Now have experience of real data and first major analysis results –What have we learned? –How should that change what we do next.
First Look at EMEC Weights using the FFT Algorithm Combined Test Beam Meeting 19 November 2002 Naoko Kanaya & Rob McPherson University of Victoria.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
S t a t u s a n d u pd a t e s Gabriella Cataldi (INFN Lecce) & the group Moore … in the H8 test-beam … in the HLT(Pesa environment) … work in progress.
Paul Scherrer Institut 5232 Villigen PSI ROME / / Matthias Schneebeli ROME Root based Object oriented Midas Extension Presented by Matthias.
Combined HEC/EMEC testbeam data can be read and analyzed within the ATLAS Athena framework A “cookbook” gives an introduction for how to access the data.
General requirements for BES III offline & EF selection software Weidong Li.
Summary of User Requirements for Calibration and Alignment Database Magali Gruwé CERN PH/AIP ALICE Offline Week Alignment and Calibration Workshop February.
M. LefebvreATLAS LAr week, November 19th HEC-EMEC beam test data analysis Filtering weight synchronization and timing issues TDC timing Cubic timing.
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
Overview of PHENIX Muon Tracker Data Analysis PHENIX Muon Tracker Muon Tracker Software Muon Tracker Database Muon Event Display Performance Muon Reconstruction.
Monitoring for the EMEC/HEC Combined Run in August HEC/FCAL/Combined Testbeam Meeting 16 April 2002 Rob McPherson for the UVic group (Fincke, Kanaya, Keeler,
The ATLAS Electromagnetic and Hadronic End-Cap Calorimeter in a Combined Beam Test Tamara Hughes University of Victoria WRNPPC 2004.
M. Lefebvre, 19 June 2003HEC-EMEC beam test geometry1 Nominal Beam Test Coordinate System Let S(x,y,z) be the “nominal beam test” coordinate system  It.
LAr Testbeam Offline Software Status and Plans Combined-Combined TB Meeting 16 June 2003 Rob McPherson University of Victoria.
Overview of EMU Software Rick Wilkinson. Slice Test DAQ We succeeded in using Slice Test DAQ code to take test beam data, combining chamber and trigger.
Test Beam Meeting Monday, January 31, 2000 Fpix1 Calibration Status 1.What we have 2.What to do Monitor Software to use now 1.Current Version 2.Calibration.
Thomas Ruf, CERN EP Experience with C++ and ROOT used in the VX Beam Test Thomas Ruf, CERN, EP  Why? Event structure for VX-data rather complex: raw hits.
Paul Scherrer Institut 5232 Villigen PSI ROME / / Matthias Schneebeli ROME Root based Object oriented Midas Extension Presented by Matthias.
S. Smith LCLS Facility Advisory October 12, Beam Position Monitors Facility Advisory Committee October 12, 2006.
1 Calice TB Review DESY 15/6/06D.R. Ward David Ward Post mortem on May’06 DESY running. What’s still needed for DESY analysis? What’s needed for CERN data.
TRTViewer: the ATLAS TRT detector monitoring and diagnostics tool 4 th Workshop on Advanced Transition Radiation Detectors for Accelerator and Space Applications.
4 Dec., 2001 Software Week Data flow in the LArG Reconstruction software chain Updated status for various reconstruction algorithm LAr Converters and miscellaneous.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
L1Calo Databases ● Overview ● Trigger Configuration DB ● L1Calo OKS Database ● L1Calo COOL Database ● ACE Murrough Landon 16 June 2008.
Online Monitoring : Detector and Performance check
Remaining Online SW Tasks
Overview of CLAS12 Calibration
Tracker Software Status
HEC-EMEC Test Beam Software
HEC Beam Test Software schematic view T D S MC events ASCII-TDS
Presentation transcript:

Offline and Monitoring Software for the EMEC+HEC Combined Run Combined Test Beam and LArg Software and Performance 11 September 2002 Rob McPherson University of Victoria

Rob McPherson2 Overview  Previous testbeams: HEC: Fortran code hec_adc EMEC: C code emtb (also athena version)  For 2002 combined EMEC/HEC run: Use HEC DAQ system for EMEC+HEC data EMEC data: pack compressed mini-ROD data directly into (new) EPIO banks with no modification Want single package handling HEC-ROD and EMEC- MINIROD data hec_adc: do not want to develop legacy fortran code emtb: annoying/difficult (impossible?) for use with HEC-EPIO data format (used also for new EMEC data) Push directly to athena-based system which will use the offline analysis tools

Rob McPherson3 athena HEC+EMEC testbeam tools  LArHECTBCnv (Kanaya): converts EPIO to athena TDS This is the core routine for getting usable data Not all information foreseen in TDS (yet)  LArHECTBPed (Kanaya): calculates pedestals run-by-run Currently done in “pass 1” by user Plan to archive pedestals in database for general use  LArHECTBAna (Kanaya) : offline analysis, produce standard ntuple First priority is to understand calibrations and energy scales  LArHECTBMon (McPherson): runs online to produce simple diagnostic histograms

HEC-EMEC Beam Test Software schematic view (Sep 2002) HEC-EMEC raw beam test data EPIO hec_adc monitoring EPIO-ASCII converter ntuple Root user analysis HEC-EMEC MC GEANT3 ASCII Data file ASCII-TDS converter LArHECTBCnv TDSTDS MC events MC-TDS converter user analysis ATHENA framework hec_adc framework LArHECTBAna LArHECTBPed LArHECTBMon

HEC-EMEC Beam Test Software schematic view (Sep 2002) HEC-EMEC raw beam test data EPIO ntuple Root user analysis LArHECTBCnv (converter service) Athena packages Athena data classes LArHECTBPed LArHECTBMon LArHECTBAna LArTBSignalBuilder LArSimplePolynomial LArPedestalSubtract LArDigitalFiltering LArCalibration LArSignalCorrection LArReadGeometry LArTBStandardNtup TDS LArTBEvent LArTBBeamChambersCont LArTBCalibContainer LArTBEvent LArTBHVDataContainer LArTBInstrument LArTBRun LArTBSlowConrol LArRawEvent LArDigitContainer LArFEB_DataContainer LArHECTBAna LArTBSignalContainer User Analysis not in Athena Athena (sub)Algorithms

Rob McPherson6 Developments and Status (I) Converter  LArHECTBCnv with athena (Kanaya et al.) HEC ROD data in August 2002 run: Complications with byte swapping took ~ 1 day to fix EMEC Mini-ROD data in August 2002 run: Uncompression routines: wrapped EMTB C code Unpacking and mapping routines: Recoded from scratch Many trials using pulser data for unmapping tests  Pulser data  Guess Pattern  Test  Iterate Took about ~ 2 days after start of data taking for valid data for EMEC timing adjustments Plus another ~ 2 days for full unpacking with final mapping Still have problems with EMEC data from corrupted runs (usually results in EMEC data compression problems, not always noticed)

Rob McPherson7 Developments and Status (II) TDS additions LArTBInstrument 4 words containing trigger pattern bits LArTBRun Particle type, Energy, Impact point (X,Y) In principle: available in database, but we did not want to rely on real-time updating/reading for monitoring LArTBChamber Wire number hit (raw data) – for expert diagnostics LArTBSlowCont FEB Temperatures LArTBEvent Need easier “raw” test beam geometry information  Atlas  TestBeam index  TestBeam ( , ,z), ATI connector, calibration line, …  Request: include complete mapping files into TDS

Rob McPherson8 Developments and Status (III) Monitoring  LArHECTBMon (McPherson, Fincke) Accesses all HEC, EMEC, Header, Beam Chamber data Basic set of monitoring histograms for shift crew Runs online from atllinux1-h6 Accesses data via nfs mount to DAQ disk Runs offline from lxplus Accesses data from local copy or directly from castor  Will maintain LArHECTBMon for offline quality control tests and code example  See clear e/  /  in EMEC and  /  in HEC

Rob McPherson9 Eg: 40 GeV e in EMEC

Rob McPherson GeV  in EMEC

Rob McPherson11 Eg: 150 GeV  in EMEC

Rob McPherson12 Eg: 150 GeV  in HEC

Rob McPherson13 Eg: 150 GeV  in HEC

Rob McPherson14 Developments and Status (IV): Analysis  LArHECTBAna with athena (Kanaya, Lefebvre) Cubic “fit” for pulse height and time available (Lefebvre) No digital filtering weights yet for EMEC TDC wrap-around timing changes many times during run Need to put in database Also need cell-to-cell timing calibrations Preliminary energy calibration now available Calibration work in progress (Strizenec, Kanaya) Investigations of timing have shown some problems with the TDC correction Trigger: B1 instead of F1*F2 until run (different WAC) Spikes in TDC distributions (also in Monitoring)  seem to be able to correct offline (Lefebvre)

Rob McPherson15 Pulse timing: good run

Rob McPherson16 Pulse timing: problem run

Rob McPherson17 TDC and Pulse timing … GoodProblem

Rob McPherson18 Plans and Schemes (I)  Started including all run information in database  database name : atlas_test_1   table name : rawrun Run, data filename, particle type, energy, impact point, … Useful place for pedestal filename, calibration files, mapping files, … ??  Access in athena via LArBookkeepingSvc  Some overlap with event header Will use database to indicate good runs, correct mistakes in event header

Rob McPherson19 Plans and Schemes (II)  HEC Calibration: done by Strizenec Uses special runs and data format  EMEC Calibration: the critical issue Uses delay+ramp runs, but standard data format LArHECTBCnv: decodes calibration board information Under study ( Strizenec, Kanaya ) Preliminary ADC  nano-amps available now (Strizenec) Can use nominal nano-amps  GeV for EMEC Need (much?) more work for digital filtering weights One critical issue: Channel-by-channel differences in the correction between calibration and data pulses  TDC (wrap-around) Calibration: Varies throughout run period Maybe correct with pulses? (cubic fit)

Rob McPherson20 Other issues  Data access All data is in castor using paths like /castor/cern.ch/atlas/testbeam/hectestb/2002/aug/run_12972.dat Data is written in EPIO format, put into TDS with LArCnv Staging not always fast (  5 min/file) Need to work on smart prestaging Some institutes may want local data copies athena/gaudi histogramming services terrible … Typical runs 0.1 – 0.5 GBytes each  1000 runs so far (many are junk) Need  1 TByte  50% for complete copy athena not brilliantly fast ~ 1 hour / 20K events on fast Pentium for 2-pass analysis About 3x – 10x slower than fortran hec_adc

Rob McPherson21 Analyzers  Alberta: Cojocaru (PhD) + Vincter  Victoria: Starke (MSc), Ince(MSc) + Fincke,Kanaya,Lefebvre  Others?   should build up a complete list and coordinate effort Especially: compare detector calibrations  Started a web page  And a mailing list  Will keep updated with information and progress More info: