1 23.July 2012Jörn Adamczewski-Musch TRB / HADAQ plug-ins for DABC and Go4 Jörn Adamczewski-Musch GSI, Experiment Electronics: Data Processing group EE-meeting,

Slides:



Advertisements
Similar presentations
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2004 Go4 v2.8 Analysis Design.
Advertisements

GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC GNAM and OHP: Monitoring Tools for the ATLAS Experiment at LHC M. Della Pietra, P. Adragna,
Slice Test DAQ. Two Systems Underway There are essentially two systems being designed concurrently: Trackfinder test, and EMU slicetest. Goals of the.
June 19, 2002 A Software Skeleton for the Full Front-End Crate Test at BNL Goal: to provide a working data acquisition (DAQ) system for the coming full.
April 2006Jean-Sébastien GraulichSlide 1 DAQ Status o Goal for BTF o Status o First results o To be done.
Workshop Goals MICE Controls and Monitoring Workshop September 25, 2006 A. Bross.
CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport.
DABCDABC D ata A cquisition B ackbone C ore RT2010 J.Adamczewski-Musch, H.G.Essel, S.Linev 1 Data Acquisition Backbone Core Framework.
Data Acquisition Software for CMS HCAL Testbeams Jeremiah Mans Princeton University CHEP2003 San Diego, CA.
New Features of APV-SRS-LabVIEW Data Acquisition Program Eraldo Oliveri on behalf of Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer] NYC,
Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Use of ROOT in the D0 Online Event Monitoring System Joel Snow, D0 Collaboration, February 2000.
Feb. 19, 2015 David Lawrence JLab Counting House Operations.
24/03/2011P.-A. Loizeau – Univ. Heidelberg The CBM Time of Flight wall electronic readout chain Pierre-Alain Loizeau PI – Uni Heidelberg DPG 2011, Münster.
Data Acquisition Backbone Core DABC J. Adamczewski, H.G. Essel, N. Kurz, S. Linev GSI, Darmstadt The new Facility for Antiproton and Ion Research at GSI.
D ata A cquisition B ackbone C ore J.Adamczewski, H.G.Essel, N.Kurz, S.Linev 1 Work supported by EU.
Online Data Challenges David Lawrence, JLab Feb. 20, /20/14Online Data Challenges.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Boosting Event Building Performance Using Infiniband FDR for CMS Upgrade Andrew Forrest – CERN (PH/CMD) Technology and Instrumentation in Particle Physics.
TRIGGER-LESS AND RECONFIGURABLE DATA ACQUISITION SYSTEM FOR POSITRON EMISSION TOMOGRAPHY Grzegorz Korcyl 2013.
ETRAX CRIS architecture and Xilinx FPGA Peter Zumbruch Experiment control systems group GSI (KS/EE)
IceCube DAQ Mtg. 10,28-30 IceCube DAQ: “DOM MB to Event Builder”
DABCDABC D ata A cquisition B ackbone C ore J.Adamczewski, H.G.Essel, N.Kurz, S.Linev 1 Work supported.
D ata A cquisition B ackbone C ore DABCDABC , Huelva J.Adamczewski, H.G.Essel, N.Kurz, S.Linev 1 Work.
Frank Lemke DPG Frühjahrstagung 2010 Time synchronization and measurements of a hierarchical DAQ network DPG Conference Bonn 2010 Session: HK 70.3 University.
DABCDABC J. Adamczewski-Musch, H.G. Essel, S. Linev Software development for CBM DAQ J. Adamczewski-Musch, H.G. Essel, S.
THttpServer for ROOT Bertrand Bellenot, CERN Sergey Linev, GSI Darmstadt
Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
Data Acquisition Backbone Core J. Adamczewski-Musch, N. Kurz, S. Linev GSI, Experiment Electronics, Data processing group.
Overview of DAQ at CERN experiments E.Radicioni, INFN MICE Daq and Controls Workshop.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 Parallel - DAQ Status, Emlyn Corrin, 8 Oct 2007 EUDET Annual Meeting, Palaiseau, Paris DAQ Status.
Developments and applications of DAQ framework DABC v2 Jörn Adamczewski-Musch, Nikolaus Kurz, Sergey Linev GSI / Experiment Electronic.
DABCDABC D ata A cquisition B ackbone C ore J.Adamczewski, H.G.Essel, N.Kurz, S.Linev 1 Work supported by EU RP6 project.
Simulations and Software CBM Collaboration Meeting, GSI, 17 October 2008 Volker Friese Simulations Software Computing.
Status DAQ Walter F.J. Müller, GSI, Darmstadt for the CBM Collaboration 14 th CBM Collaboration Meeting Friday, 9 October 2009.
18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.
Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev ROOT 2002 GSI Online Offline Object Oriented Go4.
Online Monitoring for the CDF Run II Experiment T.Arisawa, D.Hirschbuehl, K.Ikado, K.Maeshima, H.Stadie, G.Veramendi, W.Wagner, H.Wenzel, M.Worcester MAR.
GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GGO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4G.
MICE CM28 Oct 2010Jean-Sebastien GraulichSlide 1 Detector DAQ o Achievements Since CM27 o DAQ Upgrade o CAM/DAQ integration o Online Software o Trigger.
DABCDABC ROC-based DAQ: latest developments and perspectives Jörn Adamczewski-Musch, Hans G. Essel, Sergey Linev GSI, Experiment Electronics: Data Processing.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
Status & development of the software for CALICE-DAQ Tao Wu On behalf of UK Collaboration.
MMDAQ Content – Overview – Case study – adding support for VMM1 chips – Drawings (data flow, concurrency, error reporting, scalability, monitoring) 13.
Management of the LHCb DAQ Network Guoming Liu *†, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
Event Management. EMU Graham Heyes April Overview Background Requirements Solution Status.
1 DAQ.IHEP Beijing, CAS.CHINA mail to: The Readout In BESIII DAQ Framework The BESIII DAQ system consists of the readout subsystem, the.
Grzegorz Korcyl - Jagiellonian University, Kraków Grzegorz Korcyl – PANDA TDAQ Workshop, Giessen April 2010.
Flexible data transport for the online reconstruction in FairRoot Mohammad Al-Turany Dennis Klein Anar Manafov Alexey Rybalchenko 6/25/13M. Al-Turany,
David Lawrence JLab May 11, /11/101Reconstruction Framework -- GlueX Collab. meeting -- D. Lawrence.
Scalable Readout System Data Acquisition using LabVIEW Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
DHH at DESY Test Beam 2016 Igor Konorov TUM Physics Department E18 19-th DEPFET workshop May Kloster Seeon Overview: DHH system overview DHE/DHC.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
ORNL is managed by UT-Battelle for the US Department of Energy ADnED Handling V4 Neutron Event Data Matt Pearson SNS ORNL 18 th -22 nd May 2015.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GGO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4GO4G.
Go4 v2.2 Status & Overview CHEP 2003
Gu Minhao, DAQ group Experimental Center of IHEP February 2011
Data and Control link via GbE
HADES collaboration meeting XXIII GSI, Darmstadt
CMS High Level Trigger Configuration Management
HADES Event Builder Status HADES Coll. Meeting XXX, Lisboa
Distributed object monitoring for ROOT analyses with Go4 v.3
Tracker Software Status
The Go4 eventloop framework: analysis steps
J. Adamczewski, M. Al-Turany, D. Bertini, H.G. Essel
Presentation transcript:

1 23.July 2012Jörn Adamczewski-Musch TRB / HADAQ plug-ins for DABC and Go4 Jörn Adamczewski-Musch GSI, Experiment Electronics: Data Processing group EE-meeting,

2 23.July 2012Jörn Adamczewski-Musch 2 Outline Motivation Go4 trb v2/v3 unpacker and.hld user event source DABC plugin for hadaq Tests and Experience Conclusions

3 23.July 2012Jörn Adamczewski-Musch 3 Motivation Goal: Integration of TRB frontends to CBM (PANDA, R3B?) test DAQ Read out TRB data with DAQ software DABC Combine hadaq events with mbs/roc/spadic data (common trigger or sync message) Data analysis with Go4 framework (process hadaq.hld files) Online monitoring with Go4 (at DABC stream server)

4 23.July 2012Jörn Adamczewski-Musch 4 Go4 implementations File input for.hld files (THadaqEventSource) knows HADES hadtu / event / subevent formats each hadaq event is wrapped “as is” in a MBS subevent MBS output event is passed to subsequent unpacker Data analysis class (THadaqUnpackProc) Can dump any hadaq-formatted data Unpacking and histogramming of TRB v2 and v3 formats Time bin correction/calibration Channel correlations + delta t evaluation (configurable) Special MCP mapping for PANDA-DIRC / Mainz (Cahit Ugur) Repository:

5 23.July 2012Jörn Adamczewski-Musch.hld file 5 Hadaq-go4 data flow TGo4MbsEvent THadaqUnpackEvent THadaqUnpackProcTHadaqEventSource TGo4MbsSubEvent std::vector fLCoarseTime std::vector fLFineTime std::vector fTCoarseTime std::vector fTFineTime “MBS Container” File Input Unpack, analysis

6 23.July 2012Jörn Adamczewski-Musch 6 Detector Event processor MBS container DAQ Event processor DABCDABC “Unpacker” step“Detector” step TRB MBS ROC ROOT Tree i/o MBS TRB ROC DETN DET1 DETN DAQ DET1 Go4 trbmonitor for CBM testbeam monitoring “Tracking” step Tracker Tracks Event Track1 TrackN processor hadaq-go4 adjusted to CBM beamtime framework (classes TTrb*.cxx): Composite processor TTrbProc Composite Event TTrbEvent

7 23.July 2012Jörn Adamczewski-Musch 7 DABC hadaq plugin Read.hld files Wrap hadaq event into MBS subevent  export to.lmd file or stream server (-> Go4)  combine hadaq and mbs data (to do!) Receive data from TRBnet hubs via udp sockets Combine hadaq subevents from different trb inputs Export control variables to shared memory connect to HADES eventbuilder controls / EPICS Write.hld files Repository: Full HADES eventbuilder! (daq_netmem, daq_evtbuild) Like Go4 event source CBM beam tests

8 23.July 2012Jörn Adamczewski-Musch 8 DABC hadaq components Classes: HldFile – input and output of hld file format HldInput – read hadtu format from file HldOutput- write hadtu format to file UdpDataSocket – receive hadtu packets from trb frontend (single stream) MbsTransmitterModule – wrap hadtu format into mbs event container CombinerModule – eventbuilding of hadtu format from several data streams Observer – Control system interface to hades shared memory Example application configurations: HldConverter.xml – read hld file and write to lmd file HldServer.xml – read hld file and serve at mbs transport server NetmemServer.xml – receive trbnet data at 1 udp socket and serve events at mbs transport/stream server EventBuilder.xml - receive trbnet data at n udp sockets and do a full eventbuilding

9 23.July 2012Jörn Adamczewski-Musch 9 Use case : converter, online monitoring server hadaq:: UDPDataSocket hadaq:: MbsTransmitterModule Output Input mbs:: ServerTransport “eventbuilding mode” TRBnet hub hadaq:: HldInput.hld file UDP/IP GbE mbs:: LmdOutput.lmd file NetmemServer.xml HldConverter.xml HldServer.xml stream server, transport server

10 23.July 2012Jörn Adamczewski-Musch 10 Use case: HADES event builder hadaq:: CombinerModule Input1 ServOut Input0 Input2 Input.. Input N hadaq:: UDPDataSocket hadaq:: MbsTransmitterModule Output Input FileOut hadaq:: UDPDataSocket hadaq:: HldOutput.hld file hadaq:: Observer EPICS IOC /dev/shm HADES ebctrl HADES medm GUI dabc Parameters EPICS PV “worker statistics” EventBuilder.xml

11 23.July 2012Jörn Adamczewski-Musch 11 Use case: CBM beamtest DAQ hadaq:: CombinerModule Input1 Output Input0 Input2 Input.. Input N hadaq:: UDPDataSocket hadaq:: MbsTransmitterModule Output Input mbs:: Combiner MBS FileOutput ROC SPADIC ServOutput TRB “Supercombiner” hadaq:: UDPDataSocket roc:: Combiner spadic:: Combiner mbs:: Combiner.lmd file

12 23.July 2012Jörn Adamczewski-Musch (C.Ugur): hadaq-go4 for offline analysis of.hld files (acquired with old HADES production eventbuilder) Used for MAMI beamtimes June and July 2012 dabc_run NetmemServer.xml + hadaq-go4 for online monitoring: Usable, but dabc fails for high event rates >40kHz? ?? Mb/s (queue full, or crash) => dabc v1.9 debugging! Fine tuning of buffer setup! dabc_run EventBuilder.xml + hld file output + hadaq-go4:  Works with 1 trb input up to some event rate limit, see above  can not yet deliver performance (100kHz writing) of old hadaq eventbuilder! Tests with udp data sender simulator (JAM): dabc_run EventBuilder.xml + hld file output + hadaq-go4 + EPICS ioc + MEDM gui With 5 UDP streams, localhost (10kHz/1000Bytes/ 20s spill): 19 Mbyte/s with file to local disk (41 Mb/s without file) Limit: hld file io -> queue back pressure -> 60% dropped events 12 Tests + Experience

13 23.July 2012Jörn Adamczewski-Musch 13 Conclusions  Go4 analysis of hld files and trbdata from DABC online is ready (still under development)  Go4 trb classes adjusted for CBM online monitoring framework  DABC plugin for trbnet udp inputs is ready TODO: trb/mbs super combiner implementation for CBM  DABC can almost emulate the HADES production eventbuilder! (missing: RFIO, disk load balancing, multi-EBserver tests..)  DABC hadaq modules still lack performance of HADES eventbuilder TODO: optimization of i/o implementations + memory set up DABC v1.9 debugging (stability? error recovery?)