TREND DAQ BASIC PRINCIPLES … Antennas DAQ ADC Trigger condition: Max > N.σ ??? First level trigger: Nant > 3 antennas ? -By antenna : - 1 data file (Nevent.

Slides:

Advertisements

Similar presentations

Sorting Really Big Files Sorting Part 3. Using K Temporary Files Given  N records in file F  M records will fit into internal memory  Use K temp files,

Advertisements

The Tianshan Radio Experiment for Neutrino Detection Genesis & status of the TREND project Autonomous radio-detection of air showers.

Group Meeting 03/02/2004. Format of Weekly Group Meeting  Daily chore  Research report: electronic presentation required  Journal report.

The GRAND proto A prototype array to evaluate the potential of EAS identification of the radio technique.

Software and Hardware Circular Buffer Operations First presented in ENCM There are 3 earlier lectures that are useful for midterm review. M. R.

Working group report T500 and E203 Armin Reichold 30/08/2011 A Reichold, for SP group, FACET User Meeting, SLAC 1.

FALL 2006CENG 351 Data Management and File Structures1 External Sorting.

Readout of TPC with modified ALICE electronics details of current version and pending items ALICE overview New software based on homemade partly existing.

MICE CM Berkeley 9-12 Feb February 2005 Edda Gschwendtner 1 Control/Monitoring and DAQ for PIDs Edda Gschwendtner.

SIMULINK Dr. Samir Al-Amer. SIMULINK SIMULINK is a power simulation program that comes with MATLAB Used to simulate wide range of dynamical systems To.

GLAST background review dec Simulating rates: the big picture Incoming rate into the 6 m 2 sphere: is it right? Corresponding trigger rate: implies.

Development of novel R/O electronics for LAr detectors Max Hess Controller ADC Data Reduction Ethernet 10/100Mbit Host Detector typical block.

Jianchun Wang Syracuse University 10/16/99 CLEO Meeting Outline DAQ problems solved Recent results Status of DAQ Work to be done.

Optical Heart Monitor/Jump Drive Sponsor: Calit2 Mentor: Paul Blair Ph.D. Team: Matt Chandrangsu, Jeffrey Chi, Kari Nip ECE 191 – Group 6 Fall 2008.

1 DAQ Update. 2 DAQ Status DAQ was running successfully and stably in ’07 beam time Trigger bus scheme has proven to be very flexible – Added additional.

TREND simulation step by step Gu Junhua, Olivier Martineau-Huynh & Valentin Niess March 21st 2014.

LIGO-G Z Coherent Coincident Analysis of LIGO Burst Candidates Laura Cadonati Massachusetts Institute of Technology LIGO Scientific Collaboration.

I.3. The Tianshan Radio Experiment for Neutrino Detection Olivier Martineau-Huynh TREND workshop, April 19, 2013.

TREND program : establish possibility of automous radio-detection of EAS : 6 antennas to define DAQ and analysis algorithm 2010: 15.

8 Hour Heat Run Sequencer History of the test Analyze of the events Memory space used by the sequencer Questions in view of the future tests.

GLAST LAT ProjectDOE/NASA Baseline-Preliminary Design Review, January 8, 2002 K.Young 1 LAT Data Processing Facility Automatically process Level 0 data.

Greg Sullivan University of Maryland Data Filtering and Software IceCube Collaboration Meeting Monday, March 21, 2005.

GRAPES-3 ROOT Framework Pravata K Mohanty Tata Institute of Fundamental Research On behalf of the GRAPES-3 collaboration Workshop on Astroparticle Physics,

1/15 G. Manduchi EPICS Collaboration Meeting, Aix-en-Provence, Spring 2010 INTEGRATION OF EPICS AND MDSplus G. Manduchi, A. Luchetta, C. Taliercio, R.

1 Online Calibration of Calorimeter Mrinmoy Bhattacharjee SUNY, Stony Brook Thanks to: D. Schamberger, L. Groer, U. Bassler, B. Olivier, M. Thioye Institutions:

ArgonneBeamTest_ ppt1 Argonne Beam Test preparation Tsunefumi Mizuno Tuneyoshi Kamae

A Front End and Readout System for PET Overview: –Requirements –Block Diagram –Details William W. Moses Lawrence Berkeley National Laboratory Department.

Update on the new reconstruction software F. Noferini E. Fermi center INFN CNAF EEE Analysis Meeting - 15/06/20151.

C. Combaret 11/10/ 2008 Status of the DHCAL m2 software C. Combaret IPNL.

AMS Tracker Data Reduction Status Claude Zurbach Laboratoire de Physique Théorique et Astroparticules – Montpellier Houston, AMS-TIM, January 08, 2007.

1 DAQ Update MEG Review Meeting, Feb. 17 th 2010.

DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 Parallel - DAQ Status, Emlyn Corrin, 8 Oct 2007 EUDET Annual Meeting, Palaiseau, Paris DAQ Status.

Youngil Kim Awalin Sopan Sonia Ng Zeng.  Introduction  Concept of the Project  System architecture  Implementation – HDFS  Implementation – System.

Azriel Goldschmidt AMANDA/IceCube Collaboration Meeting Laguna Beach, CA March 2003 String-18 Progress and Plans.

The T IANSHAN R ADIO E XPERIMENT FOR N EUTRINO D ETECTION: an autonomous radio-array for air showers detection Olivier Martineau-Huynh IHEP, 17/02/2011.

Autonomous detection of air showers with the TREND-50 setup Genesis & status of the TREND project Autonomous radio-detection of air showers Jianli Zhang(NAOC,CAS)

A Data/Detector Characterization Pipeline (What is it and why we need one) Soumya D. Mohanty AEI January 18, 2001 Outline of the talk Functions of a Pipeline.

Laser beam diagnostics : BEAMDIAG program. Stéphan Del Burgo CERN PS/LP 30 January 1998 DBS 01/

ASIC Activities for the PANDA GSI Peter Wieczorek.

GLAST LAT Project CU Beam Test Workshop 3/20/2006 C. Sgro’, L. Baldini, J. Bregeon1 Glast LAT Calibration Unit Beam Test Status Report on Online Monitor.

(s)T3B Update – Calibration and Temperature Corrections AHCAL meeting– December 13 th 2011 – Hamburg Christian Soldner Max-Planck-Institute for Physics.

Jim Conboy / DPGTF-H 20-May Toric at JET – Status & Tools Work in Progress – See for latest.

1 Electronics Status Trigger and DAQ run successfully in RUN2006 for the first time Trigger communication to DRS boards via trigger bus Trigger firmware.

LIGO-G Z Confidence Test for Waveform Consistency of LIGO Burst Candidate Events Laura Cadonati LIGO Laboratory Massachusetts Institute of Technology.

M. LefebvreATLAS LAr week, November 19th HEC-EMEC beam test data analysis Filtering weight synchronization and timing issues TDC timing Cubic timing.

Analysis experience at GSIAF Marian Ivanov. HEP data analysis ● Typical HEP data analysis (physic analysis, calibration, alignment) and any statistical.

Vanderbilt University Toshiba IR Test Apparatus Project Final Design Review Ahmad Nazri Fadzal Zamir Izam Nurfazlina Kamaruddin Wan Othman.

Status and First Results of the Acoustic Detection System AMADEUS in ANTARES Robert Lahmann for the ANTARES Collaboration ARENA 08, Rome, 26-June-2008.

- Herve Grabas - Ecole Superieure d’Electicite 1 Internship presentation - University of Chicago – 3 sept

As a general rule you should be using multiple languages these days (except for Java)

IEEE Real Time 091 Data Acquisition System for Multi-channel Gas Detector Hongyu ZHANG, Kejun ZHU, Haitao ZHU Institute of High Energy Physics,

PHOTOTUBE SCANNING SETUP AT THE UNIVERSITY OF MARYLAND Doug Roberts U of Maryland, College Park.

Status Report on Data Reconstruction May 2002 C.Bloise Results of the study of the reconstructed events in year 2001 Data Reprocessing in Y2002 DST production.

Tuan-Shu Ho (From Wikimedia) DisplayTrigger Input.

The Tianshan Radio Experiment for Neutrino Detection Genesis & status of the TREND project Autonomous radio-detection of air showers.

1 Methods of PSD energy calibration. 2 Dependence of energy resolution on many factors Constant term is essential only for energy measurement of single.

Team LYF: Applying Python to Waveform Matching Detection Xin Liu (USC), Dongdong Yao(GT), Lili Feng(CU-Boulder)

32nd International Cosmic Ray Conference August 2011, Beijing China First detection of extensive air showers by the TREND self-triggering radio experiment.

3rd France China Particle Physics Laboratory Workshop 07 April 2010 – 09 April 2010, IPNL, Lyon, France : Update and latest results NAOC.

MADEIRA Valencia report V. Stankova, C. Lacasta, V. Linhart Ljubljana meeting February 2009.

5th FCPPL Workshop March 2011, Paris, France Status of the TREND experiment Thomas Saugrin (NAOC)

GRANDproto Principle & Status

Partitioned Memory Allocation

Monitoring glitches in the frequency divider

TREND DAQ meeting IHEP, September 7, 2012.

Computing Infrastructure for DAQ, DM and SC

Data acquisition and data processing software for magnetic measurements for NICA magnets Alexander Bychkov LHEP, JINR 2017.

ILD Ichinoseki Meeting

Limovie for Lunar Occultations - 1

Racks PC Rack >> 24 mini and 12 tall PC racks Mini Racks

Presentation transcript:

TREND DAQ BASIC PRINCIPLES … Antennas DAQ ADC Trigger condition: Max > N.σ ??? First level trigger: Nant > 3 antennas ? -By antenna : - 1 data file (Nevent * 1024o ) - 1 time file (Nevent * 4 numbers) - 2 background files (1 Mo every 20 minutes) - 2 PSD files (256o every 20 minutes) + 1 log file (1 line by second, ~ Mo) Data size of 1 run : - depends of noise condition - depends of acquisition time From 5 Go to more than 100 Go (!!) In the future : - DAQ limitation on total size (Fabio) - Second level trigger (data size reduction: 90%) Storage

DATA PREPROCESSING OVERVIEW Written integrally in MATLAB language : - preprocessing results given in MATLAB file (.mat) - data analysis (on individual PC) performed with MATLAB 3 different stages : - Coincidence identification - Filtering of main noise source + signal characteristics - Data preprocessing (arrival direction, lateral profile, calibration…) At the end: 3 MATLAB files by run (<100 Mo each)

FIRST STAGE Unexpected bug in DAQ: looking for empty signals… Requires access to all signals on each antenna !! In MATLAB: 1 fopen by antenna + 1 fseek, fread by event Looking for coincidences between antennas… Just needs a time table of all the event… But memory issues with MATLAB if table too large (>50 ^ 6 events?): LIMITATION ON RUN SIZE! 1 MATLAB file with coincidence characteristics (+basic infos on run)

SECOND STAGE Filtering of the main noise source: 90% of rejected coincidences !! Use only the infos from first stage, no need for data access Signal waveform analysis on remaining coincidences (data access needed) « Boxes » for interesting pulses Number of boxes different for each signal: save in cell array… Problem? 1 MATLAB file with filtered coincidence + signal characteristics

THIRD STAGE Filtering on waveform analysis: ~ 30% of rejected coincidences Data preprocessing on remaining candidates : Signal cross-correlation (data access): very slow!! Arrival direction reconstruction: very slow!! Performed externally by a C++ routine (Valentin Niess) Signal calibration: access to PSD files 1 final MATLAB file with pre-analyzed candidates

CC IMPLEMENTATION TREND data stocked on irods (Fabio) Big runs implies a very slow analysis + available space on CC for jobs : Each run is divided in 1 Go “metarun” (C routine, Valentin Niess) Data preprocessing launched in parallel on metaruns… Problem? Uses SPS disk Data access problem? 3 MATLAB files generated by metarun Fusion of metarun MATLAB files in 1 final MATLAB file for each run Process can be extremly slow: MATLAB cell array problem?