Status and Perspectives on the “raw2dst2root” processing C. Guerrero, A. Hernandez, C. Weiss and F. Gunsing 2013 n_TOF Annual Collaboration Meeting Bologna,

Slides:



Advertisements
Similar presentations
Project Management with VIVA PPM Tool (Project Portfolio Management)
Advertisements

MOSS 2007 Document Management Adam McCarthy 1 st April 2009.
Michigan State University 4/15/ Simulation for Level 2 James T. Linnemann Michigan State University NIU Triggering Workshop October 17, 1997.
January 6. January 7 January 8 January 9 January 10.
Simple Git Steve Pieper. Topics Git considerations and Slicer Git as if it were svn Git the way it is meant to be.
Xkl: A Tool For Speech Analysis Eric Truslow Adviser: Helen Hanson.
ILDG File Format Chip Watson, for Middleware & MetaData Working Groups.
Beamline Takashi Kobayashi 1 Global Analysis Meeting Nov. 29, 2007.
Chapter 8: I/O Streams and Data Files. In this chapter, you will learn about: – I/O file stream objects and functions – Reading and writing character-based.
CWG2 Tools, Guidelines and Procedures 16 December 2014 ALICE O 2 Asian Workshop
RMsis – v Simplify Requirement Management for JIRA
Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Wolfgang Friebel, April AFS Administration Framework.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
MIPS coding. SPIM Some links can be found such as:
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
15 Copyright © 2007, Oracle. All rights reserved. Performing Database Backups.
HDL Bencher FPGA Design Workshop. For Academic Use Only Presentation Name 2 Objectives After completing this module, you will be able to:  Describe the.
DPA follow-up review, Malargüe, Nov/2000 DPA Data Processing and Analysis Task Follow-up Review Malargüe, November 14, 2000.
RFX-mod Programme Workshop 2009 – January 2009 Scaling and validation plans Paolo Franz, Monica Spolaore.
The european ITM Task Force data structure F. Imbeaux.
Status report from T2K-SK group Task list of this group discussion about NEUT Kaneyuki, Walter, Konaka We have just started the discussion.
DAQ Data Processing Chain Vasilis Vlachoudis Feb 2015.
Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.
ICINETIC Experts in.NET technologies and architectures.
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Hall-D/GlueX Software Status 12 GeV Software Review III February 11[?], 2015 Mark Ito.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 Parallel - DAQ Status, Emlyn Corrin, 8 Oct 2007 EUDET Annual Meeting, Palaiseau, Paris DAQ Status.
Simulations and Software CBM Collaboration Meeting, GSI, 17 October 2008 Volker Friese Simulations Software Computing.
Franco Carbognani, EGO LSC-Virgo Meeting May 2007 Status and Plans LIGO-G Z Software Management.
Mantid Stakeholder Review Nick Draper 01/11/2007.
SoLID simulation with GEMC Zhiwen Zhao 2015/03/26.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 - Data Acquisition Status Report Daniel Haas DPNC Genève Extended SC Meeting 1 Sep 2008.
Our project main purpose is to develop a tool for a combinatorial game researcher. Given a version of combinatorial puzzle game and few more parameters,
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
Linda R. Coney – 5 November 2009 Online Reconstruction Linda R. Coney 5 November 2009.
1 SICBDST and Brunel Migration status and plans. 2 Migration Step 1: SICBMC/SICBDST split  Last LHCb week: Split done but not tested  Software week.
1. 2 Purpose of This Presentation ◆ To explain how spacecraft can be virtualized by using a standard modeling method; ◆ To introduce the basic concept.
Online/offline integration - Aart Heijboer - sector/soft - Cern june 2002 Integration Online and Offline software Run Control Ligier (dispatcher) Data.
WFC3 PIPELINE CDR Jim Rose October 16, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 13 Science Data Processing
Andrea Valassi (CERN IT-DB)CHEP 2004 Poster Session (Thursday, 30 September 2004) 1 HARP DATA AND SOFTWARE MIGRATION FROM TO ORACLE Authors: A.Valassi,
Software Deployment & Release 26/03/2015 1EN-ICE.
LHCb report to LHCC and C-RSG Philippe Charpentier CERN on behalf of LHCb.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
Towards new Graphical User Interfaces for nTOF experiment Collaboration meeting, Bologna 28 th Nov 2013 Towards new Graphical User Interfaces for nTOF.
T EST T OOLS U NIT VI This unit contains the overview of the test tools. Also prerequisites for applying these tools, tools selection and implementation.
Straw VME Data Monitoring M. Koval Straw WG meeting
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE FACULTÉ DES SCIENCES UNIVERSITÉ DE GENÈVE EUDET JRA1 Meeting Munich October 2006 DAQ Status Emlyn Corrin.
Analysis of IMS Data By Ed Sittler CAPS Team Meeting #28 Marseille, France July 26-28, 2004.
Rutherford Appleton Laboratory September 1999Fifth Workshop on Electronics for LHC Presented by S. Quinton.
A Beginner’s Guide to Preserving Digital Resources in Historic Environment Records Catherine Hardman and Kieron Niven Archaeology Data Service.
The HADES Oracle database and its interfaces for experimentalists Ilse Koenig, GSI Darmstadt for the HADES collaboration.
John Marshall, 1 John Marshall, University of Cambridge LCD WG6 Meeting, February
David Lawrence JLab May 11, /11/101Reconstruction Framework -- GlueX Collab. meeting -- D. Lawrence.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
LHCb Software Week 25/11/99 Gonzalo Gracia Abril 1 r Status of Geant4 in LHCb. r Ideas on how to populate the LHCb Detector Description Data Base (LHCb.
NASA Earth Science Data Stewardship
N_TOF CERN Enrico Chiaveri Spokesperson of n_TOF Collaboration
DiagBox for Toyota- Diagnostic tool support
SAP Business One B1iF Training
NetCDF 3.6: What’s New Russ Rew
CAA-OR (End of Phase 1) CAA DWP Operations Review
Calibrating ALICE.
Generator Services planning meeting
Status of Brunel team and next steps
EIN 6133 Enterprise Engineering
Many-core Software Development Platforms
Data Analysis in Particle Physics
Working with HADES WebDB HADES analysis workshop, Darmstadt, Germany, 31 January - 1 February 2012 Ilse Koenig, GSI Darmstadt Outline: Version management.
Data exchange, data merging and common storage format for NEWS
Presentation transcript:

Status and Perspectives on the “raw2dst2root” processing C. Guerrero, A. Hernandez, C. Weiss and F. Gunsing 2013 n_TOF Annual Collaboration Meeting Bologna, November 2013

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) 2 n_TOF detectors plugged into flashADC: oscilloscopes! 1) RAW data (binary): oscilloscope mode data Headers: run number, detector number, settings, etc. Data: basically timestamp and array with values “raw2dst” : basically Digital Pulse Shape Analysis Algorithms 2) DST (binary): Data Summary Tapes Headers: same as for RAW data Data: list of signals and their characteristics: amplitude/area, ToF, etc. “dst2root”: basically translation from binary to ROOT, loosing headers 3) ROOTfiles (CERN ROOT format) Data: list of signals and their characteristics, as in DST, used by scientists! Raw2dst2root for dummies: 3 levels of data UNIQUE NOT UNIQUE (PSA versions)

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Present situation ( C. Guerrero and E. Mendoza in charge ) RAW: binary with n_TOF-DAQ format DST: binary with n_TOF-DAQ format with one version number - No traceability, documentation or change-tracking for the PSA used. - Unreadable for the n_TOF users (binary + complex format) - No means for nTOF user testing of PSA routines - One individual PSA per detector type - No automatic or easy way of adding new detectors (too manual) ROOT: “root” files with one version number - Carried out manually by the user - Not necessarily ROOT variables correspond to DST variables - No traceability, documentation or change-tracking for the PSA used. 3 RAWDSTROOT PSA (auto) Translation (no auto)

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation (Weiss, Hernandez, Guerrero, Mendoza, Gunsing) Milestone 1 (November 2013) Back-up of all software used in Phase1 and Phase2 (v0.0) (AH) Create “doxygen” documentation for “raw2dst” software (AH) Create versioning system using SVN: (AH) Create a raw2dst version (v0.1) with the latest software used (AH+CG) 4

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation (Weiss, Hernandez, Guerrero, Mendoza, Gunsing) Milestone 2 (January 2014): Decide on a new strategy for RAW2DST2ROOT Decide on the tools that will be made available for the nTOF users to tests existing or new PSA routines on RAW data Create software version v0.2 5 RAW DST ROOT PSA (auto) Adding for both DST and ROOT files headers, version numbers and/or stamps for PSA tracing

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation (Weiss, Hernandez, Guerrero, Mendoza, Gunsing) Milestone 3 (February 2014): Migrate the software from 32bits SLC to 64bits SLC6X OS. Towards version V0.3 (AH) Reliability test for the new software. Stable version V0.3 (AH) 6

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation (Weiss, Hernandez, Guerrero, Mendoza, Gunsing) Milestone 4 (March 2014): Simplify the number/types of PSA routines (CW and CG) A) General routine for any detector: Based on basic principles and using derivatives and integration for peak finding and analysis (similar to present SiMon, MGAS and PPAC). From one detector to another the only changes should be the parameters for “signal width”, “noise level”, type of baseline” B) Routine for detectors with constant pulse shape: Based on the current C6D6 PSA, will fit each signals found with a “reference shape”. From one detector to another only changes should be the parameters for “signal width”, “noise level”, type of baseline” and “reference pulse shape” C) Especial routines: Cases A) and B) should be used by default, but for some case like BaF2 or maybe some new detectors dedicated routines will be used. 7

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation (Weiss, Hernandez, Guerrero, Mendoza, Gunsing) Milestone 5 (April 2014): Export the libraries to create the definite ones able to read not only the current 1 byte data but also the new type of 2 bytes data (CW + AH) Reliability test for version 1.0 (CW + AH) 8

Carlos GUERRERO “raw2dst2root” n_TOF Collaboration Meeting, Bologna (November 2013) Future situation “Profesionalization” of the raw2dst2root procedure: - Backup and versioning system - Codes visible to all n_TOF users - ROOT files produced automatically (headers/versions added) - PSA routines revised and types simplified - n_TOF users’ tools for test/create/modify PSA on raw data - Plugging of new PSA rotuines simplified But still: - Only 1-2 people capable of producing definitive DST/ROOT files From May 2014 onwards: contact C. Weiss! 9