Online & Offline software at H.E.S.S.  The H.E.S.S. Experiment  Data storage & Off-line software  Acquisition software  ROOT Problems/Wishlist ROOT.

Slides:



Advertisements
Similar presentations
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2004 Go4 v2.8 Analysis Design.
Advertisements

Threads, SMP, and Microkernels Chapter 4. Process Resource ownership - process is allocated a virtual address space to hold the process image Scheduling/execution-
Chapter 4 Threads, SMP, and Microkernels Patricia Roy Manatee Community College, Venice, FL ©2008, Prentice Hall Operating Systems: Internals and Design.
11/13/01CS-550 Presentation - Overview of Microsoft disk operating system. 1 An Overview of Microsoft Disk Operating System.
CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/20 New Experiences with the ALICE High Level Trigger Data Transport.
CHEP04 - Interlaken - Sep. 27th - Oct. 1st 2004T. M. Steinbeck for the Alice Collaboration1/27 A Control Software for the ALICE High Level Trigger Timm.
Introduction to Kernel
PRASHANTHI NARAYAN NETTEM.
Chapter 51 Threads Chapter 5. 2 Process Characteristics  Concept of Process has two facets.  A Process is: A Unit of resource ownership:  a virtual.
CLEO’s User Centric Data Access System Christopher D. Jones Cornell University.
RAID Ref: Stallings. Introduction The rate in improvement in secondary storage performance has been considerably less than the rate for processors and.
A. Homs, BLISS Day Out – 15 Jan 2007 CCD detectors: spying with the Espia D. Fernandez A. Homs M. Perez C. Guilloud M. Papillon V. Rey V. A. Sole.
CBPM System Overview (Part I?) 19 September 2012Beam Instrumentation Meeting1.
ZTF Server Architecture Roger Smith Caltech
Chapter 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System.
Imperial College Tracker Slow Control & Monitoring.
Boosting Event Building Performance Using Infiniband FDR for CMS Upgrade Andrew Forrest – CERN (PH/CMD) Technology and Instrumentation in Particle Physics.
DCE (distributed computing environment) DCE (distributed computing environment)
Opton 4 short presentation1 Opton 4 User friendly operating software for Symmetron’s Stylitis data loggers.
Processes and Threads Processes have two characteristics: – Resource ownership - process includes a virtual address space to hold the process image – Scheduling/execution.
Threads, SMP, and Microkernels Chapter 4. Process Resource ownership - process is allocated a virtual address space to hold the process image Scheduling/execution-
ALICE, ATLAS, CMS & LHCb joint workshop on
A Technical Validation Module for the offline Auger-Lecce, 17 September 2009  Design  The SValidStore Module  Example  Scripting  Status.
Management of the LHCb DAQ Network Guoming Liu * †, Niko Neufeld * * CERN, Switzerland † University of Ferrara, Italy.
CMS pixel data quality monitoring Petra Merkel, Purdue University For the CMS Pixel DQM Group Vertex 2008, Sweden.
C. Combaret 11/10/ 2008 Status of the DHCAL m2 software C. Combaret IPNL.
CHEP 2000: 7-11 February, 2000 I. SfiligoiData Handling in KLOE 1 CHEP 2000 Data Handling in KLOE I.Sfiligoi INFN LNF, Frascati, Italy.
Data Acquisition Backbone Core J. Adamczewski-Musch, N. Kurz, S. Linev GSI, Experiment Electronics, Data processing group.
INFORMATION SYSTEM-SOFTWARE Topic: OPERATING SYSTEM CONCEPTS.
1 Threads, SMP, and Microkernels Chapter Multithreading Operating system supports multiple threads of execution within a single process MS-DOS.
Lee Lueking 1 The Sequential Access Model for Run II Data Management and Delivery Lee Lueking, Frank Nagy, Heidi Schellman, Igor Terekhov, Julie Trumbo,
Hall-D/GlueX Software Status 12 GeV Software Review III February 11[?], 2015 Mark Ito.
Go4 v3 - J.Adamczewski, H.G.Essel, S.Linev IT/EE Palaver Go4 version 3.
STAR Event data storage and management in STAR V. Perevoztchikov Brookhaven National Laboratory,USA.
Apr. 8, 2002Calibration Database Browser Workshop1 Database Access Using D0OM H. Greenlee Calibration Database Browser Workshop Apr. 8, 2002.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
DEPARTEMENT DE PHYSIQUE NUCLEAIRE ET CORPUSCULAIRE JRA1 Parallel - DAQ Status, Emlyn Corrin, 8 Oct 2007 EUDET Annual Meeting, Palaiseau, Paris DAQ Status.
1 23.July 2012Jörn Adamczewski-Musch TRB / HADAQ plug-ins for DABC and Go4 Jörn Adamczewski-Musch GSI, Experiment Electronics: Data Processing group EE-meeting,
News on GEM Readout with the SRS, DATE & AMORE
IPHC - DRS Gilles CLAUS 04/04/20061/20 EUDET JRA1 Meeting, April 2006 MAPS Test & DAQ Strasbourg OUTLINE Summary of MimoStar 2 Workshop CCMOS DAQ Status.
Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
13 June 2001M.Al-Turany/Root20011 Mohammad Al-Turany Go4 GSI Darmstadt 13 June 2001.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev ROOT 2002 GSI Online Offline Object Oriented Go4.
The Mach System Silberschatz et al Presented By Anjana Venkat.
Online Monitoring for the CDF Run II Experiment T.Arisawa, D.Hirschbuehl, K.Ikado, K.Maeshima, H.Stadie, G.Veramendi, W.Wagner, H.Wenzel, M.Worcester MAR.
Lecture 4 Mechanisms & Kernel for NOSs. Mechanisms for Network Operating Systems  Network operating systems provide three basic mechanisms that support.
Online Monitoring System at KLOE Alessandra Doria INFN - Napoli for the KLOE collaboration CHEP 2000 Padova, 7-11 February 2000 NAPOLI.
ROOT Workshop M.Frank LHCb/CERN Improvements in the I/O Area (*)  General I/O related improvements  Tree related issues  Plans (*) I present.
S.Linev: Go4 - J.Adamczewski, H.G.Essel, S.Linev ROOT 2005 New development in Go4.
Event Management. EMU Graham Heyes April Overview Background Requirements Solution Status.
1 DAQ.IHEP Beijing, CAS.CHINA mail to: The Readout In BESIII DAQ Framework The BESIII DAQ system consists of the readout subsystem, the.
Distributed parallel processing analysis framework for Belle II and Hyper Suprime-Cam MINEO Sogo (Univ. Tokyo), ITOH Ryosuke, KATAYAMA Nobu (KEK), LEE.
CITA 171 Section 1 DOS/Windows Introduction. DOS Disk operating system (DOS) –Term most often associated with MS-DOS –Single-tasking operating system.
Threads, SMP, and Microkernels Chapter 4. Processes and Threads Operating systems use processes for two purposes - Resource allocation and resource ownership.
IEEE Real Time 091 Data Acquisition System for Multi-channel Gas Detector Hongyu ZHANG, Kejun ZHU, Haitao ZHU Institute of High Energy Physics,
System Components Operating System Services System Calls.
POOL Based CMS Framework Bill Tanenbaum US-CMS/Fermilab 04/June/2003.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
DAQ++: A C++ Data Acquisition Software Framework C. Lacasta 1 Co-Developers: E. Cochran 2, K. Honscheid 2, G. Llosá 1, A. Studen 3. 1 IFIC- Instituto de.
Pi of the Sky off-line experiment with GLORIA Ariel Majcher National Centre for Nuclear Research Warsaw, Poland 10th INTEGRAL/BART Workshop, April.
Go4 v2.2 Status & Overview CHEP 2003
Introduction to Kernel
KID - KLOE Integrated Dataflow
CMS High Level Trigger Configuration Management
Controlling a large CPU farm using industrial tools
Distributed object monitoring for ROOT analyses with Go4 v.3
Threads, SMP, and Microkernels
CS179G, Project In Computer Science
Lecture 4- Threads, SMP, and Microkernels
Presentation transcript:

Online & Offline software at H.E.S.S.  The H.E.S.S. Experiment  Data storage & Off-line software  Acquisition software  ROOT Problems/Wishlist ROOT User Workshop 15 October 2001 Mathieu de Naurois, LPNHE Paris University VI/VII Christoph Borgmeier, Christian Stegmann, Humboldt University Berlin

Mathieu de Naurois, LPNHE Paris VI15 Oct Central trigger  960 pixels camera The High Energy Stereoscopic System (H.E.S.S.) NGC 4261  Observe  -induced showers above 100 GeV  Active galactic nuclei  Pulsars & Plerions  Micro-quasars ...  Stereoscopy for 3D reconstruction  Fast camera & DAQ for threshold  Installed in Namibia (Gamsberg)

Mathieu de Naurois, LPNHE Paris VI15 Oct Current Status  First telescope operational since June 2002  Structure for the next 3  Second camera : early 2003

Mathieu de Naurois, LPNHE Paris VI15 Oct Data H.E.S.S.  Camera events: 1kHz (6MB/s per camera)  ~100 4 telescopes  Monitoring data (taken independently)  CCDs  Cloud scanner  Optical Telescopes  Telescope drives .... Camera Tracking PC Farm Weather stations Camera CCDs Lidar RAID array...

Mathieu de Naurois, LPNHE Paris VI15 Oct SASH: (Storage & analysis software at H.E.S.S.) I – Container hierarchy HESSArray Telescope Pixel Trigger Sector Pixel...  Fixed container hierarchy  No fixed numbering scheme  All elements accessible from the top level container via iterators (no C pointers) Sash::Pointer Sash::Telescope::beginPixel()  List, Sets,... and Iterator provided for looping over elements Sash::List Pixel::Neigbours()

Mathieu de Naurois, LPNHE Paris VI15 Oct SASH II – Data access  Each data class knows its container type  A helper template class registers a slot in the container for each data class Sash::EnvelopeEntry  Additional named slots allows coexistence of several instances (  comparison of analysis methods,...)  Data classes are created and accessed by the container (using CINT) Container::Handle (parameters) and Get ()  Data classes store their creation parameters (argument of Handle ) to enable automatic recreation at file readout  Expandable (user class libraries)

Mathieu de Naurois, LPNHE Paris VI15 Oct SASH III – Sash::DataSet  Extension of ROOT TTree  Maps the data class at their proper location in the container hierarchy  Organises the data from the same TTree in TFolder (run,events,...)  Provides iterators (iterate on events)  Provides a dependencies mechanism based on time stamp from several files (monitor information is loaded for each event)  Uses the branch splitting mechanism for fast access: data are loaded only when accessed. event ADC values Header run Telescope config Header monitor HV Temperatures...

Mathieu de Naurois, LPNHE Paris VI15 Oct SASH IV – Sash::Makers  Common interface for data manipulation  Receive a Sash::DataSet and operates on it  Full access to the container hierarchy  Can be chained + call-back mechanism  Two specific Makers:  Sash::DataSetIterator: loads an event and synchronises other DataSets (monitor,…)  Sash::TreeWriter: writes a event to disk

Mathieu de Naurois, LPNHE Paris VI15 Oct DASH: Data acquisition software  Multi-processes, multi-threaded & distributed acquisition  CORBA (omniORB) for interprocess communication (  modular, easily expandable)  ROOT for storage & processing  Python/Gtk for control  ROOT or Python/Gtk for display  Building blocks  Buffer  Server  Sender  Processor ...  Push & Pull Monitor server nodeNnode2 Camera1 Camera2 node1Event Display pull Control ROOT Event Display push Calibration

Mathieu de Naurois, LPNHE Paris VI15 Oct DASH II – Data Block Processor  Arbitrary byte sequence data (  polymorphism)  CCD images or C Structures  Streamed ROOT objects  Whole folders  Automatic conversion into python arrays if corresponded function provided  Data processed by Processor_i  Three types of RootProcessor objects:  RootProcessor_i: arbitrary ROOT object, new memory location for each event  FixedRootProcessor_i : non polymorphic but constant memory location  HESSArrayProcessor_i: maps the received objects/folders into the container hierarchy and call the registered Sash::Maker

Mathieu de Naurois, LPNHE Paris VI15 Oct Dash III - Displays  Pull mode  Process ask for a folder or a specific Sash object  Use the HESSArrayProcessor to run Sash::Maker's for incoming objects

Mathieu de Naurois, LPNHE Paris VI15 Oct Summary  Sash implements a general way to combine different ROOT trees (Sash::DataSet) from different files at a fixed memory location & automate tasks (Sash::Maker).  Analysis/Calibration software consist of ~ 15 CVS modules based on Sash, ~ 10 developers (many people develop their own analysis module)  DASH provides a class hierarchy of building blocks to organize the H.E.S.S. DAQ in a general way  CORBA protocol  transparently expandable ressources  Modularity (building blocks connected by CORBA)  Transport of ROOT objects  Highly multithreaded data transport, display and analysis software  Good performances (6MB/s on a single machine)

Mathieu de Naurois, LPNHE Paris VI15 Oct ROOT Problems/Wishlist Last year problems:  Namespace support Fixed  Template support Almost fixed  STL support much better  Thread stability improved WhishList: Better thread stability Threads created by CORBA, not by ROOT. Too much use of global variables in ROOT (gFile,fgFitter,...) Is Qt communication protocol thread-safe? Support for templates member functions class A { template f(); }; #pragma link C++ function A::f (); Support for class member type change in ROOT I/O (when cast operator or conversion constructor provided)

Mathieu de Naurois, LPNHE Paris VI15 Oct Experience with ROOT  Impressive support from the ROOT team:  Quick fixes  Fast developpement of requested features Thank you