SNiPER在LHAASO实验中的应用: LodeStar

Slides:



Advertisements
Similar presentations
Mantid Architecture Straw man proposal Nick Draper 24 th August 2007.
Advertisements

C++ & Java Dick Steflik CS-248. Similarities Syntax - almost identical Object Model - very similar Stream based I/O.
Usage of the Python Programming Language in the CMS Experiment Rick Wilkinson (Caltech), Benedikt Hegner (CERN) On behalf of CMS Offline & Computing 1.
Using ROOT geometry for FVTX reconstruction Zhengyun You Peking University Los Alamos National Lab Jan 22, 2007.
LCIO A persistency framework for LC detector simulation studies Frank Gaede, DESY, IT 4 th ECFA/DESY LC Workshop Amsterdam April 1 st -4 th 2003.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Status of the Cuore software Marco Pallavicini Cuore Co-Software coordinator with M. Pavan (Milano) Università di Genova & INFN.
Irina Sourikova Brookhaven National Laboratory for the PHENIX collaboration Migrating PHENIX databases from object to relational model.
Updating JUPITER framework using XML interface Kobe University Susumu Kishimoto.
Replay Compilation: Improving Debuggability of a Just-in Time Complier Presenter: Jun Tao.
CE Operating Systems Lecture 3 Overview of OS functions and structure.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
W. Pokorski - CERN Simulation Project1 Python binding for Geant4 toolkit using Reflex/PyROOT tool Witek Pokorski EuroPython 2006, CERN, Geneva
Framework of Job Managing for MDC Reconstruction and Data Production Li Teng Zhang Yao Huang Xingtao SDU
Heather Kelly PPA Scientific Computing Apps LAT was launched as part of the Fermi Gamma-ray Space Telescope on June 11 th 2008.
CHEP /21/03 Detector Description Framework in LHCb Sébastien Ponce CERN.
Python template engines and implementation in Indico Marius Damarackas (Vilnius University)
STAR Event data storage and management in STAR V. Perevoztchikov Brookhaven National Laboratory,USA.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
CBM ECAL simulation status Prokudin Mikhail ITEP.
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
SoLID simulation with GEMC Zhiwen Zhao 2015/03/26.
LCIO A persistency framework and data model for the linear collider CHEP 04, Interlaken Core Software, Wednesday Frank Gaede, DESY -IT-
9/12/99R. Moore1 Level 2 Trigger Software Interface R. Moore, Michigan State University.
CHEP /21/03 Detector Description Framework in LHCb Sébastien Ponce CERN.
23/2/2000Status of GAUDI 1 P. Mato / CERN Computing meeting, LHCb Week 23 February 2000.
Separate distribution of the analysis code (and more) P. Hristov 19/03/2014.
GLAST LAT Project Science Tools - 12 June 2002 T. Burnett 1 The Science Analysis Software Development Environment -- for tools too! T. Burnett.
General requirements for BES III offline & EF selection software Weidong Li.
D. Duellmann - IT/DB LCG - POOL Project1 The LCG Dictionary and POOL Dirk Duellmann.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
CPT Week, November , 2002 Lassi A. Tuura, Northeastern University Core Framework Infrastructure Lassi A. Tuura Northeastern.
Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;
1 SLAC simulation workshop, May 2003 Ties Behnke Mokka and LCDG4 Ties Behnke, DESY and SLAC MOKKA: european (france) developed GEANT4 based simulation.
Modularization of Geant4 Dynamic loading of modules Configurable build using CMake Pere Mato Witek Pokorski
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
LHCb Software Week 25/11/99 Gonzalo Gracia Abril 1 r Status of Geant4 in LHCb. r Ideas on how to populate the LHCb Detector Description Data Base (LHCb.
DANA David Lawrence Oct. 21, D. Lawrence, JLab GlueX Software Workshop Oct Outline Requirements Philosophy Overview of Features Open Questions.
15 May 2012NA61 Collaboration Meeting, Budapest1 Shine: status and plans András László, for the Shine Group.
GenFit and RAVE in sPHENIX under Fun4All
Go4 v2.2 Status & Overview CHEP 2003
JUNO Offline Geometry Management
WP12 - General Development News Sandro Wenzel
BESIII data processing
How to Contribute to System Testing and Extract Results
GEANT4 for Future Linear Colliders
CMS High Level Trigger Configuration Management
SNiPER 离线软件框架 邹佳恒 高能物理计算及软件会议
Parallelized JUNO simulation software based on SNiPER
European Organization for Nuclear Research
AliRoot survey: Generators
Parallel Computing of SNiPER based on Intel TBB
Sharing Memory: A Kernel Approach AA meeting, March ‘09 High Performance Computing for High Energy Physics Vincenzo Innocente July 20, 2018 V.I. --
POOL persistency framework for LHC
Implementation of Simulation
Jefferson Lab Andrea Cowley, George Kharashvili, Pavel Degtiarenko
5 Tips for Upgrading Reports to v 6.3
Software Installation
Lecture Topics: 11/1 General Operating System Concepts Processes
CMS Persistent Event Structure
Simulation and Physics
Search for coincidences and study of cosmic rays spectrum
G4 Workshop 2002 Detector Description Parallel Session
“Fast Simulation” of the Dirc
Use of GEANT4 in CMS The OSCAR Project
Analyzing CLAS12 Data David Payette.
Zhangxy Zhangxm Huangxt Dec 17 ,2003
Map Reduce, Types, Formats and Features
Presentation transcript:

SNiPER在LHAASO实验中的应用: LodeStar 李腾 黄性涛 张学尧 山东大学 2016.6.7

Outline Overview of Lodestar Core software of Lodestar Applications of Lodestar Next to do

Overview of Lodestar LodeStar: Constituent of LodeStar: LHAASO Offline Data Processing Software Framework Constituent of LodeStar: SNiPER: underlying framework offline: specific to LHAASO Experiments External Libraries: frequently used third-party software or tools

Lodestar Environments Programming Language:C++、Python very popular in HEP most frequently used software implemented in C++ Supported OS:Linux Scientific Linux 5, 6 are currently supported More OS will be tested and supported according to needs Software Management Tool:CMT Automatically compile, build packages Configuration Language:Python Very flexible Supported by SNiPER Version Control Tool:SVN keep history of codes developing synchronization and sharing between developers

Functionalities of Lodestar Management of the data processing procedures Process/Sequence management Based on Task, Algorithm, Incident etc. in Sniper Management of the event data Data Store Data Model, Data I/O Providing common services or tools during processing HisogramSvc, RandomSvc, DatabaseSvc Based on Service, Tool etc. in Sniper Providing friendly user interfaces Easy to develop user code Configure jobs, based on SniperPython

Data Processing Procedures in Lodestar Data Processing Workflow: Generator GenEvent Each data processing is developed based on the Algorithm, Service and Tool in Sniper Each data processing reads event data from previous step and produces its event data for the next one Simulation SimEvent Reconstruction RecEvent Analysis PhyEvent

Data Processing Procedures in Lodestar Data Processing Workflow: Generator GenEvent Simulation The event data is saved in the Data Model objects, stored in the Data Store Data Model objects can be converted into persistent form and saved into files SimEvent Reconstruction RecEvent Analysis PhyEvent

Design of the DataModel Design of LHAASO Event Data Model Each process defines their Event Objects EventObject inherits from TObject. TRelations: Matching between Headers (optional)

Design of the DataModel Each event data consists of two parts: HeaderObject EventObject separate meta data from event data Some “tag” data can be put into header To speed up event selection SmartRef: One new type of smart pointer Support correlation of data objects Support lazy-loading

XmlObjDesc: Define DataModel with XML Traditionally writing C++ Code by hand Many repeatable work such as Getters and Setters Difficult to be maintained New way to define EDM with XML file Strong syntax (DTD, XML Schema) More readable, easier to maintain Automatically generate the Get-, Set- functions, Streamers XmlObjDesc (XOD) is used as a tool to define EDM with XML *.h XOD CINT G++ *.xml *Dict.h *Dict.cc lib*.so *.cc *LinkDef.h

Event Data Management Event Data Management in Lodestar: Event data is stored in the Data Store, managed by DataStoreMgr Data Store is a dynamically allocated place, shared by all the algorithms All algorithms/services/tools can retrieve/put event data from/to the Data Store with data paths Data Store is automatically configured with Data I/O Service Data Store (MEMORY) Simulation Reconstruction Analysis DISK DataInputSvc DataOutputSvc Other Svc DataStoreMgr DataStoreMgr

Event Data Management Event Data Management in Lodestar: In Lodestar, Data Input/Output is implemented with Data I/O Services: Responsible for converting transient/persistent Data Model objects Currently support: Root Input/Output streams Corsika Input stream Data Store (MEMORY) Simulation Reconstruction Analysis DISK DataInputSvc DataOutputSvc Other Svc DataStoreMgr DataStoreMgr

Data I/O Service RootInputSvc/RootOutputSvc: CorsikaInputSvc Writing/Reading official ROOT data files Support lazy-loading mechanism CorsikaInputSvc Convert the raw corsika file to the DataModel objects Support different types of input files (particles, Cherenkov photons, Longitudinal parameters) Support event-splitting

Application: G4argo An example of G4-based detector simulation package DetSimAlg: Common algorithm of Geant4 detector simulation G4Svc: Interface to the Geant4 core ArgoSimFactory: Build all the detector simulation options Generator Geometry User-actions

Application: G4argo Some comparison from the origin results of G4argo:

Application:KM2A FastSim KM2A fast simulation Implemented with KM2ADetSimAlg and KM2ARecAlg Some comparison of the results:

Application:WFCTA Simulation Implemented with WFCTADetSimAlg Some comparison of the results: Lodestar Origin Corex, corey 30857.314453, 21321.181641 30857.314453, 21321.181641 Zenith, azimuth 38.221312, 4.110079 Total photon 720363989.469576 Photons arriving telescope 2204600 Photon after reflecting 1432315 Photon after ray tracing 220824

Summary and Next To Do Summary: We still have a large TODO list: Lodestar has been built based on SNiPER The G4-based DetSim software prototype is provided Some of the code has been moved to Lodestar We still have a large TODO list: Further improvements of Lodestar needs more considerations and discussions Many tools and services to be added Lots of existing packages to be moved to Lodestar Build our SVN/Trac server Lots of implementation work to do… …

Thank you !