Status and roadmap of the AlFa Framework Mohammad Al-Turany GSI-IT/CERN-PH-AIP.

Slides:



Advertisements
Similar presentations
Parallel Virtual Machine Rama Vykunta. Introduction n PVM provides a unified frame work for developing parallel programs with the existing infrastructure.
Advertisements

Kondo GNANVO Florida Institute of Technology, Melbourne FL.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
ALFA: The new ALICE-FAIR software framework
CHEP03 - UCSD - March 24th-28th 2003 T. M. Steinbeck, V. Lindenstruth, H. Tilsner, for the Alice Collaboration Timm Morten Steinbeck, Computer Science.
Understanding and Managing WebSphere V5
ALFA - a common concurrency framework for ALICE and FAIR experiments
FairRoot framework Mohammad Al-Turany (GSI-Scientific Computing)
Automatic Software Testing Tool for Computer Networks ARD Presentation Adi Shachar Yaniv Cohen Dudi Patimer
Quality Control B. von Haller 8th June 2015 CERN.
© 2006 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Backup, Restore, and Server Replacement Josh Rose UCBU Software Engineer.
1 An Extensible Videoconference Tool for a Collaborative Computing Network Junjun He.
Introduction to the Enterprise Library. Sounds familiar? Writing a component to encapsulate data access Building a component that allows you to log errors.
Flexible data transport for the online reconstruction of FAIR experiments Mohammad Al-Turany Dennis Klein Alexey Rybalchenko (GSI-IT) 5/17/13M. Al-Turany,
Automatic Software Testing Tool for Computer Networks ADD Presentation Dudi Patimer Adi Shachar Yaniv Cohen
J OINT I NSTITUTE FOR N UCLEAR R ESEARCH OFF-LINE DATA PROCESSING GRID-SYSTEM MODELLING FOR NICA 1 Nechaevskiy A. Dubna, 2012.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Conditions DB in LHCb LCG Conditions DB Workshop 8-9 December 2003 P. Mato / CERN.
XMPP Concrete Implementation Updates: 1. Why XMPP 2 »XMPP protocol provides capabilities that allows realization of the NHIN Direct. Simple – Built on.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
Framework for Raw Data Thomas Kuhr Offline Week 29/06/2004.
David N. Brown Lawrence Berkeley National Lab Representing the BaBar Collaboration The BaBar Mini  BaBar  BaBar’s Data Formats  Design of the Mini 
Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;
NOVA Networked Object-based EnVironment for Analysis P. Nevski, A. Vaniachine, T. Wenaus NOVA is a project to develop distributed object oriented physics.
February 17, 2015 Software Framework Development P. Hristov for CWG13.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
CBM Software Workshop for Future Challenges in Tracking and Trigger Concepts, GSI, 9 June 2010 Volker Friese.
Andreas Morsch, CERN EP/AIP CHEP 2003 Simulation in ALICE Andreas Morsch For the ALICE Offline Project 2003 Conference for Computing in High Energy and.
Development of the distributed monitoring system for the NICA cluster Ivan Slepov (LHEP, JINR) Mathematical Modeling and Computational Physics Dubna, Russia,
Introduction CMS database workshop 23 rd to 25 th of February 2004 Frank Glege.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
George Goulas, Christos Gogos, Panayiotis Alefragis, Efthymios Housos Computer Systems Laboratory, Electrical & Computer Engineering Dept., University.
Framework of a Simulation Based Shop Floor Controller Using HLA Pramod Vijayakumar Systems and Industrial Engineering University of Arizona.
- Early Adopters (09mar00) May 2000 Prototype Framework Early Adopters Craig E. Tull HCG/NERSC/LBNL ATLAS Arch CERN March 9, 2000.
Abstract A Structured Approach for Modular Design: A Plug and Play Middleware for Sensory Modules, Actuation Platforms, Task Descriptions and Implementations.
1 Checks on SDD Data Piergiorgio Cerello, Francesco Prino, Melinda Siciliano.
DØ Offline Reconstruction and Analysis Control Framework J.Kowalkowski, H.Greenlee, Q.Li, S.Protopopescu, G.Watts, V.White, J.Yu.
Tier3 monitoring. Initial issues. Danila Oleynik. Artem Petrosyan. JINR.
Cisco 3 Frame Relay.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
ALFA - a common concurrency framework for ALICE and FAIR experiments Mohammad Al-Turany GSI-IT/CERN-PH.
O 2 Project Roadmap P. VANDE VYVRE 1. O2 Project: What’s Next ? 2 O2 Plenary | 11 March 2015 | P. Vande Vyvre TDR close to its final state and its submission.
General requirements for BES III offline & EF selection software Weidong Li.
Parallelization Geant4 simulation is an embarrassingly parallel computational problem – each event can possibly be treated independently 1.
By J Swetha ( ) V V Aishwarya ( ).
An approach to Web services Management in OGSA environment By Shobhana Kirtane.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
CWG13: Ideas and discussion about the online part of the prototype P. Hristov, 11/04/2014.
Marcelo R.N. Mendes. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems;
CERN IT Department CH-1211 Genève 23 Switzerland t CERN Agile Infrastructure Monitoring Pedro Andrade CERN – IT/GT HEPiX Spring 2012.
Dds-topology Andrey Lebedev, Anar Manafov GSI Darmstadt 25/04/
Simulation Production System Science Advisory Committee Meeting UW-Madison March 1 st -2 nd 2007 Juan Carlos Díaz Vélez.
VI/ CERN Dec 4 CMS Software Architecture vs Hybrid Store Vincenzo Innocente CMS Week CERN, Dec
Current activities and short term plans 24/04/2015 P. Hristov.
Mitglied der Helmholtz-Gemeinschaft FairMQ with FPGAs and GPUs Simone Esch –
Online Software November 10, 2009 Infrastructure Overview Luciano Orsini, Roland Moser Invited Talk at SuperB ETD-Online Status Review.
Flexible data transport for the online reconstruction in FairRoot Mohammad Al-Turany Dennis Klein Anar Manafov Alexey Rybalchenko 6/25/13M. Al-Turany,
ALFA - a common concurrency framework for ALICE and FAIR experiments Mohammad Al-Turany GSI-IT/CERN-PH.
Review of PARK Reflectometry Group 10/31/2007. Outline Goal Hardware target Software infrastructure PARK organization Use cases Park Components. GUI /
1 GlueX Software Oct. 21, 2004 D. Lawrence, JLab.
Scalable Readout System Data Acquisition using LabVIEW Riccardo de Asmundis INFN Napoli [Certified LabVIEW Developer]
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
CALIBRATION: PREPARATION FOR RUN2 ALICE Offline Week, 25 June 2014 C. Zampolli.
Data Transport for Online & Offline Processing
Utility-Function based Resource Allocation for Adaptable Applications in Dynamic, Distributed Real-Time Systems Presenter: David Fleeman {
Presentation transcript:

Status and roadmap of the AlFa Framework Mohammad Al-Turany GSI-IT/CERN-PH-AIP

Just to remind you what is “AlFa” Will rely on a data-flow based model (Message Queues). It will contain – Transport layer (based on: ZeroMQ, NanoMSG) – Configuration, building and testing tools (infrastructure) – Management and monitoring tools Provide unified access to configuration parameters and databases. It will include support for a heterogeneous and distributed computing system. Incorporate common data processing components Friday 21, 2014ALICE offline week

And What is NOT in Alfa Monte-Carlo simulation (Transport) – AlFa will use the output of the Monte-Carlo simulation for developing the re-construction GRID – AlFa Should be seen as an application which could run in any distributed system Grid or what ever will be there in 2018 Friday 21, 2014ALICE offline week

Where we are now? We can choose between two transport layers and we could add new options if needed – ZeroMQ – Nanomsg Friday 21, 2014ALICE offline week

ZeroMQ vs. nanomsg Friday 21, 2014ALICE offline week Alexey Rybalchenko

Protocol buffers Google Protocol Buffers support is now implemented – Example in Tutorial 3 in FairRoot. To use protobuf, run cmake as follows: – cmake -DUSE_PROTOBUF=1 Friday 21, 2014ALICE offline week Alexey Rybalchenko

Boost serialization Code portability - depend only on ANSI C++ facilities. Code economy - exploit features of C++ such as RTTI, templates, and multiple inheritance, etc. where appropriate to make code shorter and simpler to use. Independent versioning for each class definition. That is, when a class definition changed, older files can still be imported to the new version of the class. Deep pointer save and restore. That is, save and restore of pointers saves and restores the data pointed to. …. Friday 21, 2014ALICE offline week Nicolas Winckler This is used already by the CBM Online group in Frankfurt and to we need it to communicate with them! This is used already by the CBM Online group in Frankfurt and to we need it to communicate with them!

Protobuf, Boost or Manual serialization? Boost: – we are generic in the tasks but intrusive in the data class (digi, hit, timestamp) Manual and Protobuf – we are generic in the class but intrusive in the tasks (need to fill/access payloads from class with set/get x, y, z etc ). Friday 21, 2014ALICE offline week Manual method is still the fastest, protobuf is 20% slower and boost is 30% slower. Nicolas Winckler Alexey Rybalchenko preliminary

Dynamic Deployment System Deploy executables Use (utilize) any RMS (Slurm, Grid Engine, … ), Secure execution of nodes (watchdog), Support different topologies and user process dependencies, Support a central log engine …. Friday 21, 2014ALICE offline week Anar Manafov Andrey Lebedev See talk by Anar today

Templated Digi-loader and File-sink are under development This is the interface between the simulation data driven framework. Data is read from ROOT files, converted to raw data format (if necessary) and then send as messages over the network. (de)serialise of digis and/or hits It can use manual serialization of messages, boost serialization and/or protobuf Friday 21, 2014ALICE offline week Nicolas Winckler

New Proto-Type for ALICE Use the existing geometry of the ITS and TPC detectors Port the stepping managers to FairRoot Make a simple simulation of ALICE detector that can be used with the generic digi-loader as a first step for developing algorithms in AlFa later. Friday 21, 2014ALICE offline week Charalampos Kouzinopoulos

FAIR: Next steps Testing the full reconstruction chain with the First Level Event Selector cluster (FLES) of the CBM experiment Integrate the GPU triplet finder (CUDA code) of PANDA experiment into the Framework Friday 21, 2014ALICE offline week

ALICE: Next steps Continue developing the simulation proto type (see talk by Charis today) Implement (port) the TPC and ITS digitization to the proto type and adapt them to the pile up simulation in FairRoot Use the generic loaders (data samplers) on the time frames generated by the proto type Friday 21, 2014ALICE offline week