1 The AliRoot framework, status and perspectives R.Brun, P.Buncic, F.Carminati, A.Morsch, F.Rademakers, K.Safarik for the ALICE Collaboration CHEP 2003.

Slides:



Advertisements
Similar presentations
1 ALICE Grid Status David Evans The University of Birmingham GridPP 14 th Collaboration Meeting Birmingham 6-7 Sept 2005.
Advertisements

PROOF and AnT in PHOBOS Kristjan Gulbrandsen March 25, 2004 Collaboration Meeting.
The ALICE Framework at GSI Kilian Schwarz ALICE Meeting August 1, 2005.
CHEP 2012 – New York City 1.  LHC Delivers bunch crossing at 40MHz  LHCb reduces the rate with a two level trigger system: ◦ First Level (L0) – Hardware.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Andreas Morsch CERN/ALICE 3rd LHC Computing WorkshopMarseille, September 30, 1999 Base Classes for Simulation The ALICE Simulation Strategy Andreas Morsch.
23/04/2008VLVnT08, Toulon, FR, April 2008, M. Stavrianakou, NESTOR-NOA 1 First thoughts for KM3Net on-shore data storage and distribution Facilities VLV.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
Objectivity Data Migration Marcin Nowak, CERN Database Group, CHEP 2003 March , La Jolla, California.
Data Management for Physics Analysis in PHENIX (BNL, RHIC) Evaluation of Grid architecture components in PHENIX context Barbara Jacak, Roy Lacey, Saskia.
The D0 Monte Carlo Challenge Gregory E. Graham University of Maryland (for the D0 Collaboration) February 8, 2000 CHEP 2000.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
AliEn uses bbFTP for the file transfers. Every FTD runs a server, and all the others FTD can connect and authenticate to it using certificates. bbFTP implements.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Finnish DataGrid meeting, CSC, Otaniemi, V. Karimäki (HIP) DataGrid meeting, CSC V. Karimäki (HIP) V. Karimäki (HIP) Otaniemi, 28 August, 2000.
IST E-infrastructure shared between Europe and Latin America High Energy Physics Applications in EELA Raquel Pezoa Universidad.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
5 May 98 1 Jürgen Knobloch Computing Planning for ATLAS ATLAS Software Week 5 May 1998 Jürgen Knobloch Slides also on:
ALICE Simulation Framework Ivana Hrivnacova 1 and Andreas Morsch 2 1 NPI ASCR, Rez, Czech Republic 2 CERN, Geneva, Switzerland For the ALICE Collaboration.
LOGO PROOF system for parallel MPD event processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
The ALICE short-term use case DataGrid WP6 Meeting Milano, 11 Dec 2000Piergiorgio Cerello 1 Physics Performance Report (PPR) production starting in Feb2001.
Andreas Morsch, CERN EP/AIP CHEP 2003 Simulation in ALICE Andreas Morsch For the ALICE Offline Project 2003 Conference for Computing in High Energy and.
EGEE is a project funded by the European Union under contract IST HEP Use Cases for Grid Computing J. A. Templon Undecided (NIKHEF) Grid Tutorial,
The ALICE Computing F.Carminati May 4, 2006 Madrid, Spain.
Virtual Monte Carlo and new geometry description in STAR Maxim Potekhin STAR Collaboration Meeting, BNL July 17, 2004 July 17, 2004.
The Virtual MonteCarlo D.Adamova 2, V.Berejnoi 1, R.Brun 1, F.Carminati 1, A.Fassó 1, E.Futo 1, I.Gonzalez 3, I.Hrivnacova 4, A.Morsch 1 1 CERN, Geneva;
SEAL Core Libraries and Services CLHEP Workshop 28 January 2003 P. Mato / CERN Shared Environment for Applications at LHC.
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America High Energy Physics Applications in EELA.
AliRoot survey P.Hristov 11/06/2013. Offline framework  AliRoot in development since 1998  Directly based on ROOT  Used since the detector TDR’s for.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
Integration of the ATLAS Tag Database with Data Management and Analysis Components Caitriana Nicholson University of Glasgow 3 rd September 2007 CHEP,
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
G.Govi CERN/IT-DB 1 September 26, 2003 POOL Integration, Testing and Release Procedure Integration  Packages structure  External dependencies  Configuration.
ROOT WorkShop1 ALICE F.Carminati/CERN Root WorkShop Geneva, October 14.
Computing R&D and Milestones LHCb Plenary June 18th, 1998 These slides are on WWW at:
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 WP8 - Demonstration ALICE – Evolving.
NEC' /09P.Hristov1 Alice off-line computing Alice Collaboration, presented by P.Hristov, CERN NEC'2001 September 12-18, Varna.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Super Scaling PROOF to very large clusters Maarten Ballintijn, Kris Gulbrandsen, Gunther Roland / MIT Rene Brun, Fons Rademakers / CERN Philippe Canal.
ARDA P.Cerello – INFN Torino ARDA Workshop June
ALICE RRB-T ALICE Computing – an update F.Carminati 23 October 2001.
ATLAS Distributed Analysis DISTRIBUTED ANALYSIS JOBS WITH THE ATLAS PRODUCTION SYSTEM S. González D. Liko
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
10 March Andrey Grid Tools Working Prototype of Distributed Computing Infrastructure for Physics Analysis SUNY.
ALICE Computing TDR Federico Carminati June 29, 2005.
Online Software November 10, 2009 Infrastructure Overview Luciano Orsini, Roland Moser Invited Talk at SuperB ETD-Online Status Review.
November 17, 2003LCG Comprehensive Review1 ALICE Offline Y. Schutz CERN, November 17, 2003.
Barthélémy von Haller CERN PH/AID For the ALICE Collaboration The ALICE data quality monitoring system.
CrossGrid Workshop, Kraków, 5 – 6 Nov-2001 Distributed Data Analysis in HEP Piotr MALECKI Institute of Nuclear Physics Kawiory 26A, Kraków, Poland.
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
ALICE Computing Data Challenge VI
Experience of PROOF cluster Installation and operation
ALICE Offline Organisation and Status
CMS High Level Trigger Configuration Management
ALICE analysis preservation
PROOF – Parallel ROOT Facility
Alice DC Status P. Cerello March 19th, 2004.
Alice Week Offline Day F.Carminati June 17, 2002.
ALICE Physics Data Challenge 3
ALICE – Evolving towards the use of EDG/LCG - the Data Challenge 2004
AliRoot status and PDC’04
April HEPCG Workshop 2006 GSI
Alice Week Offline Day F.Carminati March 18, 2002 ALICE Week India.
Simulation use cases for T2 in ALICE
Use of Geant4 in experiment interactive frameworks AliRoot
Presentation transcript:

1 The AliRoot framework, status and perspectives R.Brun, P.Buncic, F.Carminati, A.Morsch, F.Rademakers, K.Safarik for the ALICE Collaboration CHEP 2003 La Jolla, March 24-28, 2003

2CHEP 2003, La JollaMarch 27, 2003 online system multi-level trigger filter out background reduce data volume level 0 - special hardware 8 kHz (160 GB/sec) level 1 - embedded processors level 2 - PCs 200 Hz (4 GB/sec) 30 Hz (2.5 GB/sec) 30 Hz (1.25 GB/sec) data recording & offline analysis Alice collaboration Total weight10,000t Overall diameter 16.00m Overall length25m Magnetic Field0.4Tesla

3CHEP 2003, La JollaMarch 27, 2003 Strategic decision in 1998 Hits Zebra/RZ/FZ ROOT Framework kinematics in C++ Geometry in C++ Hits Digits ROOT Trees Geant3 Alice Geant3, PAW FORTRAN 129k binaries download 1M clicks per month 30k docs in 12 months 2.2k users in roottalk

4CHEP 2003, La JollaMarch 27, 2003 Root digit structures AliRoot evolution schema ROOT data visualisation Root tracks C++ macro Physics results Alice Offline Framework Root output file Root hits structures C++ macro C++ macro

5CHEP 2003, La JollaMarch 27, 2003 Framework AliRoot framework C++: 400kLOC + 225kLOC (generated) + macros: 77kLOC FORTRAN: 13kLOC (ALICE) + 914kLOC (external packages) Maintained on Linux (any version!), HP-UX, DEC Unix, Solaris Works also with Intel icc compiler Two packages to install (ROOT+AliRoot) + MC’s Less that 1 second to link (thanks to 37 shared libs) 1-click-away install: download and make (non-recursive makefile) AliEn 25kLOC of PERL5 (ALICE) ~2MLOC mostly PERL5 (opens source components) Installed on almost 50 sites by physicists >50 users develop AliRoot from detector groups 70% of code developed outside, 30% by the core Offline team

6CHEP 2003, La JollaMarch 27, 2003 AliRoot layout ROOT AliRoot STEER Virtual MC G3 G4 FLUKA HIJING MEVSIM PYTHIA6 PDF CRT EMCALZDC FMD ITS MUON PHOSPMDTRD TPC TOF STRUCT START RICH RALICE EVGEN HBTP HBTAN ISAJET AliEn

7CHEP 2003, La JollaMarch 27, 2003 Whiteboard Data Communication Class 1Class 2 Class 3 Class 4 Class 5Class 6 Class 7 Class 8

8CHEP 2003, La JollaMarch 27, 2003 The Virtual MC User Code VMC Geometrical Modeller G3 G3 transport G4 transport G4 FLUKA transport FLUKA Reconstruction Visualisation Geant3.tar.gz includes an upgraded Geant3 with a C++ interface Geant4_mc.tar.gz includes the TVirtualMC Geant4 interface classes Generators OPERA Neutrino oscillations, international collaboration CBM Future nucleus-nucleus collision program GSI, Darmstadt Considering of building simulation based on VMC Indicated as a technology of choice by the LHC Simulation Project

9CHEP 2003, La JollaMarch 27, 2003 ALICE 3 million volumes

10CHEP 2003, La JollaMarch 27, 2003 Performance & Checks DetectedNot detected

11CHEP 2003, La JollaMarch 27, 2003 COMMON /TRACKR/ AliMagF TVirtualMCStack TFluka TVirtualMCApplication FLUKAM CASCADE SOURCE MGDRAW ENDRAW MAGFLD

12CHEP 2003, La JollaMarch 27, 2003

13CHEP 2003, La JollaMarch 27, 2003 ALICE Physics Data Challenges Verify model and computing framework Reduce the “technological risk” Understand physics potentialities of the detector Prepare code for simulation, reconstruction and analysis Period (milestone) Fraction of final capacity (%)Physic objectives 06/01-12/011%Pp studies, TPC and ITS reconstruction 06/02-12/02 5% First test of the complete chain from simulation to analysis for the PPR. Simple analysis tools. Digits in ROOT format. 01/04-06/04 10% Compledte chain used for trigger studies. Prototype of analysis tools. Comparisons with parametrised MC. Simulated raw data. 01/06-06/06 20% Test of the final system for reconstruction and analysis.

14CHEP 2003, La JollaMarch 27, 2003 AliEn progress 32 (was 28) sites configured 5 (was 4) sites providing mass storage 12 production rounds jobs validated, 2428 failed (10%) Up to 450 concurrent jobs 0.5 operators Yerevan CERN Saclay Lyon Dubna Capetown, ZA Birmingham Cagliari NIKHEF GSI Catania Bologna Torino Padova IRB Kolkata, India OSU/OSC LBL/NERSC Merida Bari Nantes

15CHEP 2003, La JollaMarch 27, 2003 AliEn as a meta-GRID AliEn User Interface AliEn stackiVDGL stackEDG stack S.Bagnasco DataTAG

16CHEP 2003, La JollaMarch 27, 2003 AliEnFS & Distributed Analysis ******************************************* * * * W E L C O M E to R O O T * * * * Version 3.03/09 3 December 2002 * * * * You are welcome to visit our Web site * * * * * ******************************************* Compiled for linux with thread support. CINT/ROOT C/C++ Interpreter version , Oct Type ? for help. Commands must be C++ statements. Enclose multiple statements between { }. root [0]newanalysis->Submit(); Analysis Macro MSS CE merged Trees +Histograms ? Query for Input Data MSS VFS Kernel LUFS Kernel Space AliEnFS AliEn API User Space castor:// soap:// root:// /alien/ alice/atlas/ data/ prod/ mc/ a/b/ Linux File System MSS

17CHEP 2003, La JollaMarch 27, 2003 Parallel Analysis of Event Data root Remote PROOF Cluster proof TNetFile TFile Local PC $ root ana.C stdout/obj node1 node2 node3 node4 $ root root [0] tree.Process(“ana.C”) $ root root [0] tree.Process(“ana.C”) root [1] gROOT->Proof(“remote”) $ root root [0] tree->Process(“ana.C”) root [1] gROOT->Proof(“remote”) root [2] dset->Process(“ana.C”) ana.C proof proof = slave server proof proof = master server #proof.conf slave node1 slave node2 slave node3 slave node4 *.root TFile 32 Itanium II 2x1GHz, 2 GB RAM, 2x75GB 15K SCSI, Fast/GB Eth

18CHEP 2003, La JollaMarch 27, 2003 Software Development Process ALICE opted for a light core CERN offline team… Concentrate on framework, software distribution and maintenance …plus people from the collaboration GRID coordination (Torino), World Computing Model (Nantes), Detector Database (Warsaw) A development cycle adapted to ALICE has been elaborated Developers work on the most important feature at any moment A stable production version exists Collective ownership of the code Flexible release cycle and simple packaging and installation Micro-cycles happen continuously 2-3 macro-cycles per year Discussed & implemented at Off-line meetings and Code Reviews Corresponding to major code releases We have high-level milestones for technology and physics Computing Data Challenges test technology and integration DAQ – Off-line Physics Data Challenges test the Off-line from the user viewpoint

19CHEP 2003, La JollaMarch 27, 2003 AliRoot maintenance Regular release schedule One major release every six months One minor release (tag) every month Continuous maintenance and support Very few bugs in the production release because the development version is always available Emphasis on delivering production code Corrections, protections, code cleaning, geometry Nightly produced UML diagrams, code listing, coding rule violations, build and testsUML diagramscode listing, coding rule violationsbuild and tests One single repository with production and development coderepository

20CHEP 2003, La JollaMarch 27, 2003 ROOT, ALICE & LCG LCG is the LHC Computing Project The objective is to build the computing environment for LHC ALICE has lobbied strongly to base the LCG project on ROOT and AliEn The choice of the other experiments is to establish a client- provider relationship with ROOT While developing alternatives for some of existing ROOT elements or hiding them behind abstract interfaces And to use the result of GRID MiddleWare projects ALICE has expressed its worries Little time to develop and deploy a new system Duplication and dispersion of efforts Divergence with the rest of the HEP community ALICE will continue to develop its system And to provide basic technology, i.e. VMC and geometrical modeller … and it will try to collaborate with LCG wherever possible

21CHEP 2003, La JollaMarch 27, 2003 Conclusions ALICE has solutions that are evolving into a solid computing infrastructure Major decisions have been taken and users have adopted them Collaboration between physicists and computer scientists is excellent The tight integration with ROOT allows a fast prototyping and development cycle AliEn provides a complete GRID solution adapted to HEP needs and it allowed us large productions with very few people “in charge” Many ALICE-developed solutions have a high potential to be adopted by other experiments and become “common solutions”