Overview, Major Developments, Directions1 ROOT Project Status Major developments Directions NSS05 Conference 25 October Ren é Brun CERN Based on my presentation at the ROOT workshop 2005 See

NSS05 Rene BrunOverview of the ROOT system2 The ROOT Project see The ROOT system provides a set of OO frameworks with all the functionality needed to handle and analyze large amounts of data in a very efficient way. Having the data defined as a set of objects, specialized storage methods are used to get direct access to the separate attributes of the selected objects, without having to touch the bulk of the data. Included are histograming methods in 1, 2 and 3 dimensions, curve fitting, function evaluation, minimization, graphics and visualization classes to allow the easy setup of an analysis system that can query and process the data interactively or in batch mode. Thanks to the builtin CINT C++ interpreter the command language, the scripting, or macro, language and the programming language are all C++. The interpreter allows for fast prototyping of the macros since it removes the time consuming compile/link cycle. The interactively developed macros can be compiled using a C++ compiler. A Python interface is also available. The system has been designed in such a way that it can query its databases in parallel on MPP machines or on clusters of high-end PC's. ROOT is an open system that can be dynamically extended by linking external libraries. This makes ROOT a premier platform on which to build data acquisition, simulation and data analysis systems.

NSS05 Rene BrunOverview of the ROOT system3 ROOT: large user community

NSS05 Rene BrunOverview of the ROOT system4 ROOT version 5 The ROOT project started in 1995 is now a mature product with 2 PRO releases/year and monthly development releases. pro release 4.04/02 3 May (new Users Guide) 1st dev release June 2nd dev release September 3rd dev release October Pro release December See detailed Release Notes See presentations at the ROOT workshop

NSS05 Rene BrunOverview of the ROOT system5 ROOT team structure GUI Ilka Antcheva SEAL Lorenzo Moneta PROOF Fons Rademakers I/O & Trees Philippe Canal DICT Philippe Canal MATH Lorenzo Moneta 2-D/3D graphics Olivier Couet GEOM/VMC Andrei Gheata BASE Fons Rademakers The work-packages ROOT is an Open Source project with main teams from CERN, FNAL, MIT and Agilent/Japan. ROOT is distributed under LGPL.

NSS05 Rene BrunOverview of the ROOT system6 BASE work-package : Plan plug-in manager extensions port to new platforms I/O thread safe New THtml & Help/Doc system

NSS05 Rene BrunOverview of the ROOT system7 DICT work-package : Plan New version of Reflex New version of rootcint rootcint  CINT rootcint -> Reflex ->Cintex ->CINT rootcint ->gccxml -> Reflex -> CINT Adapt PyRoot to Reflex Adapt CINT to Reflex The Dictionary/Reflexion system describes the classes to the system. It is a very important component.

NSS05 Rene BrunOverview of the ROOT system8 Dictionaries : root only X.h CINT DS rootcint XDictcint.cxx CINT API ROOT Root meta C++ CINT

NSS05 Rene BrunOverview of the ROOT system9 Dictionaries : situation today X.h X.xml XDictlcg.cxx REFLEX DS CINT DS rootcint lcgdict gccxml XDictcint.cxx CINT API REFLEX API ROOT Root meta C++ CINT cintex

NSS05 Rene BrunOverview of the ROOT system10 Dictionaries : situation in the future X.h Reflex/Cint DS new rootcint Gccxml2reflex/cint XDictcint.cxx CINT/Reflex API ROOT Root meta C++ CINT Python

NSS05 Rene BrunOverview of the ROOT system11 IO work-package : Plan Consolidation, Consolidation, Consolidation Consolidation, Consolidation, Consolidation More cases in auto schema evolution Better support for references read ahead with large caches TreeSQL TBitmapIndex (speed-up Tree queries) ROOT is used today to process PetaBytes of data. Even more important for LHC

NSS05 Rene BrunOverview of the ROOT system12 MATH work-package : Plan Adapt ROOT classes to MathCore TF1,2,3, Fitting Virtual Fitter extensions corresponding changes in ROOT fitting and roofit Fitting GUI Box plots, qqplots Many new tools required for LHC Physics analysis

NSS05 Rene BrunOverview of the ROOT system13 New Math Libraries organization

NSS05 Rene BrunOverview of the ROOT system14 Graphics work-package : Plan zillions of micro/mini features reimplement (TGaxis) GL with new GUI GL for dynamic tracks Event Display infrastructure

NSS05 Rene BrunOverview of the ROOT system15 GUI work-package : Plan zillions of micro/mini features GUI Builder completion New Editor Widgets Fit Panel widget

NSS05 Rene BrunOverview of the ROOT system16 GUI work-package : Plan TVirtualX TGX11TGWin32GdkTGQt Building Blocks Widgets Combos, scroll bars, dialogs, sliders, MDI, etc Code generators High Level Widgets Editors, Browsers, Very stable Changing New features Bug fixes

NSS05 Rene BrunOverview of the ROOT system17 GEOM work-package : Plan Support for parameterized shapes. This will reduce the geometry size in memory for certain geometries defined in G3 style. CAD geometry import Geometry builder GUI

NSS05 Rene BrunOverview of the ROOT system18 The Virtual MC User Code VMC Geometrical Modeller G3 G3 transport G4 transport G4 FLUKA transport FLUKA Reconstruction Visualisation Generators

NSS05 Rene BrunOverview of the ROOT system19 Very complex geometries created using ROOT TGeo classes ATLAS ALICE CMS LHCB

NSS05 Rene BrunOverview of the ROOT system20 PROOF: major development area The PROOF system allows:  parallel analysis of trees in a set of files  parallel analysis of objects in a set of files  parallel execution of scripts on clusters of heterogeneous machines Its main design goals are:  Transparency: input objects copied from client, output objects merged, returned to client  Scalability and Adaptability: Varying packet size (depends on number of workers and their relative performance)

NSS05 Rene BrunOverview of the ROOT system21 PROOF work-package : Plan Build a test bed Get Users (help with selectors) Interfaces with data management services Provide the full ROOT service in PROOF mode exploit possible large memory caches good connection ? VERY important less important

NSS05 Rene BrunOverview of the ROOT system22 Typical query-time distribution G. Ganis, ROOT05, 29 Sept 2005 blocking Blocking / Non-blocking non-blocking

NSS05 Rene BrunOverview of the ROOT system23 PROOF and Selectors No user’s control on the order Many Trees are being processed Initialize each slave The same code works also without PROOF (of course!) Client Slaves

NSS05 Rene BrunOverview of the ROOT system24 Feedback histograms Processing information PROOF processing: API & GUI

NSS05 Rene BrunOverview of the ROOT system25 PROOF and XROOTD XROOTD (from Babar) is already playing a very important role in PROOF. It will continue to play a growing role. The PROOF and XROOTD teams are cooperating to get even more from XROOTD: caching, read ahead, new XROOTD services. Still a lot to do to have a good integration of XROOTD with other services like CASTOR.

NSS05 Rene BrunOverview of the ROOT system26 CPU/Node hierarchy latency100 nanos100 micros100 millis Disk Giga100 Tera10 Peta Disk 2012 > 1 Peta > 100 Peta> 1 Tera Laptop node 1->32->??N cpus Local cluster 1000xN cpus GRID(s) 100x1000 nodes