1. ROOT 2005 Users Workshop 28,29,30 September Summary
ROOT 2005 Users Workshop 28,29,30 September Summary
LCGapp meeting
5 October 2005
René Brun
CERN
Overview, Major Developments, Directions

2. Overview & Major Developments
115 registered participants
9 posters
5 sessions: 41 talks + 2 discussions
1:status, cint/reflex, I/O
2:graphics, GUI
3:PROOF
4:ROOT in experiments
5:Maths & Stats
ROOT2005 Rene Brun
Overview & Major Developments

3. Overview & Major Developments
Posters
See :
ROOT2005 Rene Brun
Overview & Major Developments

4. Session 1 : Wednesday morning
ROOT2005 Rene Brun
Overview & Major Developments

5. Overview & Major Developments
Project History
Jan 95: Thinking/writing/rewriting/???
November 95: Public seminar, show Root 0.5
Spring 96: decision to use CINT
Jan 97: Root version 1.0
Jan 98: Root version 2.0
Mar 99: Root version 2.21/08 (1st Root workshop FNAL)
Feb 00: Root version 2.23/12 (2nd Root workshop CERN)
Jun 01: Root version 3.01/05 (3rd Root workshop FNAL)
Oct 02: Root version 3.03/09 (4th Root workshop CERN)
Feb 04: Root version 4.00/02 (5th Root workshop SLAC)
May 05: Root version 4.04/02 (current pro release)
Sep 05: Towards version 5.0x (6th Root workshop CERN)
10 years !!
ROOT2005 Rene Brun
Overview & Major Developments

6. New ROOT team structure
The work-packages
SEAL
Lorenzo Moneta
DICT
Philippe Canal
BASE
Fons Rademakers
MATH
Lorenzo Moneta
I/O & Trees
Philippe Canal
2-D/3D graphics
Olivier Couet
GUI
Ilka Antcheva
PROOF
Fons Rademakers
GEOM/VMC
Andrei Gheata
ROOT2005 Rene Brun
Overview & Major Developments

7. Overview & Major Developments
CPU/Node hierarchy
Laptop node
1->32->??N cpus
Local cluster
1000xN cpus
GRID(s)
100x1000 nodes
latency
100 nanos
100 micros
100 millis
Disk
2005
100 Giga
100 Tera
10 Peta
2012
> 1 Peta
> 100 Peta
> 1 Tera
ROOT2005 Rene Brun
Overview & Major Developments

8. Improvements in the I/O Area (*)
Markus
General I/O related improvements
Tree related issues
Plans
(*) I present here, I did not develop it all myself Hence: forgotten credits built-in…
Overview, Major Developments, Directions

9. Overview & Major Developments
Conclusions
Event after 10 years of ROOT:
The I/O area is still moving
There were quite a number of developments
Full STL support
Data compression
Tree I/O from ASCII, tree indices
ROOT2005 Rene Brun
Overview & Major Developments

10. Overview & Major Developments
Conclusions (2)
There will be certainly some developments in the I/O area
The “classical” stuff however is intended to be kept stable
Main focus: Generic Object Reference support
User defined reference objects supported by
User defined reference handlers (proxies)
ROOT2005 Rene Brun
Overview & Major Developments

11. File types & Access in 5.04/xx
user
Local
File
X.xml
TFile
TKey/TTree
TStreamerInfo
TTreeSQL
TSQLServer
TSQLRow
TSQLResult
http
rootd/xrootd
Oracle
Local
File
X.root
MySQL
Dcache
Castor
PgSQL
RFIO
Chirp
SapDb
ROOT2005 Rene Brun
Overview & Major Developments

12. Stefan Roiser CERN / PH / SFT
Reflex & new rootcint
Stefan Roiser
CERN / PH / SFT
Overview, Major Developments, Directions

13. Overview & Major Developments
Integration with ROOT
CINT
API
CINT
interpreter
ROOT
meta
ROOT Meta
PyRoot
Reflex
API
Reflex/CINT
Datastructs
RflxDict.so
pyreflex
ROOT2005 Rene Brun
Overview & Major Developments

14. Dictionary Generation with CINT
rootcint -reflex
CINT parser
rflx_gendict
Type
Selection
Linkdef.h
G__*
.cxx .h
make
.so
.cxx X
User
Program
Core .so
Cint .so
Cintex.so
Reflex .so
ROOT2005 Rene Brun
Overview & Major Developments

15. Dictionary Generation with gccxml
rootcint -gccxml
gcc_xml
.xml
gendict.py
selection.xml
Type
Selection
Linkdef.h
(temp) .h
G__*
.cxx
.so
make
make
.cxx X
Reflex .so
Cintex.so
Cint .so
User
Program
Core .so
ROOT2005 Rene Brun
Overview & Major Developments

16. 2 May 2005 @ CERN Masaharu Goto
Cint version 6
2 May CERN
Masaharu Goto
Overview, Major Developments, Directions

17. Overview & Major Developments
Next steps
For the October release
Releasing the rootcint option –reflex
For the December release
Add option to rootcint to use gcc_xml as the parser (when available)
Adapting the CINT source code to access the Reflex in-memory database
Expected completion by the end of April 2006
ROOT2005 Rene Brun
Overview & Major Developments

18. Overview & Major Developments
National Energy Research
Scientific Computing Center
(NERSC)
PyROOT: A CINT — Python Bridge
Wim T.L.P. Lavrijsen
NERSC HENPC, LBNL
ROOT 2005 Users Workshop, CERN - 09/28/05
ROOT2005 Rene Brun
Overview & Major Developments

19. Session 2: Wednesday afternoon
ROOT2005 Rene Brun
Overview & Major Developments

20. GUI work-package : Plan
High Level Widgets
Editors, Browsers,
Building Blocks Widgets
Combos, scroll bars, dialogs, sliders, MDI, etc
Code generators
Changing
New features
Bug fixes
TVirtualX
Very stable
TGX11
TGWin32Gdk
TGQt
ROOT2005 Rene Brun
Overview & Major Developments

21. Overview & Major Developments
Next Steps (2)
GUI Classes
Oct-05
Dec-05
Mar-06
Undo/Redo Tools
Jul-06
Object Editors
Fit Panel
Style Manager
GUI Builder
...
Table Widget
ROOT2005 Rene Brun
Overview & Major Developments

22. Richard Maunder / Timur Pocheptsov
3D Viewers In ROOT
Richard Maunder / Timur Pocheptsov
Overview, Major Developments, Directions

23. Overview & Major Developments
GL Features : Clipping
ROOT2005 Rene Brun
Overview & Major Developments

24. Overview & Major Developments
Conclusion
3D Architecture:
Now stable – can extend easily for extra shapes etc
Add extensions for:
Scripted control of viewer via TVV3D - clipping, cameras, lights.
Efficient collections of particles/tracks.
Need user input on these.
GL Viewer:
Internal structure now fairly stable + suitable for detector geometry.
Complete clipping and GL-in-Pad.
More native GL shapes to take advantage of performance/quality features.
General components for event display.
ROOT2005 Rene Brun
Overview & Major Developments

25. Overview & Major Developments
The Virtual MC G3
G3 transport
User Code
VMC
G4 transport G4
Geometrical Modeller
FLUKA transport
FLUKA
Generators
Reconstruction
Visualisation
ROOT2005 Rene Brun
Overview & Major Developments

26. Virtual Monte Carlo and ROOT Geometry
TGeant3
Used in production – native GEANT3
New: TGeant3TGeo – interface to G3 using TGeo geometry
No modification required in the user code
See presentation from Ivana Hrivnacova
TGeant4
Used for Geant4 physics validation – G4 native geometry built after g3tog4 conversion
No interface yet between G4 and ROOT geometry
Few possible strategies for this implementation discussed in details at last VMC workshop (see next)
TFluka
Old geometry interface using G4 geometry vis FLUGG
Currently a fully validated geometry interface based on TGeo
ROOT2005 Rene Brun
Overview & Major Developments

27. Geometry interface validation
Done by comparing simulation results for 3 FLUKA examples between FLUKA native and TFluka
Very different setups:
Hadronic and EM transportation from very low to high energies; strong magnetic field (60T !) or no field
Geometries ranging from centimeters to 10 m
Very strong requirement from FLUKA team: same final random number after transportation !
ROOT2005 Rene Brun
Overview & Major Developments

28. AGS and RHIC Online and Offline Models based on MADX-ADXF-UAL suite
(MAD-X Day, Sept. 23, 2005)
MADX 3.x
Design Toolkit
Lattice Database
Magnet Database
UAL 1.12
Off-line Model
SXF
ADXF
AGS & RHIC
MADX-UAL-ROOT
Accelerator Physics Studio
AGS ADXF file
ROOT2005 Rene Brun
Overview & Major Developments

29. Sequel: What would be Next ?
Accelerator + Detector
based on
the Geometry package
ROOT2005 Rene Brun
Overview & Major Developments

30. Session 3 : Thursday morning
ROOT2005 Rene Brun
Overview & Major Developments

31. Overview & Major Developments
ROOT2005 Rene Brun
Overview & Major Developments

32. Overview & Major Developments
PROOF – Multi-tier Architecture
G. Ganis, ROOT05, 29 Sept 2005
Optimize for data locality
If not possible, remote data via (x)rootd, rfiod, dCache …
good connection ?
VERY important
less important
ROOT2005 Rene Brun
Overview & Major Developments

33. Overview & Major Developments
Typical query-time distribution
G. Ganis, ROOT05, 29 Sept 2005
Blocking /
Non-blocking
non-blocking
blocking
ROOT2005 Rene Brun
Overview & Major Developments

34. PROOF and Selectors Client Slaves Slaves
Initialize each slave
Slaves
Many Trees are being processed
Slaves
The same code works also without PROOF (of course!)
Slaves
No user’s control on the order
Slaves
Client
ROOT2005 Rene Brun
Overview & Major Developments

35. Processing information
Query processing
Processing information
Feedback histograms
ROOT2005 Rene Brun
Overview & Major Developments

36. Session 4 : Thursday afternoon
ROOT2005 Rene Brun
Overview & Major Developments

37. Overview & Major Developments
root4star or ROOT?
ROOT4STAR = ROOT+STAR specific
All ROOT features
Interfaces with G3 (strong linking)
STAR additional base Classes (TTable, ...)
Qt based GUIs and Event display
...
A single framework for
Simulation
Data mining
User analysis
Physics ready micro-DST DO NOT need
the framework (root+few libs suffices)
Even works on a laptop running Windows ;-)
ROOT2005 Rene Brun
Overview & Major Developments

38. The two ways to see a framework …
ROOT2005 Rene Brun
Overview & Major Developments

39. Data Sets sizes - Tier0 Projections
Note – Reconstructed ~ raw size
2.2 reconstructed passes …
Huge storage demand
(even greater processing)
ROOT2005 Rene Brun
Overview & Major Developments

40. Distributed Disks – xrootd era
Pftp on local disk from Xrootd
XROOTD provides load balancing, scalability,
a way to avoid LFN/PFN translation
Deployed on 380 nodes (biggest Xrootd usage?)
Needed to wait for the 64 node limitations removal (reported in February, available ~ in April/May)
Warning: moving from ROOTD to Xrootd is not as trivial as it seems in ROOT 4.xx.xx …
Different security model, shaky initial implementation [Should be fixed - Gerri]
ROOTD does only PFN, Xrootd cannot do both PFN and LFN [in progress??]
Several patches sent to the Xrootd team D D D D
ROOT2005 Rene Brun
Overview & Major Developments

41. Configuration, Parameters,
CBM Simulation
ROOT
Geant3
Geometry
Manager
Virtual MC
Geant4
Magnet
FLUKA
Target
IO Manager
GeoInterface
Run Manager
PIPE
Oracle
Configuration, Parameters,
Geometry
RunTime
DataBase
Cave
Module
Primary
Generator
Magnetic
Field
STS
Root files
Configuration,
Parameters,
Geometry
Detector
TRD
Tasks
EVGEN
TOF
Particle
Generator
RICH
Pluto
Field Map
ECAL
ASCII
Urqmd
ROOT2005 Rene Brun
Overview & Major Developments

42. Hades Simulation using Cbmroot, why?
Need to simulate heavy system at High energy
Need external stack for Geant3: internal stack capacity reached
Check data with geant4
Easy to use CBM framework services
The Only efforts:
Definition of Detector MC point container
Field map reader
Conversion from Lab. MC point definition to points defined in the local ref. Frame of the sensitive volume
Modification of some particles physical characteristics:
Use of TVirtualMC::Gspart()
ROOT2005 Rene Brun
Overview & Major Developments

43. Overview & Major Developments
ROOT2005 Rene Brun
Overview & Major Developments

44. Session 5 : Friday morning
ROOT2005 Rene Brun
Overview & Major Developments

45. New Math Libraries organization
ROOT2005 Rene Brun
Overview & Major Developments

46. Vector Performance Tests
comparison tests with TLorentzVector and also CLHEP
performance improvements if used optimal coordinate system
I/O tests
some performance obtained with TLorentzVector if TObject stream is ignored (otherwise performance improvement ~ 20% )
from test program stressVector in root/test
ROOT2005 Rene Brun
Overview & Major Developments

47. Plans for New Fitter interfaces
Improve fitting and minimization interface in ROOT
Redesign taking into account all fitter and minimizer methods present in ROOT
Linear and robust fitter, fraction fitter
Minuit (Migrad, Simplex), quadratic optimization
RooFit
Idea is to have separate interfaces:
Fitting interfaces used to construct an objective function (chi2, likelihood) from data and model function (pdf)
Minimization interfaces to perform the task of finding the function minimum
Various minimizers implementations as separate plug-ins
Use common function interfaces defined in MathCore for numerical algorithms
ROOT2005 Rene Brun
Overview & Major Developments

48. MathCore Current Status
Available now in MathCore:
3D and 4D Vector package
basic Math functions
Can be downloaded as a tar file and built independently from other ROOT libraries
Documentation available at
ROOT2005 Rene Brun
Overview & Major Developments

49. Overview & Major Developments
Conclusions
Released since June (ROOT) first version of new Math library (MathCore )
MathMore is available in 5.04 (see next talk)
Future work:
Add Random numbers
Define interfaces for functions and numerical algorithms to be used by client libraries (TF1)
Redesign fitting interfaces
Import new C++ Minuit
ROOT2005 Rene Brun
Overview & Major Developments

50. Remarks on confidence interval classes in ROOT (what should I use ?)
J. Conrad (CERN)
The confidence interval classes in ROOT
1) Concepts
2) Performance: Coverage
3) Properties and Applicability
How to decide what to use ?
What is missing (IMHO) ?
Summary
user
support
talk
ROOT2005 Rene Brun
Overview & Major Developments