ROOT 2005 Users Workshop 28,29,30 September Summary

Slides:



Advertisements
Similar presentations
Andreas Morsch CERN/ALICE 3rd LHC Computing WorkshopMarseille, September 30, 1999 Base Classes for Simulation The ALICE Simulation Strategy Andreas Morsch.
Advertisements

Blueprint RTAGs1 Coherent Software Framework a Proposal LCG meeting CERN- 11 June Ren é Brun ftp://root.cern.ch/root/blueprint.ppt.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
June 21, PROOF - Parallel ROOT Facility Maarten Ballintijn, Rene Brun, Fons Rademakers, Gunter Roland Bring the KB to the PB.
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
JCE A Java-based Commissioning Environment tool Hiroyuki Sako, JAEA Hiroshi Ikeda, Visible Information Center Inc. SAD Workshop.
ROOT An object oriented HEP analysis framework.. Computing in Physics Physics = experimental science =>Experiments (e.g. at CERN) Planning phase Physics.
IFluka : a C++ interface between Fairroot and Fluka Motivations Design The CBM case: –Geometry implementation –Settings for radiation studies –Global diagnosis.
Usage of ROOT geometry with GEANT4
Java Root IO Part of the FreeHEP Java Library Tony Johnson Mark Dönszelmann
IFluka : a C++ interface between Fairroot and Fluka Motivations Design The CBM case: –Geometry implementation –Settings for radiation studies –Global diagnosis.
Root based event display Dmitry Romanov October 19, 2010.
ALICE Simulation Framework Ivana Hrivnacova 1 and Andreas Morsch 2 1 NPI ASCR, Rez, Czech Republic 2 CERN, Geneva, Switzerland For the ALICE Collaboration.
Andreas Morsch, CERN EP/AIP CHEP 2003 Simulation in ALICE Andreas Morsch For the ALICE Offline Project 2003 Conference for Computing in High Energy and.
ACAT 2005 Workshop, May UAL Interactive Analysis Environment Interactive Analysis Environment of Unified Accelerator Libraries V. Fine, N. Malitsky,
ROOT Future1 Some views on the ROOT future ROOT Workshop 2001 June 13 FNAL Ren é Brun CERN.
Virtual Monte Carlo and new geometry description in STAR Maxim Potekhin STAR Collaboration Meeting, BNL July 17, 2004 July 17, 2004.
The Virtual MonteCarlo D.Adamova 2, V.Berejnoi 1, R.Brun 1, F.Carminati 1, A.Fassó 1, E.Futo 1, I.Gonzalez 3, I.Hrivnacova 4, A.Morsch 1 1 CERN, Geneva;
Simulations for CBM CBM-India Meeting, Jammu, 12 February 2008 V. Friese
Geant4 in production: status and developments John Apostolakis (CERN) Makoto Asai (SLAC) for the Geant4 collaboration.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
Introduction What is detector simulation? A detector simulation program must provide the possibility of describing accurately an experimental setup (both.
VMC workshop1 Ideas for G4 navigation interface using ROOT geometry A.Gheata ALICE offline week, 30 May 05.
CBM ECAL simulation status Prokudin Mikhail ITEP.
ROOT 2005 Workshop, Sept UAL and ROOT The next episode in the UAL and ROOT integration V. Fine, N. Malitsky, R.Talman.
Mantid Stakeholder Review Nick Draper 01/11/2007.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev ROOT 2002 GSI Online Offline Object Oriented Go4.
ROOT Data bases access1 LCG Data base deployment workshop 11 October Ren é Brun CERN.
March, PROOF - Parallel ROOT Facility Maarten Ballintijn Bring the KB to the PB not the PB to the KB.
Super Scaling PROOF to very large clusters Maarten Ballintijn, Kris Gulbrandsen, Gunther Roland / MIT Rene Brun, Fons Rademakers / CERN Philippe Canal.
Jerome Lauret – ROOT Workshop 2005, CERN, CH ROOT4STAR: a ROOT based framework for user analysis and data mining J é r ô me Lauret -
Overview, Major Developments, Directions1 ROOT Project Status Major developments Directions NSS05 Conference 25 October Ren é Brun CERN Based on my presentation.
CINT/Reflex workshop 1 Rene Brun 4 May 2005 Summary of the CINT/Reflex workshop 2-6 May 2005
LCG AA Meeting 30 June 2004 Ilka Antcheva Graphics User Interface in ROOT.
Follow-up to SFT Review (2009/2010) Priorities and Organization for 2011 and 2012.
MAUS Status A. Dobbs CM43 29 th October Contents MAUS Overview Infrastructure Geometry and CDB Detector Updates CKOV EMR KL TOF Tracker Global Tracking.
Fermilab Scientific Computing Division Fermi National Accelerator Laboratory, Batavia, Illinois, USA. Off-the-Shelf Hardware and Software DAQ Performance.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Status of TFluka: geometry and validation Andrei Gheata ALICE Off-line week, 21 Feb
Monthly video-conference, 18/12/2003 P.Hristov1 Preparation for physics data challenge'04 P.Hristov Alice monthly off-line video-conference December 18,
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
ROOT / Reflex ‘07+ Stefan Roiser Missed last team meeting b/c.
Go4 v2.2 Status & Overview CHEP 2003
Progress Apama Fundamentals
Jean-Philippe Baud, IT-GD, CERN November 2007
Stefan Roiser CERN / PH / SFT
ALICE Computing Data Challenge VI
Database Replication and Monitoring
Current Status of the Geometry Database for the CBM Experiment
ROOT Base and SealBase Fons Rademakers Ilka Antcheva Bertrand Bellenot
SFT-CORE-ROOT team structure
(on behalf of the POOL team)
CMS High Level Trigger Configuration Management
Complex Geometry Visualization TOol
ROOT Project Status Report
INFN-GRID Workshop Bari, October, 26, 2004
The LHCb Software and Computing NSS/IEEE workshop Ph. Charpentier, CERN B00le.
Distributed object monitoring for ROOT analyses with Go4 v.3
Readiness of ATLAS Computing - A personal view
Dirk Düllmann CERN Openlab storage workshop 17th March 2003
Ideas for G4 navigation interface using ROOT geometry
Project Status and Plan
Oracle Architecture Overview
Support for ”interactive batch”
Use of Geant4 in experiment interactive frameworks AliRoot
Simulation and Physics
Use of GEANT4 in CMS The OSCAR Project
SEAL Project Core Libraries and Services
Status and plans for bookkeeping system and production tools
Presentation transcript:

ROOT 2005 Users Workshop 28,29,30 September Summary http://root.cern.ch/root/R2005/Welcome.html ROOT 2005 Users Workshop 28,29,30 September Summary LCGapp meeting 5 October 2005 René Brun CERN Overview, Major Developments, Directions

Overview & Major Developments 115 registered participants 9 posters 5 sessions: 41 talks + 2 discussions 1:status, cint/reflex, I/O 2:graphics, GUI 3:PROOF 4:ROOT in experiments 5:Maths & Stats ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Posters See : http://root.cern.ch/root/posters/Posters.html ROOT2005 Rene Brun Overview & Major Developments

Session 1 : Wednesday morning ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Project History Jan 95: Thinking/writing/rewriting/??? November 95: Public seminar, show Root 0.5 Spring 96: decision to use CINT Jan 97: Root version 1.0 Jan 98: Root version 2.0 Mar 99: Root version 2.21/08 (1st Root workshop FNAL) Feb 00: Root version 2.23/12 (2nd Root workshop CERN) Jun 01: Root version 3.01/05 (3rd Root workshop FNAL) Oct 02: Root version 3.03/09 (4th Root workshop CERN) Feb 04: Root version 4.00/02 (5th Root workshop SLAC) May 05: Root version 4.04/02 (current pro release) Sep 05: Towards version 5.0x (6th Root workshop CERN) 10 years !! ROOT2005 Rene Brun Overview & Major Developments

New ROOT team structure The work-packages SEAL Lorenzo Moneta DICT Philippe Canal BASE Fons Rademakers MATH Lorenzo Moneta I/O & Trees Philippe Canal 2-D/3D graphics Olivier Couet GUI Ilka Antcheva PROOF Fons Rademakers GEOM/VMC Andrei Gheata ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments CPU/Node hierarchy Laptop node 1->32->??N cpus Local cluster 1000xN cpus GRID(s) 100x1000 nodes latency 100 nanos 100 micros 100 millis Disk 2005 100 Giga 100 Tera 10 Peta 2012 > 1 Peta > 100 Peta > 1 Tera ROOT2005 Rene Brun Overview & Major Developments

Improvements in the I/O Area (*) Markus General I/O related improvements Tree related issues Plans (*) I present here, I did not develop it all myself Hence: forgotten credits built-in… Overview, Major Developments, Directions

Overview & Major Developments Conclusions Event after 10 years of ROOT: The I/O area is still moving There were quite a number of developments Full STL support Data compression Tree I/O from ASCII, tree indices ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Conclusions (2) There will be certainly some developments in the I/O area The “classical” stuff however is intended to be kept stable Main focus: Generic Object Reference support User defined reference objects supported by User defined reference handlers (proxies) ROOT2005 Rene Brun Overview & Major Developments

File types & Access in 5.04/xx user Local File X.xml TFile TKey/TTree TStreamerInfo TTreeSQL TSQLServer TSQLRow TSQLResult http rootd/xrootd Oracle Local File X.root MySQL Dcache Castor PgSQL RFIO Chirp SapDb ROOT2005 Rene Brun Overview & Major Developments

Stefan Roiser CERN / PH / SFT Reflex & new rootcint Stefan Roiser CERN / PH / SFT Overview, Major Developments, Directions

Overview & Major Developments Integration with ROOT CINT API CINT interpreter ROOT meta ROOT Meta PyRoot Reflex API Reflex/CINT Datastructs RflxDict.so pyreflex ROOT2005 Rene Brun Overview & Major Developments

Dictionary Generation with CINT rootcint -reflex CINT parser rflx_gendict Type Selection Linkdef.h G__* .cxx .h make .so .cxx X User Program Core .so Cint .so Cintex.so Reflex .so ROOT2005 Rene Brun Overview & Major Developments

Dictionary Generation with gccxml rootcint -gccxml gcc_xml .xml gendict.py selection.xml Type Selection Linkdef.h (temp) .h G__* .cxx .so make make .cxx X Reflex .so Cintex.so Cint .so User Program Core .so ROOT2005 Rene Brun Overview & Major Developments

2 May 2005 @ CERN Masaharu Goto Cint version 6 2 May 2005 @ CERN Masaharu Goto Overview, Major Developments, Directions

Overview & Major Developments Next steps For the October release Releasing the rootcint option –reflex For the December release Add option to rootcint to use gcc_xml as the parser (when available) Adapting the CINT source code to access the Reflex in-memory database Expected completion by the end of April 2006 ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments National Energy Research Scientific Computing Center (NERSC) PyROOT: A CINT — Python Bridge Wim T.L.P. Lavrijsen NERSC HENPC, LBNL ROOT 2005 Users Workshop, CERN - 09/28/05 ROOT2005 Rene Brun Overview & Major Developments

Session 2: Wednesday afternoon ROOT2005 Rene Brun Overview & Major Developments

GUI work-package : Plan High Level Widgets Editors, Browsers, Building Blocks Widgets Combos, scroll bars, dialogs, sliders, MDI, etc Code generators Changing New features Bug fixes TVirtualX Very stable TGX11 TGWin32Gdk TGQt ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Next Steps (2) GUI Classes Oct-05 Dec-05 Mar-06 Undo/Redo Tools Jul-06 Object Editors Fit Panel Style Manager GUI Builder ... Table Widget ROOT2005 Rene Brun Overview & Major Developments

Richard Maunder / Timur Pocheptsov 3D Viewers In ROOT Richard Maunder / Timur Pocheptsov Overview, Major Developments, Directions

Overview & Major Developments GL Features : Clipping ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Conclusion 3D Architecture: Now stable – can extend easily for extra shapes etc Add extensions for: Scripted control of viewer via TVV3D - clipping, cameras, lights. Efficient collections of particles/tracks. Need user input on these. GL Viewer: Internal structure now fairly stable + suitable for detector geometry. Complete clipping and GL-in-Pad. More native GL shapes to take advantage of performance/quality features. General components for event display. ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments The Virtual MC G3 G3 transport User Code VMC G4 transport G4 Geometrical Modeller FLUKA transport FLUKA Generators Reconstruction Visualisation ROOT2005 Rene Brun Overview & Major Developments

Virtual Monte Carlo and ROOT Geometry TGeant3 Used in production – native GEANT3 New: TGeant3TGeo – interface to G3 using TGeo geometry No modification required in the user code See presentation from Ivana Hrivnacova TGeant4 Used for Geant4 physics validation – G4 native geometry built after g3tog4 conversion No interface yet between G4 and ROOT geometry Few possible strategies for this implementation discussed in details at last VMC workshop (see next) TFluka Old geometry interface using G4 geometry vis FLUGG Currently a fully validated geometry interface based on TGeo ROOT2005 Rene Brun Overview & Major Developments

Geometry interface validation Done by comparing simulation results for 3 FLUKA examples between FLUKA native and TFluka Very different setups: Hadronic and EM transportation from very low to high energies; strong magnetic field (60T !) or no field Geometries ranging from centimeters to 10 m Very strong requirement from FLUKA team: same final random number after transportation ! ROOT2005 Rene Brun Overview & Major Developments

AGS and RHIC Online and Offline Models based on MADX-ADXF-UAL suite (MAD-X Day, Sept. 23, 2005) MADX 3.x Design Toolkit Lattice Database Magnet Database UAL 1.12 Off-line Model SXF ADXF AGS & RHIC MADX-UAL-ROOT Accelerator Physics Studio AGS ADXF file ROOT2005 Rene Brun Overview & Major Developments

Sequel: What would be Next ? Accelerator + Detector based on the Geometry package ROOT2005 Rene Brun Overview & Major Developments

Session 3 : Thursday morning ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments PROOF – Multi-tier Architecture G. Ganis, ROOT05, 29 Sept 2005 Optimize for data locality If not possible, remote data via (x)rootd, rfiod, dCache … good connection ? VERY important less important ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Typical query-time distribution G. Ganis, ROOT05, 29 Sept 2005 Blocking / Non-blocking non-blocking blocking ROOT2005 Rene Brun Overview & Major Developments

PROOF and Selectors Client Slaves Slaves Initialize each slave Slaves Many Trees are being processed Slaves The same code works also without PROOF (of course!) Slaves No user’s control on the order Slaves Client ROOT2005 Rene Brun Overview & Major Developments

Processing information Query processing Processing information Feedback histograms ROOT2005 Rene Brun Overview & Major Developments

Session 4 : Thursday afternoon ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments root4star or ROOT? ROOT4STAR = ROOT+STAR specific All ROOT features Interfaces with G3 (strong linking) STAR additional base Classes (TTable, ...) Qt based GUIs and Event display ... A single framework for Simulation Data mining User analysis Physics ready micro-DST DO NOT need the framework (root+few libs suffices) Even works on a laptop running Windows ;-) ROOT2005 Rene Brun Overview & Major Developments

The two ways to see a framework … ROOT2005 Rene Brun Overview & Major Developments

Data Sets sizes - Tier0 Projections Note – Reconstructed ~ raw size 2.2 reconstructed passes … Huge storage demand (even greater processing) ROOT2005 Rene Brun Overview & Major Developments

Distributed Disks – xrootd era Pftp on local disk from Xrootd XROOTD provides load balancing, scalability, a way to avoid LFN/PFN translation Deployed on 380 nodes (biggest Xrootd usage?) Needed to wait for the 64 node limitations removal (reported in February, available ~ in April/May) Warning: moving from ROOTD to Xrootd is not as trivial as it seems in ROOT 4.xx.xx … Different security model, shaky initial implementation [Should be fixed - Gerri] ROOTD does only PFN, Xrootd cannot do both PFN and LFN [in progress??] Several patches sent to the Xrootd team D D D D ROOT2005 Rene Brun Overview & Major Developments

Configuration, Parameters, CBM Simulation ROOT Geant3 Geometry Manager Virtual MC Geant4 Magnet FLUKA Target IO Manager GeoInterface Run Manager PIPE Oracle Configuration, Parameters, Geometry RunTime DataBase Cave Module Primary Generator Magnetic Field STS Root files Configuration, Parameters, Geometry Detector TRD Tasks EVGEN TOF Particle Generator RICH Pluto Field Map ECAL ASCII Urqmd ROOT2005 Rene Brun Overview & Major Developments

Hades Simulation using Cbmroot, why? Need to simulate heavy system at High energy Need external stack for Geant3: internal stack capacity reached Check data with geant4 Easy to use CBM framework services The Only efforts: Definition of Detector MC point container Field map reader Conversion from Lab. MC point definition to points defined in the local ref. Frame of the sensitive volume Modification of some particles physical characteristics: Use of TVirtualMC::Gspart() ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments CbmRoot@GF+E ROOT2005 Rene Brun Overview & Major Developments

Session 5 : Friday morning ROOT2005 Rene Brun Overview & Major Developments

New Math Libraries organization ROOT2005 Rene Brun Overview & Major Developments

Vector Performance Tests comparison tests with TLorentzVector and also CLHEP performance improvements if used optimal coordinate system I/O tests some performance obtained with TLorentzVector if TObject stream is ignored (otherwise performance improvement ~ 20% ) from test program stressVector in root/test ROOT2005 Rene Brun Overview & Major Developments

Plans for New Fitter interfaces Improve fitting and minimization interface in ROOT Redesign taking into account all fitter and minimizer methods present in ROOT Linear and robust fitter, fraction fitter Minuit (Migrad, Simplex), quadratic optimization RooFit Idea is to have separate interfaces: Fitting interfaces used to construct an objective function (chi2, likelihood) from data and model function (pdf) Minimization interfaces to perform the task of finding the function minimum Various minimizers implementations as separate plug-ins Use common function interfaces defined in MathCore for numerical algorithms ROOT2005 Rene Brun Overview & Major Developments

MathCore Current Status Available now in MathCore: 3D and 4D Vector package basic Math functions Can be downloaded as a tar file and built independently from other ROOT libraries Documentation available at http://seal.web.cern.ch/seal/MathLibs/MathCore-5_0_4/html/index.html ROOT2005 Rene Brun Overview & Major Developments

Overview & Major Developments Conclusions Released since June (ROOT) first version of new Math library (MathCore ) MathMore is available in 5.04 (see next talk) Future work: Add Random numbers Define interfaces for functions and numerical algorithms to be used by client libraries (TF1) Redesign fitting interfaces Import new C++ Minuit ROOT2005 Rene Brun Overview & Major Developments

Remarks on confidence interval classes in ROOT (what should I use ?) J. Conrad (CERN) The confidence interval classes in ROOT 1) Concepts 2) Performance: Coverage 3) Properties and Applicability How to decide what to use ? What is missing (IMHO) ? Summary user support talk ROOT2005 Rene Brun Overview & Major Developments