24 - 29 March 2003 Conference for Computing in High Energy and Nuclear Physics1 ROOT Status and Future Developments CHEP 2003 La Jolla, CA March 24th Ren.

Slides:



Advertisements
Similar presentations
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2004 Go4 v2.8 Analysis Design.
Advertisements

LINUX-WINDOWS INTERACTION. One software allowing interaction between Linux and Windows is WINE. Wine allows Linux users to load Windows programs while.
CHEP031 Analysis of CMS Heavy Ion Simulation Data Using ROOT/PROOF/Grid Jinghua Liu for Pablo Yepes, Jinghua Liu Rice University, Houston, TX Maarten Ballintijn,
Blueprint RTAGs1 Coherent Software Framework a Proposal LCG meeting CERN- 11 June Ren é Brun ftp://root.cern.ch/root/blueprint.ppt.
O. Stézowski IPN Lyon AGATA Week September 2003 Legnaro Data Analysis – Team #3 ROOT as a framework for AGATA.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
June 21, PROOF - Parallel ROOT Facility Maarten Ballintijn, Rene Brun, Fons Rademakers, Gunter Roland Bring the KB to the PB.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL June 23, 2003 GAE workshop Caltech.
An Overview of Qt - asankar1. Agenda About Qt –A brief intro of Qt Qt development tools –Tools used for building Qt application Qt Architecture –The underlying.
Bertrand Bellenot root.cern.ch ROOT I/O in JavaScript Reading ROOT files from any web browser ROOT Users Workshop
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
Introduction to HP LoadRunner Getting Familiar with LoadRunner >>>>>>>>>>>>>>>>>>>>>>
Sept 11, 2003ROOT Day1, Suzanne Panacek39 ROOT An object oriented HEP analysis framework. Day 1.
ROOT An object oriented HEP analysis framework.. Computing in Physics Physics = experimental science =>Experiments (e.g. at CERN) Planning phase Physics.
ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.
Zubanov Alexei, 2006 Aug 07 – Sep 28 QtROOT package extension with Coin3D lib.
CINT Retrospect ROOT Workshop Mar 2013 Agilent Technologies Masaharu Goto.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
Bertrand Bellenot ROOT Users Workshop Mar ROOT GUI Builder Status & Plans ROOT & External GUI World MFC, FOX, Qt, PVSS… Snapshot of the Future.
Java Analysis Studio Status Update 12 May 2000 Altas Software Week Tony Johnson
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
21-Apr-2005J. Adamczewski1 DVEE C++ course 2005 The ROOT framework 1: Introduction.
THttpServer class Sergey Linev (GSI). Some history Development was inspired by JSRootIO why not achieve similar functionality with online ROOT application?
Java Root IO Part of the FreeHEP Java Library Tony Johnson Mark Dönszelmann
1 Marek BiskupACAT2005PROO F Parallel Interactive and Batch HEP-Data Analysis with PROOF Maarten Ballintijn*, Marek Biskup**, Rene Brun**, Philippe Canal***,
ROOT for Data Analysis1 Intel discussion meeting CERN 5 Oct 2003 Ren é Brun CERN Distributed Data Analysis.
ROOT Dreams & Facts ROOT Users Workshop: Saas Fe September René Brun.
“Paper” output Root Graphics Workshop 16/07/2010.
THttpServer for ROOT Bertrand Bellenot, CERN Sergey Linev, GSI Darmstadt
ROOT and Federated Data Stores What Features We Would Like Fons Rademakers CERN CC-IN2P3, Nov, 2011, Lyon, France.
ROOT Future1 Some views on the ROOT future ROOT Workshop 2001 June 13 FNAL Ren é Brun CERN Interesting to look at our programme of work 16 months ago.
ROOT Future1 Some views on the ROOT future ROOT Workshop 2001 June 13 FNAL Ren é Brun CERN.
New software library of geometrical primitives for modelling of solids used in Monte Carlo detector simulations Marek Gayer, John Apostolakis, Gabriele.
Jump to first page The new ROOT geometry package Andrei Gheata - ALICE Institute of Space Sciences, Bucharest.
H.G.Essel: Go4 - J. Adamczewski, M. Al-Turany, D. Bertini, H.G.Essel, S.Linev CHEP 2003 GSI Online Offline Object Oriented Go4.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
VMC workshop1 Ideas for G4 navigation interface using ROOT geometry A.Gheata ALICE offline week, 30 May 05.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
FreeHEP, JAS and WIRED Mark Dönszelmann, CERN/IT Charles Loomis, UC, Santa Cruz ATLAS Software Week, 30 November 2000.
9/28/2005Philippe Canal, ROOT Workshop TTree / SQL Philippe Canal (FNAL) 2005 Root Workshop.
March, PROOF - Parallel ROOT Facility Maarten Ballintijn Bring the KB to the PB not the PB to the KB.
Super Scaling PROOF to very large clusters Maarten Ballintijn, Kris Gulbrandsen, Gunther Roland / MIT Rene Brun, Fons Rademakers / CERN Philippe Canal.
R.Brun: April 30ROOT Status & developments1 ROOT Status and Current Developments LCGapp meeting April Ren é Brun, CERN (for the ROOT team)
- GMA Athena (24mar03 - CHEP La Jolla, CA) GMA Instrumentation of the Athena Framework using NetLogger Dan Gunter, Wim Lavrijsen,
Giulio Eulisse, Northeastern University CHEP’04, Interlaken, 27th Sep - 1st Oct, 2004 CHEP’04 IGUANA Interactive Graphics Project:
Overview, Major Developments, Directions1 ROOT Project Status Major developments Directions NSS05 Conference 25 October Ren é Brun CERN Based on my presentation.
Latest Improvements in the PROOF system Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers, Gerri Ganis, Jan Iwaszkiewicz CERN.
Latest Improvements in the PROOF system Bleeding Edge Physics with Bleeding Edge Computing Fons Rademakers, Gerri Ganis, Jan Iwaszkiewicz CERN.
Overview & Major Developments1 Workshop Overview Summary of major developments ROOT Workshop 2002 CERN 14 October Ren é Brun CERN
CHEP06, Mumbai, India February 2006 General Status of ROOT GUI Ilka Antcheva, Bertrand Bellenot, René Brun, Valeriy Onuchin *, Fons Rademakers CERN,
1 G4UIRoot Isidro González ALICE ROOT /10/2002.
LCG AA Meeting 30 June 2004 Ilka Antcheva Graphics User Interface in ROOT.
Next Generation of Apache Hadoop MapReduce Owen
What is New in Core Fons Rademakers 1. Library Reorganization Split off from libCore: libRIO libNet libMath (soon) These libraries are now loaded at run-
Wednesday NI Vision Sessions
2001 ROOT Workshop The Summary. Content Most Requested Request already satisfied Build and Distribution Web Page Information and Documentation.
LCG AA Internal Review 30 March 2005 ROOT Graphical User Interface Ilka Antcheva, Bertrand Bellenot, Valeri Fine, Valeriy Onuchin, Fons Rademakers.
Go4 v2.2 Status & Overview CHEP 2003
ROOT Base and SealBase Fons Rademakers Ilka Antcheva Bertrand Bellenot
CMS High Level Trigger Configuration Management
Getting Started with R.
PROOF – Parallel ROOT Facility
Distributed object monitoring for ROOT analyses with Go4 v.3
Support for ”interactive batch”
PROOF - Parallel ROOT Facility
Introducing Windows Operating Systems
ROOT Support and Developments at FNAL
Presentation transcript:

March 2003 Conference for Computing in High Energy and Nuclear Physics1 ROOT Status and Future Developments CHEP 2003 La Jolla, CA March 24th Ren é Brun, CERN Philippe Canal, Fermilab Masa Goto, Agilent technologies Fons Rademakers, CERN

March 2003 Conference for Computing in High Energy and Nuclear Physics2 Project History Jan 95: Thinking/writing/rewriting/??? November 95: Public seminar, show Root 0.5 Spring 96: decision to use CINT Jan 97: Root version 1.0 Jan 98: Root version 2.0 Mar 99: Root version 2.21/08 (1st Root workshop FNAL) Feb 00: Root version 2.23/12 (2nd Root workshop CERN) Mar 01: Root version 3.00/06 Jun 01: Root version 3.01/05 (3rd Root workshop FNAL) Jan 02: Root version 3.02/07 (LCG project starts: RTAGs) Oct 02: Root version 3.03/09 (4th Root workshop CERN) Mar 03: Root version 3.05/03 8 years !!

March 2003 Conference for Computing in High Energy and Nuclear Physics3 Official Support A very important step for the ROOT project Support provided by new SFT group in EP division As a result new manpower in the project

March 2003 Conference for Computing in High Energy and Nuclear Physics4 ROOT Team & Associates ROOT Team: Ilka Antcheva (LCG staff) (since 1st Aug 2002) Rene Brun: new SFT group and Alice part time Philippe Canal (FNAL/CD) (since 1998) Olivier Couet CERN (from PAW) (since 1st Jun 2002) Masa Goto (Agilent technologies) Valeriy Onuchin (LCG project associate) (since 1st Feb 2002) Fons Rademakers: Alice and new SFT group Associates Bertrand Bellenot (scopus) Win32gdk (since June 2000) Maarten Ballintijn (MIT/Phobos) PROOF (since Sep 2001) Andrei Gheata: (Alice) Geometry package (since Sep 2001)

March 2003 Conference for Computing in High Energy and Nuclear Physics5 ROOT Team & Associates (2) Now in the LCG(LHC Computing GRID context) Valery Fine (BNL/Atlas) I/O, TVirtualX/Qt Victor Perevoztchikov (BNL/Atlas) STL, foreign classes AND more than 50 important contributions from people spending a substantial fraction of their time on the project. See $ROOTSYS/README/CREDITS Special thanks to Suzanne Panacek who did a great job with the ROOT Users Guide, tutorials, lectures Many thanks to FNAL computing Division for the continuous support of the project since 1998

March 2003 Conference for Computing in High Energy and Nuclear Physics6 Source & Binary Distributions 26 binary tar files + all possible combinations of OS/Compiler in the Makefile

March 2003 Conference for Computing in High Energy and Nuclear Physics7 Downloads Total

March 2003 Conference for Computing in High Energy and Nuclear Physics8 Monthly Downloads

March 2003 Conference for Computing in High Energy and Nuclear Physics9 Short summary of main releases since CHEP2001 Jan 2002: version 3.02/07 Sep 2002: version 3.03/09 Dec 2002: version 3.04/02 Mar 2003: version 3.05/

March 2003 Conference for Computing in High Energy and Nuclear Physics10 ROOT I/O Developments Foreign classes Classes that have not been instrumented for ROOT in any way They can now be stored in ROOT files Just generate a dictionary Very useful for 3 rd party libraries Emulated classes ROOT files are “self-describing” This information can be used to emulate classes for which the actual code is not available while reading

March 2003 Conference for Computing in High Energy and Nuclear Physics11 ROOT I/O Developments (2) TRef, TRefArray Designed as light weight entities Very fast dereferencing (direct access tables) B A TBuffer b1; A.Streamer(b1) TBuffer b2; B.Streamer(b2) TRef C++ pointerDuplicated Saved only once

March 2003 Conference for Computing in High Energy and Nuclear Physics12 TTree improvements Creating branches from collection of objects. Split algorithm improved For complex cases of inheritance or composition. TTreeFormula enhancements Drawing TBits Custom Histogram Size Special variables (Entry #, Iteration #, etc.) Automatic file overflow When file reaches user specified maximum Create a new file: with "myfile.root", subsequent files are named "myfile_1.root",

March 2003 Conference for Computing in High Energy and Nuclear Physics13 Histograms New class THStack Long list of new functions in TH1 Plenty of new drawing options Filling with string variables TH1::Merge(TCollection *list)

March 2003 Conference for Computing in High Energy and Nuclear Physics14 Able to represent & navigate geometries of most HEP experiments Faster than Geant3 : 20% (ATLAS) up to 800% (CDF) Includes an interactive geometry checker able to detect/visualize most geometry definition errors (none of the tested geometries is error-free) To be soon integrated in a general VMC scheme able to run several simulation MC’s with same user code/geometry Geometrical Modeler

March 2003 Conference for Computing in High Energy and Nuclear Physics15 Geometrical Modeler Features Geometry browsing + interactive visualization based on context menus Easy-to-use API/user interface Extensible set of 16 shapes, Boolean composite shapes & parameterized Able to automatically map any G3 geometry Provides navigation functionality (“where am I?”, distances computation, “safety radius”, stepping, …) I/O: N objectsRZ size (G3).root size (fully voxelized) Time to load PIII/500 ATLAS kBytes4238 kBytes~ 8 seconds

March 2003 Conference for Computing in High Energy and Nuclear Physics16 Geometrical Modeler Features Several interactive checking methods Geometry overlap checker providing a sorted list of overlaps/extrusions & taking as input a minimum value for the overlapping distance Extensively benchmarked against G3 able to optimize even non-optimizable G3 geometries big gain in speed See talk by A. Gheata “A geometrical modeler for HEP” on Thursday at 1:30pm

March 2003 Conference for Computing in High Energy and Nuclear Physics17 PROOF System for the interactive analysis of very large sets of ROOT data files on a cluster of computers The main design goals are: transparency, scalability, adaptability Allows: parallel analysis of trees or object in a set of files parallel execution of scripts on a cluster of heterogeneous machines “Distributed Parallel Analysis Framework with PROOF” F.Rademakers on Tuesday at 2pm “Analyse your Data in Parallel using PROOF” M.Ballintijn on Tuesday at 2:40pm

March 2003 Conference for Computing in High Energy and Nuclear Physics18 PROOF Scalability 32 nodes: dual Itanium II 1 GHz CPU’s, 2 GB RAM, 2x75 GB 15K SCSI disk, 1 Fast Eth, 1 GB Eth nic (not used) Each node has one copy of the data set (4 files, total of 277 MB), 32 nodes: 8.8 Gbyte in 128 files, 9 million events

March 2003 Conference for Computing in High Energy and Nuclear Physics19 GRID and ROOT TGrid: Abstract interface to GRID services TAlien: an implementation of TGrid Proof can use Grid Resource Broker Grid File Catalogue Grid Monitoring Services Condor Remote File protocol implemented: Chirp (Condor) DCache (Desy, CDF) RFIO (Castor, CERN)

March 2003 Conference for Computing in High Energy and Nuclear Physics20 Graphics Improvements New class TGraphSmooth (Christian Stratowa) This class is a helper class to smooth TGraph, TGraphErrors or interpolate a graph at a set of given points. See new tutorial motorcycle.C New class TSVG implemented by Olivier Couet. TSVG may be used like TPostScript to produce a Scalable Vector Graphics file instead of a postscript file. Viewers like Internet Explorer can view directly the SVG files. Drawing TF3 TASImage Based on AfterImage freetype 2 font support Distributed by default

March 2003 Conference for Computing in High Energy and Nuclear Physics21 Current status on Windows Current Status Pro: Gui fully working Same look and feel as other platforms Fully compatible with other platforms OpenGL is working Cons: Much slower No Sockets (pending) No memory mapped files To-do list Short term: Improve speed Implement Sockets Middle term: Implement X3D Implement TMapFile Long term: “win32 native” version rootd as a windows service More information :

March 2003 Conference for Computing in High Energy and Nuclear Physics22 New Features and Classes TMatrix Many enhancements by Eddy Offermann (Renaissance Technologies) TMath New fundamental mathematical and physical constants (Tony Colley). New functions: Voigt(), BreitWigner(), Bessel and Struve Add two new sorting functions (Adrian Bevan) Add functions TMath::IsInside

March 2003 Conference for Computing in High Energy and Nuclear Physics23 New Features and Classes TFractionFitter (Frank Filthaut) Fits MC fractions to data histogram Confidence Level classes (Christophe Delaere) TLimit, TLimitDataSource and TConfidenceLevel TFeldmanCousins for confidence level (Adrian Bevan)

March 2003 Conference for Computing in High Energy and Nuclear Physics24 System Enhancement Plugin Manager Allow easy extension of abstract interfaces ACLiC Full dependency check Allow selection of debug or optimized compilation Building of read-only scripts Ability to use CINT’s pragma anywhere # base class regexp plugin class plugin lib ctor or factory Plugin.TFile: ^rfio: TRFIOFile RFIO "TRFIOFile(const char*,Option_t*,const char*,Int_t)" +Plugin.TFile: ^dcache: TDCacheFile DCache "TDCacheFile(const char*,Option_t*,const char*,Int_t)"

March 2003 Conference for Computing in High Energy and Nuclear Physics25 System Enhancement rootcint Improvement in handling of templates in general and STL containers in particular Introduce I/O for foreign classes Enhancement for multiple inheritance CINT improvements Very long list of enhancements:

March 2003 Conference for Computing in High Energy and Nuclear Physics26 Port to new platforms Port to MacOS Ben Cowan, Keisuke Fujii, George Irwin, etc. Port to Windows with cygwin and gcc 3.2 Axel Naumann Port to Intel Compiler v7 Fons Rademakers Port to Itanium 64 Fons Rademakers

March 2003 Conference for Computing in High Energy and Nuclear Physics27 ROOT I/O new developments Lifting remaining limitation of foreign class I/O implementation. Enhance support for STL container New I/O mechanism Split vector/list Enable emulation of STL container Support for large file (more than 2Gb) Support for XML interchange format.

March 2003 Conference for Computing in High Energy and Nuclear Physics28 TTree new developments STL list/vector Split mode Emulated class mode TTree::Drawing a user function Will allow the user to provide a function which will be executed for each entry of the TTree in a context such that the branch name can be used to read the values in the branch Branches will be read only if accessed The function can use arbitrary C++ The return value of the function will be histogrammed

March 2003 Conference for Computing in High Energy and Nuclear Physics29 New graphical interface Interface Redesign core panels and tools to be more in line with modern interfaces QT implementation of TVirtualX Valeri Fine See next slide GUI Builder First step (done): implement the ability to generate the code for an existing GUI. Second step: implement a GUI builder Documentation Ilka Antcheva is writing documentation for the GUI classes.

March 2003 Conference for Computing in High Energy and Nuclear Physics30 Gui/Graphics strategy TVirtualX TGWin32TGX11TGWin32GDKTGQt TVirtualPad TPad User/Root GUI and Graphics classes Applications see only Abstract Interfaces Low level screen graphics and GUI High level pad graphics TG??

March 2003 Conference for Computing in High Energy and Nuclear Physics31 GUI Examples

March 2003 Conference for Computing in High Energy and Nuclear Physics32 Others future developments New online help system Will generate a compact file containing the documentation An interface will allow easy lookup in this file Information will be available in any ROOT process Proof continued development See talk by M.Ballintijn and F. Rademakers

March 2003 Conference for Computing in High Energy and Nuclear Physics33 Closing Mains areas of developments Parallel processing and GRIDS Graphics I/O: STL, TTree::Draw, large files Many Contributions from “users” Labs and Universities Private sectors