Lucas Taylor, Northeastern University User Analysis Environment October 1999, CERN 1st Internal Review of CMS Software and Computing User Analysis Environment Lucas Taylor Northeastern University

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment IntroductionIntroduction “User Analysis Environment” u data analysis and presentation u histograms, ntuples/tags, and plotting u interactive 2D/3D detector and event visualisation u graphical user interfaces u statistical and numerical analysis “IGUANA” (Interactive Graphical User Analysis) u Recently created CMS project (May 1999) u Together with LHC++, addresses CMS needs for “User Analysis Environment” u Follow/collaborate with related activities (AIDA, HEPVis, Hippodraw, JAS, OpenScientist, ROOT, WIRED,...)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment IGUANA Phases 1) Select Baseline technologies(completed) u design should allow for reasonable mixing of technologies...but... should concentrate on one specific set of tools early on è trying to be overly general can mean nothing concrete gets done! 2) Prototypes(ongoing) u test each choice of technology with a realistic (if simplistic) prototype u test the mixing of the various technologies with prototypes 3) Development / deployment of applications(started) u should start to evolve naturally from the prototypes u early involvement of end-users (don’t make products nobody wants) Functional prototype milestone: June 2000

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment OpenGLX11 qxtQwtSoQt XtOpenInventorQt Objectivity GEMINI NAG_C HEPVis HepODBMS HTL QGL IGUANA / CMS / User libraries HEPFitting IGUANA Component Software Strategy Consistent with LHC++ strategy (and many specific components) u Combine (only the required) components to build a given application u Develop/acquire, test, deploy, maintain, & replace components individually u Leverage non-CMS efforts (commercial/free SW, common projects) MasterSuite HEPInventor

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment IGUANA Baseline Toolkit for Graphical User Interfaces Qt Evaluation of widget sets led to choice of: Qt u Extensible OO GUI Toolkit with C++ API u Full set of “standard” widgets u Support for Unix/X11 (incl. Linux) and Windows 9x / NT u Free for all Unix platforms (~$1500/developer for NT) u Excellent documentation and examples u High-level 2D drawing classes with good off-screen rendering Already a lot of interest from LHC++, ATLAS, HEPVis,... (since presentations at HEPVis99 and subsequent discussions)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment IGUANA Prototypes Prototypes should demonstrate (or not!): u functionality of individual technologies u (component-like) inter-operability of various technologies to make realistic applications 1) Embedding OpenGL and OpenInventor Components in Qt 2) Embedding Xt and Motif Components in Qt 3) Multi-document architecture 4) Interactive 3D Detector and Event Visualisation with ORCA 5) 2D Display for Graphical Online Monitoring and Control 6) Retrieval & Display of OO Histograms/Tags from Objectivity

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 1: Embedding OpenGL / OpenInventor Components in Qt OpenInventor Objects Online help OpenGL render window Graphics hierarchy manager Visibility control Rotate Zoom Pick Manipulate Seek Perspective / Orthographic “QGL” extension for OpenGL u OpenGL windows can be created & managed as any other Qt widget “SoQt” extension for OpenInventor u Needs OpenGL extension u Needed some “tweaking” Aside remark: LiveConnect extension for plug-ins u For both Navigator and Explorer u Full Qt functionality on Unix,W9x/NT

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 2: Embedding Xt / Motif Components in Qt A potentially useful feature for legacy or third-party widgets IGUANA sheet manager IGUANA Objectivity / HTL browser “SciPlot” Xt widget wrapped by Qt widget exploits qxt extension (Troll Tech) “SciPlot” Xt widget wrapped by Qt widget exploits qxt extension (Troll Tech)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 3: Multi-document Architecture Common services Sheet management Customised services

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 4: Interactive 3D Detector and Event Visualisation with ORCA Reconstructed (ORCA) object Generic (GEANT3) detector display

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 5: 2D Display for Graphical Online Monitoring and Control Push Button Check box Drag&drop toolbars Pull-down menu List views Slider Status bar Multi-line text editor Paint window Radio box Scrollbar XML rich text Tabbed window Postscript (vector) Demonstrate with a pseudo-realistic application: u the wide-range of Qt widgets u 2D drawing capabilities u short development time (~1 week)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Display Create Store Browse ORCA Application Persistent HTL (& HepODBMS/Objectivity) Transient HTL HBOOK4 HEPInventor (& OpenInventor) ZEBRA file SciPlot (Xt in Qt) HEPExplorer (& IRIS Explorer) Objy HTL browser (Qt component) Prototype 6: Retrieval & Display of OO Histograms and Tags from Objectivity Objy HTL browser (Motif “component”) Qwt (pure Qt) New widget (pure Qt) PAW IGUANA OO prototypes 6(a)6(a)6(b)6(b)6(c)6(c)6(d)6(d)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 6: Retrieval & Display of OO Histograms and Tags from Objectivity 6(a) HepExplorer and IRIS Explorer

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 6: Retrieval & Display of OO Histograms and Tags from Objectivity 6(b) HepInventor and OpenInventor 6(c) SciPlot (Xt / Motif)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 6: Retrieval & Display of OO Histograms and Tags from Objectivity 6(d) Qwt and Qt Browsing persistent OO (HTL) histograms in Objectivity DB Browsing tag data in Objectivity DB and displaying histograms interactively

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Prototype 6: Retrieval & Display of OO Histograms and Tags from Objectivity None of the prototypes was a complete solution...but the Qwt (Qt-based) solution was preferred è Fully OO (not even wrapped), hence easily extended è Well-integrated with the rest of the GUI è Only Qt is required No need for OpenGL, OpenInventor, Mastersuite, IRIS Explorer,... è Good vector hardcopy (Postscript) Strategy for Histogram display u Develop a new Qt-based histogram widget (light-weight and free) u Collaboration with others (LHC++, etc...) u For “3D views of plots” (e.g. Lego plots) evaluate: è Simple system based on Qt è Fully functional 3D system (OpenInventor)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment From Prototypes to Project: Software Configuration Management Software repository u CVS-based (similar to ORCA) u Minimise external dependencies for each package (library) Build and release system u SCRAM-based (similar to ORCA) Documentation  doxygen auto-documentation tool u examples in progress HEPVis qxt SoQt qwt IgQt Ig_ExtensionsIg_Imports QGL IgHTL IgObjectivity IGUANA Ig_ExamplesCmscan IgMotif IgXt IgGeant3qextmdi Ig3DViewer IgExDBrowser IgTagBrowser Examples IgCmscan

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment IGUANA between now and June 2000 (towards the Functional Prototype Milestone) CMSCAN Development (Detector &Event Visualisation Toolkit) u Conversion of GUI from Motif to Qt (and feedback to HEPVis) u Correlation/picking of information (graphics / GUI  underlying data) u 2D views and non-cartesian transformations (  - , fish-eye,...) CMSCAN Deployment u Full range of reconstructed objects (ORCA3 and ORCA 4) u OO detector display tools (GEANT4 / OSCAR and ORCA) u Test-beam visualisation systems Physics Analysis Tools u Continue prototypes in close collaboration with LHC++, HEPVis, etc. u IGUANA focus is more on graphics and GUI’s (rather than scripting, statistical analysis tools, histogram/tag storage and retrieval, etc.) u Definition of generic IGUANA deliverables (in context of LHC++) u Development of GUI’s for test-beam monitoring, control, analysis,...

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment Manpower Shortfall and Schedule Slippage V = Visualisation SW Engineer Hired April 99 Later than hoped and must also cover shortfall on analysis tools prototyping U = UI / GUI SW Engineer (not yet hired)  (late)      Not finished Delayed  CMSCAN: ~ 4 month slippage of CMSCAN schedule so far in 1999 Analysis Tools: prototypes defined as high priority (on time for now) Delayed  (late)

27-28 October 1999, CERN 1st Internal Review of CMS Software and Computing Lucas Taylor, Northeastern University User Analysis Environment SummarySummary Technology Evaluations and Choices (completed) u Modular software components è Software is robust, maintainable and can evolve è Leverage efforts elsewhere (HEP, free software community, commerce) u Baseline choice of a specific set of tools has been made Prototyping (ongoing) u Realistic tests of each choice of technology and mixing of technologies u Interactive 3D detector / event visualisation (with ORCA) u Browsing and display of histograms and tags in Objectivity DB Development / deployment of CMS applications (started) u ORCA underway, start with OSCAR and test-beams by end 1999 Excellent progress has been made so far but......timely continuation is contingent on sufficient SW engineering Functional prototype milestone: June 2000