Victor Serbo, CHEP071 JAIDA, JAS3, WIRED4 and the AIDA tag library - experience and new developments DONSZELMANN, Mark (SLAC)DONSZELMANN, Mark JOHNSON, Tony (SLAC)JOHNSON, Tony SERBO, Victor (SLAC)SERBO, Victor TURRI, Max (SLAC)TURRI, Max

Victor Serbo, CHEP072 FreeHEP Java Library  Items discussed in this talk are all part of FreeHEP Java Library Open-Source utilities for HEAP and beyond  Mostly Java (now also open-source)   FreeHEP philosophy Avoid common HEP pitfall of lock-in to monolithic frameworks  Small modular projects which can be used together or separately Define interfaces to allow open communication between modules  Easy to extend or replace components  Use open-standards where possible Example: AIDA - Abstract Interfaces for Data Analysis  Data can be in different formats and representations  Adapt data to “look like” standard AIDA object and then use set of standard interfaces to work with it  Tools built using AIDA can work with analysis objects from Root, PAW, Fits, SQL transparently.  New in FreeHEP organization Re-factor dependences and move code from CVS to SVN Use Maven 2 to build/test/deploy  see poster by Mark Donszelmann: #52 in Poster Session 1

Victor Serbo, CHEP073 AIDA  AIDA is a standard set of interfaces for creating and manipulating histograms, n-tuples and related data analysis objects, like Plotter, Fitter, etc.  Documentation and examples: Current release  There are several AIDA implementations: Java: C++  Open Scientist:  PI: Python:  Also AIDAJNI layer that allows using Java implementation from C++:

Victor Serbo, CHEP074 JAIDA – Java Imlementation of AIDA  Features: Data analysis and fitting (JMinuit and FMinuit) High quality plots in variety of formats (pdf, ps, gif, png, swf, etc.) Read/Write support for AIDA XML format (with zip and gzip options) Read support for Hbook, Root and plain Text files.  Download and Setup: Current version , implements AIDA Documentation and setup instructions at Needs Java 1.4 or higher

Victor Serbo, CHEP075 New in JAIDA  Full implementation of the AIDA 3.3 interfacesAIDA 3.3  Add Zip option for AIDA XML files Provides directories that map to AIDA ITree structure Now can read and create AIDA XML objects on-demand  Opening XML files with many objects much faster  Add Binary XML option for AIDA XML files Faster reading – don’t have to convert numbers from String to double Saves space Will support incremental storage of large objects (e.g. n-tuples)  New module for reading and writing Fits files  Add support for plotting 1D and 2D histograms with variable bins  Add utility class to fill IHistogram, ICloud, or ITuple with data distributed according to a given IFunction  Add utility class to convert individual AIDA objects to XML and back  Support for native i386-MacOSX (Hbook, FMinuit)

Victor Serbo, CHEP076 Using JAIDA GEANT4 (C++) AIDAJNI Layer JAIDAJAIDA JAIDAJAIDA Oracle, MySQL,... Java Application AIDATLD (Tag Library) AIDATLD (Tag Library) JAS3 GUI XML Hbook Root Fits

Victor Serbo, CHEP077 JAS3  Pulls together many FreeHEP modules, event display (WIRED4), etc. into single GUI application  Design based on Application Shell, into which many (optional) modules can be plugged Highly customizable for different application domains  HEP/Astrophysics/Other  Data analysis/Online Monitoring/GRID analysis  Experiment/User specific modules Modules can be updated independently of the shell  Possible to release bug fixes fast  Includes support for programming in several languages Scripting: currently Pnuts and Python Java (compiled)  Analysis (histograms, tuples, fitting, etc.) based on JAIDA  JAS3 web page:  Current 0.8.4rc1 ftp://ftp.slac.stanford.edu/software/jas/JAS3/v0.8.4rc1

Victor Serbo, CHEP078 JAS3 Example Can write and run scripts, Java code Console allows direct interaction with scripting language

Victor Serbo, CHEP079 JAS3 in BaBar  Combine on one HTML page Live monitoring plots Static reference plots Instructions and useful information  Fast Monitoring Live plots received from the shared memory via CORBA Reference plots from Hbook and Root files Featured on YouTube (during the last minute of )  Ambient or “Slow Monitoring” (time histories of voltages, currents, temperatures, etc.) Data received from the DB or Live Archivers via CORBA

Victor Serbo, CHEP0710

Victor Serbo, CHEP0711  Ambien t  DHP

Victor Serbo, CHEP0712 Data on the web AIDA Tag Library  Using the AIDA Tag Library (AIDATLD) you can easily insert live plots into the web pages (using Java Server Pages technology).  Users don’t need any special software – just a web browser  Can be used to make data/plots accessible to distributed collaboration quickly  HTML-like tags:,,  The AIDA Tag Library is designed to work in a container supporting JSP 2.0 or greater (such as e.g.Tomcat 5.5.*)  Examples/Demo and Documentation: Web Application Server (e.g. Apache Tomcat) AIDATLD Web Browser Data (Root, SQL etc) Plots sent as images (png, swf, pdf etc.)

Victor Serbo, CHEP0713 AIDATLD Demo – plot from ROOT file SimpleAIDA Plot Plot Histogram from Root File <aida:objects storeName="${treeName}" path="${treePath}" var="aidaPlotObject">

Victor Serbo, CHEP0714 JAIDA/AIDATLD in GLAST  The Gamma-ray Large Area Space Telescope  Many web applications developed for GLAST make use of JAIDA/AIDATLD Software releases validation  Telemetry trending Data Quality Monitoring Calibrations trending Pipeline processing overview  See also talk by Dan Flath (Id:361): “The GLAST Data Handling Pipeline” Sky source and Gamma Ray Burst Monitoring

Victor Serbo, CHEP0715 GLAST Data Origin  Data is stored in various formats Databases  Oracle, MySQL Files  Xml, Fits, Root  Adapters are used to convert it to AIDA objects  These objects are then handled and displayed using JAIDA and AIDATLD  Users don’t care where data is coming from and in what format they were stored.  Can mix-and-match different data on one web page

Victor Serbo, CHEP0716 Navigation Tree Summary Table Comparison plots

Victor Serbo, CHEP0717 Telemetry Trending  ~12K telemetries are stored in Oracle db Raw values on change Accumulated statistics every 5 minutes  This application allows users to View any telemetry over any time period Group telemetries together in a navigation tree  Stack corresponding plots  Or produce a single overlay plot Access raw/statistical data Choose the maximum number of data points per plot  If necessary data is accumulated on the fly Tabular view of the selected data

Victor Serbo, CHEP0718

Victor Serbo, CHEP0719 SQL Backend for AIDA  Next 3 slides provided by Julius Hrivnac  SQLTuple SQL backend for AIDA ntuples Uses direct SQL commands to perform ntuple operations (like creation of projections) => allows work with very big ntuples (unlike other SQL-AIDA couplings) Exists also as a JAS plugin and a Web Service More information at uple/ uple/

Victor Serbo, CHEP0720 AIDATLD at Atlas  AIDATLD used together with SQLTuple to look at SQL databases deployed as J2EE Web Service at Atlas Tag Database Characteristic Histograms available in or as a Google Gadget: url=http%3A//hrivnac.web.cern.ch/hrivn ac/Activities/Packages/GoogleGadgets/T agsCharacteristicsHistograms.xml url=http%3A//hrivnac.web.cern.ch/hrivn ac/Activities/Packages/GoogleGadgets/T agsCharacteristicsHistograms.xml

Victor Serbo, CHEP0721 SQLTuple in JSP Page

Victor Serbo, CHEP0722 Status and Plans  Continue support and development of JAIDA and JAS3 Need new, more functional plotter Need ability to work with big data volumes  Support and develop web applications based on AIDATLD  AIDA meeting Summer 2007 to discuss improvements and future releases  WIRED4: experiment-independent interactive event display  User Support: Bug reports: Forum: