K. Harrison CERN, 21st February 2005 GANGA: ADA USER INTERFACE - Ganga release Python client for ADA - ADA job builder - Ganga release Conclusions

21st February Ganga release Ganga 3.0 to be released in next week or two  Work of many people: D.L.Adams, C.Collins-Tooth, U.Egede, K.Harrison, A.Maier, J.T.Moscicki, A.Soroko, C.L.Tan - Basic functionality as in Ganga 2.0 (May 2004)  Job definition and submission through Graphical User Interface (GUI)  Fully functional Job-Options Editor (JOE)  Job catalogue and automatic monitoring - Many additions and extensions  Backend support extended to cover PBS, LSF, LCG, gLite, DIRAC  Command Line Interface in Python (CLIP) makes Ganga functionality easily available from Python prompt  Installation and setup available for RH7.3 and SLC3

21st February Ganga release ATLAS-specific features  Access to AMI  Athena applications supported, using W.Lavrijsen’s Athena Startup Kit (ASK) in background - Preview of Ganga 3.0 functionality available with Ganga  Ganga is a developers’ release: a few minor issues still to be resolved - User documentation available at:

21st February Job creation

21st February Job definition for Athena application

21st February JOE: main window

21st February AMI query

21st February Python client for ADA - Package dial-python is being developed as a Python client for ADA  Currently provides bindings for DIAL C++ classes  Provides Python modules to simplify use of these classes  In longer term, aim for a pure Python implementation - Python bindings generated for DIAL releases 0.90, 0.92, 0.94  Use PyLCGDict/PyLCGDict2 to import DIAL classes  Solutions found for technical challenges presented by the C++ code:  Mapping from C++ insertion operator to Python __str__ function  Use of STL container classes  Thanks to J.Generowicz, M.Marino, P.Mato and S.Roiser from SEAL/PyLCGDict teams for their help here

21st February Python client for ADA - Build procedure for dial-python has relied on DIAL being developed as a set of CMT classes  DIAL 1.0 no longer uses CMT  Will move to building dial-python from DIAL release, rather than DIAL source packages  New strategy effectively decouples releases of DIAL and dial-python, and has a number of advantages - Aim to have dial-python release for DIAL 1.0 in 2-3 weeks’ time

21st February ADA job builder - ADA job builder being developed by C.L.Tan as a GUI on top of the dial-python API - Have separate panels for defining Application, Task, Dataset, Preferences - Can browse catalogues/repositories used by ADA, and edit Tasks  Close to point of being able to push Submit button

21st February ADA Job Builder: Application selection

21st February ADA Job Builder: Task selection

21st February ADA Job Builder: Task Editing

21st February ADA Job Builder: Dataset selection

21st February ADA Job Builder: Examining dataset

21st February ADA Job Builder: Defining preferences

21st February Ganga release Ganga 3.0 provides a lot of useful functionality, but there are shortcomings in design  Too much coupling between components  Job model inflexible: mapping from ADA job to Ganga job not obvious - Design problems being addressed in work started for Ganga 4.0  Keep the functionality, use existing code base, but improve flexibility - Ganga 4.0 will essentially be a job-management framework  Main components are Job Registry, Job Manager, Application Manager  Define interfaces and example implementations, but allow easy substitution with alternative components that respect the interfaces  dial-python and ADA job builder have natural places within scheme - KH and CLT will be going to BNL for a week in April, to work with DLA on ensuring Ganga 4.0 satisfies ADA requirements  Aim to have release before May Software Workshop

21st February Conclusions - Ganga 3.0 will be released in next week or two  Includes ATLAS-specific functionality, available for testing in Ganga developers’ release  Installation instructions and user guide available from Ganga web site - Python bindings for C++ classes provided up to DIAL 0.94  Moving to new procedure to generate bindings for DIAL Excellent progress with ADA job builder  Almost ready to push Submit button - Work proceeding well on Ganga 4.0  Important for ATLAS, as this will be the first Ganga release supporting ADA submission  Aim to have release before May Software Workshop