K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.

Slides:



Advertisements
Similar presentations
Metadata Progress GridPP18 20 March 2007 Mike Kenyon.
Advertisements

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
13/05/2004Janusz Martyniak Imperial College London 1 Using Ganga to Submit BaBar Jobs Development Status.
MCTS Guide to Microsoft Windows Server 2008 Network Infrastructure Configuration Chapter 8 Introduction to Printers in a Windows Server 2008 Network.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
“This presentation is for informational purposes only and may not be incorporated into a contract or agreement.”
K. Harrison CERN, 15th May 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Development strategy - Ganga prototype - Release plans - Conclusions.
Basics of Web Databases With the advent of Web database technology, Web pages are no longer static, but dynamic with connection to a back-end database.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
K.Harrison CERN, 21st November 2002 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Background and scope - Project organisation - Technology survey - Design -
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting June 13-14, 2002.
Nightly Releases and Testing Alexander Undrus Atlas SW week, May
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL July 15, 2003 LCG Analysis RTAG CERN.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
Marcel Casado NCAR/RAP WEATHER WARNING TOOL NCAR.
K.Harrison CERN, 6th March 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Aims and design - Progress with low-level software - Progress with Graphical User.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
David Adams ATLAS AJDL: Analysis Job Description Language David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
Nick Brook Current status Future Collaboration Plans Future UK plans.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
ATLAS DIAL: Distributed Interactive Analysis of Large Datasets David Adams – BNL September 16, 2005 DOSAR meeting.
David Adams ATLAS DIAL status David Adams BNL July 16, 2003 ATLAS GRID meeting CERN.
David Adams ATLAS ATLAS Distributed Analysis Plans David Adams BNL December 2, 2003 ATLAS software workshop CERN.
CERN - IT Department CH-1211 Genève 23 Switzerland t DB Development Tools Benthic SQL Developer Application Express WLCG Service Reliability.
K. Harrison CERN, 25th September 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Project news - Ganga release 1 - Work towards Ganga release 2 - Interaction.
Ganga A quick tutorial Asterios Katsifodimos Trainer, University of Cyprus Nicosia, Feb 16, 2009.
David Adams ATLAS ADA, ARDA and PPDG David Adams BNL June 28, 2004 PPDG Collaboration Meeting Williams Bay, Wisconsin.
INFSO-RI Enabling Grids for E-sciencE ATLAS Distributed Analysis A. Zalite / PNPI.
Production Tools in ATLAS RWL Jones GridPP EB 24 th June 2003.
INFSO-RI Enabling Grids for E-sciencE SCDB C. Loomis / Michel Jouvin (LAL-Orsay) Quattor Tutorial LCG T2 Workshop June 16, 2006.
Metadata Mòrag Burgon-Lyon University of Glasgow.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL June 7, 2004 BNL Technology Meeting.
FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL September 30, 2004 CHEP2004 Track 5: Distributed Computing Systems and Experiences.
Module 2 Part I Introduction To Windows Operating Systems Intro & History Introduction To Windows Operating Systems Intro & History.
D. Adams, D. Liko, K...Harrison, C. L. Tan ATLAS ATLAS Distributed Analysis: Current roadmap David Adams – DIAL/PPDG/BNL Dietrich Liko – ARDA/EGEE/CERN.
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
1 DIRAC Job submission A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
David Adams ATLAS ATLAS Distributed Analysis: Overview David Adams BNL December 8, 2004 Distributed Analysis working group ATLAS software workshop.
2 June 20061/17 Getting started with Ganga K.Harrison University of Cambridge Tutorial on Distributed Analysis with Ganga CERN, 2.
David Adams ATLAS ATLAS-ARDA strategy and priorities David Adams BNL October 21, 2004 ARDA Workshop.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
ADA Job Builder A Graphical Approach to Job Building ATLAS Software and Computing Workshop May 2005 Chun Lik Tan
Institute for the Protection and Security of the Citizen HAZAS – Hazard Assessment ECCAIRS Technical Course Provided by the Joint Research Centre - Ispra.
GangaTasks Automating of job submission wit Athena/AthenaMC in Ganga sw week, johannes ebke, tariq mahmoud.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Ganga development - Theory and practice - Ganga 3 - Ganga 4 design - Ganga 4 components and framework - Conclusions K. Harrison CERN, 25th May 2005.
July 19, 2004Joint Techs – Columbus, OH Network Performance Advisor Tanya M. Brethour NLANR/DAST.
K. Harrison CERN, 21st February 2005 GANGA: ADA USER INTERFACE - Ganga release Python client for ADA - ADA job builder - Ganga release Conclusions.
K. Harrison BNL, 29th August 2003 THE GANGA PROJECT -Project objectives and organisation - Ganga design - Current status of software - Conclusions.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 Technical Overview Jakub T. Moscicki, CERN.
A GANGA tutorial Professor Roger W.L. Jones Lancaster University.
David Adams ATLAS AJDL: Abstract Job Description Language David Adams BNL June 29, 2004 PPDG Collaboration Meeting Williams Bay.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Seven things you should know about Ganga K. Harrison (University of Cambridge) Distributed Analysis Tutorial ATLAS Software & Computing Workshop, CERN,
User view Ganga classes and functions can be used interactively at a Python prompt, can be referenced in scripts, or can be used indirectly via a Graphical.
The Ganga User Interface for Physics Analysis on Distributed Resources
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
Status and plans for bookkeeping system and production tools
Production Manager Tools (New Architecture)
Presentation transcript:

K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python client for AMI web service - Conclusions

22nd September Ganga release status (1) - Ganga 2.0 released May 2004, and followed by several minor releases  Ganga 2.3 released 13th September 2004  Bulk of code written by A.Soroko  Ganga releases coordinated by J.T.Moscicki - Have built on basic job-management capabilities of Ganga 1.0 (July 2003)  Improved Graphical User Interface (GUI)  Command echoing  Fully functional Job-Options Editor (JOE)  Submission to local batch systems (LSF, PBS)  Job catalogue and automatic monitoring  Simple installation procedure (for RH7.3) - Some LHCb-specific functionality included for testing  Job submission through DIRAC  Access to metadata catalogue

22nd September Ganga release status (2) - Ganga 2.x is a working system  Used successfully on lxplus to run Artemis jobs (C. Collins-Tooth) - Installation instructions and user guides available from Ganga web site: - Work in progress on ATLAS-specific functionality  Job builder that uses Analysis Job Definition Language (AJDL)  Job submission via AJDL interface  Access to AMI - Aim to have ATLAS features included in Ganga 3.0  Release tentatively pencilled in for mid October, but probably November is more realistic  Release should also include user-friendly Command-Line Interface (J.T.Moscicki)

22nd September Job creation

22nd September Job definition

22nd September Examination of job output

22nd September Job-options editor: main features - Job-Options Editor (JOE) developed by C.L.Tan - Standalone Qt-based graphical editor, available from Ganga - Presents hierarchical view of available options, and helps user with value entry - Multiple job-options files may be edited simultaneously - Have support for both text and Python job-options files - Included files expanded when changes are saved, so that result is portable

22nd September JOE: main window

22nd September JOE: option entry

22nd September Python support for AJDL - Package dial-python developed to allow use of AJDL from Python  Provides bindings for DIAL C++ classes  Provides Python modules to simplify use of these classes - First version of dial-python released with DIAL 0.90 (June 2004)  Uses PyLCGDict to import DIAL classes  Workarounds needed for methods causing problems  Issues with printing object information  Able to submit job to remote DIAL server and query status - Improved version of dial-python released with DIAL 0.92 (August 2004)  Uses PyLCGDict2 to import DIAL classes  No methods causing problems  Object printing enabled by mapping insertion operator associated with C++ class to __str__ function of Python class (solution suggested by J.Generowicz)

22nd September dial-python documentation - Code documentation for dial-python Python modules available at:

22nd September Job builder - Work by C.L.Tan - Prototype GUI has separate panels for defining Application, Task, Dataset, Preferences -Task builder will integrate JOE for configuring Athena applications - Need to understand interaction with task repository - Dataset selection will rely on access to AMI - Need appropriate handlers for connection to Ganga

22nd September Prototype GUI for AJDL job builder

22nd September Python client for AMI web service - Python client for AMI web service developed by C.L.Tan - Allows use of main AMI methods for querying and updating catalogue - Checks made for mandatory parameters before a command is sent to AMI - XML results returned by AMI are automatically converted to appropriate Python object

22nd September Ganga interface to AMI - Work by C.Collins-Tooth - Simple prototype implemented  Use Python client for AMI web service  Select project / processing step  Build query  Select LFNs, which Ganga adds automatically to job script

22nd September Conclusions - Ganga 2.3 has been released and is a working system  Installation instructions and user guide available from Ganga web site - Good progress made with Python tools for job definition and submission in ADA  dial-python package developed to allow access from Python to functionality of DIAL C++ classes  Work started on AJDL job builder  Python client for AMI web services has been implemented - Aim to include job submission via AJDL interface in Ganga 3.0  Release tentatively scheduled for mid October