ADA analysis transformations

Slides:



Advertisements
Similar presentations
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
Advertisements

David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL June 23, 2003 GAE workshop Caltech.
BizTalk Deployment using Visual Studio Release Management
DCT 1123 PROBLEM SOLVING & ALGORITHMS INTRODUCTION TO PROGRAMMING.
Status of Onboard Filter & Ground Software Integration Work done by Navid Golpayegani Steve Ritz J.J. Russell David Wren SLAC Ground Software Workshop:
K.Harrison CERN, 21st November 2002 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Background and scope - Project organisation - Technology survey - Design -
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL July 15, 2003 LCG Analysis RTAG CERN.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
The RunTimeTester - where to now? Eric NZUOBONTANE Peter SHERWOOD Brinick SIMMONS 29 th July 2004.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
OpenSees on NEEShub Frank McKenna UC Berkeley. Bell’s Law Bell's Law of Computer Class formation was discovered about It states that technology.
Systems Development Lifecycle Testing and Documentation.
Steps toward ttH (H->bb) in the Atlas ‘PhysicsAnalysis’ Environment. Chris Collins-Tooth Christian Shaw.
David Adams ATLAS AJDL: Analysis Job Description Language David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
® IBM Software Group © 2008 IBM Corporation Setting up Build Forge demo projects for ALM Windows only May – work in progress Stuart Poulin
ATLAS DIAL: Distributed Interactive Analysis of Large Datasets David Adams – BNL September 16, 2005 DOSAR meeting.
David Adams ATLAS DIAL status David Adams BNL July 16, 2003 ATLAS GRID meeting CERN.
David Adams ATLAS ATLAS Distributed Analysis Plans David Adams BNL December 2, 2003 ATLAS software workshop CERN.
Event Data History David Adams BNL Atlas Software Week December 2001.
Introduction Advantages/ disadvantages Code examples Speed Summary Running on the AOD Analysis Platforms 1/11/2007 Andrew Mehta.
INFSO-RI Enabling Grids for E-sciencE ATLAS Distributed Analysis A. Zalite / PNPI.
David Adams ATLAS Architecture for ATLAS Distributed Analysis David Adams BNL March 25, 2004 ATLAS Distributed Analysis Meeting.
David Adams ATLAS DIAL status David Adams BNL November 21, 2002 ATLAS software meeting GRID session.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
CSCI-100 Introduction to Computing
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL June 7, 2004 BNL Technology Meeting.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL September 30, 2004 CHEP2004 Track 5: Distributed Computing Systems and Experiences.
D. Adams, D. Liko, K...Harrison, C. L. Tan ATLAS ATLAS Distributed Analysis: Current roadmap David Adams – DIAL/PPDG/BNL Dietrich Liko – ARDA/EGEE/CERN.
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
David Adams ATLAS DIAL: Distributed Interactive Analysis of Large datasets David Adams BNL August 5, 2002 BNL OMEGA talk.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
David Adams ATLAS ATLAS Distributed Analysis: Overview David Adams BNL December 8, 2004 Distributed Analysis working group ATLAS software workshop.
How To Get Started in Analysis with Atlas software FAQ on How to Get account at BNL
David Adams ATLAS ATLAS-ARDA strategy and priorities David Adams BNL October 21, 2004 ARDA Workshop.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
ADA Job Builder A Graphical Approach to Job Building ATLAS Software and Computing Workshop May 2005 Chun Lik Tan
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
K. Harrison CERN, 21st February 2005 GANGA: ADA USER INTERFACE - Ganga release Python client for ADA - ADA job builder - Ganga release Conclusions.
IBM Express Runtime Quick Start Workshop © 2007 IBM Corporation Deploying a Solution.
David Adams ATLAS ATLAS Distributed Analysis (ADA) David Adams BNL December 5, 2003 ATLAS software workshop CERN.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Software. Introduction n A computer can’t do anything without a program of instructions. n A program is a set of instructions a computer carries out.
CAA Database Overview Sinéad McCaffrey. Metadata ObservatoryExperiment Instrument Mission Dataset File.
David Adams ATLAS AJDL: Abstract Job Description Language David Adams BNL June 29, 2004 PPDG Collaboration Meeting Williams Bay.
David Adams ATLAS ADA: ATLAS Distributed Analysis David Adams BNL December 15, 2003 PPDG Collaboration Meeting LBL.
ATLAS DIAL: Distributed Interactive Analysis of Large Datasets David Adams Brookhaven National Laboratory February 13, 2006 CHEP06 Distributed Data Analysis.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
EXPERIENCE WITH ATLAS DISTRIBUTED ANALYSIS TOOLS S. González de la Hoz L. March IFIC, Instituto.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL May 19, 2003 BNL Technology Meeting.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
David Adams ATLAS Hybrid Event Store Integration with Athena/StoreGate David Adams BNL March 5, 2002 ATLAS Software Week Event Data Model and Detector.
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
L1Calo DBs: Status and Plans ● Overview of L1Calo databases ● Present status ● Plans Murrough Landon 20 November 2006.
ATLAS Distributed Analysis S. González de la Hoz 1, D. Liko 2, L. March 1 1 IFIC – Valencia 2 CERN.
Planning the Digital Transformation Readiness Check for SAP S/4HANA
Analysis Trains - Reloaded
Analysis framework - status
June 2011 David Front Weizmann Institute
LCG middleware and LHC experiments ARDA project
ADA aodhisto transformation
Software Development Process
Computer Fundamentals
Introduction to Athena
SEAL Project Core Libraries and Services
 Is a machine that is able to take information (input), do some work on (process), and to make new information (output) COMPUTER.
J. Adamczewski, M. Al-Turany, D. Bertini, H.G. Essel
Presentation transcript:

ADA analysis transformations Farida Fassi, Julio Lozano Bahilo IFIC, Valencia-Spain December 8, 2004 ATLAS Software Workshop 3 July, 2019

Outline Transformation goal and components Transformation steps Integration within DIAL Transformation status 3 July, 2019

Transformation goal and components √ The analysis transformation, aodhisto, aims to loop over the events in an AOD event dataset producing a Root histogram dataset in the ADA environment.  The transformation components are the following:  Input Data: - AOD datasets supported by the ADA environment  Analysis algorithm package: - the UserAnalysis Package provided by Kétévi Assamagan. - the package is available in CVS, and consists of a simple Gaudi Algorithm and the AnalysisSkeleton. - user may implement his/her analysis code within the package.  A set of bash scripts to build and to run the AOD analysis package in ATHENA is required. 3 July, 2019

Transformation steps  To satisfy the DIAL strategy the transformation must run in two steps managed by the scripts mentioned previously.  Build step: expands the required directory structure to run copies the required files (to run the analysis) to the working area compiles/builds the transformation in the working area needs to be only called once and dose not require any input data  Run step: TestRelease is not needed to run the package Runs on the output of the build step Calls the user algorithm for each file to be processed Produces a set of output files: AnalysisSkeleton.root, athena.log Cleans up the working directory 3 July, 2019

Integration within DIAL  The analysis transformation is already integrated with ADA model  The task file (XML format) associated to the analysis transformation should carry the following files: the user analysis algorithm to process the input data the UserAnalysis_JobOptions.py for the user algorithm √ User can run an analysis algorithm in ATHENA from a DIAL user interface/client on a remote machine. √ User can access to the transformation following the instructions for demo 4, located in this URL: http://www.usatlas.bnl.gov/~dladams/dial/releases/0.94 3 July, 2019

Transformation status √ The analysis transformation is ready for usage - it makes use of both ATLAS releases 8.0.6 and 9.0.2 There are only two AOD file datasets available for analysis (multi-file datasets will be added soon – David Adams) √ work is in progress to provide a set of example task files to enable users either - to test the system, or - to use them as a basis for their own analysis algorithm. 3 July, 2019