ATLAS Software Kaushik De University of Texas At Arlington based on a tutorial by P. Calafiura (LBNL) LHC Computing Workshop, Ankara May 2, 2008.

Slides:



Advertisements
Similar presentations
Introduction to Maven 2.0 An open source build tool for Enterprise Java projects Mahen Goonewardene.
Advertisements

The Computing Environment. Outline Software Management –CVS –CMT –Tag-Collector –Savannah Data Structures Grid & Local cluster Athena –Projects & Packages.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Test results Test definition (1) Istituto Nazionale di Fisica Nucleare, Sezione di Roma; (2) Istituto Nazionale di Fisica Nucleare, Sezione di Bologna.
ATLAS Software Infrastructure Frederick Luehring Indiana University US ATLAS Tier 1&2 Meeting at Harvard August 8, 2006.
Common Experiment Workbook Status Report Anne Heavey, Rob Kutschke May 22, 2013.
SPI Software Process & Infrastructure GRIDPP Collaboration Meeting - 3 June 2004 Jakub MOSCICKI
SEAL V1 Status 12 February 2003 P. Mato / CERN Shared Environment for Applications at LHC.
The Atlas Software Distribution Christian ArnaultAlessandro De SalvoSimon GeorgeGrigori Rybkine
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Abstract The automated multi-platform software nightly build system is a major component in the ATLAS collaborative software organization, validation and.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
SPI Software Process & Infrastructure EGEE France - 11 June 2004 Yannick Patois
Testing Virtual Machine Performance Running ATLAS Software Yushu Yao Paolo Calafiura LBNL April 15,
SKA/KAT SPIN Presentation Software Engineering (!?) Robert Crida.
DTIAtlasBuilder Adrien Kaiser Neuro Image Research and Analysis Laboratories University of North Carolina at Chapel Hill A tool to create an atlas from.
NICOS System of Nightly Builds for Distributed Development Alexander Undrus CHEP’03.
Overview of LHCb applications and software environment LHCb software tutorial - March
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER Charles Leggett The Athena Control Framework in Production, New Developments and Lessons Learned.
CMT Christian Arnault - LAL - Chep /18 Introduction What is CMT, its goals Operating CMT The concepts in CMT, the internal model Status, implementation.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
The report on the current situation of the BESIII framework zhangxiaomei maqiumei 10/3/2004.
MINER A Software The Goals Software being developed have to be portable maintainable over the expected lifetime of the experiment extensible accessible.
Advanced BioPSE NCRR How to Install and Configure J. Davison de St. Germain Chief Software Engineer SCI Institute December 2003 J. Davison.
ATLAS Data Challenges US ATLAS Physics & Computing ANL October 30th 2001 Gilbert Poulard CERN EP-ATC.
Organization and Management of ATLAS Nightly Builds F. Luehring a, E. Obreshkov b, D.Quarrie c, G. Rybkine d, A. Undrus e University of Indiana, USA a,
Heather Kelly PPA Scientific Computing Apps LAT was launched as part of the Fermi Gamma-ray Space Telescope on June 11 th 2008.
National Center for Supercomputing ApplicationsNational Computational Science Grid Packaging Technology Technical Talk University of Wisconsin Condor/GPT.
1 Moving Linux in CMS Vincenzo. 2 Generic Certification backward compatibility SLC4 is binary backward compatible: –Binaries built on SLC3 are usable.
GDB Meeting - 10 June 2003 ATLAS Offline Software David R. Quarrie Lawrence Berkeley National Laboratory
LHCb-ATLAS GANGA Workshop, 21 April 2004, CERN 1 DIRAC Software distribution A.Tsaregorodtsev, CPPM, Marseille LHCb-ATLAS GANGA Workshop, 21 April 2004.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen CERN
Marco Cattaneo - DTF - 28th February 2001 File sharing requirements of the physics community  Background  General requirements  Visitors  Laptops 
GLAST LAT Offline SoftwareCore review, Jan. 17, 2001 Review of the “Core” software: Introduction Environment: THB, Thomas, Ian, Heather Geometry: Joanne.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
Servicing HEP experiments with a complete set of ready integrated and configured common software components Stefan Roiser 1, Ana Gaspar 1, Yves Perrin.
 Programming - the process of creating computer programs.
Software Engineering Overview DTI International Technology Service-Global Watch Mission “Mission to CERN in Distributed IT Applications” June 2004.
A. Aimar - EP/SFT LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Project Overview LCG Application Area Internal.
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
10/2/2000LHCb Computing, CHEP Use of Configuration Management tool in LHCb software J. Harvey, P. Mato, F. Ranjard CERN (Switzerland)
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
NA61/NA49 virtualisation: status and plans Dag Toppe Larsen Budapest
Geant4 is a toolkit to simulate the passage of particles through matter, and is widely used in HEP, in medical physics and for space applications. Ongoing.
BESIII Offline Software Development Environment Ma qiumei * Development environment * Configuration & management tool * Software development.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
CERN Tutorial, September Overview of LHCb applications and software environment.
Introduction to the Athena Software Hong Ma BNL Athena Tutorial USATLAS Software Workshop.
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
Bologna Tutorial, June Overview of LHCb applications and software environment.
SPI Software Process & Infrastructure Project Plan 2004 H1 LCG-PEB Meeting - 06 April 2004 Alberto AIMAR
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
SimTK 1.0 Workshop Downloads Jack Middleton March 20, 2008.
Comments on SPI. General remarks Essentially all goals set out in the RTAG report have been achieved. However, the roles defined (Section 9) have not.
Use of CMT in LHCb CMT Workshop, LAL (Orsay) 28 th February - 1 st March 2002 P. Mato / CERN.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
Software Release Build Process and Components in ATLAS Offline Emil Obreshkov for the ATLAS collaboration.
Outline Installing Gem5 SPEC2006 for Gem5 Configuring Gem5.
CSC 215 : Procedural Programming with C
Installation of the ALICE Software
Ruby Getting started & Ruby.New Presented by Mario Tayah
NA61/NA49 virtualisation:
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
SPI external software build tool and distribution mechanism
ATLAS Software Distribution
The ATLAS software in the Grid Alessandro De Salvo <Alessandro
Overview of LHCb applications and software environment
FEniCS = Finite Element - ni - Computational Software
Presentation transcript:

ATLAS Software Kaushik De University of Texas At Arlington based on a tutorial by P. Calafiura (LBNL) LHC Computing Workshop, Ankara May 2, 2008

References Workbook Wiki: Glossary: ATLAS Code LXR indexer: cvs repository: Doxygen summary: computing/links/nightlyDocDirectory/allpackages.html computing/links/nightlyDocDirectory/allpackages.html

Platform and Releases ATLAS software certified on linux SLC4 with gcc 3.4.x in 32 bits mode  Also built in native 64 bits and with gcc 4.1  Port to Mac OS long-standing low priority goal  No Windows version planned Regular developer and production releases  next production release, being validated  latest developer, being validated  latest production “cache” (bugfix patched release, distributed to Tier Xs)

Code Distribution  Each release, and many nightly builds can be installed on your laptop using pacman distribution kits  Mainly geared towards grid production and running existing code  Usable for code development ngAtlasSoftware

CMT Configuration Management Tool  Used for almost everything  Build releases  Setup work environment  Compile and install your code, jo files,...  Generate documentation  Create distribution kits

AtlasLogin Standard environment setup CMT package takes care of setting up core cmt environment ● $CMT..CONFIG,..PATH,..PROJECTPATH ● Differ per release, and per workspace ● Define lookup for rest of environment setup ● CMT project, part of releases and kit Centrally maintained (lots of work) Reasonably customizable Easy to use! > setup ,dbg

Important envars (1)  $CMTCONFIG  Determined by platform, compiler, and dbg or opt. Defines library selection and compiler/linker options  $CMTPATH  Search path for finding packages.  $CMTPROJECTPATH  Search path for finding projects  cmt show path  As envars above can change on-the-fly Bootstrap Settings

Important envars (2)  $JOBOPTSEARCHPATH  For athena.py to find job options files  $DATAPATH  For PathResolver to find data files  $PATH  For shell to find binaries  $LD_LIBRARY_PATH  For dld.so to find libraries  $PYTHONPATH  For python to find modules Final Settings

Athena in a nut shell Athena is based on LHCb's GAUDI

Job Options Use python scripts to configure  Global job properties  Verbosity, inputs, outputs, no of evts to process,...  Hierarchy of JobProperties containers jobproperties.CaloCellFlags.doLArCellEmMisCalib()  Detector tasks  Digitize InDet, Reconstruct Pixel, skip LAr,...   Gaudi Components (Algs, Tools, Services)  via Configurables, python classes mirroring C++  Set component properties, see doc, default values

Selected Top-level Job Options HelloWorld elloWorldOptions.py elloWorldOptions.py elloWorldOptions.py Job Options Examples (more advanced) Digitization (and pileup) leup10_perfmon.py leup10_perfmon.py leup10_perfmon.py RecExCommon (standard offline reco) e/RecExCommon_topOptions.py RecExCommission (combined cosmic reco) ecExCommission_topOptions.py AODtoDPD (primary DPD maker)

Job Transformations Python scripts used to run production tasks  More complex than job options scripts  Variable configuration (e.g. Input files)  Validate results, produce report  Flexible framework helps writing them  Many ready to use  Event Generators  G4 simulation, digitization/pileup  Reconstruction