AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.

Slides:



Advertisements
Similar presentations
MFA for Business Banking – Security Code Multifactor Authentication: Quick Tip Sheets Note to Financial Institutions: We are providing these QT sheets.
Advertisements

Professional Toolkit V2.0 C:\Presentations - SmartCafe_Prof_V2.0 - bsc page 1 Professional Toolkit 2.0.
Corporate Property Automated Information System (CPAIS) Macro Walkthrough Guide for Excel Version 2003.
Chapter 14 Chapter 14: Server Monitoring and Optimization.
1 of 5 This document is for informational purposes only. MICROSOFT MAKES NO WARRANTIES, EXPRESS OR IMPLIED, IN THIS DOCUMENT. © 2006 Microsoft Corporation.
Trains status&tests M. Gheata. Train types run centrally FILTERING – Default trains for p-p and Pb-Pb, data and MC (4) Special configuration need to be.
Julie McEnery1 Installing the ScienceTools The release manager automatically compiles each release of the Science Tools, it creates a set of wrapper scripts.
Solaris Software Packaging and Installation Paul Foster 14/11/2000.
Statistics of CAF usage, Interaction with the GRID Marco MEONI CERN - Offline Week –
Staging to CAF + User groups + fairshare Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE Offline week,
A crash course in njit’s Afs
Backup & Recovery 1.
Status of CAF and SKAF Arsen Hayrapetyan, Yerevan Physics Institute 1 November 18, 2010 ALICE Offline Week.
Business Optix Library Service – Workflow
Using Data Active Server Pages Objectives In this chapter, you will: Learn about variables and constants Explore application and session variables Learn.
Customized cloud platform for computing on your terms !
Programming and Application Packages
AliEn uses bbFTP for the file transfers. Every FTD runs a server, and all the others FTD can connect and authenticate to it using certificates. bbFTP implements.
Guide Demo Program installation SOP ePAD SW PM. Before you start Check “Guide” version is latest ( or ) * follow next page Latest version.
© 2013 IBM Corporation Get started on IBM Linux on Power SDK November 2013.
DTIAtlasBuilder Adrien Kaiser Neuro Image Research and Analysis Laboratories University of North Carolina at Chapel Hill A tool to create an atlas from.
Guideline: How to build AMSS source code? History: 01/02/ Make Draft 05/02/2010 – Release /02/2010 – Updated.
CMSBrownBag,05/29/2007 B.Mangano How to “use” CMSSW on own Linux Box and be happy In this context “use” means: - check-out pre-compiled CMSSW code - run.
March 2, 2005Wah-kai Ngai1 Installation of Geant4 1st HK Simulation Meeting.
1 Part III: PROOF Jan Fiete Grosse-Oetringhaus – CERN Andrei Gheata - CERN V3.2 –
1 / 22 AliRoot and AliEn Build Integration and Testing System.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Installing CompuCell3D from source. Why you might want to install from source? 1.There are no binaries for your platform (e.g. gentoo linux) 2.You want.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
GRID Zhen Xie, INFN-Pisa, on DataGrid WP6 meeting1 Globus Installation Toolkit Zhen Xie On behalf of grid-release team INFN-Pisa.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Analysis trains – Status & experience from operation Mihaela Gheata.
LANDESK SOFTWARE CONFIDENTIAL Tips and Tricks with Filters Jenny Lardh.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
Enabling Grids for E-sciencE Software installation and setup Viet Tran Institute of Informatics Slovakia.
1 Running MPI on “Gridfarm” Bryan Carpenter February, 2005.
SPI NIGHTLIES Alex Hodgkins. SPI nightlies  Build and test various software projects each night  Provide a nightlies summary page that displays all.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
AliRoot survey: Analysis P.Hristov 11/06/2013. Are you involved in analysis activities?(85.1% Yes, 14.9% No) 2 Involved since 4.5±2.4 years Dedicated.
Lab 9 Department of Computer Science and Information Engineering National Taiwan University Lab9 - Debugging I 2014/11/4/ 28 1.
Marian Ivanov (New) Root Memory checker. Outlook ● Motivation ● New memory checker – Implementation – User interface – Examples ● AliRoot observations.
Alice off-line week, AliEn package for Windows users Artem Harutyunyan 1,2,3 Arsen Hayrapetyan 1,2,4 1 Yerevan Physics Institute 2 Armenian.
Good user practices + Dynamic staging to a CAF cluster Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CUF,
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
Some topics for discussion 31/03/2016 P. Hristov 1.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Advanced Computing Facility Introduction
CLINIC-LAB COMMUNICATION Configuring 3Shape Communicate™
bitcurator-access-webtools Quick Start Guide
Welcome to Indiana University Clusters
Experience of PROOF cluster Installation and operation
Installation of the ALICE Software
Introduction to Operating Systems
How to Utilize the Consortium Resources / Community / Training Materials REDCapCon 2017 Sue Lowry University of Minnesota in Minneapolis,
Analysis trains – Status & experience from operation
Report PROOF session ALICE Offline FAIR Grid Workshop #1
Status of the CERN Analysis Facility
Off-line weekly meeting
Analysis Trains - Reloaded
Submit BOSS Jobs on Distributed Computing System
LCGAA nightlies infrastructure
Bomgar Remote support software
CCA Skill Certification
Instructor: Prasun Dewan (FB 150,
Introduction to Operating Systems
Assignment Preliminaries
bitcurator-access-webtools Quick Start Guide
Carthage ios 8 onwards Dependency manager that streamlines the process of integrating the libraries into the project.
Review of Previous Lesson
Presentation transcript:

AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia

Software packages: aliroot, root, geant, alien Should I download the source and compile it? ◦ You can, of course, but you can also download precompiled binaries. (See  Benefits:  Exactly the same packages used on AAF and grid  Much less time consuming  Correct dependencies for aliroot  Easy to use (you just source a shell script)  You can have multiple installations and switch between them  Available for Linux (SLC, Ubuntu…)  Mac support is underway ALICE Offline Week, 18 Nov 20102

Enabling aliroot on AAF (1) You can get the list of packages available on AF with gProof->ShowPackages() Once you have selected the aliroot package, you can enable it on AF with gProof->EnablePackage() By default, only the “base” aliroot libraries are loaded (libVMC, libTree, libPhysics, libMatrix, libMinuit, libXMLParser, libGui, libSTEER, libESD, libAOD, libANALYSIS, libANALYSISalice) You can load different subsets of aliroot libraries for different needs: reconstruction, simulation, etc. ◦ Different subsets are loaded through different “aliroot modes”  ALIROOT  REC  SIM ALICE Offline Week, 18 Nov 20103

Enabling aliroot on AAF (2) You can also load extra libraries, e.g. CORRFW and PWG2resonances. Here is an example: ◦ TList * list = new TList; ◦ list->Add(new TNamed(“ALIROOT_MODE”, “ALIROOT”)); ◦ list ‐ >Add(new TNamed(“ALIROOT_EXTRA_LIBS”, “ANALYSIS:ANALYSISalice:CORRF W:PWG2resonances”)); ◦ TProof::Open(”alice-caf.cern.ch”); ◦ list); … 05:16: Mst-0 | Info in : Running in ALIROOT mode... 05:16: Mst-0 | Info in : Loading libANALYSIS.so... 05:16: Mst-0 | Info in : Loading libANALYSISalice.so... 05:16: Mst-0 | Info in : Loading libCORRFW.so... 05:16: Mst-0 | Info in : Loading libPWG2resonances.so... 05:16: Mst-0 | Info in : Enabling was OK... ALICE Offline Week, 18 Nov 20104

Enabling aliroot on AAF (3) You can enable your own libraries using PAR files. Here is an example of enabling own TOF library: ◦ TList * list = new TList; ◦ list->Add(new TNamed(“ALIROOT_MODE", "ALIROOT”); ◦ list->Add(new TNamed(“ALIROOT_EXTRA_LIBS”, “ANALYSIS:ANALYSISalice”)); ◦ list->Add(new TNamed(“ALIROOT_EXTRA_INCLUDES”, “TOF”)); ◦ list); ◦ gProof->UploadPackage(“MyTOFPar.par”); ◦ gProof->EnablePackage(“MyTOFPar”); ALICE Offline Week, 18 Nov 20105

Enabling aliroot on AAF using the plugin Here is an example of loading aliroot libraries + extra CORRFW and PWG2resonances libraries: #include "AliAnalysisAlien.h” AliAnalysisAlien* plugin = new AliAnalysisAlien(); plugin->SetRunMode(“full”); plugin->SetAliRootMode("ALIROOT"); plugin->SetAliROOTVersion("v AN"); plugin->SetAdditionalLibs("libCORRFW.so libPWG2resonances.so"); …. ALICE Offline Week, 18 Nov 20106

Common user problems ALICE Offline Week, 18 Nov 20107

Can’t connect after TProof::Reset() Sometimes (e.g. when you kill your proof session with Ctrl + C) you need to reset the connection. Resetting means killing your user proof processes on cluster machines. This requires some time. ◦ Remedy: Wait for ~1 min before reconnecting. This pause should be enough for proof to clean up your previous session completely. ALICE Offline Week, 18 Nov 20108

My task crashes and I see “bad_alloc” error There are memory limits per worker on AAF (3GB on resident and 3GB on virtual memory). When you hit them (no memory can be allocated) you might see the following message: “terminate called after throwing an instance of 'std::bad_alloc’”. ◦ Remedy: Check your code for memory leaks. ALICE Offline Week, 18 Nov 20109

Authentication problems (1) ALICE Offline Week, 18 Nov You are getting the following error: Remedy: Do one of the following: Invoke gEnv->SetValue("XSec.GSI.DelegProxy", "2"); before connecting to the cluster. Add the following line to your user.rootrc file: XSec.GSI.DelegProxy 2

Authentication problems (2) ALICE Offline Week, 18 Nov You are getting the following error: Remedy: You should tell proof where are your trusted CA certificates. This can be done setting environment variable X509_CERT_DIR before connecting to AF: export X509_CERT_DIR=$ALIEN_ROOT/globus/share/certificates

Management of the output in “proof” mode Quite often the problems are caused by the violation of any of the following rules: ◦ When running in “proof” mode with plug-in or directly running analysis on AAF, you should NOT delete the output in the destructor:  AliAnalysisTask::~AliAnalysisTask () {delete fOutput;} is wrong!  Correct version of the destructor is:  AliAnalysisTask::~AliAnalysisTask() { if(fOutput && ! AliAnalysisManager::GetAnalysisManager()->IsProofMode()) delete fOutput; } ◦ The owner should be set in UserCreateOutputObjects():  fOutput->SetOwner(kTRUE); ◦ At the end of UserCreateOutputObjects() one should have:  PostData(1, fOutput); ◦ All data members of your task class must be initialised. ALICE Offline Week, 18 Nov

I want a dataset to be staged… You can request dataset staging from AAF team, posting a staging request in AAF savannah: ◦ Following details must be specified:  Dataset name  Your (Originator , determined automatically when you log in)  Cluster(s) on which the dataset should be staged ◦ The dataset will be staged under /alice/data or /alice/sim You can stage the dataset yourself following instructions at (staging macro) ◦ The dataset is staged under /, e.g. /PWG3/zampolli We are planning to create a page on AAF where you can request the staging and mark it “official” (i.e. to be staged under /alice/data or /alice/sim). The dataset with redirector paths will be then created and copied to alien and staging daemons on different clusters will “pick it up” later and stage it on every cluster. ALICE Offline Week, 18 Nov

My dataset is not fully staged… For example: ◦ gProof->ShowDataSets(“/PWG2/jgrosseo/LHC10e13_121040”) Dataset URI | # Files | Default tree | # Events | Disk | Staged /PWG2/jgrosseo/LHC10e13_ | 1576 | /esdTree | 5.708e+05 | 17GB | 90% ◦ If you want your dataset to be staged completely, you should send an to Martin or me, and we’ll complete/repair it for you. ◦ In the future a macro will be available for users to complete the staging. (like one for staging a dataset) ALICE Offline Week, 18 Nov

Links AAF user manual: AAF FAQ: AAF user support: ALICE Offline Week, 18 Nov

Thank you! and… Questions? ALICE Offline Week, 18 Nov