AliEn2 and GSI batch farm/disks/tape Current status Kilian Schwarz.

Slides:



Advertisements
Similar presentations
Status GridKa & ALICE T2 in Germany Kilian Schwarz GSI Darmstadt.
Advertisements

The ALICE Framework at GSI Kilian Schwarz ALICE Meeting August 1, 2005.
GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.
AliEn Tutorial MODEL th May, May 2009 Installation of the AliEn software AliEn and the GRID Authentication File Catalogue.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
PROOF - Parallel ROOT Facility Kilian Schwarz Robert Manteufel Carsten Preuß GSI Bring the KB to the PB not the PB to the KB.
ALICE Offline Tutorial Using the AliEn Grid Client GSI, 4 th Mar
Zhiling Chen (IPP-ETHZ) Doktorandenseminar June, 4 th, 2009.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Alice off-line meeting Alberto Colla Cern, October 3, 2005 AliEn How-To Alice off-line meeting Cern, October 3, 2005 Alberto Colla (Alice off-line Calibration.
VIPBG LINUX CLUSTER By Helen Wang March 29th, 2013.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
INTRODUCTION The GRID Data Center at INFN Pisa hosts a big Tier2 for the CMS experiment, together with local usage from other HEP related/not related activities.
1 Part III: PROOF Jan Fiete Grosse-Oetringhaus – CERN Andrei Gheata - CERN V3.2 –
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
M. Schott (CERN) Page 1 CERN Group Tutorials CAT Tier-3 Tutorial October 2009.
GRID. Register Fill the form. Your IP (Juanjo) signature is needed and the one from the.
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
1 PROOF The Parallel ROOT Facility Gerardo Ganis / CERN CHEP06, Computing in High Energy Physics 13 – 17 Feb 2006, Mumbai, India Bring the KB to the PB.
Status of PDC’07 and user analysis issues (from admin point of view) L. Betev August 28, 2007.
Infrastructure for QA and automatic trending F. Bellini, M. Germain ALICE Offline Week, 19 th November 2014.
Working with AliEn Kilian Schwarz ALICE Group Meeting April
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
PROOF and ALICE Analysis Facilities Arsen Hayrapetyan Yerevan Physics Institute, CERN.
UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Site Report: Prague Jiří Chudoba Institute of Physics, Prague WLCG GridKa+T2s Workshop.
March, PROOF - Parallel ROOT Facility Maarten Ballintijn Bring the KB to the PB not the PB to the KB.
1 Status of PROOF G. Ganis / CERN Application Area meeting, 24 May 2006.
+ AliEn site services and monitoring Miguel Martinez Pedreira.
Materials for Report about Computing Jiří Chudoba x.y.2006 Institute of Physics, Prague.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
Analysis train M.Gheata ALICE offline week, 17 March '09.
Data transfers and storage Kilian Schwarz GSI. GSI – current storage capacities vobox LCG RB/CE GSI batchfarm: ALICE cluster (67 nodes/480 cores for batch.
Alien and GSI Marian Ivanov. Outlook GSI experience Alien experience Proposals for further improvement.
Axel Naumann, DØ University of Nijmegen, The Netherlands 6/20/2001 Dutch Morning Meeting 1 From n-Tuples to b-Tags ?
AliEn Tutorial ALICE workshop Sibiu 20 th August, 2008 Pablo Saiz.
ROOT and PROOF Tutorial Arsen HayrapetyanMartin Vala Yerevan Physics Institute, Yerevan, Armenia; European Organization for Nuclear Research (CERN)
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
ALICE Physics Data Challenge ’05 and LCG Service Challenge 3 Latchezar Betev / ALICE Geneva, 6 April 2005 LCG Storage Management Workshop.
Gestion des jobs grille CMS and Alice Artem Trunov CMS and Alice support.
AAF tips and tricks Arsen Hayrapetyan Yerevan Physics Institute, Armenia.
ALICE Full Dress Rehearsal ALICE TF Meeting 02/08/07.
Pledged and delivered resources to ALICE Grid computing in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Lyon Analysis Facility - status & evolution - Renaud Vernet.
Availability of ALICE Grid resources in Germany Kilian Schwarz GSI Darmstadt ALICE Offline Week.
The ALICE Analysis -- News from the battlefield Federico Carminati for the ALICE Computing Project CHEP 2010 – Taiwan.
Kilian Schwarz ALICE Computing Meeting GSI, October 7, 2009
GRID COMPUTING.
Installation of the ALICE Software
ARDA-ALICE activity in 2005 and tasks in 2006
Real Time Fake Analysis at PIC
AliEn Tutorial Panos Christakoglou University of Athens - CERN
Basic aliensh S. Bagnasco, INFN Torino CNAF Nov 27-28, 2007.
Belle II Physics Analysis Center at TIFR
Running a job on the grid is easier than you think!
Running a job on the grid is easier than you think!
Report PROOF session ALICE Offline FAIR Grid Workshop #1
PROOF – Parallel ROOT Facility
GSIAF & Anar Manafov, Victor Penso, Carsten Preuss, and Kilian Schwarz, GSI Darmstadt, ALICE Offline week, v. 0.8.
SAM at CCIN2P3 configuration issues
MC data production, reconstruction and analysis - lessons from PDC’04
GSIAF "CAF" experience at GSI
April HEPCG Workshop 2006 GSI
ALICE GSI Compile Cluster
Support for ”interactive batch”
PROOF - Parallel ROOT Facility
Presentation transcript:

AliEn2 and GSI batch farm/disks/tape Current status Kilian Schwarz

Status GSI batch farm 4 machines dedicated to ALICE (alice queue) (Dual P4 Xeon 2 GHz, 1 GB RAM) New queue (bsarge) in testing state (ca. 20 Opteron, 2.3 GHz, 4 GB RAM, Currently Debian Sarge 32bit) ROOT/AliRoot exist compiled for Debian Sarge (gcc 3.3.5) access via. Alilogin v sarge. First AliRoot test runs successful

Status GSI disk /d/alice01/03/04/05 dedicated for ALICE altogether still 220 GB space free 3 new fileserver provide 8 TB disk space for Grid usage (LCG SRM) – interface to local users still investigated (xrootd ?) 2 new fileservers available with 6 TB disk space. Need to be built in by systems group

Status GSI tape 3 ALICE tape archives available Alice (generic use), Aliprod (AliEn use), Aliceraw (for raw data)

Status AliEn2 Newest version (AliEn2.5) installed and working

production - GSI participates in SC3 and DC05 currently 6 jobs in parallel (alice queue) new Sarge machines being included soon GSI SC3 is planned to run via Christmas holidays At GSI central IT services are not planned to be supervised On new Sarge queue in principle 96 jobs in parallel possible (limited only by GSI bandwidth)

Get certificate ( New AliEn user has to be created (workflow unclear !!!) Mkdir $HOME/.alien Echo „export AlIEN_USER=user“ > $HOME/.alien/Environment ln –s $HOME/.globus $HOME/.alien/globus >. /u/aliprod/bin/.alienlogin > alien register-cert (AFS password required) > alien proxy-init > alien (login) Access to AliEn User story discussed in ALICE-LCG- TF: User support and documentation needed SC4: individual user analysis

Production via AliEn Ingredients: sim.C, rec.C, simRun.C, production.jdl sim.C void rec() { AliSimulation simu; TStopwatch timer; timer.Start(); sim.Run(); timer.Stop(); timer.Print(); } rec.C void rec() { AliReconstruction reco; TStopwatch timer; timer.Start(); reco.Run(); timer.Stop(); timer.Print(); }

simRun.C // #define VERBOSEARGS // simrun.C { // extract the run and event variables given with --run --event int nrun = 0; int nevent = 0; int seed = 0; char sseed[1024]; char srun[1024]; char sevent[1024]; sprintf(srun,""); sprintf(sevent,""); for (int i=0; i Argc();i++){ #ifdef VERBOSEARGS printf("Arg %d: %s\n",i,gApplication- >Argv(i)); #endif if (!(strcmp(gApplication->Argv(i),"--run"))) nrun = atoi(gApplication->Argv(i+1)); sprintf(srun,"%d",nrun); if (!(strcmp(gApplication->Argv(i),"-- event"))) nevent = atoi(gApplication->Argv(i+1)); sprintf(sevent,"%d",nevent); } seed = nrun * nevent; sprintf(sseed,"%d",seed); if (seed==0) { fprintf(stderr,"!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!\n"); fprintf(stderr,"!!!! WARNING! Seeding variable for MC is 0 !!!!\n"); fprintf(stderr,"!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!\n"); } else { fprintf(stdout,"!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!\n"); fprintf(stdout,"!!! MC Seed is %d \n",seed); fprintf(stdout,"!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!\n"); } // set the seed environment variable gSystem->Setenv("CONFIG_SEED",sseed); gSystem->Setenv("DC_RUN",srun); gSystem->Setenv("DC_EVENT",sevent); gSystem->Exec("cp $ROOTSYS/etc/system.rootrc.rootrc"); gSystem->Exec("aliroot -b -q sim.C > sim.log 2>&1"); gSystem->Exec("aliroot -b -q rec.C > rec.log 2>&1"); } Main à la pâte: simRun.C

production.jdl Executable = "aliroot"; Jobtag={"comment:PDC05 flow events“, "round::2005“, "tag:v ", "type:Flow"}; Packages={"AliRoot::v “, "GEANT3::v1-3"}; TTL = "86400"; Validationcommand ="/alice/cern.ch/user/a/aliprod/prod uction_2005/flow/configs/validation.sh"; Requirements = ( other.CE == "Alice::LCG::Catania" ); InputFile= {"LF:/alice/cern.ch/user/a/aliprod/p dc05_flow/production/configs/Confi g.C", "LF:/alice/cern.ch/user/a/aliprod/pd c05_flow/production/configs/simru n.C", "LF:/alice/cern.ch/user/a/aliprod/pdc05 _flow/production/configs/sim.C", "LF:/alice/cern.ch/user/a/aliprod/pdc05 _flow/production/configs/rec.C" }; Alice::CERN::Castor2", ice::CERN::se01"}; OutputDir="/alice/cern.ch/user/a/alipro d/production_2005/flow/output_allfi les/$1/#alien_counter_03i#"; splitarguments="simrun.C --run $1 -- event #alien_counter#"; split="production:1-50"; Workdirectorysize={"1500MB"}; Main à la pâte: jdl

Add locally produced files in AliEn File Catalogue e.g. > alien alien:> cd alien:> add ks_newfile file://lxg0503.gsi.de/misc/kschwarz/testjob s/Config.C file://lxg0503.gsi.de/misc/kschwarz/testjob s/Config.C alien:>“Registering file in ALICE::GSI::File“ alien:>“File inserted into catalogue“

Submit the job, monitor, get output > alien login alien:> submit production.jdl alien:> top alien:> spy jobID nodeinfo/stdout/stderr alien:> cd outputdirectory alien:> get outputfiles

Analysis via AliEn Ingredients: esdanalysis.jdl, AliESD.par (PROOF Archive), AliEnBatchAnalysis.C, esdTree.C/h (Selector files) method: same as with production – create files, register them in AliEn FC, submit job, get output.

AliEnBatchAnalysis.C Int_t AlienBatchAnalysis( const char *collectionfile, const char *selectorfile, const char* pararchivename, const char *chainname="esdTree" ) { ////////////////////////////////////////// // Libraries required to load // gSystem.Load("libRAliEn.so"); // gSystem.Load("libXMLIO.so"); gSystem->Load("libapmoncpp.so"); ////////////////////////////////////////// ////////////////////////////////////////////////////////////////// // Setup PAR File if (pararchivename) { char processline[1024]; sprintf(processline,".! tar xvzf %s.par",pararchivename); gROOT->ProcessLine(processline); const char* ocwd = gSystem->WorkingDirectory(); gSystem->ChangeDirectory(pararchivename); // check for BUILD.sh and execute if (!gSystem->AccessPathName("PROOF-INF/BUILD.sh")) { printf("*******************************\n"); printf("*** Building PAR archive ***\n"); printf("*******************************\n"); if (gSystem->Exec("PROOF-INF/BUILD.sh")) { Error("AlienBatchAnalysis","Cannot Build the PAR Archive! - Abort!"); return -1; } // check for SETUP.C and execute if (!gSystem->AccessPathName("PROOF-INF/SETUP.C")) { printf("*******************************\n"); printf("*** Setup PAR archive ***\n"); printf("*******************************\n"); gROOT->Macro("PROOF-INF/SETUP.C"); } gSystem->ChangeDirectory("../"); } ////////////////////////////////////////////////////////////////// // Connect to AliEn printf("*******************************\n"); printf("*** Connect to AliEn ***\n"); printf("*******************************\n"); TGrid::Connect("alien://"); ////////////////////////////////////////////////////////////////// // Create Collection printf("*******************************\n"); printf("*** Create Collection ***\n"); printf("*** Wk-Dir = |%s| \n",gSystem->WorkingDirectory()); printf("*** Coll = |%s| \n",collectionfile); printf("*******************************\n"); TAlienCollection* coll = TAlienCollection::Open(collectionfile); coll->Print(); ////////////////////////////////////////////////////////////////// printf("*******************************\n"); printf("*** Convert Collection ***\n"); printf("*******************************\n"); TGridResult* result = coll->GetGridResult("",1); TList* analysisfilelist = result->GetFileInfoList(); analysisfilelist->Print();

AlienBatchAnalysis.C part 2 ////////////////////////////////////////////////////////////////// // Create A Chain printf("*******************************\n"); printf("*** Create Chain ***\n"); printf("*******************************\n"); TChain* analysischain = new TChain(chainname); analysischain->AddFileInfoList(analysisfilelist); analysischain->Print(); ///////////////////////////////////////////////////////////////// // Run the Analysis Selector printf("*******************************\n"); printf("*** Run Analysis Selector %s\n",selectorfile); printf("*******************************\n"); analysischain->Process(selectorfile);

Collection XML file …