110/10/06 - AliEn AliEn Tutorial Solutions Panos Christakoglou University of Athens - CERN.

Slides:



Advertisements
Similar presentations
Linux commands exercise 1. What do you need, if you try to these at home? You need to download and install Ubuntu Linux from the Internet – DVD is need.
Advertisements

Learning Unix/Linux Bioinformatics Orientation 2008 Eric Bishop.
1 Introduction to UNIX Ke Liu
Introducing the Command Line CMSC 121 Introduction to UNIX Much of the material in these slides was taken from Dan Hood’s CMSC 121 Lecture Notes.
Linux+ Guide to Linux Certification, Second Edition
Unix Basics. Systems Programming: Unix Basics 2 Unix Basics  Unix directories  Important Unix file commands  File and Directory Access Rights through.
Very Quick & Basic Unix Steven Newhouse Unix is user-friendly. It's just very selective about who its friends are.
Linux Shell. 2 Linux Command-Line Interface ■ Linux shells: A shell is a command interpreter that allows you to type commands from the keyboard to interact.
L INUX C OMMAND L INE I NTERFACE G UNAANBAN.G
CS 141 Labs are mandatory. Attendance will be taken in each lab. Make account on moodle. Projects will be submitted via moodle.
Using Macs and Unix Nancy Griffeth January 6, 2014 Funding for this workshop was provided by the program “Computational Modeling and Analysis of Complex.
Systems Programming Concepts
Introduction to Linux Workshop February Introduction Rob Lane & The HPC Support Team Research Computing Services CUIT.
Learning basic Unix command IT 325 operating system.
Introduction to UNIX/Linux Exercises Dan Stanzione.
AliEn Tutorial MODEL th May, May 2009 Installation of the AliEn software AliEn and the GRID Authentication File Catalogue.
ALICE Offline Tutorial Using the AliEn Grid Client GSI, 4 th Mar
Linux environment ● Graphical interface – X-window + window manager ● Text interface – terminal + shell.
AQS Web Quick Reference Guide Changing Raw Data Values Using Maintenance 1. From Main Menu, click Maintenance, Sample Values, Raw Data 2. Enter monitor.
Unix Basics Chapter 4.
– Introduction to the Shell 10/1/2015 Introduction to the Shell – Session Introduction to the Shell – Session 2 · Permissions · Users.
Basic unix commands that everyone should know (Even if you have a mac) Slightly more advanced:
Linux+ Guide to Linux Certification, Second Edition
Nadia LAJILI User Interface User Interface 4 Février 2002.
Session 2 Wharton Summer Tech Camp Basic Unix. Agenda Cover basic UNIX commands and useful functions.
UNIX Commands. Why UNIX Commands Are Noninteractive Command may take input from the output of another command (filters). May be scheduled to run at specific.
Unix/Linux cs3353. The Shell The shell is a program that acts as the interface between the user and the kernel. –The shell is fully programmable and will.
Lesson 2-Touring Essential Programs. Overview Development of UNIX and Linux. Commands to execute utilities. Communicating instructions to the shell. Navigating.
BIF713 Basic Unix/Linux Commands Getting Help with Commands.
Agenda Basic Unix Commands (Chapters 2 & 3) Miscellaneous Commands: whereis, which, whoami, finger, passwd, cal, date Working with Files: cat, more, less.
Lecture One. Objective: Provide description of the Command-Line Editor of Linux operating system. Enable students to understand the practical side of.
Working with AliEn Kilian Schwarz ALICE Group Meeting April
Manipulating Files Refresher. The touch Command touch is used to create a new, empty file. If the file already exists, touch updates the time and date.
Basic of UNIX For fresh members of SPARCS
Agenda Basic Unix Commands (Chapters 2 & 3) Miscellaneous Commands: which, passwd, date, ps / kill Working with Files: file, touch, cat, more, less, grep,
SAG INFOTECH PVT. LTD Help Manual For New Challans correction statement SOFT SOLUTION FOR THOSE WHO CAN”T AFFORD TO MAKE ERROR.
M. Oldenburg GridPP Metadata Workshop — July 4–7 2006, Oxford University 1 Markus Oldenburg GridPP Metadata Workshop July 4–7 2006, Oxford University ALICE.
 Last lesson, the Windows Operating System was discussed along with the Windows command shell  Unix is a computer operating system, that similarly manages.
1 CS3695 – Network Vulnerability Assessment & Risk Mitigation – Introduction to Unix & Linux.
ICE UNIX TUTORIAL. File System Commands cd – change directory cd – change directory ls – list contents ls – list contents rm – remove/delete rm – remove/delete.
A GANGA tutorial Professor Roger W.L. Jones Lancaster University.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES The AliEn File Catalogue Jamboree on Evolution of WLCG Data &
Linux Tutorial Lesson Two *Getting Help in Linux *Data movement and manipulation *Relative and Absolute path *Processes Note: see chapter 1,2,3 from Linux.
AliEn Tutorial ALICE workshop Sibiu 20 th August, 2008 Pablo Saiz.
Learning Unix/Linux Based on slides from: Eric Bishop.
Job Management Beijing, 13-15/11/2013. Overview Beijing, /11/2013 DIRAC Tutorial2  DIRAC JDL  DIRAC Commands  Tutorial Exercises  What do you.
Introduction to the Linux Command Line Interface Research Computing Systems Bob Torgerson July 19, 2016.
UNIX Basics Matt Hayward October 18, 2016 LS560 – Information Technology for information professionals.
GRID COMPUTING.
UNIX To do work for the class, you will be using the Unix operating system. Once connected to the system, you will be presented with a login screen. Once.
AliEn Tutorial Panos Christakoglou University of Athens - CERN
Getting started with CentOS Linux
Basic aliensh S. Bagnasco, INFN Torino CNAF Nov 27-28, 2007.
Andy Wang Object Oriented Programming in C++ COP 3330
Running a job on the grid is easier than you think!
Running a job on the grid is easier than you think!
Some Linux Commands.
The Linux Operating System
Tutorial of Unix Command & shell scriptS 5027
Introduction to UNIX.
Tutorial of Unix Command & shell scriptS 5027
Web Programming Essentials:
Tutorial of Unix Command & shell scriptS 5027
Introduction to Computer Organization & Systems
Getting started with CentOS Linux
Andy Wang Object Oriented Programming in C++ COP 3330
Tutorial Unix Command & Makefile CIS 5027
CSE 303 Concepts and Tools for Software Development
Module 6 Working with Files and Directories
LPI Linux Certification
Presentation transcript:

110/10/06 - AliEn AliEn Tutorial Solutions Panos Christakoglou University of Athens - CERN

210/10/06 - AliEn Installation of AliEn software Try it out Download the installer from the web [bash]$ wget ien-installer Make the file executable [bash]$ chmod a+x al ien-installer Run the installer [bash]$./al ien-installer For the solutions, we assume that the user name is trn2301 with the following attributes: ● Local home directory: /home/trn2301 ● Alien home directory: /alice/cern.ch/user/t/trn2301 change the names accordingly to match your case!!!

310/10/06 - AliEn Authentication Try it out Get a valid proxy [bash]$ grid-proxy-init //provide the password when asked Get a valid token [bash]$ alien-token-init trn2301 //the username is optional and should be put if the local username isn't the same as the alien one Get your proxy info [bash]$ grid-proxy-info Get your token info [bash]$ alien-token-info [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

410/10/06 - AliEn General description of the shell Try it out (1) Access the shell [bash]$ aliensh List the contents of your alien directory [aliensh]$ whoami Check your user name [aliensh]$ whoami Check the alien working direcory [aliensh] $ pwd [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

510/10/06 - AliEn General description of the shell Try it out (2) Create the following directory structure in your alien $HOME directory: Tutorial/XML/jdl [aliensh] $ mkdir Tutorial [aliensh] $ mkdir Tutorial/XML [aliensh] $ mkdir Tutorial/XML/jdl Tutorial/XML/par [aliensh] $ mkdir Tutorial/XML/par Tutorial/XML/output [aliensh] $ mkdir Tutorial/XML/output Tutorial/XML/selectors [aliensh] $ mkdir Tutorial/XML/selector Tutorial/XML/macros [aliensh] $ mkdir Tutorial/XML/macros [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

610/10/06 - AliEn General description of the shell Try it out (3) Get the information of the file: /alice/cern.ch/user/p/pchrist/Tutorial/XML/selectors/esdPt.C [aliensh] $ whereis /alice/cern.ch/user/p/pchrist/Tutorial/XML/selectors/esdPt.C [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

710/10/06 - AliEn Working with the file catalog Try it out (1) Exit the shell [aliensh] $ exit Create the following directory structure in your local $HOME directory: AliEn/PDC06/001 and AliEn/PDC06/002 [bash]$ mkdir AliEn [bash]$ mkdir AliEn/PDC06 [bash]$ mkdir AliEn/PDC06/001 [bash]$ mkdir AliEn/PDC06/002 AliEn/Tags, AliEn/Local, AliEn/Interactive and AliEn/Batch [bash]$ mkdir AliEn/Tags [bash]$ mkdir AliEn/Local [bash]$ mkdir AliEn/Interactive [bash]$ mkdir AliEn/Batch [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

810/10/06 - AliEn Working with the file catalog Try it out (2) Copy the following files from the file catalog to your local $HOME/AliEn/Local directory: /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/ESD.par [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/ESD.par file:/home/trn2301/AliEn/Local/ESD.par /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/esdPt.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/esdPt.C file:/home/trn2301/AliEn/Local/esdPt.C /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/esdPt.h [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/esdPt.h file:/home/trn2301/AliEn/Local/esdPt.h /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/demoLocal.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/LOCAL/demoLocal.C file:/home/trn2301/AliEn/Local/demoLocal.C [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

910/10/06 - AliEn Working with the file catalog Try it out (3) Copy the following files from the file catalog to your local $HOME/AliEn/Tags directory: /alice/cern.ch/user/p/pchrist/Tutorial/TAGS/ESD.par [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/TAGS/ESD.par file:/home/trn2301/AliEn/Tags/ESD.par /alice/cern.ch/user/p/pchrist/Tutorial/TAGS/CreateTags.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/TAGS/CreateTags.C file:/home/trn2301/AliEn/Tags/CreateTags.C [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1010/10/06 - AliEn Working with the file catalog Try it out (4) Copy the following files from the file catalog to your local $HOME/AliEn/PDC06/001 and $HOME/AliEn/PDC06/002 directories: /alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/002/AliESDs.ro ot [aliensh]$ cp /alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/002/AliESDs. root file:/home/trn2301/AliEn/PDC06/001/AliESDs.root /alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/004/AliESDs.ro ot [aliensh]$ cp /alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/004/AliESDs. root file:/home/trn2301/AliEn/PDC06/002/AliESDs.root [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1110/10/06 - AliEn Working with the file catalog Try it out (5) Query the f.c. and get all the tag files (*.tag.root) under: /alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/* and redirect it to the file tag100.xml [aliensh]$ find -x tag100 alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/* tag.root > tag100.xml Repeat the previous exercise, limiting this time the number of output files to 10 and copy the xml file to your local $HOME/AliEn/Interactive [aliensh]$ find -l 10 -x tag100 alice/cern.ch/user/a/aliprod/prod2006_2/output_pp/100/* tag.root > tag100.xml [aliensh]$ exit [bash]$ mv tag100.xml /home/trn2301/AliEn/Interactive/ [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1210/10/06 - AliEn Local analysis Try it out Open your local $HOME/AliEn/Tags/CreateTags.C file and modify it accordingly t->ReadLocalCollection("/home/trn2301/AliEn/PDC06"); Run it to create the tag files. [bash]$ root.exe -b -q CreateTags.C Delete the single tag files and stay with just the merged one. [bash]$ rm Run100.Event* Go to your local $HOME/AliEn/Local directory and open the demoLocal.C file. Change the line where you define the location of the tag files and run the macro. TagAna->ChainLocalTags(“/home/trn2301/AliEn/Tags”); [bash]$ root.exe demoLocal.C Impose some selection criteria inside the macro and rerun the example. EvCuts->SetMultiplicityRange(10,15); [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1310/10/06 - AliEn Interactive analysis Try it out (1) Copy the following files to your local $HOME/AliEn/Interactive: /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/ESD.par [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/ESD.par file:/home/trn2301/AliEn/Interactive/ /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/esdPt.h [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/esdPt.h file:/home/trn2301/AliEn/Interactive/ /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/esdPt.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/esdPt.C file:/home/trn2301/AliEn/Interactive/ /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/demoInteractive.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/INTERACTIVE/demoInteractive.C file:/home/trn2301/AliEn/Interactive/

1410/10/06 - AliEn Interactive analysis Try it out (2) Go to your local $HOME/AliEn/Interactive directory and open the demoInteractive.C file. Change the line where you define the tag collection and put the name of the file you created by querying the f.c (it should be tag100.xml). TAlienCollection* coll = TAlienCollection::Open("tag100.xml"); Run the macro. [bash]$ root.exe demoInteractive.C Impose some selection criteria and rerun the example. EvCuts->SetMultiplicityRange(10,15); [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1510/10/06 - AliEn Batch analysis Try it out (1) Copy the following files to $HOME/AliEn/Batch: /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/ESD.par [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/ESD.par file:/home/trn2301/AliEn/Batch/ /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/esdPt.h [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/esdPt.h file:/home/trn2301/AliEn/Batch/ /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/esdPt.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/esdPt.C file:/home/trn2301/AliEn/Batch/ /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/demoBatch.C [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/demoBatch.C file:/home/trn2301/AliEn/Batch/

1610/10/06 - AliEn Batch analysis Try it out (2) /alice/cern.ch/user/p/pchrist/bin/batch.sh [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/batch.sh file:/home/trn2301/AliEn/Batch/ /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/pp10.xml [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/pp10.xml file:/home/trn2301/AliEn/Batch/ /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/analysis.jdl [aliensh]$ cp /alice/cern.ch/user/p/pchrist/Tutorial/BATCH/analysis.jdl file:/home/trn2301/AliEn/Batch/ [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1710/10/06 - AliEn Batch analysis Try it out (3) Modify the InputFile, InputDataCollection and OutputDir fields of your analysis.jdl. InputFile= {"LF:/alice/cern.ch/user/t/trn2301/Tutorial/XML/selectors/esdPt.C", "LF:/alice/cern.ch/user/t/trn2301/Tutorial/XML/selectors/esdPt.h", "LF:/alice/cern.ch/user/t/trn2301/Tutorial/XML/par/ESD.par", "LF:/alice/cern.ch/user/t/trn2301/Tutorial/XML/macros/demoBatch.C"}; InputDataCollection="LF:/alice/cern.ch/user/t/trn2301/Tutorial/XML/xml/pp10.xml,nodow nload"; OutputDir="/alice/cern.ch/user/t/trn2301/Tutorial/XML/output"; [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1810/10/06 - AliEn Batch analysis Try it out (4) Enter the shell and go to your AliEn $HOME directory. [bash]$ aliensh [aliensh]$ cd Copy the local batch.sh to your AliEn $HOME/bin. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/batch.sh Copy the local analysis.jdl to your AliEn $HOME/Tutorial/XML/jdl. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/analysis.jdl Copy the local pp10.xml to your AliEn $HOME/Tutorial/XML/xml. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/pp10.xml [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

1910/10/06 - AliEn Batch analysis Try it out (5) Copy the local ESD.par to your AliEn $HOME/Tutorial/XML/par. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/ESD.par Copy the local esdPt.* to your AliEn $HOME/Tutorial/XML/selectors. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/esdPt.C Tutorial/XML/selectors/esdPt.C::CERN::Castor2 [aliensh]$ cp file:/home/trn2301/AliEn/Batch/esdPt.h Tutorial/XML/selectors/esdPt.h::CERN::Castor2 Copy the local demoBatch.C to your AliEn $HOME/Tutorial/XML/macros. [aliensh]$ cp file:/home/trn2301/AliEn/Batch/demoBatch.C Tutorial/XML/macros/demoBatch.C::CERN::Castor2 Go to your AliEn $HOME/Tutorial/XML/jdl and submit the job. [aliensh]$ cd Tutorial/XML/jdl [aliensh]$ submit analysis.jdl [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

2010/10/06 - AliEn Batch analysis Try it out (6) Check your job priority. [aliensh]$ check priority jobs trn2301 Display all your active jobs. [aliensh]$ top -user trn2301 Display the jdl of your job: [aliensh]$ ps -jdl XXX (where XXX is the given job id) Trace the status of your job: [aliensh]$ ps -trace XXX (where XXX is the given job id) [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file

2110/10/06 - AliEn Batch analysis Try it out (7) When the job 's status turns to RUNNING you can get the stdout and stderr of the job: [aliensh]$ spy XXX stdout (where XXX is the given job id) [aliensh]$ spy XXX stderr (where XXX is the given job id) Edit the already registered analysis.jdl while being in the shell [aliensh]$ edit analysis.jdl [bash]$ --> Your local bash shell [aliensh]$ --> Your alien bash shell No notation --> inside a file