Corso di Calcolo Parallelo Grid Computing Catania - ITALY 25-29 September 2006 Introduction to the Command Line Interface for Job Submission Alessandro Costa INAF Catania

How to find the right resources on the grid Job List Match It is possible to see which CEs are eligible to run a job specified by a given JDL using the glite-job-list-match (for gLite WMS) $ glite-job-list-match [options] <jdl_file> where <jdl file> is a file containing the job description, usually with extension .jdl. --rank : This option can be used to display the ranking value of each matching resource --o : option can be used to store the CE list on a file, which can later be used with the –i<file path> option of glite-job-submit.

[inafoact01@glite-tutor prova_mpi]$ glite-job-list-match mpi.jdl Selected Virtual Organisation name (from proxy certificate extension): gilda Connecting to host glite-rb2.ct.infn.it, port 7772 *************************************************************************** COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short …..

Connecting to host glite-rb2.ct.infn.it, port 7772 [inafoact01@glite-tutor prova_mpi]$ glite-job-list-match --rank -o ce_list mpi2-glite.jdl Selected Virtual Organisation name (from proxy certificate extension): gilda Connecting to host glite-rb2.ct.infn.it, port 7772 ======================= glite-job-list-match output ======================= Computing Element(s) matching your job requirements have been stored in the file: /home/inafoact01/prova_mpi/ce_list ================================================================== [inafoact01@glite-tutor prova_mpi]$ cat ce_list *************************************************************************** COMPUTING ELEMENT IDs LIST The following CE(s) matching your job requirements have been found: *CEId* *Rank* iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite22 iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long 22 iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short 22 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite 14 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long 14 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short 14 …..

Job Submission I Job Submission $ glite-job-submit [options] <jdl_file> Perform the job submission to the Grid. where <jdl file> is a file containing the job description, usually with extension .jdl. --vo <vo name> : perform submission with a different VO than the UI default one. --output, -o <output file> save the jobId on a file. --resource, -r <resource value> specify the resource for execution. --input, -i <input_file> if this option is specified, the user ill be asked to choose a CEId from a list of CEs contained in the file_path. Once a CEId has been selected the command behaves as explained for the --resource option.

Customization --config-vo: this option allows a a greater control on the submission. You can customize the Resource Broker, VO & MyProxyServer. A template configuration file (for the 'gilda' VO) is the following: $ cat /opt/edg/etc/gilda/edg_wl_ui.conf [ VirtualOrganisation = "gilda"; NSAddresses = {"glite-rb.ct.infn.it:7772"}; LBAddresses = {"glite-rb.ct.infn.it:9000"}; MyProxyServer = grid001.ct.infn.it; ] RB consists of two components, a Network Server to receive the JDL and a Logging & Bookkeeping server to manage the job logging, but these are normally on the same machine.

--config: if the command is launched with this option, the configuration file pointed to by file_path is used instead of the standard configuration file. [inafoact02@glite-tutor 03]$ cat /opt/edg/etc/edg_wl_ui_cmd_var.conf [ rank = - other.GlueCEStateEstimatedResponseTime; requirements = other.GlueCEStateStatus == "Production"; RetryCount = 3; ErrorStorage = "/tmp"; OutputStorage = "/tmp/jobOutput"; ListenerPort = 44000; ListenerStorage = "/tmp"; LoggingTimeout = 30; LoggingSyncTimeout = 30; LoggingDestination = "glite-rb.ct.infn.it:9002"; NSLoggerLevel = 0; DefaultLogInfoLevel = 0; DefaultStatusLevel = 0; DefaultVo = "unspecified"; ]

Choosing a VO The following precedence rule is followed for determining the user's VO the default VO from the user proxy (if it contains VOMS extensions), the VO specified through the --vo or --config-vo options, the VO specified in the configuration file pointed by the GLITE_WMSUI_CONFIG_VO environment variable, the VirtualOrganisation attribute in the JDL the default VO specified in the $GLITE_WMS_LOCATION/etc/glite_wmsui_cmd_var.conf (DefaultVO field) configuration file.

[inafoact01@glite-tutor prova_mpi]$ glite-job-submit -i ce_list mpi-glite.jdl Selected Virtual Organisation name (from proxy certificate extension): gilda ------------------------------------------------------------------------- ……. 3 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-infinite22 4 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-long 22 5 : iceage-ce-01.ct.infn.it:2119/jobmanager-lcgpbs-short 22 6 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite 14 7 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long 14 8 : grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short 14 9 : trigriden00.unime.it:2119/jobmanager-lcgpbs-infinite 8 10: trigriden00.unime.it:2119/jobmanager-lcgpbs-long 8 …. .. q : quit Choose a CEId in the list - [1-18]1:

How about my jobs? I $ glite-job-status [options] <Job Id(s)> Displays bookkeeping information about submitted jobs --input, -i <file_path>: displays bookkeeping info about jobid contained in the input file. When using this option the user is interrogated for choosing among all, one or a subset of the listed job identifiers.

A job can be canceled before it ends using the command glite-job-cancel. glite-job-cancel https://lxshare0234.cern.ch:9000/dAE162is6EStca0VqhVkog Are you sure you want to remove specified job(s)? [y/n]n :y =================== glite-job-cancel Success==================== The cancellation request has been successfully submitted for the following job(s) - https://lxshare0234.cern.ch:9000/dAE162is6EStca0VqhVkog ===========================================================

Questions…