Production client status Job submission Production client Production worker scripts Status Andrei Tsaregorodtsev, CPPM, Marseille

Job submission schema Castor Storage CERN Job scripts Production Data Production DB Bookkeeping DB Job scripts Production service <XML-RPC> Monitoring service Production center <XML-RPC> Castor Bookkeeping service Production client <XML-RPC> Bookkeeping XML files <BBFTP> Storage <BBFTP>

Client operations Check the availability of the CPU resources (queue); Check …/job/ToDo directory for pending tasks: submit tasks formulated in the old production if any; Request job script(s) from the Production Server; Check for the necessary software, configuration files: install the lacking software if necessary; Submit the jobs obtained, report to the Production Server; Check …/bookkeeping/ToDo directory for bookkeeping update files: - update the bookkeeping database; - initiate bbftp transfer of data files to Castor; - accomplish the bookkeeping update if transfer successful

Job description (1) A *.csh file: Production and job identifiers To be fixed ! setenv SUBMIT_DATE 2002-10-09 setenv SUBMIT_TIME 17:42 setenv PRODUCTION_IDENTIFIER 400000067 setenv JOB_NAME 400000370 # Parameters of step MinBias.Dec.2002 setenv MBIAS_QQ_USER_FILE None setenv MBIAS_EVTYPE 61 # ================================================================ # Parameters of step B2pipi.Dec.2002 setenv B2PIPI_QQ_USER_FILE B2pipi.dec setenv B2PIPI_EVTYPE 411300 Signal part description Signal part description

Applications and other packages versions Job description (2) Applications and other packages versions # Parameters of work flow B2pipi.Dec.2002 setenv SIMULATION_APP SICBMC setenv SIMULATION_VSN v254r2 setenv RECONSTRUCTION_APP Brunel setenv RECONSTRUCTION_VSN v13r1 setenv DBASE_PKG dbase setenv DBASE_VSN v248r4 setenv XMLDDDB_PKG XmlDDDB setenv XMLDDDB_VSN v8r1 setenv QQ_USER_FILE ${MBIAS_QQ_USER_FILE},${B2PIPI_QQ_USER_FILE} setenv mcevtype ${MBIAS_EVTYPE},${B2PIPI_EVTYPE} setenv SPILLOVER on setenv mcmonihisto on # ( optional ) statistics, 500 by default setenv mcstat 500 # ( optional ) output file size, 1000 and 1000 by default setenv mcsize 1000 setenv dstsize 1000 # ================================================================ A list of different signal datasets to be produced with the same spill-over events Spill-over flag Monitoring histo flag Optional parameters

Production worker scripts The job scripts are interpreted on a worker node by a set of production scripts: getting input data; invoking executables for each step; saving output datasets and log files; checking the log files; preparing bookkeeping update scripts; reporting job status to PVSS and “new” monitoring services; The current production scripts are used with the Production Client: Should we retain compatibility with the whole current production procedure or just the bookkeeping part ?

Client status Implemented in Python; Code is functional, some parts to be added: Logging; Simple local production manager tool Tests are being done: New job script format; Compatibility with the old production schema; Proper packaging is to be done; Easy installation (rpm like) is to be done;