1. Status of CVS repository Production databases Production tools
Data Management
Status of CVS repository
Production databases
Production tools

2. CVS Separate area for each sub-project Internal structure
cmt : requirements
<package> : public headers
src : source opt: src/<component>
Opt: python, cmds, images, etc
POOL
M.Frank LHCb/CERN 2

3. Components Job . Configuration Job Sub- mission Data . Production
Physicist
App/
Pack.
Mgr
Prod.Mgr
Data Production
Tool
Book keeping
Real dataflow
Apparent dataflow
POOL
M.Frank LHCb/CERN 3

4. Components Job configuration Markus Data production Markus
Job submission Andrei
Bookkeeping Sebastien/Francoise
POOL
M.Frank LHCb/CERN 4

5. Job Configuration Database ok. Simple HTTP based Editor
XML-RPC based interface
Boost + python
Tool to import applications
POOL
M.Frank LHCb/CERN 5

6. Job Configuration: Editor
POOL
M.Frank LHCb/CERN 6

7. Data Production Work Flow Execution Flow (Jobs) Gauss - v5 GenTag v7
Brunel - v12
Pythia – v2
1) Generation
2) Simulation
3)Reconstruct
4) Mini
Work Flow
Execution Flow (Jobs)
POOL
M.Frank LHCb/CERN 7

8. Data Production - Details
Workflow
Run
Name
State
N(evt) to be processed
Name
Step Seq. #
Nevt(Split)
Nevt(Merge)
Step
Step
State
Center
Machine
<Rec>
Job
Step
<Tags>
Job
Step
Name
Input file types
Output file types
Application Name
Input File
Output File
Input File
Output File
FileType
File Type
Job Configuration DB
Workflow description
POOL
M.Frank LHCb/CERN 8

9. Instantiation of work flows to production runs
Data Production
Work flows
Database ok.
Simple HTTP based Editor
XML-RPC based interface
Boost + python
Data Production
Instantiation of work flows to production runs
Very primitive
POOL
M.Frank LHCb/CERN 9

10. Work Flow Instantiation
Pythia – v2
1) Generation
2) Simulation
3)Reconstruct
4) Mini
Gauss - v5
Gauss - v5
Gauss - v5
All processes in one job
Tools missing…
Gauss - v5
Brunel - v12
Brunel - v12
GenTag v7
Work Flow
Execution Flow (Jobs)
POOL
M.Frank LHCb/CERN 10

11. Work Flow Instantiation
Script generation through servlet
Select work flow
Instantiate work flow to production run
Add basic information
# of events
CPU requirements etc.
Generate scripts
Possibility to extend existing runs
Scripts are then picked up by Andrei’s client
POOL
M.Frank LHCb/CERN 11

12. Interacting Components
Main strategy on component failure(s)
The system must stay operable
Intermediately produced information items are cached locally until servers are up again
Production server (see next slide)
Production client (see Andrei’s talk)
Servers/servlets to publish bookkeeping information (see Sebastiens talk)
POOL
M.Frank LHCb/CERN 12

13. Component Collaboration
Work flow
Editor
Production
Editor
Production
data
Production DB
Scripts
Edit
Instantiate
Workflow
Production Server
Job request
Status updates
Prod.Mgr
Production
Client
Bookkeeping info
XML Bookkeeping
POOL
M.Frank LHCb/CERN 13

14. “Instantiated” Workflow
Script Generation
setenv PRODUCTION_IDENTIFIER
setenv JOB_NAME
# Target operating system: linux
# Parameters of step MinBias.Dec.2002
setenv MBIAS_QQ_USER_FILE None
setenv MBIAS_EVTYPE 61
# Parameters of step B2pipi.Dec.2002
setenv B2PIPI_QQ_USER_FILE B2pipi.dec
setenv B2PIPI_EVTYPE
# Parameters of work flow B2pipi.Dec.2002
setenv SIMULATION_APP SICBMC
setenv SIMULATION_VSN v254r2
setenv RECONSTRUCTION_APP Brunel
setenv RECONSTRUCTION_VSN v13r1
setenv DBASE_PKG dbase
setenv DBASE_VSN v248r4
setenv XMLDDDB_PKG XmlDDDB
setenv XMLDDDB_VSN v8r1
setenv QQ_USER_FILE ${MBIAS_QQ_USER_FILE},${B2PIPI_QQ_USER_FILE}
setenv mcevtype ${MBIAS_EVTYPE},${B2PIPI_EVTYPE}
setenv SPILLOVER on
setenv mcmonihisto on
“Instantiated” Workflow
POOL
M.Frank LHCb/CERN 14

15. Production Editor
POOL
M.Frank LHCb/CERN 15

16. Work Flow Editor
POOL
M.Frank LHCb/CERN 16

17. Production DBs - Summary
Primitive production tools exist
WWW based
Basic interface for production clients exists
Needs testing
The environment to start developing production tools is in place
Problems with MySQL
MySQL does not support nested SELECT
MySQL will not come in the very near future
POOL
M.Frank LHCb/CERN 17

18. Job List
Import Brunel versions used in production run to job configuration database
Construct “reasonable” work flow
Test generated production script(s)
Test production server-client collaboration
POOL
M.Frank LHCb/CERN 18