Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University

Mar17, 2009Belle MC with Grid2 Contents  Status of MC production  Belle MC production procedure with Grid  Ganga

Mar17, 2009Belle MC with Grid3 MC Production Status  Long down time since last June  Just resumed  New sites  KISTI, Melbourne, Ljubljana, Karlsruhe

Mar17, 2009Belle MC with Grid4 Belle VO sites InstituteCPUStatus KISTI60new Merbourne60new Karlsruhe400new Ljubljana80new ASGC120 Stop due to fire incident KEK0112 Unavailable due to old OS KEK0232 Under upgrading Krakow90

Mar17, 2009Belle MC with Grid5 One Week Statistics

Mar17, 2009Belle MC with Grid6 Problems  Storage, HSM busy  Stays inside B system and shared with Belle users  Access to HSM sometimes concentrate on one of four server  Job processing time exceed limits

Mar17, 2009Belle MC with Grid7 Belle MC Procedure 1. Get Assignment from Web  4 physics modes (charged, mixed, charm, uds)  1 slot = 100 run range  Same number of events with experiment data  10 set (streams)

Mar17, 2009Belle MC with Grid8 Belle MC Procedure 2. Receive a mail Gen and Bkg files: copy to HSM (in B computer system) and register to SRB “Sregister hoge.pgen srbdir” Copy script.tgz to UI SRB (Storage Resource Broker) Accessible to/from Grid UI (User Interface) Server you work for Grid Generator, Bkg, sh script files are provided by MC manager

Mar17, 2009Belle MC with Grid9 Belle MC Procedure 3. Submit jobs 1.Create a directory for the slot (prepare-job.rb) 2.Modify sh script and create JDL files (basf2grid.sh) Add “copy inputs from SRB” and “copy outputs to SRB” 3.Create a sh script to submit (mksubmit.rb) “edg-job-submit … job.jdl” 4.Submit (submit) Executable=Job.sh Stdout=log.out Stderr=log.err JDL

Mar17, 2009Belle MC with Grid10 Belle MC Procedure 4. Monitor running jobs Summary CPU Elapse time

Mar17, 2009Belle MC with Grid11 Belle MC Procedure 5. Retrieve finished job Retrieve log files of finished jobs Checking the job is correctly completed

Mar17, 2009Belle MC with Grid12 Ganga  Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources. PythonATLASLHCbGaudi AthenaPythonATLASLHCbGaudi Athena

Mar17, 2009Belle MC with Grid13 Ganga “ Hello World ”  Configure with Job()  Directories  JDL file  Backend = local Configuration Submit Status

Mar17, 2009Belle MC with Grid14 Ganga MC Production → edg-job-submit Backend=LCG

Mar17, 2009Belle MC with Grid15 Summary  MC Production resumed !!  New sites working correctly with large resouces  Configuration and Job submission tool “Ganga” tried.  Easy to see what we’re doing  Good to unified interface  No convenience about functionality We must write script for scripts, anyway.