Presentation is loading. Please wait.

Presentation is loading. Please wait.

Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University.

Similar presentations


Presentation on theme: "Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University."— Presentation transcript:

1 Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University

2 Mar17, 2009Belle MC with Grid2 Contents  Status of MC production  Belle MC production procedure with Grid  Ganga

3 Mar17, 2009Belle MC with Grid3 MC Production Status  Long down time since last June  Just resumed  New sites  KISTI, Melbourne, Ljubljana, Karlsruhe

4 Mar17, 2009Belle MC with Grid4 Belle VO sites InstituteCPUStatus KISTI60new Merbourne60new Karlsruhe400new Ljubljana80new ASGC120 Stop due to fire incident KEK0112 Unavailable due to old OS KEK0232 Under upgrading Krakow90

5 Mar17, 2009Belle MC with Grid5 One Week Statistics

6 Mar17, 2009Belle MC with Grid6 Problems  Storage, HSM busy  Stays inside B system and shared with Belle users  Access to HSM sometimes concentrate on one of four server  Job processing time exceed limits

7 Mar17, 2009Belle MC with Grid7 Belle MC Procedure 1. Get Assignment from Web  4 physics modes (charged, mixed, charm, uds)  1 slot = 100 run range  Same number of events with experiment data  10 set (streams)

8 Mar17, 2009Belle MC with Grid8 Belle MC Procedure 2. Receive a mail Gen and Bkg files: copy to HSM (in B computer system) and register to SRB “Sregister hoge.pgen srbdir” Copy script.tgz to UI SRB (Storage Resource Broker) Accessible to/from Grid UI (User Interface) Server you work for Grid Generator, Bkg, sh script files are provided by MC manager

9 Mar17, 2009Belle MC with Grid9 Belle MC Procedure 3. Submit jobs 1.Create a directory for the slot (prepare-job.rb) 2.Modify sh script and create JDL files (basf2grid.sh) Add “copy inputs from SRB” and “copy outputs to SRB” 3.Create a sh script to submit (mksubmit.rb) “edg-job-submit … job.jdl” 4.Submit (submit) Executable=Job.sh Stdout=log.out Stderr=log.err JDL

10 Mar17, 2009Belle MC with Grid10 Belle MC Procedure 4. Monitor running jobs Summary CPU Elapse time

11 Mar17, 2009Belle MC with Grid11 Belle MC Procedure 5. Retrieve finished job Retrieve log files of finished jobs Checking the job is correctly completed

12 Mar17, 2009Belle MC with Grid12 Ganga  Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources. PythonATLASLHCbGaudi AthenaPythonATLASLHCbGaudi Athena http://ganga.web.cern.ch/ganga/index.php

13 Mar17, 2009Belle MC with Grid13 Ganga “ Hello World ”  Configure with Job()  Directories  JDL file  Backend = local Configuration Submit Status

14 Mar17, 2009Belle MC with Grid14 Ganga MC Production → edg-job-submit Backend=LCG

15 Mar17, 2009Belle MC with Grid15 Summary  MC Production resumed !!  New sites working correctly with large resouces  Configuration and Job submission tool “Ganga” tried.  Easy to see what we’re doing  Good to unified interface  No convenience about functionality We must write script for scripts, anyway.


Download ppt "Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University."

Similar presentations


Ads by Google