Download presentation
Presentation is loading. Please wait.
Published byTimothy Goodman Modified over 9 years ago
1
Belle MC Production on Grid 2 nd Open Meeting of the SuperKEKB Collaboration Soft/Comp session 17 March, 2009 Hideyuki Nakazawa National Central University
2
Mar17, 2009Belle MC with Grid2 Contents Status of MC production Belle MC production procedure with Grid Ganga
3
Mar17, 2009Belle MC with Grid3 MC Production Status Long down time since last June Just resumed New sites KISTI, Melbourne, Ljubljana, Karlsruhe
4
Mar17, 2009Belle MC with Grid4 Belle VO sites InstituteCPUStatus KISTI60new Merbourne60new Karlsruhe400new Ljubljana80new ASGC120 Stop due to fire incident KEK0112 Unavailable due to old OS KEK0232 Under upgrading Krakow90
5
Mar17, 2009Belle MC with Grid5 One Week Statistics
6
Mar17, 2009Belle MC with Grid6 Problems Storage, HSM busy Stays inside B system and shared with Belle users Access to HSM sometimes concentrate on one of four server Job processing time exceed limits
7
Mar17, 2009Belle MC with Grid7 Belle MC Procedure 1. Get Assignment from Web 4 physics modes (charged, mixed, charm, uds) 1 slot = 100 run range Same number of events with experiment data 10 set (streams)
8
Mar17, 2009Belle MC with Grid8 Belle MC Procedure 2. Receive a mail Gen and Bkg files: copy to HSM (in B computer system) and register to SRB “Sregister hoge.pgen srbdir” Copy script.tgz to UI SRB (Storage Resource Broker) Accessible to/from Grid UI (User Interface) Server you work for Grid Generator, Bkg, sh script files are provided by MC manager
9
Mar17, 2009Belle MC with Grid9 Belle MC Procedure 3. Submit jobs 1.Create a directory for the slot (prepare-job.rb) 2.Modify sh script and create JDL files (basf2grid.sh) Add “copy inputs from SRB” and “copy outputs to SRB” 3.Create a sh script to submit (mksubmit.rb) “edg-job-submit … job.jdl” 4.Submit (submit) Executable=Job.sh Stdout=log.out Stderr=log.err JDL
10
Mar17, 2009Belle MC with Grid10 Belle MC Procedure 4. Monitor running jobs Summary CPU Elapse time
11
Mar17, 2009Belle MC with Grid11 Belle MC Procedure 5. Retrieve finished job Retrieve log files of finished jobs Checking the job is correctly completed
12
Mar17, 2009Belle MC with Grid12 Ganga Ganga is an easy-to-use frontend for job definition and management, implemented in Python. It has been developed to meet the needs of the ATLAS and LHCb for a Grid user interface, and includes built-in support for configuring and running applications based on the Gaudi / Athena framework common to the two experiments. Ganga allows trivial switching between testing on a local batch system and large-scale processing on Grid resources. PythonATLASLHCbGaudi AthenaPythonATLASLHCbGaudi Athena http://ganga.web.cern.ch/ganga/index.php
13
Mar17, 2009Belle MC with Grid13 Ganga “ Hello World ” Configure with Job() Directories JDL file Backend = local Configuration Submit Status
14
Mar17, 2009Belle MC with Grid14 Ganga MC Production → edg-job-submit Backend=LCG
15
Mar17, 2009Belle MC with Grid15 Summary MC Production resumed !! New sites working correctly with large resouces Configuration and Job submission tool “Ganga” tried. Easy to see what we’re doing Good to unified interface No convenience about functionality We must write script for scripts, anyway.
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.