Download presentation
Presentation is loading. Please wait.
Published byShannon Holmes Modified over 8 years ago
1
Dzero MC production on LCG How to live in two worlds (SAM and LCG)
2
What is SAM? SAM: Sequential Access by Metadata –file store –sam stations –replica catalog –metadata database –optimizes file delivery to consumers batch interface 2Grid meeting Jan 28, 2008
3
What is SAMGrid? SAM: Sequential Access by Metadata JIM: Job Information and Monitoring Fermigrid OSG LCG … 3Grid meeting Jan 28, 2008
4
resource broker user interface SAM station dorsvlegel.nikhef.nl 4Grid meeting Jan 28, 2008 Until January 2007
5
What is SAMGrid? SAM: Sequential Access by Metadata JIM: Job Information and Monitoring Fermigrid OSG LCG … 5Grid meeting Jan 28, 2008
6
submission site execution site jim client SAM station cluster (Nikhef) FNAL Wuppertal Lyon 6Grid meeting Jan 28, 2008 From January 2007
7
JIM client Submits job to submission site –input.jdl specifies: request number cluster 7Grid meeting Jan 28, 2008
8
input.jdl lcg_requirement_string = tbn20.nikhef.nl:2119/jobmanager-pbs-qlong job_type = dzero_monte_carlo runjob_requestid = 59873 d0_release_version = p20.08.02 jobfiles_dataset = sg_p20.08.02-v3_d0r07-05-03_cfv01- 00-00 minbias_dataset = zerob_p20.08.01_RunIIbMC_REALsample_2 runjob_numevts = 205000 events_per_file = 250 station_name = ccin2p3-grid1 8Grid meeting Jan 28, 2008
9
Submission site Submits cluster job to execution site –Collects non physical output (logs, …) Collects monitoring data Monitoring web pages 9Grid meeting Jan 28, 2008
10
Execution site User interface Submits individual jobs to cluster (edg-job-submit) Resource broker 10Grid meeting Jan 28, 2008
11
SAM station Delivers exec files delivers input files stores metadata and data in SAM 11Grid meeting Jan 28, 2008
12
Output from WN To SAM database: –metadata of intermediate files and MC output To SAM store: –reconstructed MC output To submission site –log files 12Grid meeting Jan 28, 2008
13
Pro’s Always in line with Fermi lab (no home grown scripts) less labor intensive better monitoring 13Grid meeting Jan 28, 2008
14
Cons Not scalable SAM station @ in2p3 Resource broker @ wuppertal User interface@ wuppertal less flexible (no home grown scripts) 14Grid meeting Jan 28, 2008
15
Scalability SAM station @ in2p3 –dCache @ ic.ac.uk Resource broker @ wuppertal –Moved to dorsvlegel.nikhef.nl User interface @ wuppertal 15Grid meeting Jan 28, 2008
16
dorsvlegel@nikhef.nl Until January 2007 –UI + SAM station Until January 2008 –UI + JIM station Now –UI + JIM station + RB (dzero only) 16Grid meeting Jan 28, 2008
17
Monitoring Go to http://samgrid.fnal.gov:8080 Click submission sites Click samgrid.fnal.gov 17Grid meeting Jan 28, 2008
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.