Presentation is loading. Please wait.

Presentation is loading. Please wait.

Dzero MC production on LCG How to live in two worlds (SAM and LCG)

Similar presentations


Presentation on theme: "Dzero MC production on LCG How to live in two worlds (SAM and LCG)"— Presentation transcript:

1 Dzero MC production on LCG How to live in two worlds (SAM and LCG)

2 What is SAM? SAM: Sequential Access by Metadata –file store –sam stations –replica catalog –metadata database –optimizes file delivery to consumers batch interface 2Grid meeting Jan 28, 2008

3 What is SAMGrid? SAM: Sequential Access by Metadata JIM: Job Information and Monitoring Fermigrid OSG LCG … 3Grid meeting Jan 28, 2008

4 resource broker user interface SAM station dorsvlegel.nikhef.nl 4Grid meeting Jan 28, 2008 Until January 2007

5 What is SAMGrid? SAM: Sequential Access by Metadata JIM: Job Information and Monitoring Fermigrid OSG LCG … 5Grid meeting Jan 28, 2008

6 submission site execution site jim client SAM station cluster (Nikhef) FNAL Wuppertal Lyon 6Grid meeting Jan 28, 2008 From January 2007

7 JIM client Submits job to submission site –input.jdl specifies: request number cluster 7Grid meeting Jan 28, 2008

8 input.jdl lcg_requirement_string = tbn20.nikhef.nl:2119/jobmanager-pbs-qlong job_type = dzero_monte_carlo runjob_requestid = 59873 d0_release_version = p20.08.02 jobfiles_dataset = sg_p20.08.02-v3_d0r07-05-03_cfv01- 00-00 minbias_dataset = zerob_p20.08.01_RunIIbMC_REALsample_2 runjob_numevts = 205000 events_per_file = 250 station_name = ccin2p3-grid1 8Grid meeting Jan 28, 2008

9 Submission site Submits cluster job to execution site –Collects non physical output (logs, …) Collects monitoring data Monitoring web pages 9Grid meeting Jan 28, 2008

10 Execution site User interface Submits individual jobs to cluster (edg-job-submit) Resource broker 10Grid meeting Jan 28, 2008

11 SAM station Delivers exec files delivers input files stores metadata and data in SAM 11Grid meeting Jan 28, 2008

12 Output from WN To SAM database: –metadata of intermediate files and MC output To SAM store: –reconstructed MC output To submission site –log files 12Grid meeting Jan 28, 2008

13 Pro’s Always in line with Fermi lab (no home grown scripts) less labor intensive better monitoring 13Grid meeting Jan 28, 2008

14 Cons Not scalable SAM station @ in2p3 Resource broker @ wuppertal User interface@ wuppertal less flexible (no home grown scripts) 14Grid meeting Jan 28, 2008

15 Scalability SAM station @ in2p3 –dCache @ ic.ac.uk Resource broker @ wuppertal –Moved to dorsvlegel.nikhef.nl User interface @ wuppertal 15Grid meeting Jan 28, 2008

16 dorsvlegel@nikhef.nl Until January 2007 –UI + SAM station Until January 2008 –UI + JIM station Now –UI + JIM station + RB (dzero only) 16Grid meeting Jan 28, 2008

17 Monitoring Go to http://samgrid.fnal.gov:8080 Click submission sites Click samgrid.fnal.gov 17Grid meeting Jan 28, 2008


Download ppt "Dzero MC production on LCG How to live in two worlds (SAM and LCG)"

Similar presentations


Ads by Google