1. GangaTasks Automating of job submission wit Athena/AthenaMC in Ganga hepcg workshop, siegen, 13.12.2007 johannes ebke, johannes elmsheuser, tariq mahmoud

2. tariq mahmoud hepcg workshop, siegen, 13122007 automating of job submission in Athena/AthenaMC outline I. introduction, motivation II. concept of tasks III. some illustration IV. conclusion

3. automating of job submission in Athena/AthenaMC I. motivation, mc simul:5 recon:10 1 13597 246108 1 evgen:50 79 tariq mahmoud hepcg workshop, siegen, 13122007 35 3 6 35 63 3 6 5 6 3 3 3 need automate job (re)submission

4. automating of job submission in Athena/AthenaMC I. motivation, mc tariq mahmoud hepcg workshop, siegen, 13122007 13597 246108 1 1 9 7 7 7 13597 246 8 1 1 79 3 6 35 63 3 5 56 5 6 6 6

5. 13597 246 8 1 1 79 3 6 35 63 13597 246 8 1 1 79 3 5 35 53 13597 246 8 1 1 79 3 6 35 63 7 5 6 13597 246 8 1 1 9 7 7 3 5 5 5 13597 246 8 1 1 79 3 6 35 63 automating of job submission in Athena/AthenaMC I. motivation, mc 13597 246108 1 1 79 3 6 35 63 7 5 6 13597 246 8 1 1 9 7 7 3 5 5 5 13597 246 8 1 1 79 3 6 35 63 13597 246 8 1 1 9 7 7 3 5 5 6 7 4 4 44 need automate job (re)submission need job chaining (interconnection) tariq mahmoud hepcg workshop, siegen, 13122007

6. automating of job submission in Athena/AthenaMC I. motivation, analysis complete dataset tariq mahmoud hepcg workshop, siegen, 13122007 A,B,C: f1,f2,f3, …,fn A,B,C  f1,f2,f3 A,B,C  f4,f5,f6 A,B,C  f7,f8,f9 A,B,C  f4,f5,f6 A,B,C  f7,f8,f9 A,B,C  fn-2,fn-1,fn incomplete dataset A: f1,f2,f3 B: f1,f5,f6,f7,f8,f9 C: f1,f2,f7,f8,f9,f10 A,C  f1,f2 B  f5,f6 A  f3 B,C  f7,f8,f9 C  f10

7. automating of job submission in Athena/AthenaMC II. concept of tasks task few parameters: task parameters: float, name, number of events etc. process parameters: datasets, process name, geometry etc. input/output specifications Athena version AbstractJob generated automatically: name, task, status, necessary, prerequisites, run limit, number of attempts and attempt jobs, … AbstractJob job Ganga jobs tariq mahmoud hepcg workshop, siegen, 13122007

8. automating of job submission in Athena/AthenaMC II. concept of tasks: GangaTasks MCTask MCJob AnaTask AnaJob Task AnaJob repository/tools.data TaskList(GangaObject ) GPI.tasks tariq mahmoud hepcg workshop, siegen, 13122007

9. automating of job submission in Athena/AthenaMC III. illustration, resubmission tariq mahmoud hepcg workshop, siegen, 13122007 automate job (re)submission need job chaining (interconnection)

10. automating of job submission in Athena/AthenaMC III. illustration: chaining task steps mc.total_events = 200; mc.events_per_job={"evgen": 50, "simul": 5, "recon":10} 1 3 5 7 9 1 3 5 7 9 1 3 5 7 9 1 3 5 7 9 13597 246 10 8 13597 246 8 13597 246 8 13597 246 8 2341 evgen:i-0 simul:i-j recon:i-k tariq mahmoud hepcg workshop, siegen, 13122007

11. mc.total_events = 200 mc.events_per_job= {"evgen": 50, "simul": 5, "recon":10} mc.float=10 AbstractJob.prerequisites() tariq mahmoud atlas sw week, cern, 24102007 automating of job submission in Athena/AthenaMC III. illustration : interconnections, prerequisites automate job (re)submission job chaining (interconnection)  the user sets few parameters … and gets RESULTS

12. automating of job submission in Athena/AthenaMC IV. conclusion GangaTask package: automates job management ( small scale production system ) works with Ganga Athena and Ganga AthenaMC ( available from Ganga443 onwards ) works at cern wiki with tutorial: https://twiki.cern.ch/twiki/bin/view/Atlas/GangaTasks https://twiki.cern.ch/twiki/bin/view/Atlas/GangaTasks applicable to any job submission-software on the grid To do: 1. implementing site-test-code 2. making use of GangaRobot 3. act on user suggestions tariq mahmoud hepcg workshop, siegen, 13122007 Configure once – run anywhere