Download presentation
Presentation is loading. Please wait.
Published byConner Shelburne Modified over 10 years ago
1
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 1 WP1 Speaker name (Speaker function and WP ) speaker@ Presentation address e.g. https://edms.cern.ch/document/366530
2
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 2 Review of WP1 architecture u WP1 WMS architecture reviewed n To apply the “lessons” learned and addressing the problems emerged with the first release of the software, deployed in the EDG testbed s E.g. reduce of persistent job info repositories, delegate some functionalities to pluggable modules, etc. n To increase the reliability of the system n To support new functionalities: s User APIs s Job checkpointing n Shown at the WP1 demo s Job partitioning s Interactive jobs s Dependencies of jobs s Parallel jobs s Grid Accounting s Resource reservation and co-allocation n To make easier the interoperability with other Grid frameworks
3
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 3 WP1 reviewed architecture Details in D1.4 …
4
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 4 Job submission example (for a “simple” job) UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status
5
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 5 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status edg-job-submit myjob.jdl Myjob.jdl JobType = “Normal”; Executable = "$(CMS)/exe/sum.exe"; InputData = "LF:testbed0-00019"; ReplicaCatalog = "ldap://sunlab2g.cnaf.infn.it:2010/rc=WP2 INFN Test Replica Catalog,dc=sunlab2g, dc=cnaf, dc=infn, dc=it"; DataAccessProtocol = "gridftp"; InputSandbox = {"/home/user/WP1testC","/home/file*”, "/home/user/DATA/*"}; OutputSandbox = {“sim.err”, “test.out”, “sim.log"}; Requirements = other. GlueHostOperatingSystemName == “linux" && other. GlueHostOperatingSystemRelease == "Red Hat 6.2“ && other.GlueCEPolicyMaxWallClockTime > 10000; Rank = other.GlueCEStateFreeCPUs; submitted Job Status UI: allows users to access the functionalities of the WMS Job Description Language (JDL) to specify job characteristics and requirements
6
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 6 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Input Sandbox files Job waiting submitted Job Status NS: network daemon responsible for accepting incoming requests
7
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 7 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status WM: responsible to take the appropriate actions to satisfy the request Job
8
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 8 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- maker Where does this job must be executed ?
9
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 9 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Matchmaker: responsible to find the “best” CE where to submit a job
10
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 10 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- Maker/ Broker Where are (which SEs) the needed data ? What is the status of the Grid ?
11
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 11 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Match- maker CE choice
12
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 12 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage waiting submitted Job Status Job Adapter JA: responsible for the final “touches” to the job before performing submission (e.g. creation of wrapper script, etc.)
13
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 13 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status JC: responsible for the actual job management operations (done via CondorG) Job submitted waiting ready
14
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 14 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node CE characts & status SE characts & status RB storage Job Status Job Input Sandbox files submitted waiting ready scheduled
15
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 15 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node RB storage Job Status Input Sandbox submitted waiting ready scheduled running “Grid enabled” data transfers/ accesses Job
16
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 16 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done
17
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 17 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox submitted waiting ready scheduled running done edg-job-get-output
18
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 18 Job submission UI Network Server Job Contr. - CondorG Workload Manager Replica Catalog Inform. Service Computing Element Storage Element RB node RB storage Job Status Output Sandbox files submitted waiting ready scheduled running done cleared
19
EU 2nd Year Review – 04-05 Jan. 2003 – Title – n° 19 Job monitoring UI Log Monitor Logging & Bookkeeping Network Server Job Contr. - CondorG Workload Manager Computing Element RB node LM: parses CondorG log file (where CondorG logs info about jobs) and notifies LB LB: receives and stores job events; processes corresponding job status Log of job events edg-job-status Job status
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.