Presentation is loading. Please wait.

Presentation is loading. Please wait.

4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli.

Similar presentations


Presentation on theme: "4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli."— Presentation transcript:

1 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli

2 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Tasks list: Task 1. 2 Job description and resource spec : Responsible DATAmat : Task 1.3 Job decomposition partitioning: Responsible INFN Task 1.4 Scheduling Responsible INFN Task 1.5 Services and access control Responsible Cesnet

3 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1 Estimated Resources: 670 mm in 3 years Funded/Unfunded resources 216 - 186 INFN 108 Datamat 144 - 72 Czech Rep. 18 PPARC

4 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1- Effort/Task Breakdown Task 1.1 24 - INFN 9 PPARC 9 DATAMAT 3 CESnet 3 Task 1.2 90 - DATAMAT 80 INFN 10 Task 1.3 132 - INFN 108 CESnet 24 Task1.4 183 - INFN 152 Datamat 13 CESnet 18 Task1.5 132 - CESnet 75 INFN 57 Task 1.6 40 - INFN 40 Task 1.7 69 - INFN 24 PPARC 9 CESnet 24 DATAMAT 12

5 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1- Effort/Deliverable Breakdown D1.1 effort 44: task 1.1 (24) + task 1.4 (20) D1.2 effort 15: task 1.4 (15) D1.3 effort 85: task 1.4 (85) D1.4 effort 141: task 1.3 +task 1,7 (9) D1.5 effort 100 : task1.2 +task 1.7 (10) DATAMat D1.6 effort 144: task 1.5 + task 1.7 (12)CESnet D1.7 effort 101 : task 1.4 (63) + task 1.7 (38)

6 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Contact Points INFN: C.Vistoli, M.Sgaravatto PPARC: A.Martin Datamat: Ugo Grandinetti, S.Beco Cesnet: L.Matiska. M.Ruda WP mailing list: workload-eu-datagrid@infn.it

7 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Progress Report 2 INFN weeks with Globus Team members Steve Tuecke, Lee Liming + Miron Livny (Condor Team) Ann Cheverniak, Steve Fitzgerald Workload management applied to real HEP application: Event production CMS-HLT production analyzed in terms of GRID requirements and Globus tools availability Simplified description :

8 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli PDBOBA…CERN IOOOO HLT production simplified description

9 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Application Grid Requirements The GRID requirements are: Resource Broker to select, find and allocate the computing resources where the jobs have to be submitted. move the input files in the selected farm and submit the jobs collect the output files produced in each farm in a central repository

10 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Resource Broker Architecture condor_submit Globus submit Master Condor schedd Grid Information Server (LDAP Server) Job code (class-ads) condor-rm log LDAP to Class-ads converter GRAM Job Manager LSF PC Cluster PBS PC Cluster Condor PC Cluster

11 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Work needed GRAM: to provide all the necessary info to the Grid Information System Collaboration with Globus team on-going: Massimo Sgaravatto presented Need to define “what” is the necessary info in PC cluster resource environment Collaboration with WP£ GRAM/job manager persistent and fault tolerant Massimo Sgaravatto presentation Collaboration with WP3/WP4 Export the information about computing systems availability, disk and network from the LDAP server to the Class-ad collection

12 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Work needed - cont Master implements job policy and monitor the job execution. A real possibility to verify if match-making algorithm satisfy application requirements. Master access Class-ads collection to select the GRAM resource Input files are moved to the selected resource using ‘gsiftp’ using third part transfer. Input files are for this use-case small, no need for advance network reservation

13 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Work needed - cont To complete the application execution: Output files have to be collected in the central repository Data Mover and Replica Manager are useful tools. Strict collaboration with WP2 Investigate the use of advance network reservation for these files transfer: GARA

14 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli WP interactions Application requirements from WP8.. And WP3 Job Management, Accounting, Bookeeping WP4 Data Access, Replica Management API, access format WP2 Network Reservation : WP7 Security and Access Control WP?


Download ppt "4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Parallel session report Cristina Vistoli."

Similar presentations


Ads by Google