I Datagrid Workshop- Marseille C.Vistoli Wide Area Workload Management Work Package DATAGRID project Cristina Vistoli - INFN - CNAF 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Tasks list: Job description and resource spec Job decomposition partitioning Scheduling Co-allocator+adv reservation Resource management Services and access control 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Scheduling Definition of scheduling policies in order to find the best match between job requirements and available resources Network Storage Cpu 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
Scheduling: architecture schema JOB queue Grid Policy and admission control JOB Information Service Co - allocator+Advance Scheduler reservation Resource management GRID Resources 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
Co-Allocation & Advance Reservation Co-allocation is necessary because applications need simultaneously resources of different types: CPU and DATA and NETWORK Advance Reservation of heterogeneous resources is necessary to guarantee end-to-end performance Analysis of possible strategies and paradigms for rescheduling in case of resource fault or change in allocation The different architectural approaches have to be investigated: Reserv/co-alloc done by application Reserv/co-alloc agents between appl and res. Reserv/co-alloc global broker GARA and IBP 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Resource Management Resource manager implements the defined scheduling policies Multiple (local) resource managers Interfaces, protocols to different Resource Managers Reources type: PC cluster GRAM evaluation 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Services Access Control Bookkeeping Accounting Logging 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1 Estimated Resources: 670 mm in 3 years Funded/Unfunder resources 216 - 186 INFN 108 Datamat 144 - 72 Czech Rep. 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1- Effort/Task Breakdown Task 1.1 24 - INFN 9 PPARC 9 DATAMAT 3 CESnet 3 Task 1.2 90 - DATAMAT 80 INFN 10 Task 1.3 132 - INFN 108 CESnet 24 Task1.4 183 - INFN 152 Datamat 13 CESnet 18 Task1.5 132 - CESnet 75 INFN 57 Task 1.6 40 - INFN 40 Task 1.7 69 - INFN 24 PPARC 9 CESnet 24 DATAMAT 12 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Deliverables D1.1 (Report) month 12 Definition of architecture and technical plan for scheduling and resource management. D1.2 (Report) month 16 Definition of the resource co-allocation framework based on the evaluation of the existing research prototypes D1.3 (Report) month 24 Description of the workload management system implementing code migration D1.4 (Report) month 30: Mechanism and Methods to specify jobs flows and job parallel partitioning in the GRID 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Deliverables-cont D1.5 (Prototype) month 30: Job description and resource specification language, and user interface for task management D1.6 (Prototype) month 36: Services for bookkeeping, accounting, logging and security integrated in the workload management framework D1.7 (Report) month 36: Description of the workload management system implementing data migration and remote access 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
I Datagrid Workshop- Marseille C.Vistoli Datagrid WP1- Effort/Deliverable Breakdown D1.1 effort 44: task 1.1 (24) + task 1.4 (20) D1.2 effort 15: task 1.4 (15) D1.3 effort 85: task 1.4 (85) D1.4 effort 141: task 1.3 +task 1,7 (9) D1.5 effort 100 : task1.2 +task 1.7 (10) DATAMat D1.6 effort 144: task 1.5 + task 1.7 (12)CESnet D1.7 effort 101 : task 1.4 (63) + task 1.7 (38) 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli
Milestones and expected result . Milestones and expected result M1.1 Month 8: Choice of a job description language architecture based on the evaluation of existing job description languages and methods M1.2 Month 10: Choice of a security architecture based on the evaluation of existing security models M1.3 Month24: Workload management scheduling implementing code migration M1.4 Month 36: Workload management scheduling implementing data migration and remote access 4/9/ 2000 I Datagrid Workshop- Marseille C.Vistoli