1. New Capabilities in QosCosGrid Middleware for Advanced Job Management, Advance Reservation and Co-allocation of Computing Resources B. Bosak, P. Kopta, K. Kurowski, M. Mamonski, T. Piontek Poznan Supercomputing and Networking Center Cracow Grid Workshop 8-th November 2011

2. Introduction Main features of QCG Comparison with other Grid systems QCG Architecture and its main Components Status on deployments 2

3. 3

4. 4

5. 5

6. 6

7. 7

8. 8

9. Grid domain meta-scheduling framework Deals with load-balancing and scheduling of cross-cluster jobs Provides consisted WebService interface to the Grid; JobProfile XML-based language is used as a job description format Interacts directly with cluster level services (QCG-Computing, QCG-Notification, gridFTP, …) 9

10. The key component of the cluster domain; Provides WebService interface to various DRMs – integration based on DRMAA (e.g. PBS Pro, LoadLeveler, GE, Torque/Maui); Compliant with OGF HPC Basic Profile Specification (JSDL as a job description language, BES interface); Offers methods for creation and management of advance reservations; Many plugins for authentication, authorization and accounting. 10

11. 11

12. Its main function in QCG system is brokering asynchronous notifications between the QCG- Computing and QCG-Broker services Implementation of brokered version of WS- Notification standard; features: – Advanced two-level filtering based on topics and content of the notification messages – Pull and push styles of distributing notification messages – HTTP/HTTPS and XMPP transport protocols 12

13. 13

14. Nano portal – advanced web-based portal dedicated for nanotechnologists (Abinit, NAMD, Quantum Espresso) QCG-Icon – lightweight desktop interface to QCG (MATLAB) QCG-Mobile – mobile access to QosCosGrid services (Android, JME) 14

15. QCG is deployed at 4 production sites in PL-Grid (PSNC, Cyfronet AGH, TASK, WSNC): – proxy certificates, – LDAP grid-mapfile generation, – BAT accounting, – Nagios probes, – RPM packages. NEL, the application from Quantum Chemistry written by prof. Jacek Komasa was adapted to cross-cluster execution on top of QosCosGrid. Tests were performed on the PL-Grid infrastructure. Ongoing production deployments in Europe on EGI and PRACE resources (e.g. LRZ, UCL, SARA) – MAPPER project. 15

16. QosCosGrid is an alternative grid middleware Great support for cross-cluster application execution (MPI, ProActive, MUSCLE) Ready production deployments in PL-Grid infrastructure. Further reading: http://www.qoscosgrid.org 16

17. 17 ?