1. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS Manager Oxford e-Research Centre University of Oxford Partner Joining Consultant National Grid Service

2. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Beyond Campus Grids: My brief Connecting Campus Grids to broader grids How Campus Grids can be used to bridge to broader area grids like the NGS or NW- GRID What are the impediments? What can Campus Grids do to make things easier?

3. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Straw Poll Who’s running a Campus Grid? –Condor-based, Other batch system (SGE, PBS, LSF), Globus-based Level of service? –Grown organically, Well developed service User engagement? –Handful of heavy users, embedded into institution’s teaching and research

4. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Talk Summary Joining the NGS –The NGS Site Joining Process –Benefits & difficulties Providing your users with a uniform interface to resources –Options for local deployment –Useful NGS services and resources Workshop discussion

5. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NGS expansion Two levels of membership 1.Affiliates run compatible stack, integrated support 2.Partners also contribute “significant resources”. Run compatible middleware – as defined by NGS Minimum Software Stack – and verified by compliance test suite Partners define their level of service commitment through a Service Level Definition

6. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Joining Quickstart http://www.ngs.ac.uk/guide/ Partner’s Joining Guide Minimum Software Stack Conformance Testing Quickstart guide

7. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Joining Procedure Initial contact Registration of Partner Contacts: Security, Operations, Helpdesk Testing of Site Validation of Site Continuous Monitoring

8. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NGS Minimum Software Stack Access, Job submission, File transfer Globus GRAM, GridFTP, IGTF CAs, GSIssh, SRB Information Publishing GLUE schema, MDS People Management edg-mkgridmap, VOMS Compiling C/C++/Fortran/Java Resource Control Accounting, Job Scheduling

9. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Levels of Conformance Level 0: Globus, CAs, GLUE, MDS, VO Management, Accounting, Resource Scheduler Level 1: Level 0 + gsissh, compilers, SRB clients Level 2: Level 1 + Resource Broker, SRB servers/vaults/MCAT

10. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Conformance Testing Inca framework: http://inca2.ngs.ac.uk “When the partner and the buddy are satisfied that the partner site can pass all the tests the partner site is progressed to the validation process.” Site needs to pass tests for a 7 day period. Final report, SLD are written Approval by NGS Technical Board and GOSC Board Continuous monitoring: “failures must be corrected within 2 working days.”

11. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Benefits Access to wider grid expertise Work put in to formalise processes for being part of NGS is not wasted NGS brand has value

12. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Difficulties Justifying the effort of joining –Full Economic Costing Split focus –NGS software stack and interfaces may not be what your users care about

13. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Uniform Interface for Users Things that could be deployed locally Condor-G Nimrod Gridway

14. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Condor-G http://www.cs.wisc.edu/condor/condorg/ Condor-G OxGrid is based on Condor-G technology –Some additional “magic” to generate Grid resource ClassAds. Glide-in mechanisms

15. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Nimrod-G http://www.csse.monash.edu.au/~davida/nimrod Tool for Distributed Parametric Modelling Actuators which can pass jobs to Globus resources as well as other local batch systems (Condor, PBS, SGE, LSF). Nimrod Portal

16. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Gridway Metascheduler http://www.gridway.org/ Works on top of Globus services –Which you will have if you become an NGS affiliate.

17. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Useful NGS services (1) NGS Resource Broker –A gLite Workload Management System and User Interface node is available for use. NGS VOMS service –We can host VOMS instances for institutions, groups, virtual organisations. NGS GridSAM EPR –Belfast provide GridSAM end point references for NGS sites.

18. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Useful NGS services (2) NGS Application Repository portal –JSDL repository for user applications. Could allow generalised job submission to more than NGS resources.\ NGS RUS and UAS –NGS UAS User Accounting System aims to conform to OGF UR (Usage Record) and OGF RUS (Resource Usage Service) specifications.

19. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Workshop session Discussion around how practical issues surrounding: –Joining of campus grids to NGS Eg. Globus interface node in front of a Condor pool –Implementation of middleware solutions

20. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Questions?

21. NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Shibboleth JISC funded projects to work on Shibboleth Grid integration Shibboleth SP used as a portal using “some X509 certificate mechanism” in the background to provide access to Grid resources.