1. http://www.ngs.ac.ukhttp://www.nesc.ac.uk/training The Wider Context of the NGS Mike Mineter Training Outreach and Education Edinburgh e-Science mjm@nesc.ac.uk

2. 2 You are welcome to re-use these slides. We ask only that you let us know, by email to training-support@nesc.ac.uk training-support@nesc.ac.uk

3. 3 Contents More of the projects and organisations that influence the NGS –EGEE –OMII-UK –OMII-Europe –NextGRID –ICEAGE

4. Enabling Grids for E-sciencE INFSO-RI-508833 4 EGEE – international e-infrastructure Build, deploy and operate a consistent, robust a large scale production grid service that –Links with and build on national, regional and international initiatives Improve and maintain the middleware in order to deliver a reliable service to users Attract new users from research and industry and ensure training and support for them Network infrastructure & Resource centres Operations, Support and training Collaboration Pan-European Grid

5. Enabling Grids for E-sciencE INFSO-RI-508833 5 EGEE – In the first 2 years Established production quality sustained Grid services –3000 users from at least 5 disciplines –Goal was to integrate 50 sites into a common infrastructure  currently 180 –offer 5 Petabytes (10 15 ) storage Demonstrated a viable general process to bring other scientific communities on board Secured a second phase from April 2006 Pilot New

6. Enabling Grids for E-sciencE INFSO-RI-508833 6 Enabling Grids for E-sciencE EU-funded project to establish international e-Infrastructure Began phase 2 in April 2006 –Expanded consortium –Emphasis on providing an infrastructure  increased support for applications  interoperate with other infrastructures  more involvement from Industry SA: service activities - establishing operations NA: network activities - supporting VOs JRA: “joint research activities” - e.g. hardening middleware EGEE-II

7. Enabling Grids for E-sciencE INFSO-RI-508833 7 EGEE-II: Expertise & Resources More than 90 partners 32 countries 12 federations  Major and national Grid projects in Europe, USA, Asia + 27 countries through related projects: –BalticGrid –SEE-GRID –EUMedGrid –EUChinaGrid –EELA

8. Enabling Grids for E-sciencE INFSO-RI-508833 8 EGEE is running… … the largest multi-VO production grid in the world! What’s happening now? http://gridportal.hep.ph.ic.ac.uk/rtm/ http://gridportal.hep.ph.ic.ac.uk/rtm/ What resources are connected? http://goc.grid-support.ac.uk/gridsite/monitoring/ http://goc.grid-support.ac.uk/gridsite/monitoring/

9. Enabling Grids for E-sciencE INFSO-RI-508833 9 NGS – Some Possible Futures NGS EGEE Campus grids GridPP Interoperability GridPP / NGS Convergence ? UK & Ireland LCG VO’s Note: EU-wide progress towards European and National Grid Infrastrustures…

10. Enabling Grids for E-sciencE INFSO-RI-508833 10 NGS- adopting VOMS, as used in EGEE grid Virtual Organization Membership Service Before VOMS User is authorised as a member of a single VO All VO members have same rights Gridmapfiles are updated by VO management software: map the user’s DN to a local account grid-proxy-init VOMS User can be in multiple VOs –Potentially: aggregate rights VO can have groups –Different rights for each –Nested groups VO has roles –Assigned to specific purposes  E,g. system admin  When assume this role Proxy certificate carries the additional attributes voms-proxy-init VOMS establishes and communicates VO credentials… how these are used is service-specific

11. Enabling Grids for E-sciencE INFSO-RI-508833 11 t-Infrastructure Why t-infrastructure? –Training is necessary: personal + e-learning –e-Infrastructure for production –t-Infrastructure for training Need guaranteed response for tutorials; limit the vulnerability of production systems –use training grid –have training CA –able to change middleware to prepare participants for future releases on production system –need safe resources for installation training –easy entry point for new communities

12. Enabling Grids for E-sciencE INFSO-RI-508833 12 GILDA demonstrator and testbed (https://gilda.ct.infn.it)

13. Enabling Grids for E-sciencE INFSO-RI-508833 13 Related Projects

14. Enabling Grids for E-sciencE INFSO-RI-508833 14 Related projects: infrastructure, education, application NameDescription BalticGridEGEE extension to Estonia, Latvia, Lithuania EELAEGEE extension to Brazil, Chile, Cuba, Mexico, Argentina EUChinaGRIDEGEE extension to China EUMedGRIDEGEE extension to Malta, Algeria, Morocco, Egypt, Syria, Tunisia, Turkey OMII-Europeinteroperable, tested, certified middleware ISSeGSite security eIRGSPPolicies ETICSRepository, Testing BELIEFDigital Library of Grid documentation, organisation of workshops, conferences BIOINFOGRIDBiomedical Health-e-ChildBiomedical – Integration of heterogeneous biomedical information for improved healthcare ICEAGEInternational Collaboration to Extend and Advance Grid Education

15. 15 OMII-UK: Open Middleware Infrastructure Institute

16. 16 Mind the gap…. ResearchPilot projects Early adopters Routine production Researchers are not funded to provide production quality software for others to use OMII-UK exists to help bridge this gap!

17. 17 Open Middleware Infrastructure Institute Formed University of Southampton (2004) Focus on an easy to install e-Infrastructure solution Utilise existing software & standards Expanded with new partners in 2006 OGSA-DAI team at Edinburgh my Grid team at Manchester To be a leading provider of reliable interoperable and open-source Grid middleware components services and tools to support advanced Grid enabled solutions in academia and industry.

18. 18 Activity By providing a software repository of Grid components and tools from e-science projects By re-engineering software, hardening it and providing support for components sourced from the community By a managed programme to contract the development of “missing” software components necessary in grid middleware By providing an integrated grid middleware release of the sourced software components

19. 19 The Managed Programme: Integrated with the OMII Distribution OGSA-DAI (Data Access service) GridSAM (Job Submission & Monitoring service) Grimoires (Registry service based on UDDI) GeodiseLab (Matlab & Jython environments) FINS (Notification services using WS-Eventing) Delivering into the repository BPEL (Workflow service) MANGO (Managing workflows with BPEL) FIRMS (Reliable messaging)

20. What is OMII-Europe? http://wiki.nesc.ac.uk/read/omii-eu-na3?BeijingMarch2007 http://wiki.nesc.ac.uk/read/omii-eu-na3?BeijingMarch2007 Mike Mineter Training Outreach Education – National e-Science Centre, Edinburgh, UK mjm@nesc.ac.uk

21. EU project: RIO31844-OMII-EUROPE 21 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe European Union funded FP6 project (RI) –FP: Framework Programme - all research-related EU investment –OMII-Europe is funded from the 6 th FP –a ”Research Infrastructure - Integrated Infrastructure Initiative” –Starting May 2006, initial 2 year duration –16 partners (8 European, 4 USA, 4 Chinese) Complimentary to existing national programmes (OMII-UK, NMI, C-OMEGA, OMII-China…) Goal is to provide key software components for building e- infrastructures Project will demonstrate “proof of concept” with expectation for a follow-on project in FP7

22. EU project: RIO31844-OMII-EUROPE 22 What will OMII-Europe do? Initial focus on providing common interfaces and integration of major Grid software infrastructures Common interoperable services: –Data Access, Virtual Organisation Management, Portal, Accounting, Job Submission and Job Monitoring –Capability to add additional services Infrastructure integration –Initial EGEE/UNICORE/Globus/CROWN interoperability –Interoperable security framework

23. EU project: RIO31844-OMII-EUROPE 23 OMII-Europe JRA1 re-engineering activities OGSA DAIBESVOMSRUS Grid Sphere Etc. Identified Components EGEE (GLite) UNICORE Globus Etc. OMII-UK, USA, China

24. 24 NextGRID: Next Generation Grids Stephen Davey, NeSC, UK

25. NextGRID Project 11M€ EU FP6 project; 3 years starting September 2004. 22 partners, some industrial, some academic. Developing Architecture for Next Generation Grids. Research and exploration project: A 5-10 year lookout. www.nextgrid.org

26. NextGRID Project Vision Grid offering services Business focus  Grids Applicable to Industry  Inter Enterprise Grids Service Level Agreements & Quality of Service (not just best effort). Basis in Standards (for interoperability & stability).

27. service provider service User SLA Configuration Policy Monitoring Policy Event Business layer Technology layer NextGRID Service SLA SLA? SLA SLAs in NextGRID

28. NextGRID Architecture Interactions Registry Functional Systems SLA Management Trust and Security Naming and Addressing Orchestration Register / Update Query Resolve Generate / Verify Administer policy Monitor/ Control Get tokens Negotiate SLA Invoke Get token assertions Register / Update / Query Get token assertions Get token assertions Get token assertions Schemas

29. NextGRID Approach NextGRID Architecture is being realised in a series of specifications or profiles called Generalised Specifications : Management Systems  Basic Profile  Naming and Addressing  Registry  Trust and Security  SLA Management Functional Systems  Data Focused (Transfer, Storage, Processing, Access) Orchestrators  Workflow, Data Integration/Federation, Discovery Schemas  Message, Security, SLA, Service Description

30. Challenges & Experiments Key focus areas:  Service Level Agreements  Workflows (across domains)  Security  Data Challenges are manifested in NextGRID reference applications:  Financial modelling (Implied Volatility, Derivatives Pricing)  Digital media production (On-demand video rendering) Key components being developed and evaluated.

31. NextGRID Architecture White Paper Presents the NextGRID Vision and Technical Challenges, plus future work of the project Architectural Principles  Dynamics, Composition, Infrastructure  NextGRID Generalized Specifications and Profiles http://www.nextgrid.org/download/publications/NextGRID_Architecture_White_Paper.pdf Contributors & Acknowledgments. Particular thanks to: Malcolm Atkinson (NeSC), David Snelling (Fujitsu), Bryce Mitchell (BT) NextGRID Architecture WP1 & many others www.nextgrid.org

32. INFSO-SSA-26637 32 Training – Targeted – Immediate goals – Specific skills – Building a workforce Education – Pervasive – Long term and sustained – Generic conceptual models – Developing a culture Both are needed Society Graduates EducationInnovation Invests PreparesCreate Enriches Organisation Skilled Workers TrainingServices & Applications Invests PreparesDevelop Strengthens Malcolm Atkinson International Collaboration to Extend and Advance Grid Education – ICEAGE

33. INFSO-SSA-26637 33 ICEAGE Mission Stimulate and support advances in grid education throughout Europe Goals – Achieve rapid growth in effective advanced grid education – Make best use of worldwide capacity for advanced grid education – Deliver a stimulating programme of educational events  Including international summer schools – Broaden engagement in an advanced grid education  both geographically and across disciplines

34. INFSO-SSA-26637 34 Iceage – Activities Forum – International panel of experts to develop curricula, policies & strategies, ontologies Support, Outreach, Induction & Training services – Attracting & Training the Trainers – Persuading Universities to adopt Grid Computing Curricula – E-Learning, repository & course scheduling & announcement Summer Schools – General – Specialised – S/W engineering Bio-informatics… T-Infrastructure – A training grid - very different from a production grid response time vs throughput lightweight CA middleware agility safe and effective play-ground

35. 35 Contents More of the projects and organisations that influence the NGS –EGEE –OMII-UK –OMII-Europe –NextGRID –ICEAGE NGS Future Developments

36. 36 NGS middleware: future Middleware recently deployed –Portal v2 –GridSAM – alternative job submission and monitoring Developed by partners: –Application Hosting Environment: AHE –P-GRADE portal and GEMLCA Being deployed –VOMS support – coupled to developments of support procedures for projects –WS-GRAM: GT4 job submission –Resource Broker Under development –Shibboleth integration

37. 37 The End That’s All Folks …almost!!

38. 38 Feedback Thanks to EGEE’s GGUS for this picture!! NGS