1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 The EGI Ecosystem Steven Newhouse Project Director, EGI.eu Context & NA2 - EGI-InSPIRE Review 2011 1

2. www.egi.eu EGI-InSPIRE RI-261323 C21: Digital Research Context & NA2 - EGI-InSPIRE Review 2011 Extracting Knowledge from the Data Deluge 2

3. www.egi.eu EGI-InSPIRE RI-261323 Infrastructure (Wikipedia) Infrastructure is the basic physical and organisational structures needed for the operation of a society or enterprise, or the services and facilities necessary for an economy to function EGI provides a service infrastructure that exposes and federates a resource infrastructure Context & NA2 - EGI-InSPIRE Review 2011 3 The Enterprise for us is the European Research Area

4. www.egi.eu EGI-InSPIRE RI-261323 EGI Collaboration Context & NA2 - EGI-InSPIRE Review 2011 4 NGI EIRO NGI EIRO Virtual Research Community NGI Virtual Research Community NGI: National Grid InitiativeEIRO: European Intergovernmental Research Organisation EGI.eu

5. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE EGEE-III EGI Ecosystem Context & NA2 - EGI-InSPIRE Review 2011 5 Public Funding Bodies European Commission National Research Councils Service & Resource Providers EGI.eu Resource Infrastructure Providers Technology Providers Open Source Providers Commercial Providers Requirements + Feedback Policies + Funding Strategic Feedback Requirements + Feedback User Community Services + Support Requirements + Feedback Technology + Support NA3 & SA3 SA2 NA2 SA1 & JRA1 NA1

6. www.egi.eu EGI-InSPIRE RI-261323 EGI.eu Coordination for European Grid resources –Established 8 February 2010 –Central policy & services needed to run a grid –Sustainable small coordinating organisation Based in Amsterdam –Coordinating core (21 people) in Amsterdam –Technical services from partners (~20 FTEs) Context & NA2 - EGI-InSPIRE Review 2011 6 EGI and EGI.eu: Supported by the EGI-InSPIRE project

7. www.egi.eu EGI-InSPIRE RI-261323 EGI.eu Governance EGI.eu established as non-profit foundation Governance & ownership by its participants –Participants: European NGIs –Associated participants: Organisations aligned with EGI.eu’s objectives EGI Council contains all participants –Votes linked to fees Context & NA2 - EGI-InSPIRE Review 2011 7

8. www.egi.eu EGI-InSPIRE RI-261323 A Virtuous Service Cycle Context & NA2 - EGI-InSPIRE Review 2011 Used by Researchers Gathering New Requirements New Technology Assessed Deployed Infrastructure Services 8 EGI.eu National Resource Providers Current User Communities New User Communities MoUs MoUs & OLAs Technology Providers MoUs & SLAs LoIs

9. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4-year project with €25M EC contribution –Project cost €72M –Total Effort ~€330M –Effort: 9261PMs Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 unfunded partners) Context & NA2 - EGI-InSPIRE Review 2011 9

10. www.egi.eu EGI-InSPIRE RI-261323 Project Objectives A sustainable production infrastructure –Resource providers in Europe and worldwide –With new technologies as they mature Support structured international research –Sustain current domain specific services –Attract new international user communities e.g. ESFRI - European Strategic Forum on Research Infrastructures Context & NA2 - EGI-InSPIRE Review 2011 10

11. www.egi.eu EGI-InSPIRE RI-261323 PY1 Achievements Establishing EGI.eu –Legal organisation employing 21 people Transitioning to a national infrastructure –38 independent European NGIs Support to Virtual Research Communities –Software & centrally provided services Establishing open sustainable processes –For requirements & policy development Two large community building events –For the whole EGI community & its ecosystem Context & NA2 - EGI-InSPIRE Review 2011 11

12. www.egi.eu EGI-InSPIRE RI-261323 Establishing EGI.eu Activity EGI-InSPIRE Project Task Work summary Management & Administration TNA1.1 & TNA1.2 Organisation, Project and Consortium Management Technical Management TNA1.3, TNA1.4 TSA1.1, TSA2.1, TNA2.1, TNA3.1 Technical Management of Operations, Technology, User Community & External Relations Dissemination TNA2.2 & TNA2.4 Dissemination and Events and their management PolicyTNA2.3 Policy Development across Operations and other areas User CommunityTNA3.2User Community Support Team EGI-InSPIRE 4yr Linear Average (~46PM under) Context & NA2 - EGI-InSPIRE Review 2011 12 Impact: Project Management: Focus only on critical time-sensitive issues Technical: M & D where EGI.eu key contributing partner delayed

13. www.egi.eu EGI-InSPIRE RI-261323 Funding EGI & EGI.eu Context & NA2 - EGI-InSPIRE Review 2011 13 European Commission EGI-InSPIRE (25000K) EGI.eu Activity (8010K) Partner Tasks (International & EGI Global Tasks) (65848K) NGIs & EIROs (49455K) EGI.eu NGI Activity EGI-InSPIRE Central Budget (597K) 4653K 2643K 43455K 6000K 19750K 597K This moves EGI.eu towards sustainability Management Activities & EGI Global Tasks (performed once for all) EC Re-imbursement rates 100% - Management (M) 40% - General tasks (G) 33% - International tasks (N) 25% - EGI Global tasks (E)

14. www.egi.eu EGI-InSPIRE RI-261323 Software (SA2) Software (SA2) EGI HQ (NA1 & NA2) EGI HQ (NA1 & NA2) EGI & EGI-InSPIRE Context & NA2 - EGI-InSPIRE Review 2011 14 Resource Infrastructure (NGIs & EIROs) Service Infrastructure (SA1+JRA1) Service Infrastructure (SA1+JRA1) User Functional Services (SA3) User Coordination Services (NA3) End-Users Virtual Organisations Virtual Research Communities End-Users Virtual Organisations Virtual Research Communities Local Global EGI-InSPIRE EGI

15. www.egi.eu EGI-InSPIRE RI-261323 European Grid Infrastructure (April 2011 and yearly increase) Context & NA2 - EGI-InSPIRE Review 2011 15 Logical CPUs (cores ) 239,840 EGI (+24.9%) 338,895 All 102 PB disk and 89 PB tape Resource Centres 338 EGI 345 All (+6.8 %) 96 supporting MPI (+6.8%) Countries (+11.5%) 51 EGI 57 All (+18.75) 38 NGIs providing resources 22 National Operations Centres 16 NGIs in 5 Federated Operations Centres 1 EIRO providing resources 18 countries in 4 non-European Operations Centres

16. www.egi.eu EGI-InSPIRE RI-261323 EGI Usage (April 2011) Context & NA2 - EGI-InSPIRE Review 2011 16 Year to Year Increase 18,271 End-users (+47%) 219 VOs (+17.7%) ~30 high activity VOs (no change) Average usage 2010-2011 vs 2009-2010 27.8M jobs/month, 91,.000 jobs/month (+82%) 74.8M CPU wall clock hours/month (+35%) 2.8M jobs/month for non-HEP users (+47%) User Communities Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences …

17. www.egi.eu EGI-InSPIRE RI-261323 Review Agenda Project Overview –9:30: The EGI Context (we are now here!) –10:00: External Relations (NA2) + Q&A –10:30: Project Administration (NA1) + Q&A User Community –11:15: Supporting VRCs (NA3) + Q&A –12:00: Software for Heavy User Communities (SA3) + Q&A Distributed Computing Technology –14:00: Software Provisioning (SA2) + Q&A –14:45: Operations (SA1) and supporting Tools (JRA1) + Q&A Future –16:00: Plans for PY2 + Q&A 30/05/2011 Context & NA2 - EGI-InSPIRE Review 2011 17

18. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 NA2 – External Relations Steven Newhouse Director, EGI.eu Context & NA2 - EGI-InSPIRE Review 2011 18

19. www.egi.eu EGI-InSPIRE RI-261323 NA2 Overview Context & NA2 - EGI-InSPIRE Review 2011 19 33 Countries 34 Beneficiaries 812 PMs 16.8 FTEs WPBeneficiaryTotal PMs WP2-E EGI.eu308 WP2-E NCF5 WP2-E STFC19 WP2-N ARNES28 WP2-N CESNET8 WP2-N CNRS21 WP2-N CSC17 WP2-N CSIC35 WP2-N CYFRONET16 WP2-N E-ARENA14 WP2-N ICT-BAS8 WP2-N IMCS-UL22 WP2-N INFN20 WP2-N IPB12 WP2-N IUCC4 WP2-N KIT-G17 WP2-N LIP12 WP2-N MTA KFKI4 WPBeneficiaryTotal PMs WP2-NNCF7 WP2-NSIGMA6 WP2-NSTFC24 WP2-NSWITCH7 WP2-NTCD6 WP2-NTUBITAK16 WP2-NUCPH12 WP2-NUCY8 WP2-NUI SAV8 WP2-NUPT12 WP2-NVR-SNIC8 WP2-NVU21 WP2-NASGC48 WP2-NASTI20 WP2-NITB3 WP2-NUNIMELB4 WP2-NNUS20 WP2-NUPM12 The Netherlands UK Slovenia Czech Republic France Finland Spain Poland Russia Bulgaria Latvia Italy Serbia Israel Germany Portugal Hungary Norway Switzerland Ireland Turkey Denmark Cyprus Slovakia Albania Sweden Lithuania Taiwan Phillippines Indonesia Australia Singapore Malaysia TaskLeader/PartnerWP Effort % TNA2.1Activity ManagementS. Newhouse/EGI.eu2% TNA2.2DisseminationC. Gater/EGI.eu44% TNA2.3Policy DevelopmentS. Andreozzi/EGI.eu44% TNA2.4EventsR. v.d. Meer/EGI.eu10%

20. www.egi.eu EGI-InSPIRE RI-261323 Objectives Disseminating the work of EGI & its communities: –Within the project –Worldwide Supporting policy development: –Within and external to EGI.eu –In conjunction with EGI‘s stakeholders –Cover governance, standardisation and integration with other infrastructures. Running two large events each year with: –Partners in the European e-Infrastructure ecosystem –The community using e-Infrastructure services Context & NA2 - EGI-InSPIRE Review 2011 20

21. www.egi.eu EGI-InSPIRE RI-261323 30,000 visitors 365,000 page views Communications Website Quarterly Newsletters Wiki Blogs Monthly Letters Social Media Context & NA2 - EGI-InSPIRE Review 2011 21

22. www.egi.eu EGI-InSPIRE RI-261323 Dissemination Disseminate EGI’s activity within the project and worldwide through its regionally dispersed dissemination contacts Develop the EGI branding and content for the project and event websites –Leverage NGIs for contributed events, websites, materials, publications, papers, translations, press releases and outreach to policy makers Booths at international events in Europe and around the world –Europe: ISC2010 in Germany, ICT 2010 in Brussels, eChallenges in Warsaw & SciTech in Brussels –Worldwide: ISGC in Taipei & SC10 in the US. Hosted booths at the EGI Technical and User Forums –Outreach campaigns that included printed materials (brochures & posters), press releases, social media feeds and blogs Contribute stories in International Science Grid This Week and Public Service Review Context & NA2 - EGI-InSPIRE Review 2011 22

23. www.egi.eu EGI-InSPIRE RI-261323 Terms of Reference (ToR) Policy Development Process (PDP) Common Glossary (GCG) Terms of Reference (ToR) Policy Development Process (PDP) Common Glossary (GCG) EGI Technical Governance Technology TCB Security SCGSPGSVG/RATCSIRT Operations OMBOTAGOAT Users UCB USAG 23 Context & NA2 - EGI-InSPIRE Review 2011 EGI Council http://www.egi.eu/policy/groups/ http://go.egi.eu/policies_and_procedures EGI.eu Executive Board SVG/RAT CSIRT

24. www.egi.eu EGI-InSPIRE RI-261323 Strategic Policy Documents 24 Context & NA2 - EGI-InSPIRE Review 2011 Help plan future activities See later PY2 presentation

25. www.egi.eu EGI-InSPIRE RI-261323 Project VRC Resource Provider Technology Provider MoUs Structure Ecosystem 25 Context & NA2 - EGI-InSPIRE Review 2011 http://www.egi.eu/collaoboration/ + more to come Astro-VRC, DARIAH, CLARIN, … + more to come Astro-VRC, DARIAH, CLARIN, …

26. www.egi.eu EGI-InSPIRE RI-261323 EGI Technical Forum 2010 Beurs van Berlage, Amsterdam, 14 - 17 September 2010 in partnership with the BiG Grid project Brought together European DCI projects and their collaborators in academia and businesses, and users in the research community 570 delegates, 290 contributions in the form of presentations, demos, posters and workshops 22% of delegates used the iPhone application, 28% used Twitter, 10% Flickr, 25% YouTube, 8% the GLOBAL webcast of the plenaries and 28% read the GridCast blog 27 press cuttings, including HPCwire, iSGTW, ZDNet, Yahoo News, ITnews in Australia, Science Business and Environment & Energy Management GridCast team from e-ScienceTalk produced 26 posts on the blog and 6 videos on YouTube Context & NA2 - EGI-InSPIRE Review 2011 26

27. www.egi.eu EGI-InSPIRE RI-261323 EGI User Forum 2011 Vilnius, Lithuania, 11-14 April 2011 in partnership with Vilnius University and LITNET Co-located with the European Middleware Initiative (EMI) Technical Conference Showcasing the diversity of the EGI user community and to ‘meet the EMI experts’ 427 delegates, 196 contributions, 173 speakers and 34 session conveners Context & NA2 - EGI-InSPIRE Review 2011 27 Book of Abstracts published for distribution at the event Over 250 images on Flickr, 30 posts on the GridCast blog, including 14 videos and slide shows Press articles appeared in HPCWire, the SSI blog, the GÉANT newsletter and iSGTW

28. www.egi.eu EGI-InSPIRE RI-261323 Use of Resources EGI.eu – low across all parts of NA2 –Staff in place since January 2011 –Impact on work in PQ1-3: Primarily Dissemination & Policy M & D Local partner contributions to central staff –Different level of effort across the community Some of this effort very low, a few PMs for project –Can lead to large % fluctuations No concern about delivering over the project Context & NA2 - EGI-InSPIRE Review 2011 28

29. www.egi.eu EGI-InSPIRE RI-261323 Plans for next year EGI Technical Forum, Lyon –19-23 rd September 2011 EGI Community Forum, Munich –26-30 th March 2012 –For whole ecosystem, not just users! Develop community consensus on ERIC –EGI.eu participants see 2013 as better time –Move D2.11 (EGI ERIC Plan) to PY3 Context & NA2 - EGI-InSPIRE Review 2011 29

30. www.egi.eu EGI-InSPIRE RI-261323 Summary Established HQ function across: –Governance & policy coordination –Project management & finance –Dissemination & event management Established Community Outreach: –Consumer: website, blogs, events, publications –Management: policy, communications Context & NA2 - EGI-InSPIRE Review 2011 30