Steven Newhouse Project Director, EGI.eu The EGI Ecosystem Steven Newhouse Project Director, EGI.eu Context & NA2 - EGI-InSPIRE Review 2011

C21: Digital Research Extracting Knowledge from the Data Deluge Context & NA2 - EGI-InSPIRE Review 2011

Infrastructure (Wikipedia) Infrastructure is the basic physical and organisational structures needed for the operation of a society or enterprise, or the services and facilities necessary for an economy to function EGI provides a service infrastructure that exposes and federates a resource infrastructure The Enterprise for us is the European Research Area Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 EGI Collaboration NGI EIRO NGI NGI EIRO NGI NGI Virtual Research Community Virtual Research Community Virtual Research Community EGI.eu NGI: National Grid Initiative EIRO: European Intergovernmental Research Organisation Context & NA2 - EGI-InSPIRE Review 2011

Service & Resource Providers EGI Ecosystem User Community EGEE-III Policies + Funding Requirements + Feedback Services + Support EGI-InSPIRE NA3 & SA3 Service & Resource Providers Requirements + Feedback NA2 Requirements + Feedback Public Funding Bodies Policies + Funding Technology Providers European Commission EGI.eu NA1 SA2 Open Source Providers Resource Infrastructure Providers National Research Councils SA1 & JRA1 Strategic Feedback Technology + Support Commercial Providers Policies + Funding Context & NA2 - EGI-InSPIRE Review 2011

EGI.eu Coordination for European Grid resources Based in Amsterdam Established 8 February 2010 Central policy & services needed to run a grid Sustainable small coordinating organisation Based in Amsterdam Coordinating core (21 people) in Amsterdam Technical services from partners (~20 FTEs) EGI and EGI.eu: Supported by the EGI-InSPIRE project Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 EGI.eu Governance EGI.eu established as non-profit foundation Governance & ownership by its participants Participants: European NGIs Associated participants: Organisations aligned with EGI.eu’s objectives EGI Council contains all participants Votes linked to fees Context & NA2 - EGI-InSPIRE Review 2011

A Virtuous Service Cycle National Resource Providers European Grid Infrastructure Ecosystem Current User Communities Used by Researchers Gathering New Requirements New Technology Assessed Deployed Infrastructure Services MoUs & OLAs MoUs EGI.eu MoUs & SLAs LoIs New User Communities Technology Providers Context & NA2 - EGI-InSPIRE Review 2011

EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4-year project with €25M EC contribution Project cost €72M Total Effort ~€330M Effort: 9261PMs Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 unfunded partners) Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Project Objectives A sustainable production infrastructure Resource providers in Europe and worldwide With new technologies as they mature Support structured international research Sustain current domain specific services Attract new international user communities e.g. ESFRI - European Strategic Forum on Research Infrastructures Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 PY1 Achievements Establishing EGI.eu Legal organisation employing 21 people Transitioning to a national infrastructure 38 independent European NGIs Support to Virtual Research Communities Software & centrally provided services Establishing open sustainable processes For requirements & policy development Two large community building events For the whole EGI community & its ecosystem Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Establishing EGI.eu Impact: Project Management: Focus only on critical time-sensitive issues Technical: M & D where EGI.eu key contributing partner delayed EGI-InSPIRE 4yr Linear Average (~46PM under) Activity EGI-InSPIRE Project Task Work summary Management & Administration TNA1.1 & TNA1.2 Organisation, Project and Consortium Management Technical Management TNA1.3, TNA1.4 TSA1.1, TSA2.1, TNA2.1, TNA3.1 Technical Management of Operations, Technology, User Community & External Relations Dissemination TNA2.2 & TNA2.4 Dissemination and Events and their management Policy TNA2.3 Policy Development across Operations and other areas User Community TNA3.2 User Community Support Team Context & NA2 - EGI-InSPIRE Review 2011

Funding EGI & EGI.eu EGI.eu EGI-InSPIRE Central Budget 597K European Commission EGI-InSPIRE (25000K) EGI-InSPIRE Central Budget (597K) 597K Management Activities & EGI Global Tasks (performed once for all) 4653K EGI.eu Activity (8010K) This moves EGI.eu towards sustainability 2643K 19750K 6000K NGI Activity EC Re-imbursement rates 100% - Management (M) 40% - General tasks (G) 33% - International tasks (N) 25% - EGI Global tasks (E) Partner Tasks (International & EGI Global Tasks) (65848K) NGIs & EIROs (49455K) 43455K Context & NA2 - EGI-InSPIRE Review 2011

EGI & EGI-InSPIRE End-Users Virtual Organisations Virtual Research Communities User Functional Services (SA3) User Coordination Services (NA3) (NA1 & NA2) EGI HQ EGI-InSPIRE Service Infrastructure (SA1+JRA1) Software (SA2) Local Global Resource Infrastructure (NGIs & EIROs) EGI Context & NA2 - EGI-InSPIRE Review 2011

European Grid Infrastructure (April 2011 and yearly increase) Logical CPUs (cores) 239,840 EGI (+24.9%) 338,895 All 102 PB disk and 89 PB tape Resource Centres 338 EGI 345 All (+6.8 %) 96 supporting MPI (+6.8%) Countries (+11.5%) 51 EGI 57 All (+18.75) 38 NGIs providing resources 22 National Operations Centres 16 NGIs in 5 Federated Operations Centres 1 EIRO providing resources 18 countries in 4 non-European Operations Centres Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 EGI Usage (April 2011) Average usage 2010-2011 vs 2009-2010 27.8M jobs/month, 914,000 jobs/day (+82%) 74.8M CPU wall clock hours/month (+35%) 2.8M jobs/month for non-HEP users (+47%) Year to Year Increase 18,271 End-users (+47%) 219 VOs (+17.7%) ~30 high activity VOs (no change) User Communities Archeology Fusion Astronomy Geophysics Astrophysics High Energy Physics Civil Protection Life Sciences Comp. Chemistry Multimedia Earth Sciences Material Sciences Finance … Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Review Agenda Project Overview 9:30: The EGI Context (we are now here!) 10:00: External Relations (NA2) + Q&A 10:30: Project Administration (NA1) + Q&A User Community 11:15: Supporting VRCs (NA3) + Q&A 12:00: Software for Heavy User Communities (SA3) + Q&A Distributed Computing Technology 14:00: Software Provisioning (SA2) + Q&A 14:45: Operations (SA1) and supporting Tools (JRA1) + Q&A Future 16:00: Plans for PY2 + Q&A 30/05/2011 Context & NA2 - EGI-InSPIRE Review 2011

NA2 – External Relations Steven Newhouse Director, EGI.eu Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 NA2 Overview The Netherlands UK Slovenia Czech Republic France Finland Spain Poland Russia Bulgaria Latvia Italy Serbia Israel Germany Portugal Hungary Norway Switzerland Ireland Turkey Denmark Cyprus Slovakia Albania Sweden Lithuania Taiwan Phillippines Indonesia Australia Singapore Malaysia WP Beneficiary Total PMs WP2-E EGI.eu 308 NCF 5 STFC 19 WP2-N ARNES 28 CESNET 8 CNRS 21 CSC 17 CSIC 35 CYFRONET 16 E-ARENA 14 ICT-BAS IMCS-UL 22 INFN 20 IPB 12 IUCC 4 KIT-G LIP MTA KFKI WP Beneficiary Total PMs WP2-N NCF 7 SIGMA 6 STFC 24 SWITCH TCD TUBITAK 16 UCPH 12 UCY 8 UI SAV UPT VR-SNIC VU 21 ASGC 48 ASTI 20 ITB 3 UNIMELB 4 NUS UPM 33 Countries 34 Beneficiaries 812 PMs 16.8 FTEs Task Leader/Partner WP Effort % TNA2.1 Activity Management S. Newhouse/EGI.eu 2% TNA2.2 Dissemination C. Gater/EGI.eu 44% TNA2.3 Policy Development S. Andreozzi/EGI.eu TNA2.4 Events R. v. d. Meer/EGI.eu 10% Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Objectives Disseminating the work of EGI & its communities: Within the project Worldwide Supporting policy development: Within and external to EGI.eu In conjunction with EGI‘s stakeholders Cover governance, standardisation and integration with other infrastructures. Running two large events each year with: Partners in the European e-Infrastructure ecosystem The community using e-Infrastructure services Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Communications Website Quarterly Newsletters Wiki Blogs Monthly Letters Social Media 30,000 visitors 365,000 page views Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Dissemination Disseminate EGI’s activity within the project and worldwide through its regionally dispersed dissemination contacts Develop the EGI branding and content for the project and event websites Leverage NGIs for contributed events, websites, materials, publications, papers, translations, press releases and outreach to policy makers Booths at international events in Europe and around the world Europe: ISC2010 in Germany, ICT 2010 in Brussels, eChallenges in Warsaw & SciTech in Brussels Worldwide: ISGC in Taipei & SC10 in the US. Hosted booths at the EGI Technical and User Forums Outreach campaigns that included printed materials (brochures & posters), press releases, social media feeds and blogs Contribute stories in International Science Grid This Week and Public Service Review Context & NA2 - EGI-InSPIRE Review 2011

EGI Technical Governance EGI Council EGI.eu Executive Board Technology TCB Security SCG SPG SVG/RAT CSIRT Operations OMB OTAG OAT Users UCB USAG Terms of Reference (ToR) Policy Development Process (PDP) Common Glossary (GCG) SVG/RAT CSIRT http://www.egi.eu/policy/groups/ http://go.egi.eu/policies_and_procedures Context & NA2 - EGI-InSPIRE Review 2011

Strategic Policy Documents Help plan future activities See later PY2 presentation Context & NA2 - EGI-InSPIRE Review 2011

MoUs Structure Ecosystem http://www.egi.eu/collaoboration/ + more to come Astro-VRC, DARIAH, CLARIN, … Technology Provider Resource Provider VRC Project Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 EGI Technical Forum 2010 Beurs van Berlage, Amsterdam, 14 - 17 September 2010 in partnership with the BiG Grid project Brought together European DCI projects and their collaborators in academia and businesses, and users in the research community 570 delegates, 290 contributions in the form of presentations, demos, posters and workshops 22% of delegates used the iPhone application, 28% used Twitter, 10% Flickr, 25% YouTube, 8% the GLOBAL webcast of the plenaries and 28% read the GridCast blog 27 press cuttings, including HPCwire, iSGTW, ZDNet, Yahoo News, ITnews in Australia, Science Business and Environment & Energy Management GridCast team from e-ScienceTalk produced 26 posts on the blog and 6 videos on YouTube Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 EGI User Forum 2011 Vilnius, Lithuania, 11-14 April 2011 in partnership with Vilnius University and LITNET Co-located with the European Middleware Initiative (EMI) Technical Conference Showcasing the diversity of the EGI user community and to ‘meet the EMI experts’ 427 delegates, 196 contributions, 173 speakers and 34 session conveners Book of Abstracts published for distribution at the event Over 250 images on Flickr, 30 posts on the GridCast blog, including 14 videos and slide shows Press articles appeared in HPCWire, the SSI blog, the GÉANT newsletter and iSGTW Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Use of Resources EGI.eu – low across all parts of NA2 Staff in place since January 2011 Impact on work in PQ1-3: Primarily Dissemination & Policy M & D Local partner contributions to central staff Different level of effort across the community Some of this effort very low, a few PMs for project Can lead to large % fluctuations No concern about delivering over the project Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Plans for next year EGI Technical Forum, Lyon 19-23rd September 2011 EGI Community Forum, Munich 26-30th March 2012 For whole ecosystem, not just users! Develop community consensus on ERIC EGI.eu participants see 2013 as better time Move D2.11 (EGI ERIC Plan) to PY3 Context & NA2 - EGI-InSPIRE Review 2011

Context & NA2 - EGI-InSPIRE Review 2011 Summary Established HQ function across: Governance & policy coordination Project management & finance Dissemination & event management Established Community Outreach: Consumer: website, blogs, events, publications Management: policy, communications Context & NA2 - EGI-InSPIRE Review 2011