1. www.egi.eu July 2014 EGI-InSPIRE RI-261323 www.egi.eu July 2014 EGI-InSPIRE RI-261323 EGI-InSPIRE Community-Driven Innovation and Support Solution Gergely Sipos EGI.eu gergely.sipos@egi.eu 1

2. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Outline Objectives Structure of activities Results in PY5 –Heavy User Communities –Events and communications –Research Infrastructures –Long-tail of science –Federated Cloud Next steps Summary 2

3. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Objectives 3 Enabling excellent science through EGI solutions –Raising awareness of EGI –Technical engagement with community representatives –Support the uptake, customisation and extension of EGI solutions Target groups: –Heavy User Communities –Research Infrastructures, international research collaborations –The ‘long tail’ –(SMEs and industry) Engagement strategy defined and driven from EGI-InSPIRE

4. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Approach 4 Engagement strategy –http://go.egi.eu/engagementstrategyhttp://go.egi.eu/engagementstrategy –To define what, why, who, how, when –Monthly Engagement meetings Coordination, implementation and support from EGI-InSPIRE NGI International Liaisons Champions Heavy User Communities (User Community Board) EGI.eu teams Communication Coordination Support Collaborating projects EGI-InSPIRE NA4.2 NA4.1 NA4.3, SA5.2 NEW in PY5 Distributed Competence Centre

5. www.egi.eu July 2014 EGI-InSPIRE RI-261323 From needs to solutions 5 Excellent science Events and communication Consultancy and support Virtual Team projects Outreach Technical engagement Implementation Outcome Activity plan Awareness and interest in EGI Success cases, tools, champions, etc. Existing solutions User communities

6. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Need for European coordination 6 Several process instances at the same time –National and multi-national Distributed process –Leadership –Target communities –Competences Long vs. short cycles –Days to years

7. www.egi.eu July 2014 EGI-InSPIRE RI-261323 7 Results from PY5

8. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Results from PY5 1.Heavy User Communities 2.Events and communications 3.Research Infrastructures 4.Long-tail of science 5.Federated Cloud 8

9. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Heavy User Communities 9 COMMUNITYPROGRESS IN PY5 High Energy Physics Experimenting with cloud resources Astronomy & Astrophysics Infrastructure use dominated by CTA and AUGER Science gateway federation concept  VRE Computational Chemistry, Materials Sciences and Techn. “Quality of users, quality of sites” concept  VRE Gateway framework for mixed EGI-XSEDE use Earth Sciences (incl. VERCE VRE) Solid earth research is moving to HPC EPOS is emerging with need for clouds, AAI Fusion Declining grid use (lack of funding and ITER problems) Life Sciences Grid Community Deployment of CVMFS for SW management Strongly emerging Research Infrastructures WeNMR Deployment of CVMFS for SW management DRIHM VRE Expand from clusters to HPC and cloud Biodiversity sci. (BioVeL) Heaviest users of the cloud (Web Services)  VRE Nanotechnology Application porting and gateway support  VRE PY1-3 PY5 NEW in PY5

10. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Events EGI events –EGI Community Forum, Helsinki, May 2014 Ca. 400 participants Technical tracks, Hackathons,Tutorials, Workshops, … –EGI Conference on Challenges and Solutions for Big Data Processing on Cloud, Amsterdam, Sep 2014. Ca. 160 participants Technical sessions on AAI, Data, Storage, etc.; EGI-GEANT Symposium Contributions to external events –Conferences Bioenergetics, Computational Biology, Climate modelling, Low-frequency Radio Telescopes –ESFRI workshops BioMedBridges; DASISH, BBMRI, ELIXIR, EPOS, LifeWatch, DARIAH –EC consultation events E-infrastructures for Mathematics; E-infrastructures for Africa 10

11. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Communications: Publications 11 Solutions’ brochures EGI CF2014 –Book of Abstracts Case studies –Six new case studies Astro-seismology, Crystallography, Environmental science, Physics, Medical, Space science –Case studies booklet http://www.go.egi.eu/cst http://www.go.egi.eu/cst Newsletters –2 issues of Inspired

12. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Research Infrastructures Technical projects –Support for genome analysis and protein folding –Science gateway integration for CTA –Integrating ELIXIR Reference Datasets into EGI Formulated joint workplan with 7 ESFRIs –8 Competence Centres in EGI-Engage –Joining effort from NGIs, RIs, technology and service providers 12 ELIXIR BBMRI MoBrain (Instruct, WeNMR) LifeWatch EISCAT_3D EPOS Disaster mitigation Life sciencesEnv. sciences ELI ICOS ESS KM3NET DARIAH Humanities CLARIN

13. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Integrating ELIXIR Reference Datasets into EGI Aims: –Identify life science datasets suitable for replication in EGI –Extend Applications Database (AppDB) towards a dataset registry –Propose analysis tools to work with data replicas –Integration with the ELIXIR-BMB Registry Members –EGI.eu, EUDAT, ELIXIR Hub + ELIXIR nodes of DK, GR, IT, PT, SI 13 Survey – Early analysis (25 responses): Impact of data transfer rate on analysis Impact of computation time on analysis Very significant Significant Insignificant Very significant Significant Insignificant

14. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Support for the long-tail National solutions exist in several countries. But there is need for –More consistent support across all countries –Simplified access to grid and cloud –More interactions between researchers and NGIs –Lower cost of operation Long-tail platform –User registration portal –Dedicated resources (grid and cloud) –Science gateways –New security mechanism: User-specific robot proxies Development started in October 2014. Release in Spring 2015 14

15. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Reach out to the private sector Main issues until now –No dedicated effort to reaching out to the private sector –Diverse mandate of NGIs to business engagement –Lack of tools and processes that would work at the European scale EGI Business Engagement Programme –Framework underlying future joint activities between EGI and industry –Identifies opportunities Market intelligence; Consultancy and support; Pre-­commercial R&D; Test proof of concepts; Developing added-­value services –Identifies benefits –Identifies structure and processes –Defines an activity plan Promotion; Network of Business Engagement Centres; Secure funding Launch in 2015 15

16. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Federated Cloud A new EGI platform –Production launch in May 2014 Established user support –Online guides for different levels of access API, cmd line, graphical –Incubator resource pool –Network of user support teams in 13 NGIs Bi-weekly meetings –Tutorials and webinars 16

17. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Federated Cloud - Impact Supported 50 use cases from 26 communities in PY5 –29 use cases access the infrastructure through the rOCCI client –12 use cases adopted an high level brokering tools CSGF, COMPSs, Slipstream, WS-PGRADE, DIRAC, VCYCLE –5 use cases from private companies Electric grids, Digital archiving, Music score analysis, Virtual screening, Data backup 17

18. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Next steps Keeping the diversified approach –Setup service and operation level agreements for heavy user communities –Launch Competence Centres for RIs –Roll-out the long-tail platform –Expand support for the Federated Cloud High level platforms (e.g. Hadoop clusters) –Implement the ‘Business engagement strategy’ Reinforce the human networks –NILs, Champions, Operation Managers –New partner projects under H2020 –E-infrastructure partnerships (joint calls) 18

19. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Summary Engagement activity at the pan-European scale would not be possible without EGI-InSPIRE –Successfully established framework, tools and human networks Activities driven by the Engagement Strategy –Integrates effort across NGIs and projects –Customised approaches for each user segment Intensified technical activities in PY5 for –ESFRIs, long-tail, Heavy User Communities –Federated Cloud Intensify business engagement and RI activities in 2015 19

20. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Community Engagement20

21. www.egi.eu July 2014 EGI-InSPIRE RI-261323 www.egi.eu July 2014 EGI-InSPIRE RI-261323 EGI-InSPIRE OLD SLIDES Community Engagement21

22. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Next round of RIs CLARIN in BG, PL and CZ + EGI.eu ELI in CZ ICOS in CZ ESS in PL Nanotechnology in SK KM3Net by EGI.eu in DE, GR Community Engagement22

23. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Engagement stories from PY4 23 ESFRIs, FET flagships Estim. size of individual groups Multinational communities ‘Long tail’ (‘Two- pizza teams’) ELIXIR EPOS CTA EISCAT_3D BBMRI CLARIN LOFAR EMSO ELI LifeWatch ICOS VPH BioMedBridges ENVRI MAPPER BioVeL WeNMR DRIHM AgINFRA CMMST LSGC DCH-RP VERCE SuperSites Exploitation Environmental sci. CERN@School neuGRID PeachNote CEBA Galaxy eLab Semiconductor design Main-belt comets Quantum pysics studies Virtual imaging (LS) Bovine tuberculosis spread Convergent evol. in genomes Geography evolution Seafloor seismic waves 3D liver maps with MRI Metabolic rate modelling Genome alignment Tapeworms infection on fish … Industry, SMEs SixSq Liberologico 100%IT Teamnet Codory Ecohydros InConTec Rasdaman SAC Community Engagement: Strategy and Results

24. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Engagement stories from PY4 24 ESFRIs, FET flagships Estim. size of individual groups Multinational communities ‘Long tail’ (‘Two- pizza teams’) ELIXIR EPOS CTA EISCAT_3D BBMRI CLARIN LOFAR EMSO ELI LifeWatch ICOS VPH BioMedBridges ENVRI MAPPER BioVeL WeNMR DRIHM AgINFRA CMMST LSGC DCH-RP VERCE SuperSites Exploitation Environmental sci. CERN@School neuGRID PeachNote CEBA Galaxy eLab Semiconductor design Main-belt comets Quantum pysics studies Virtual imaging (LS) Bovine tuberculosis spread Convergent evol. in genomes Geography evolution Seafloor seismic waves 3D liver maps with MRI Metabolic rate modelling Genome alignment Tapeworms infection on fish … Industry, SMEs SixSq Liberologico 100%IT Teamnet Codory Ecohydros InConTec Rasdaman SAC Excellent science Societal challenge Innovation Involving industry (supply, demand) Community Engagement: Strategy and Results

25. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Excellent Science 25 Cherenkov Telescope Array (CTA ESFRI) –Next generation ground-based very high energy gamma-ray instrument CTA project –Data Management WP with members from NGI-PL and NGI-IT EGI Virtual Team project –Members from 8 NGIs + EGI.eu + Terena –Facilitated requirement gathering (science gateway with single sign-on) –Investigated, identified and recommended suitable technologies –Establish links to providers, defined and launched integration activity Image: www.cta-observatory.org Community Engagement: Strategy and Results

26. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Societal challenge 26 DRIHM: Hydro-meteorology FP7 VRE project –To mitigate risks related to extreme weather –Scientific gateway with workflow applications EGI services used: –Coordination: IGE, EMI, SCI-BUS, ER-flow –Grid VO + Cloud resources –Model porting and integration support from several NGIs Data repository HPC meteo models HMR Models Windows Models Testbed Citizen Scientists and proprietary software Source: EGI Accounting Portal Community Engagement: Strategy and Results

27. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Involving industry (SMEs) Supply side collaboration: 100%IT Value to EGI –Integrating a commercial IaaS Cloud provider –Gain expertise in SLA-governed service provision –Commercial expertise in pay-for-use scenarios –Commercial backing for Cloud bursting use cases Value to 100%IT: –Level playing field across Cloud provider in Europe –Common services provided at federation level E.g. Accounting, Monitoring, Operational Security –Shared business development (and profit generation) 27Community Engagement: Strategy and Results

28. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Involving industry (SMEs) Demand side: InConTec Value to EGI –Access to InConTec’s customer network and market –Access to commercial use cases and requirements –Commercial and industrial use of e-Infrastructure contributes to overall EGI sustainability Value to InConTec –Powerful and far-reaching e-Infrastructure provider underpinning own service delivery –Wide and varied expertise available in scientific domains 28Community Engagement: Strategy and Results

29. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Innovation 29 Study electric flow in naphthalene Research team from Belgrade and Basel Aim at better organic semiconductors Support from the Serbian NGI (AEGIS) Model porting and simulation setup Computing and storage resources National VO, federated with EGI tools Science gateway from SCI-BUS FP7 project Image:meharris/wikicommons Publications: N. Vukmirović et al. (2012) Electron-Phonon Coupling in Crystalline Organic Semiconductors: Microscopic Evidence for Nonpolaronic Charge Carriers. Phys. Rev. Lett. 109, 126407 https://www.egi.eu/case-studies/eng_tech/semiconductor.html Community Engagement: Strategy and Results

30. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Reaching the middle and long tail 30 Image from http://www.sci-bus.eu/science-gatewayshttp://www.sci-bus.eu/science-gateways Collaboration with science gateway providers: 12 frameworks 40 instances in 4 years SCI-BUS collaboration: 15 gateways in 3 years MoU in March 2012 Community support Training VT participation Service integration Community Engagement: Strategy and Results

31. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Technical service: Applications Database 31 New additions in PY4: 28 applications 5 tools 3 science gateway items 3 workflow items 10 middleware 16 virtual appliances Content reuse in PY4: Approx. 2500 searches 296 Ratings and comments 28 shares in social media Community Engagement: Strategy and Results

32. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Technical services: Use of resources All partners contributed with unfunded effort too Funding in PY5: –AppDB from EGI-InSPIRE –Training Marketplace from UK funding –CRM discontinued without impact on Engagement 32 Project Year 4Project Year 1-4 ServicePartner Worked PM Funded Committed PM Achieved Funded PM % Worked PM Committed PM Achieved PM % Applications Database IASA + GRNET 011.5100%>46.646.6>100% Training MarketplaceSTFC 10.37.3141%>2424>100% CRMCSIC + LIP 4.33.2137%>2121>100% Community Engagement: Strategy and Results

33. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Key achievements of 4 years 33 Operational Infrastructure Virtual Research CommunitiesCommunity coord. Excellent science +82 partners: NILs, UCB, Champions (only ~10 FTE from EGI-InSPIRE) +21 Virtual Team projects +251 software registration in the Applications Database +41 multi-national + 26 national new VOs +5 ESFRI VOs ELI, LifeWatch, EISCAT_3D, Km3Net, BBMRI-NL +62 million CPUh in new VOs +680 power users + 80 user groups +100 links among 19 NGIs and 23 ESFRIs +200+ support projects for science groups + >2000 publications with support from EGI Community Engagement: Strategy and Results

34. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Lessons learnt 34 ESFRI communities are becoming ‘e-infrastructure-aware’ –Trend continues across all scientific disciplines –Many new links in PY4. Even more expected in the next years Successful engagement depends on strong partnerships –FP7: BioVeL, SCI-BUS, ER-flow, …, –ESFRI cluster: BioMedBridges, ENVRI Technical engagement requires dedicated effort –Distributed Competence Centre in PY5 Engagement should look at other sectors –EGI recently started a new VT for business engagement Community Engagement: Strategy and Results

35. www.egi.eu July 2014 EGI-InSPIRE RI-261323 PY5 plans 35 1.Facilitate EGI–ESFRI interactions –Combined top-down and bottom-up approach –EGI presence at community events 2.Engagement through the Federated Cloud –Scale-out and scale-up support through the Distributed Competence Centre 3.Open Call for Use Cases – jointly with other e-infrastructures –Recommendation from BioMedBridges E-infrastructure Workshop 4.EGI Conference with users and technology providers –September 24-26, Amsterdam 5.Improve further our community engagement process and tools –Rationalise Customer Relationship Management processes (FitSM) –Scientific publication tracking via OpenAIRE –User-oriented EGI portal Community Engagement: Strategy and Results

36. www.egi.eu July 2014 EGI-InSPIRE RI-261323 Questions 36 Members of the EGI-InSPIRE collaboration thank the EC for supporting EGI Community Engagement: Strategy and Results