1. EGI and Project Overview
Tiziana Ferrari
EGI.eu Technical Director
EGI-Engage Technical Coordinator

2. EGI-Engage PY1 Review - EGI and Project Overview
Outline
EGI
Service Portfolio
EGI-Engage
EGI-Engage PY1 Review - EGI and Project Overview

3. Vision and mission Solutions Governance International collaborations
EGI
Vision and mission
Solutions
Governance
International collaborations

4. The needs of modern research
In research and society, ICT has become one key enabling factor for progress
Changing the modus operandi of research, new possibilities for geographically distributed collaboration and sharing
Data-driven science and more open access to data and scientific results transforming how science is made
All large-scale Research Infrastructures and the long tail of science are dependent on ICT resources
Need to find synergies and to develop ways to tackle the ICT challenges at a generic level
Effective and cost efficient services that can be of wide and general use
EGI-Engage PY1 Review - EGI and Project Overview

5. EGI-Engage PY1 Review - EGI and Project Overview
A globally distributed ICT infrastructure that federates the digital capabilities, resources and expertise of national and international research communities in Europe and worldwide.
Mission: empower researchers from all disciplines to collaborate and to carry out data- and compute-intensive science and innovation.
EGI-Engage PY1 Review - EGI and Project Overview

6. The Open Science Commons Vision
Researchers from all disciplines have easy, integrated and open access to the advanced digital services, scientific instruments, data, knowledge and expertise they need to collaborate and achieve excellence in science, research and innovation.  They feel engaged in governing, managing and preserving these resources for everyone’s benefit, with the support of all stakeholders.
European Council conclusions, May 2015,
EGI-Engage PY1 Review - EGI and Project Overview

7. Open Science Commons: Definition
A set of interrelated resource systems governed as commons that support the open creation and dissemination of scholarly knowledge
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
EGI-Engage PY1 Review - EGI and Project Overview

8. Applying the Commons to Open Science
Shared resources
Integrated, easy and fair access  EGI: Compute, Storage, Software and Tools
Engaged communities
Participating in the process  EGI: hybrid, federating community infrastructures
Culture of sharing  EGI: enable opportunistic use
Collaborating in the management and stewardship  EGI: thematic services with SLAs (B2B), and UAs in EGI-Engage
Governance
Rules to access and participation  EGI: for users and providers
Rules to resolve conflicts  EGI: boards for User Community, Technology and Operations Management coordination
Rules to balance quality vs. openness  EGI: OLAs
Financial support
For long-term availability  EGI: national funding for capacity building, fees for operating the federation fabric
EGI-Engage PY1 Review - EGI and Project Overview

9. Horizontal and thematic infrastructures
EGI contributes to the “e-Infrastructure Commons” with generic solutions for shared needs and requirements
Common solutions for shared needs and requirements
@ ESFRI Roadmap 2016
EGI-Engage PY1 Review - EGI and Project Overview

10. EGI-Engage PY1 Review - EGI and Project Overview
EGI solutions
High throughput data analysis
Federated cloud
Federated
Operations
Community-
driven
innovation and support
EGI provides open solution built through a service catalogue that has been evolving for many years.
The EGI Federated Cloud Solution offers a standards-based and open infrastructure to deploy on-demand IT services that can manage and process datasets of public or commercial relevance, and can be flexibly expanded by integrating new providers.
This is complemented by the EGI High Throughput Computing Solution which provides a global high-throughput data analysis infrastructure, linking a large number of independent organisations and delivering computing resources and high scalability.
The EGI Federated Operations Solution provides processes and tools to federate and manage distributed ICT capabilities.
The EGI Community-Driven Innovation & Support Solution provides the processes, framework and experts so that research communities can co-create the new capabilities
or adapt their existing applications or platforms for compute- or data- intensive science on EGI. A
 EGI-Engage evolves solutions portfolio with all WPs
EGI-Engage PY1 Review - EGI and Project Overview

11. EGI-Engage PY1 Review - EGI and Project Overview
EGI Membership
Major national e-Infrastructures: 22 NGIs
EIROs: CERN and EMBL-EBI
EGI Foundation
(ERICs)
EGI-Engage PY1 Review - EGI and Project Overview

12. EGI and EGI Participants
deliver services through its participants and collaborating e-Infrastructures
harmonizes service delivery and policies
EGI Participants
develop local capacity with own funding
build on national strengths and priorities
Add EGI.eu
 EGI-Engage evolves governance with NA2
EGI-Engage PY1 Review - EGI and Project Overview

13. EGI-Engage PY1 Review - EGI and Project Overview
EGI  EGI Federation  EGI Community
Term
Definition
EGI
EGI.eu, the EGI.eu Participants and Associated Participants, their related organisations represented within EGI.eu that contribute to the objective of the foundation
EGI Federation
EGI Partnership plus all resource providers (RP) and representing organisations that established an MoU with EGI.eu
EGI Community
EGI Federation plus the served research communities (RC), the technology providers (TP), partners in projects (PP) and all other organisations having agreements with EGI.eu
EGI.eu
EIRO
ERIC
EGI
NGI RP
NGI RP
EGI Federation RC
other PP TP
EGI Community
EGI-Engage PY1 Review - EGI and Project Overview

14. The challenge of borderless science
“develop internationally-coordinated opportunities to fund research cyber infrastructure that reflect individual funding agency and national priorities while building towards a greater collaborative and interoperable whole”
EGI-Engage PY1 Review - EGI and Project Overview

15. A system of open e-Infrastructures
EGI European participants
Integrated e-Infrastructures
1 peer Open Science Grid/US
 EGI-Engage ensures operations coordination with SA1
EGI-Engage PY1 Review - EGI and Project Overview

16. A system of open e-Infrastructures
Canada
Ukraine
China
India
USA
Asia
Pacific
Latin America
Africa
Arabia
EGI-Engage develops international cooperation
With NA2, SA1, SA2
EGI-Engage PY1 Review - EGI and Project Overview

17. EGI-Engage PY1 Review - EGI and Project Overview
History
5.2015
EGI New statutes
3.2015
OSC adopted by the Competitiveness Council conclusions
EGI Strategy based on OSC vision
4.2014
EGI-Engage start ( / )
4.2012
Open Science Commons vision
First EGI Strategy document: “Seeking new Horizons: EGI’s role in 2020”
5.2010
EGI-InSPIRE start ( / )
2.2010
EGI Foundation established
EGI-Engage PY1 Review - EGI and Project Overview

18. EGI-Engage PY1 Review - EGI and Project Overview
EGI Federation, 2016 QR1
650,000 CPU Cores
500 PB of storage
21 Cloud providers
325 resource providers
46,000 users
+4,000 research papers
> 790 in 2015
EGI-Engage PY1 Review - EGI and Project Overview

19. EGI-Engage PY1 Review - EGI and Project Overview
EGI Federated Cloud
21 providers
Publicly funded, one commercial
Offer of virtual access to GPU
+ 2 sites ready to enter production (JINR, BITP)
28 projects over the last 12 months
Activity starting from CCs: Elixir, MoBrain, LifeWatch
Training infrastructure
5 sites, +10 events run on the infrastructure
EGI-Engage operates & develops cloud
Federation with JRA2 and SA1
EGI-Engage PY1 Review - EGI and Project Overview

20. EGI-Engage PY1 Review - EGI and Project Overview
Funding
Local infrastructure capacity building and operations
National funding
ESIF
Research funds
Federation services and processes
EGI council fees
EGI participants’ in kind contributions
H2020
Research and Innovation
Human networks
EGI Community
EGI Participants
EGI.eu
EGI-Engage develops business models with NA2
EGI-Engage PY1 Review - EGI and Project Overview

21. EGI-Engage PY1 Review - EGI and Project Overview
EGI is member of
Research Data Alliance
International initiative supporting the findability, accessibility, interoperability and reuse of research data
Big Data Value Association
A public-private partnership created to boost the value of European Big Data research.
The association is part of the EC’s DSM plan to generate value (jobs, growth, income) from the data
ERF-AISB
European Association of Research Infrastructures which promotes cooperation between European-level RIs which are open at international level, to external researchers
Knowledge 4 Innovation
Network of organizations promoting the European Innovation Summit and the expansion of the innovation potential in Europe
EGI-Engage PY1 Review - EGI and Project Overview

22. Components Technical Architecture Access policies User groups
Service Portfolio
Components
Technical Architecture
Access policies
User groups

23. EGI-Engage PY1 Review - EGI and Project Overview
TRAINING
LEARN WITH EGI INFRASTRUCTURE
COMPUTE
RUN, EXECUTE, ANALYZE
OPERATIONS
CONFIGURATION, MONITORING AND TOOLS FOR YOUR INFRASTRUCTURE
STORAGE
EASY AND SECURE ACCESS TO YOUR FILES
SECURITY
MANAGE COMMUNITY, EXPOSE TRUSTED INFORMATION
DATA
MANAGE, ACCESS, TRANSFER AND DELIVER DATA
EGI-Engage PY1 Review - EGI and Project Overview

24. Configuration Database Training Infrastructure Federated Data Manager
Compute
Storage
Data
Security
Operations
Training
Design Phases
Cloud Compute
Data Transfer
Configuration Database
Discovery
Online Storage
Attribute Management
FitSM
Alpha
Cloud
ContainerCompute
Content Distribution
Service Monitoring
Beta
Archive Storage
Training Infrastructure
IdP Proxy
High Throughput
Compute
Federated Data Manager
Each service can be in a different design phase defines as follows:
discovery: researching users needs, exploring technological or policy constraints;
alpha: prototype available for closed set of users;
beta: service being developed while available for testing publicly;
production: service available in the live environment meeting security/performance requirements;
retired: the service is not anymore offered
Production
Helpdesk
Retired
Data Hub
EGI-Engage PY1 Review - EGI and Project Overview

25. Technical architecture
Community Platforms
Brokering, community-specific data, tools and applications
EXPAND
EGI endorsed VM images, Helpdesk
Collaboration Platform
VM Image Catalogue of
Data-intensive computing
Cloud
GPGPU Platform
Open Data Platform
OPERATE
& DEVEL
OPERATE
NEW
NEW
EGI Core Infrastructure Platform
AAI, Service Registry, Accounting, Monitoring
Federated Service Management
OPERATE & DEVEL
OPERATE
DEVEL EXPAND
Physical Infrastructure
EGI-Engage PY1 Review - EGI and Project Overview

26. EGI-Engage PY1 Review - EGI and Project Overview
EGI access policies
Policy-based
users are granted access based on policies defined by the EGI resource providers or by EGI.eu; such policies usually apply to resources being offered “free at point of use” to meet some national or EU level objective
Wide access
users can freely access scientific data and digital services provided by EGI resource providers
Market-driven
users can negotiate a fee to access services either directly with EGI resource providers or indirectly with EGI.eu
EGI aligned with the charter for access to RIs
EGI-Engage PY1 Review - EGI and Project Overview

27. Target groups and project portfolio
Research Infrastructures
Research Communities
Industry and SMEs
High education
EGI-Engage PY1 Review - EGI and Project Overview

28. Users and disciplines 9 RIs using the EGI federation 46,000 users SLAs
Natural sciences, 66%
Medical and Health sciences, 6.5%
Engineering and Technology, 6.3%
SLAs
MoBrain/INSTRUCT and Structural Biology
BILS/Bioinformatics
DRIHM/Hydro-meteorology
9 RIs using the EGI federation
7 RIs preparatory stage
SLAs In progress: Terradue, HBP, Nanotechnology, Life sciences, EXTraS
9 RIs in production INSTRUCT, BBMRI.NL, IceCube, CTA, KM3NeT, LOFAR, LSST, Virgo, LifeWatch
7 RIs in preparatory stage: DARIAH, EISCAT-3D, ELIXIR, ELI, EMSO, EPOS, SKA
EGI-Engage supports users and co-development with NA2, SA2
EGI-Engage PY1 Review - EGI and Project Overview

29. on the Open Science Commons vision to advance its realization
EGI-Engage
A project built
on the Open Science Commons vision to advance its realization

30. EGI-Engage PY1 Review - EGI and Project Overview
Objective 1
Ensure the continued coordination of the EGI Community in
Strategy and policy development,
Engagement,
Technical user support and
Operations of the federated infrastructure in Europe and worldwide.
EGI.eu
EIRO
ERIC
EGI
NGI RP
EGI Federation
NGI RP RC
other
EGI Community PP TP
EGI-Engage PY1 Review - EGI and Project Overview

31. EGI-Engage PY1 Review - EGI and Project Overview
Objective 2
Evolve the EGI Solutions, related business models and access policies for different target groups aiming at an increased sustainability of these outside of project funding.
The solutions will be offered to large and medium size RIs, small research communities, the long-tail of science, education, industry and SMEs.
EGI-Engage PY1 Review - EGI and Project Overview

32. Objective 3 Offer and expand an e-Infrastructure Commons solution
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
Offer and expand an e-Infrastructure Commons solution
Develop the capabilities for an ecosystem of infrastructure services that implement the distributed fabric (Core infrastructure platform and Collaboration platform)
EGI-Engage PY1 Review - EGI and Project Overview

33. Objective 4
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
Prototype an open data platform and contribute to the implementation of the European Big Data Value
Extend the capabilities of existing EGI platforms (cloud and HTC)
Develop new platforms
Open data platform
Accelerated computing platform
EGI-Engage PY1 Review - EGI and Project Overview

34. Objective 5 1/2
Promote the adoption of the current EGI services and extend them with new capabilities through user co-development
Requirement gathering, co-design, co-development and integration, training and technical user support
Provide new platforms compatible with the EGI Core Infrastructure Platform and drives its evolution
Co-design through a network of Competence Centres
Digital services and applications
Knowledge & Expertise
Instruments
Research Data
EGI-Engage PY1 Review - EGI and Project Overview

35. Objective 5 2/2 Distributed Competence Centre BBMRI DARIAH EISCAT-3D
ELIXIR
EPOS
LifeWatch
MoBrain/ INSTRUCT
Environment (disaster mitigation)
EMSO (unfunded, MoU0
EGI-Engage PY1 Review - EGI and Project Overview
EGI-Engage PY1 Review. Project Overview

36. Work Packages NA2 Policy, Strategy and Communications
JRA2
Platforms for the Open Data Commons
SA2
Knowledge Commons
SA1
Operations
Project Management
NA1
Relationship between the EGI-InSPIRE work packages
JRA1
E-Infrastructure Commons
EGI-Engage PY1 Review - EGI and Project Overview

37. Research and Innovation
Innovating technology
within the production infrastructure
Technology innovations outside the production infrastructure
Collaboration
Prototype
Requirements
Implementation
Usage
Release
Evaluate
Deployment
Service
Providers
User Communities
R&I
Projects
Interaction between technology innovations taking place outside of EGI and their deployment in to the production infrastructure,
Feedback
EGI-Engage PY1 Review - EGI and Project Overview

38. EGI-Engage PY1 Review - EGI and Project Overview
Summary
EGI
a service component of a global system of e-Infrastructures that support Open Science
EGI-Engage
An instrument that supports coordination of service federation in Europe and the advancement of the Open Science Commons worldwide
EGI-Engage PY1 Review - EGI and Project Overview

39. Acknowledgements
This presentation used icons made by Freepik from