European Grid Initiative Per Öster Director Application Services, CSC – IT Center for Science Ltd, Finland EGI Council Chair Chair EGI.eu Executive Board

Why Still Grids? 2

Evolution of European Grid Testbeds Utility Productive Use National/Regional EU Projects European e-Infrastructure 3

Grids and key European e-Infrastructure European Data Grid (EDG) –Explore concepts in a testbed Enabling Grid for E-sciencE (EGEE) –Moving from prototype to production European Grid Infrastructure (EGI) –Routine usage of a sustainable e-infrastructure 4

EGI – European Grid Initiative Overall governing body: –EGI Council NGIs + other associated partners (e.g. EIRO members) Legal entity, 8 Feb 2010: –EGI.eu Coordinating organization -“glue” between different distributed computing infrastructures in Europe and beyond

EGI Council 24 Member Countries 1 June 2010 Committed to the EGI objectives and yearly fee ParticipantCountryCouncil Member 1BELNETBelgiumRosette Vandenbroucke 2IPP-BASBulgariaKiril Boyanov 3SWITCHSwitzerlandChristoph Witzig 4CESNETCzech RepublicJan Gruntorád 5Gauß-AllianzGermanyDieter Kranzlmüller 6CSICSpainIsabel Campos 7CSCFinlandPer Öster 8CNRSFranceMichel Spiro 9GRNETGreecePanagiotis Louridas 10SRCECroatiaIvan Marić 11Grid-IrelandIrelandBrian Coghlan 12INFNItalyMirco Mazzucato 13NCFthe NetherlandsArjen van Rijn 14CYFRONET AGHPolandMichał Turała 15IPBSerbiaAleksandar Belic 16ARNESSloveniaMarko Bonac 17IISASSlovakiaLadislav Hluchý 18ULAKBIMTurkeySerkan Orcan 19JISCUnited KingdomAndrew Richards 20CERNEIRORobert Jones 21UNINETT Sigma ASNorwayJacko Koster 22EENetEstoniaMihkel Kraav 23SNICSwedenSverker Holmgren 24CyGridCyprusMarios Dikaiakos 6

EGI Objectives EGI.eu Statutes Article 3.1 “The objective of the foundation is to create and maintain a pan-European grid infrastructure in collaboration with NGIs in order to guarantee its long-term availability for performing research and innovation activities.” 7

EGI European Grid Initiative 8 EGI.eu: The legal Entity EGI.eu: The legal Entity EGI Council: The overall governing body

EGI Interaction 9

EGI.eu Organization in Amsterdam Director –Steven Newhouse Chief Administrative Officer –Catherine Gater Chief Community Officer –Steven Brewer Chief Operations Officer –Tiziana Ferrari Chief Technology Officer –Vacant ( User Community Support Team Policy Development Team Dissemination Team Financial Officer 10

EGI Infrastructure … International Research Collaboration National Grid Initiative 1 National Grid Initiative 2 National Grid Initiative N Middleware A Middleware B Middleware X gLite UNICORE ARC EGI.eu European-level Grid Services Services

The EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4 year project with €25M EC contribution –Project cost €69M –Total Effort ~€330M –Staff ~ 170FTE –Start 1 May 2010 Project Partners (48) EGI.eu, 37 NGIs, 2 EIROs, 8 AP Funded Un-Funded 12

EGI-InSPIRE Objectives Support Grids of high-performance and high-throughput computing resources Integrate existing and new Distributed Computing Infrastructures (DCIs) Be a coordinating hub for European DCIs –Support interoperation of individual national grid infrastructures Collect requirements and provide user-support for the current and new (e.g. ESFRI) users –Support new European and other international research collaborations 13

EGI-InSPIRE Objectives Support current heavy users (e.g. WLCG) –In move their critical services and tools from a central support model to ones driven by their own individual communities Define, verify and integrate within the Unified Middleware Distribution –middleware from external providers needed to access the e- Infrastructure (European Middleware Initiative with ARC, gLite, and UNICORE, ….) Extend operational tools to support a national operational deployment model Include new DCI technologies in the production infrastructure –New Grid techs, Virtualization, Clouds,… 14

Scalable Community Interactions USERS VOs Virtual Research Community User Community Board USERS VOs Virtual Research Commmuity USERS NGINGI NGI Helpdesk E G I. e u Training Events Trainers Apps. DB EGI Helpdesk VRC Helpdesk Other Helpdesk ESFRI Project VOs Virtual Research Community 15

VRC Characteristics International Existence & Governance –A research community that spans borders –Ability for groups to join and leave –e.g. ESFRI, EIROForum, Collaboration, etc. Sustainable beyond just a funded project Engagement with EGI –Resources, Policies, Planning,... May provide community specific support –Dissemination, Training, Application Porting,... 16

European Strategy Forum on Research Infrastructures Roadmap updated in 2008 Preparatory phase funding for most projects Big push in FP8 (2013 and beyond)? 44 projects covering: –Social Sciences and Humanities –Environmental Sciences –Energy –Biological and Medical Sciences –Materials and Analytical Facilities –Physical Sciences and Engineering –e-Infrastructures Data Intensive Science National commitments in European context Global collaboration and shared access Long lifetime ( years) Data Intensive Science National commitments in European context Global collaboration and shared access Long lifetime ( years)

Road to Success yes/no? A few things to have in mind… 18

Be a Neutral Infrastructure Consider IP network providers –Open to any traffic from many different communities Restrictions to protect other users –Customised solutions within a generic framework Light paths on demand –Standards drive integrated deployment Hardware and fibre from many different providers And for sustainable E-Infrastructures? –Any application domain or middleware technology –A platform for domain specific innovation and use –Integration of any compliant compatible resources

Can we learn from others? Grids have benefited from commoditisation –Hardware: HTC & HPC affordable to all –Networking: >GBs can be moved over WAN –Software: Open source software comes of age How will commodity virtualisation impact us? –For transactional models  Cloud Computing: A model based on compute not data –For large distributed data-oriented models  The emergence of true ‘function shipping’?

Evolving Service Delivery Models Move towards an interoperable cloud infrastructure –Federated pan-European infrastructure –Use standards and the established AAAA mechanisms Provide a Data-Oriented Infrastructure as a Service –Use existing high performance data storage & transfers –Empower VRCs/VOs to source and run their own services Bring new research innovations into production –Federated cloud environments (i.e. each site) –Experimenting with virtualised worker nodes in EGEE: e.g. INFN, BiG Grid, CERN, NGS, Dgrid,...

What does this evolution mean? EGI coordinates the core infrastructure –Assessing & certifying technology for deployment –Ensure integration of the core services in Europe –Operate & manage domain specific environments If required by that domain! VOs now manage their own infrastructure –Decide what services are deployed where –Flexibility (& responsibility) to meet their own needs Deregulate and open up the infrastructure (Where it makes sense to do so!) Deregulate and open up the infrastructure (Where it makes sense to do so!)

A long-term need for Standards Data Layer –Secure reliable data movement –Standardised access to data resources Virtualisation Layer –VMM across trust domains within agreed policies –Monitoring as important as lifecycle control Service Layer –The services that go into the virtual machine –Avoid domain specific silos & promote reuse Openness Consensus Balance Transparency Openness Consensus Balance Transparency

Sustainability Reduce barriers for collaborative data intensive science –Integration with GEANT provides unique offering –Support to ESFRI projects and new communities Flexibility to run the services and software they need Open global collaboration of e-infrastructures providers –Domain driven collaboration with other infrastructures –Open standardised interfaces to avoid vendor lock in –Add value where we can and outsource where we can’t ‘Europe as a hub for sustainable e-science and continuous service innovation’

Summary EGI: –Provide a sustainable production e-infrastructure EGI.eu is now a legal entity based in Amsterdam –Supported transition for 4 years through EGI-InSPIRE Contact: EGI Technical Forum th September 2010 in Amsterdam with NRENS and Grids Workshop 15 th Sept

Acknowledgment EGI.eu Steven Newhouse, EGI.eu Director 26