1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 EGI and the European Scientific Communities: Astro-CG, OGF35, Delft, NL 1 Steve Brewer, Chief Community Officer, EGI.eu steve.brewer@egi.eu

2. www.egi.eu EGI-InSPIRE RI-261323 Outline 1.The landscape for integrated e-infrastructure 2.Overview of grid user communities 3.Roadmap for community collaboration 2 Astro-CG OGF35 19 June 2012

3. www.egi.eu EGI-InSPIRE RI-261323 Outline 1.The landscape for integrated e-infrastructure 2.Overview of grid user communities 3.Roadmap for community collaboration 3 Astro-CG OGF35 19 June 2012

4. www.egi.eu EGI-InSPIRE RI-261323 C21: Digital Research 4 Astro-CG OGF35 19 June 2012 Extracting Knowledge from the Data Deluge Requires an infrastructure to share services and tools personalised to individual research communities

5. www.egi.eu EGI-InSPIRE RI-261323 Digital Agenda for Europe 5 Astro-CG OGF35 19 June 2012 Borderless Services Interoperability Supporting Innovation Digital Agenda for Europe Europe should also build its innovative advantage in key areas through reinforced e-Infrastructures (i.e. GEANT & EGI) remove barriers to the free movement of knowledge

6. www.egi.eu EGI-InSPIRE RI-261323 What is EGI? European Grid Infrastructure (EGI) –Federation of National Grid Infrastructures –Represented by EGI.eu (Dutch foundation) National Grid Infrastructures (NGIs) –Sole national point of contact for Grids –Integrates individual resource centres Current Status: –35+ NGIs & 350+ resource centres –300,000 CPUs & 200PB+ storage 6 Astro-CG OGF35 19 June 2012 EGI.eu partners

7. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4 year project with 25M EC contribution –Project cost 72M –Total Effort ~330M –Effort: 9261PMs 7 Astro-CG OGF35 19 June 2012 Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 partners)

8. www.egi.eu EGI-InSPIRE RI-261323 Outline 1.The landscape for integrated e-infrastructure 2.Overview of grid user communities 3.Roadmap for community collaboration 8 Astro-CG OGF35 19 June 2012

9. www.egi.eu EGI-InSPIRE RI-261323 VO Statistics (April 2012) 9 Astro-CG OGF35 19 June 2012 Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … Supported Research Communities

10. www.egi.eu EGI-InSPIRE RI-261323 Technology Innovation 10 Astro-CG OGF35 19 June 2012 Will come from outside EGI –Moving research technologies into production Partnership with technology projects –EMI (European Middleware Initiative) –IGE (Initiative for Globus in Europe) –EDGI (European Desktop Grid Initiative) –StratusLab –VenusC –SAGA

11. www.egi.eu EGI-InSPIRE RI-261323 VOs, VRCs and partner projects 11 Virtual Organisations: rules defining people & resources VRCs are self-organised (virtual) research communities which give individuals within their community a clear mandate to represent the interests of their research field within the EGI ecosystem. Current EGI VRCs: (http://www.egi.eu/community/vrcs/)http://www.egi.eu/community/vrcs/ –WeNMR - Structural biology –LSGC – Life sciences –HMRC – Hydro-meteorology –WLCG – High energy physics –CLARIN/DARIAH – Humanities (with a Letter of Intent) Plus: Astro, Earth Sciences, Comp. Chem., Fusion, Digital Cultural Heritage Astro-CG OGF35 19 June 2012

12. www.egi.eu EGI-InSPIRE RI-261323 EGI: strategy for 2020 Pillars of the strategy: Community & Coordination –Community building through events –Community networking through the NGIs Operational Infrastructure –Operate a European wide infrastructure –Offer its use to other research infrastructures –Build a federated cloud environment Virtual Research Environments –Enable 3 rd party integration & operation of VREs http://go.egi.eu/EGI2020 12 Astro-CG OGF35 19 June 2012

13. www.egi.eu EGI-InSPIRE RI-261323 VRCs – VREs & EGI 13 EGI Community Platform EGI Collaboration platform EGI resources (clusters, storages,...) Dedicated or shared resources/platforms (e.g. Clusters; EC2, PRACE, XSEDE) Research facilities (e.g. detectors, sensor networks) VM SW VM SW EGI Infrastructure platform DB Virtual Research Environment Created by a project such as CLARIN, ELIXIR, LifeWatch,... Virtual Research Communities Astro-CG OGF35 19 June 2012

14. www.egi.eu EGI-InSPIRE RI-261323 Services (Applications & data) Anatomy of a VRE 14 Service access (Science gateways - portal, desktop and mobile) Off-the-shelf and custom VM images Domain specific and generic data repositories Off-the-shelf and custom applications Service integration (workflows) EGI support Astro-CG OGF35 19 June 2012

15. www.egi.eu EGI-InSPIRE RI-261323 EGI support: Service access Catalogue of existing solutions –http://go.egi.eu/sciencegatewayshttp://go.egi.eu/sciencegateways Gateway components repository –SCI-BUS portlet repository will be used (see MoU)MoU Plan: How-to documentation –Develop an EGI science gateway primer (through a new EGI Virtual Team project and portal-community@mailman.egi.eu)EGI Virtual Team projectportal-community@mailman.egi.eu Portal & gateway workshops –CF & TF –Portal workshops by NGIs –Community workshops on portals 15 Astro-CG OGF35 19 June 2012

16. www.egi.eu EGI-InSPIRE RI-261323 EGI support: Cross cutting support Applications Database (EGI software catalogue)Applications Database –Stores information about any EGI software –Tags: Organise software into clusters –Subscription: Join an item/cluster as supporter (developer, operator, expert) –Notifications: To get informed about changes –Web gadgets: Embed customised lists of software into your website –Write API Planned Itegrate the catalogue with the EGI platform (e.g. Info system) Integrate the catalogue with other catalogues Training Marketplace –Advertise and search for events, materials, online courses –Web gadgets: Embed customised lists of software into your website Events –Community and Technical Forums (Call for TF2012 co-located events is open!) –Topical workshops (hosted by NGIs) 16 Astro-CG OGF35 19 June 2012

17. www.egi.eu EGI-InSPIRE RI-261323 EGI support: Service development and operation Established & evolving processes from various EGI(-InSPIRE) stakeholders: –EGI Operations –EGI Technology –NGIs, VRCs, EGI.eu –Pojects (e.g. SKA, CTA, Auger...) But the EGI platform is about to change: –Services will run in Virtual Machines EGI Strategic Plan; EGI Platform RoadmapEGI Strategic PlanEGI Platform Roadmap –Developers & operators will need new support mechanisms: VM image repository VM information system VM monitor with helpdesk integration... EGI Federated Cloud Task force EGI Infrastructure platform Join as user community! 17 Astro-CG OGF35 19 June 2012

18. www.egi.eu EGI-InSPIRE RI-261323 Outline 1.The landscape for integrated e-infrastructure 2.Overview of grid user communities 3.Roadmap for community collaboration 18 Astro-CG OGF35 19 June 2012

19. www.egi.eu EGI-InSPIRE RI-261323 Roadmap for collaboration EGI wants to support Astronomy –work with Astro-CG, AA VRC, other projects –What is needed? VRE, gateways, apps? –Virtual Teams to achieve short-term goals Specific use cases and scenarios – descriptions? Formally involve specific NGIs – which? Virtualisation to achieve scalability of solutions? Identify which software applications are needed? Data archiving and reuse; sharing and security 19 Astro-CG OGF35 19 June 2012

20. www.egi.eu EGI-InSPIRE RI-261323 EGI activities: forums, workshops, VTs and TFs –Forums Every 6 months, around 500 people meet to share knowledge and plans Keynotes, presentations, workshops, training, demonstrations, posters Next: Technical Forum TF12 in Prague – 17-21 September 2012 –Task Forces Federated Clouds MAPPER Identity –Workshops (face-to-face and also webinars) Integration of complex scientific workflow systems with EGIs services. Research Infrastructure interested in adopting EGIs operational tools to support their own distributed production infrastructure Science Gateways Workshop –Virtual Team (VT) projects – 3- 6 months (with NGIs) 20 Astro-CG OGF35 19 June 2012

21. www.egi.eu EGI-InSPIRE RI-261323 VT projects and more Initiatives of relevance to Astronomy 21 Astro-CG OGF35 19 June 2012 1.The Federated Cloud Task Force is already providing a cloud infrastructure through a few committed NGIs. Pilot resources are being made available to various research communities participating in the Task. (User workshop in July in Amsterdam) 2.A lively portal developer and provider community is being supported by EGI. The group is able to setup and operate custom, application and/or community specific portals for members of the community to interact with EGI. 3.A project to assess the possibilities for federated identity management in EGI and the readiness of EGI member states for federated authentication and authorisation mechanisms will deliver greater flexibility for integrated services. 4.EGIs operating resources and user support services continue to grow, with new types of services and infrastructures, such as desktop grids, map-reduce frameworks, GPU clusters continuously being developed and made available. 5.Virtual Team (VT) projects – 3- 6 months (with NGIs) Suggestions for future VT projects may emerge from discussions at OGF35 Further information on VTs: https://wiki.egi.eu/wiki/Virtual_teamshttps://wiki.egi.eu/wiki/Virtual_teams

22. www.egi.eu EGI-InSPIRE RI-261323 Conclusions EGI is more than a production infrastructure: –A framework for sharing and innovation –A forum for communication and collaboration Astronomy research community has strong grid history –Many years experience plus involved from the start of EGI –Many grid-based applications, research and publications Astronomy community is a key part of future EGI Strategy –EGI Strategy is aligned with EU 2020 strategy inc. Innovation Union –EGI will support and partner various ESFRI projects and researchers –EGI will develop requirements with technology developers & providers 22 Astro-CG OGF35 19 June 2012

23. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Astro-CG OGF35 19 June 2012 Questions? EGI user community support team: ucst@egi.eu 23 See you at the EGI Technical Forum 2012, Prague, Czech Republic between 17–21 September