1. 1 Introduction to EGEE-II Antonio Fuentes Antonio.fuentes@rediris.es Tutorial Grid Madrid, May 2007 RedIRIS/Red.es (Slices of Bob Jone, Director of EGEE-II Project )

2. 2 The project EGEE  1 April 2004 – 31 March 2006  71 partners in 27 countries, federated in regional Grids EGEE-II  1 April 2006 – 31 March 2008  91 partners in 32 countries Objectives  Large-scale, production-quality grid infrastructure for e-Science  Attracting new resources and users from industry as well as science  Maintain and further improve “gLite” Grid middleware

3. 3 Applications on EGEE Applications from many scientific domains  Archaeology  Astrophysics  Computational Chemistry  Digital libraries  Earth Sciences  Financial Simulation  Fusion  Geophysics  High Energy Physics  Life Sciences  Multimedia  Material Sciences  ….. Book of abstracts: http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-005.pdf

4. 4 Support for digital repositories GÉANT. INFRASTRUCTURE GRID. INFRASTRUCTURE KNOWLEDGE. INFRASTRUCTURE 3 layered model to support access to heterogeneous information and connect resources through common shared services Grids can offer: Sharing of resources Secure Access Control Data management Execution of computationally demanding applications (e.g. multi- media content)

5. 5 EGEE Operations Structure Operations Coord. Centre (OCC) Regional Operations Centres (ROC)  Front-line support for user and operations issues  Provide local knowledge and adaptations  One in each region – many distributed  Manage daily grid operations – oversight, troubleshooting  “Operator on Duty”  Run infrastructure services ROCs serving

6. 6 Grid monitoring tools Tools used by the Grid Operator on Duty team to detect problems Distributed responsibility CIC portal  single entry point  Integrated view of monitoring tools Site Functional Tests (SFT) -> Service Availability Monitoring (SAM)  Need to expand usage in GIIS monitor (Gstat) GOC certificate lifetime GOC job monitor

7. 7 EGEE Related Infrastructures GINGIN

8. 8 Grid Interoperability We currently see different flavors of Grids deployed worldwide  Because of application needs, legacy constraints, funding, etc.  Diversity is positive! – Competition to find the best solutions Many applications need to operate on more than one Grid infrastructure  Pragmatic approach to interoperability is key  Applications need interoperable Grid infrastructures now  A production infrastructure cannot be an early adopter of quickly changing standards Interoperability and standardization pursued at multiple levels  Bilateral efforts (e.g. EGEE and EUChinaGrid, OSG and TeraGrid, EGEE and Naregi)  Resulted in the “Grid Interoperability Now (GIN)” effort combining major worldwide and regional Grid efforts at GGF  Grid standardization and best practices at the Global Grid Forum  Now merging with comparable industry efforts – Open Grid Forum  Standardization of basic infrastructure like web services (OASIS)

9. 9 Grid Middleware Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed to help the users building their computing infrastructure but should not be mandatory Foundation Grid Middleware will be deployed on the EGEE infrastructure  Must be complete and robust  Should allow interoperation with other major grid infrastructures  Should not assume the use of Higher-Level Grid Services Foundation Grid Middleware Security model and infrastructure Computing (CE) and Storage Elements (SE) Accounting Information and Monitoring Higher-Level Grid Services Workload Management Replica Management Visualization Workflow Grid Economies... Applications

10. 10 EGEE Middleware Distribution gLite Exploit experience and existing components from VDT (Condor, Globus), EDG/LCG, and others Develop a lightweight stack of generic middleware useful to EGEE applications (HEP and Biomedics are pilot applications). Pluggable components – cater for different implementations Follow SOA approach, WS-I compliant where possible Focus is on re-engineering and hardening Business friendly open source license Plan to switch to Apache-2

11. 11 Workload ManagementData Management Security Information & Monitoring Access gLite Grid Middleware Services API Computing Element Workload Management Metadata Catalog Storage Element Data Movement File & Replica Catalog Authorization Authentication Information & Monitoring Application Monitoring Auditing Job Provenance Package Manager CLI Accounting Site Proxy Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf

12. 12 gLite Grid Middleware Services Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf

13. 13 EGEE and Sustainability BUT … How does EGEE compare to other computing infrastructures?  Number of infrastructure users?  Number of application domains?  Number of computing nodes?  Number of years in service? What would happen, if EGEE is turned off? What happens after April 2008 (End of EGEE-II)?

14. 14 Sustainability: Beyond EGEE-II Need to prepare for permanent Grid infrastructure  Maintain Europe’s leading position in global science Grids  Ensure a reliable and adaptive support for all sciences  Independent of short project cycles  Modelled on success of GÉANT  Infrastructure managed in collaboration with national grid initiatives

15. 15 Structure Federated model bringing together National Grid Initiatives (NGIs) to build a European organisation (EGI) EGEE-II federations would evolve into NGIs Each NGI is a national body  Recognised at the national level  Mobilises national funding and resources  Contributes and adheres to international standards and policies  Operates the national e-Infrastructure  Is application independent, open to new user communities and resource providers

16. 16 EGEE’06 Conference EGEE’06 – Capitalising on e-infrastructures  Keynotes on state-of-the-art and real- world use  Dedicated business track exploring Grids’ business potential  Demos and business/industry exhibition  Involvement of international community 25-29 September 2006 Geneva, Switzerland http://www.eu-egee.org/egee06

17. 17 Summary Grids are all about sharing – they are an excellent means of working with groups around the world EGEE operates the world’s largest multi-disciplinary grid infrastructure for scientific research  In constant and significant production use  EUMedGrid & EUChinaGrid as part of this production infrastructure We have gained significant experience in what it takes to deploy, operate and manage a large distributed infrastructure  Next steps: Service Availability Monitoring, Service Level Agreements This work has shown the importance of interoperability/interoperations with related projects Need to prepare the long-term  EGEE, related EU projects, national grid initiatives and user communities are working to define a model for a sustainable grid infrastructure