INFSO-RI Enabling Grids for E-sciencE Technical Overview EGEE’s achievements in the first two years Erwin Laure EGEE Technical Director

Enabling Grids for E-sciencE INFSO-RI Technical Overview 2 Highlights of 2 Years of EGEE CPU EGEE Production Grid Infrastructure Steady growth over the lifetime of the project Improved reliability (typically >80 % of sites) sites

Enabling Grids for E-sciencE INFSO-RI Technical Overview 3 Highlights of 2 Years of EGEE >60 VOs from 9 domains –Archaeology –Astronomy –Biomedicine –Computational Chemistry –Earth Sciences –Financial Simulation –Geo-Physics –High Energy Physics –Physics of Plasma Further applications in evaluation Applications have moved from testing to routine and daily usage ~80-90% efficiency Results reported in over 50 publications and presentations

Enabling Grids for E-sciencE INFSO-RI Technical Overview 4 Highlights of 2 Years of EGEE gLite middleware distribution re- engineered according to industry strength process –Now more widely available via ETICS project Planned convergence with distribution existing at the start of the project (LCG-2) reached with gLite 3.0 –Publicly released on May 4, 2006 LCG-2 prototyping product product gLite 2006 gLite 3.0

Enabling Grids for E-sciencE INFSO-RI Technical Overview 5 Highlights of 2 Years of EGEE Incubator for new Grid efforts world-wide –Infrastructure and application efforts Leading role in building world-wide Grids through interoperation efforts –Bilateral: EGEE/OSG, EGEE/NDGF, EGEE/NAREGI –Multilateral: Grid Interoperability Now (GIN) Experiences and requirements fed back into standardization process (GGF) –Many EGEE members are area directors, WG chairs, WG members Contacts with industry strengthened –See specific presentation tomorrow GINGIN

Enabling Grids for E-sciencE INFSO-RI Technical Overview 6 PoW of technical activities is coordinated by the Technical Coordination Group (TCG) Makes decision process clearer and ensures application driven progress Started in November 2005 Main accomplishments –Definition of gLite 3.0 –Clarification and prioritization of main application requirements –Draft short term workplans for mw development and integration

INFSO-RI Enabling Grids for E-sciencE Summary of Activity Achievements

Enabling Grids for E-sciencE INFSO-RI Technical Overview 8 NA2 Dissemination & Outreach Successful teamwork –29 partners in 21 countries –NA2 team worked closely together to drive Dissemination Plan Building the brand –Easily recognisable EGEE brand and style –EGEE Style Guide –Templates for posters, fact sheets, presentations, websites etc. –EGEE and gLite now trademarks Publicity material developed –Glossy brochure –Information sheets and folders  In 13 different languages –Multimedia video –Business cards –Stickers –EGEE newsletters

Enabling Grids for E-sciencE INFSO-RI Technical Overview 9 NA2 Dissemination & Outreach Websites: –21 websites (public and local) –Over 16,000 unique visitors to an EGEE website every month Events –EGEE promoted and presented at 461 events all over the world  IT events, e.g. SC05, GGF, CHEP06, ISGC2006  User events, e.g. Lepton-Photon 2005, ICHEP06, HealthGrid –Four successful project conferences held Media relations: –145 news releases about EGEE issued across Europe and beyond –Resulted in 360 press cuttings, 11 television interviews and 5 radio interviews –Equivalent in paid advertising of over 500K Euros

Enabling Grids for E-sciencE INFSO-RI Technical Overview 10 NA3 User Training and Induction The NA3 Activity in EGEE –Has delivered beyond targets ( 250 courses compared with 52 promised ) –Help to bring new areas and domains into EGEE –This has depended on  Close interaction with all other activities, particularly other NA.  Teamwork & Enthusiasm  Assistance from many experts QA and management is a challenge with a thinly spread community –But we have met this challenge –And improved the model in EGEE-II Developed a major repository of material –Self-paced learning support –Developing further content & quality processes  (ETF results being incorporated) Becoming a ‘hub’ for the interaction of related projects and their commitments to training. –Based on a recognition of the quality of the NA3 processes and on the developments of the repository Leading international efforts to coordinate training & education

Enabling Grids for E-sciencE INFSO-RI Technical Overview 11 DC2 (long jobs period) DC2 (short jobs period) Mix of jobs Prep for ‘Rome’ Example: HEP - Atlas NA4 Application Identification & Support Previous peak: ~7500

Enabling Grids for E-sciencE INFSO-RI Technical Overview 12 Example: Biomed Achievements Development of secured data management and complex data flows on the grid –Medical Data Manager for the storage & analysis of medical images on the grid First CPU-intensive grid deployments for bioinformatics in the world –In silico drug discovery against malaria and bird flu –Very large impact in the grid community –Biologically-relevant results under process Sustained growth of the “Biomed” VO –New applications interested in joining the VO: 11 apps. in DNA4.4 inventory –~80 users –1000 jobs / day on average –3 sub-areas: bioinformatics, medical imaging, drug discovery NA4 Application Identification & Support

Enabling Grids for E-sciencE INFSO-RI Technical Overview 13 Non-pilot Applications In EGEE we have observed a real “explosion” of scientific communities interested and active: –June 2004: 4 disciplines –November 2004: 5 disciplines –October 2005: 6 disciplines –March 2006: 9 disciplines + several applications from Related Projects + tens of small applications on GILDA The number of users has increased from a few to hundreds The number of potential users affected by the grid technology in the new communities is currently evaluated in the order of several thousands (see DNA4.4 for details)

Enabling Grids for E-sciencE INFSO-RI Technical Overview 14 Policy-related activities : –Coordinated support to the e-Infrastructures Reflection Group (e-IRG) defining grid policies across Europe and beyond –During 1Q 2006 started working on sustainability aspects International cooperation activities: –“Concertation” with other EU projects –Reinforced cooperation with other geographical areas (in middleware, operations, training and dissemination) –Coordinating an inventory of EGEE contributions to standardisation efforts –Contributed to participation to major conferences and workshops NA5: Policy and International Cooperation

Enabling Grids for E-sciencE INFSO-RI Technical Overview 15 JRA1 Middleware Reengineering and Integration Provides a comprehensive middleware stack Developed according to a well defined process Tested, Documented, with installation and release notes Many releases with increasing functionality Components have been gradually deployed on the production infrastructure and have been used for applications challenges

Enabling Grids for E-sciencE INFSO-RI Technical Overview 16 JRA1 Middleware Reengineering and Integration gLite 3.0 represents an important milestone –Currently being deployed on the production infrastructure The experience of the Integration Team lead to the creation of the new ETICS project –gLite 3.0 uses a prototype of the ETICS build system Important role of the Design Team in the definition of the functionalities –With significant contributions by the Globus and Condor teams Development is continuing to provide increased robustness, usability and functionality LCG-2 prototyping product product gLite 2006 gLite 3.0

Enabling Grids for E-sciencE INFSO-RI Technical Overview 17 JRA2 Quality Assurance The QA approach adopted by the project in merging academic and industrial best practices has proven successful to the project and ensured its processes, services and deliverables are of high- quality QA is active across all activities –Set of procedures –Automated tools –Metrics programme periodically refined The project has exceeded the targets set for the first 2 year phase A metrics programme has been initialised to measure the performance of each partner through the project activities and their contribution to the programme of work

Enabling Grids for E-sciencE INFSO-RI Technical Overview 18 JRA3 Security Middleware security in place –Security Architecture in place, with a first revision and overall security assessment up to date –Security modules for gLite 3.0, as part of JRA1 effort. –Coordination with other Grid initiatives ensured - through the EGEE/OSG Middleware Security Group, extended to other projects s.a. NAREGI, DILIGENT, GRIDCC, DEISA, SEEGRID –Contributing part of the emerging standards - leading the GGF Security Operational security documents in place –Foundamental policy and operational security documents in place, together with SA1 Security –Coordination with other Grid initiatives ensured - through the EGEE/OSG Joint Security Policy Group (lead by SA1) International Grid Trust Federation in place –EUGridPMA work –Contributing part in the launch of IGTF –First year chair of the IGTF

Enabling Grids for E-sciencE INFSO-RI Technical Overview 19 JRA4 Network Services Development Forged unique working relationship with GÉANT2 through both BAR and NPM –Relationship continues with fixed monthly meetings during EGEE-II to set common course Using standard interfaces (NM-WG), we demonstrated the world’s first single-point access to heterogeneous NPM data Performed the world’s first inter-domain, software-based, BAR requests Published, pioneering work, adopting and contributing to GGF standards –Gridnets, RIPE, CESNET, TERENA –GGF-13, GGF-15 NM-WG demonstrations

Enabling Grids for E-sciencE INFSO-RI Technical Overview 20 SA1 Grid Support, Operation, and Management Steady growth of infrastructure and usage Improved reliability of sites (typically over 80%) Operational and support procedures in place Interoperability and interoperation with related projects world-wide sites CPU

Enabling Grids for E-sciencE INFSO-RI Technical Overview 21 SA2 Network Resource Provision Creation of the EGEE Network Operations Centre: –Act as an end-to-end NOC, –Operation interface for the NRENs, –Network support unit for EGEE, –LCG will partially delegate its networks operations to the ENOC. Network SLAs for the EGEE infrastructure: –Creation process inline with BAR and GÉANT2, –Creation and Follow-up done by the ENOC. Network Operational Database: –An operational tool for many of the ENOC tasks: SLAs creation, troubleshooting, assessment of the impact of network incident on the EGEE infrastructure, –Schema to give a logical view of the network in terms of interconnection of administrative domains.

Enabling Grids for E-sciencE INFSO-RI Technical Overview 22 Summary EGEE is the largest multi-disciplinary Grid infrastructure of the world supporting more than 60 VOs from 9 domains – many of them in production mode Improvements needed: –reliability, fault-tolerance, deployability, usability EGEE is working towards a sustainable world-wide Grid infrastructure through international collaborations, standardization, and industry