EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Bob Jones EGEE project director
Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE - Bob Jones - OGF25/User Forum March 2009 ~280 sites 45 countries >80,000 CPUs >20 PetaBytes >14,000 users >250,000 jobs/day Quality: –Monitoring via Nagios - distributed via official releases, configured through YAIM, integrated with other tools –Gradual implementation of Service Level Agreement with sites –Result: 85% of sites are now above the 75% availability threshold Geographical expansion: –now have production sites all across Asia: Australia, China, India, Japan, Korea, Malaysia, Pakistan, Taiwan, Thailand In certification: Indonesia, Philippines, Vietnam
Enabling Grids for E-sciencE EGEE-III INFSO-RI Production & Volunteer grids EGEE - Bob Jones - OGF25/User Forum March
Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE - Bob Jones - OGF25/User Forum March Grids and Cloud Computing EGEE report “An EGEE Comparative study: Grids and Clouds- evolution or revolution?” –Compare real implementations and production offerings EGEE/gLite grid production service Amazon Web Services, with focus on EC2 and S3 –Presented at OGF23 (Barcelona, June’08) and covered in the press Outcome: –Identified convergence paths and –Recommendations for managing convergence going forward Future: –Investigate the possibility of gateways between EGEE and commercial cloud systems to offer a migration path for under-resourced applications (no national support or mature commercial applications)
Enabling Grids for E-sciencE EGEE-III INFSO-RI Extendable Infrastructure EGEE - Bob Jones - OGF25/User Forum March
Enabling Grids for E-sciencE EGEE-III INFSO-RI Where would clouds come in? EGEE - Bob Jones - OGF25/User Forum March Majority of EGEE’s CPUs are at the sites The interaction with site resources is ‘simple’ In: Authorization, Compute & Storage Out: Monitoring & Accounting Additional Site Requirements VO specific site services VO specific applications deployed to the worker nodes Provide classical ‘cloud’ scale out capability Potentially, with VO specific worker nodes
Enabling Grids for E-sciencE EGEE-III INFSO-RI Who are you…? Representing 22 Registered Collaborating Projects EGEE - Bob Jones - OGF25/User Forum March
Enabling Grids for E-sciencE EGEE-III INFSO-RI More than 100 projects present EGEE - Bob Jones - OGF25/User Forum March
Enabling Grids for E-sciencE EGEE-III INFSO-RI A multi-disciplinary event EGEE - Bob Jones - OGF25/User Forum March
Enabling Grids for E-sciencE EGEE-III INFSO-RI Applications database Provide details about your application to publicize your work and to allow others interested in your application to contact you –61 registered applications so far –Joint initiative between EGEE and SEE-GRID-SCI – & EGEE - Bob Jones - OGF25/User Forum March Readiness status: 7 HandledByRS 6 In production 5 Ready for deployment 4 Ready for validation 3 Ready for portal interface 2 Ready for gLite middlewaregLite middleware 1 Ready for standalone use / running in a local cluster
Enabling Grids for E-sciencE EGEE-III INFSO-RI Grid Application Support Centre The Grid Application Support Centre (GASuC) provides assistance to current and future grid users and application developers during the application gridification process –GASuC helps identify and apply best patterns, practices, tools and infrastructures in order to get your code running on production grids as soon as possible Success stories –Particle and Nuclear Physics –E-Business & Logistics –Earth Science –Computational chemistry –Computational evolution –Physical modelling –+ 9 more on-going EGEE - Bob Jones - OGF25/User Forum March Numerical Modelling of Mantle Convection application Theoretical modelling of thermal convection using Fortran programs in 3D
Enabling Grids for E-sciencE EGEE-III INFSO-RI High-level Grid Services Recommended External Software for EGEE CommuniTies) - grid software and services that works with the EGEE gLite software: –Expand the functionality of the grid infrastructure for users, –Reduce duplicated development when porting applications, and –Speed the porting of new application to the grid Currently includes: –P-GRADE: The Parallel Grid Run-time and Application Development Environment Portal –GANGA: frontend for job definition and management, implemented in Python –DIANE: framework for parallel scientific applications in master-worker model –i2glogin: enables interactive communication between a grid job and the user –GRelC Data Access Service for RDBMS and XML DB engines –Instrument Element: WS-I compliant abstraction of an instruments/sensors –Virtual Control Room: grid portal based on GridSphere and Web 2.0 technologiesGridSphere –Migrating Desktop user-friendly access to services covering the whole application lifecycle from job defining, launching, monitoring until visualization of job results –g-Eclipse provides a user-friendly, easy-to-learn, and reliable client for gLite and other grid middlewares EGEE - Bob Jones - OGF25/User Forum March
Be seen on GridGuide: 13
EGEE - Bob Jones - OGF25/User Forum March 2009 Follow us online Read the conference blog at Follow EGEE on Twitter at if you are tweeting from the conference, tag your tweets #egeeuf09 Flickr tag egeeuf09 ( 14
Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE-III status & plans - Bob Jones – CB - 3 March EGEE→EGI transition planning
Enabling Grids for E-sciencE EGEE-III INFSO-RI EGEE-III status & plans - Bob Jones – CB - 3 March EGEE→EGI transition planning Transition plan produced in Dec’08 This plan (DNA1.4) details the steps needed to migrate EGEE’s operation to EGI, identified major risks and open issues with input from 19 collaborating projects. Used as input for the final version of the EGI Blueprint endorsed by national representatives in Prague in Jan’09
Enabling Grids for E-sciencE EGEE-III INFSO-RI Key objectives for this event Advance standards for production grid infrastructures –26 OGF working groups have scheduled meetings 11 with key input from EGEE 3 area directors, 10 (co-chairs) All EGEE members are linked to at least one user community –Bring the users needs to the standards table Learn from each other –Cross-fertilisation between communities/VOs/applications Take European grids to the next level –Advance with the planning of EGI and the transition from current projects EGEE - Bob Jones - OGF25/User Forum March Take time to enjoy each others company and beautiful Sicily