EGEE-III INFSO-RI Enabling Grids for E-sciencE Antonio Retico CERN, Geneva 19 Jan 2009 PPS in EGEEIII: Some Points

Enabling Grids for E-sciencE EGEE-III INFSO-RI From the EGEE public web Preproduction Service: This service consists of a limited number of sites running a preview of the next release of the gLite software. This should be used to test existing applications against the new release, and to understand new gLite services.Preproduction Service ( 2 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Mandate in EGEEII The EGEE Pre-Production Service (PPS) is a distributed service whose goal is to give early access to new services to WLCG/EGEE users in order to evaluate new features and changes in the release. As a contribution to the overall quality of the gLite middleware the PPS provides –Evaluation of the deployment procedure and software in real operational conditions –Evaluation and debugging of new functionality done by the applications/VOs before they move into the production service –Feedback for early bug fix to the release before moving to production EGEE – 19th January

Enabling Grids for E-sciencE EGEE-III INFSO-RI Mandate in EGEEIII The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users, in order to test, evaluate and give feedback to changes and new features of the middleware. In addition to that, the pre-production extends the middleware certification activity, helping to evaluate deployment procedures, [inter]operability and basic functionality of the software against operational scenarios reflecting real production conditions 4 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Drivers For Change Promote Usage Optimise Work Reduce Costs 5 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI One Key Change The EGEE Pre-Production Service (PPS) is a distributed service whose goal is to give early access to new services to WLCG/EGEE users in order to evaluate new features and changes in the release. The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users in order to test, evaluate and give feedback to changes and new features of the middleware. 6 Key change: not EVERY user at EVERY time. Setup and usage conditions of previews to be agreed with users in advance EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI One Key Change The EGEE Pre-Production Service (PPS) is a distributed service whose goal is to give early access to new services to WLCG/EGEE users in order to evaluate new features and changes in the release. The EGEE Pre-Production provides access to grid services in preview to WLCG/EGEE interested users in order to test, evaluate and give feedback to changes and new features of the middleware. 7 Promote Usage  A service is set-up only when a real interest in testing is expressed by the VOs Optimise Work  The preview (or pilot) services are successful and they would be set-up anyway out of PPS Reduce Costs  No more permanent platform with all services EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Two Service Classes + Support Corresponding to the two statements in the mandate Middleware Quality Services – MQS Middleware Pilot Services – MPS PPS Support - SUP 8 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Middleware Quality Services Mission: “To test the middleware deployment tools (packaging, documentation) against scenarios relevant for production” Workload distributed among 'PPS' sites (not registered as production) Services published in pre-production IS Testing interaction with different platforms, batch and storage systems Contributing to interoperability testing Providing additional info and advice for deployment in production Dedicated monitoring infrastructure for validation "service-oriented" testing: several deployment test managers sharing the tools NOT production-like service --> pre-deployment runs on-demand with releases 9 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Middleware Preview Services 10 Mission: “To provision previews of new middleware functionality” Distribution of clients tools in preview mostly automated Instances of pilot services created on-demand Close interactions with the VOs for the definition of scope and goals of the pilots Workload distributed among partner sites in production Services published in production IS Production-like service of limited duration Pre-registration of sites to sets of tasks (PPS Partner Sites) –Silver Partners (or Silver Sites): Sites supporting the installation of non-backward- compatible client updates –Gold Partners (or Gold Sites): Sites providing support for pilots services in case of backward-compatible server updates or new services –Platinum Partners (or Platinum Sites): Sites providing support for pilots services in case of non-backward-compatible server updates Details in EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Service breakdown PPS in EGEEII General coordination (CERN) pre-dep test coordinator (LIP-SWE) pre-deployment tests (6 sites from CERN(1), CE(1), RU(1), SWE(3) A few PPS sites running basic service (decommissioning) SAM service (2 sites from CERN and CE) PPS release managers (2 sites from SWE, IT) EMT: release to production (CERN) Cream pilot service (IT, DECH, +ROCs) Pilot coordination (CERN) MQS (PPS grid) pre-deployment tests (~12 sites from all ROCs) –test coordinators per service SAM service (1 site) Release testing 11 MPS (prod grid) List of production sites available to support pilots (‘PPS partners’) Pilot Services in production … (on demand) –Pilot coordinators to be appointed PPS support PPS release management EMT: release to production (CERN) Activity management Metrics and quality Communication PPS on Sept2008 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI PPS Support Mission: “To support the work of the MPS and MQS and be the interface of PPS with the external world” MQS: –Maintain the release procedure –Set requirements for deployment scenarios coming from middleware development/certification and "global" VOs –Interface to EMT for release to production MPS –Interface with VOs, regions, sites and middleware providers to start-up pilots –Access point for PPS users Technical coordination –Activity tracking and statistics –Reporting Communication and outreach 12 EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Partners in MPS EGEE – 19th January

Enabling Grids for E-sciencE EGEE-III INFSO-RI Partners in MQS EGEE – 19th January

Enabling Grids for E-sciencE EGEE-III INFSO-RI Partners in Support EGEE – 19th January

Enabling Grids for E-sciencE EGEE-III INFSO-RI For Further Reading 16 WLCG/EGEE Pre Production: Use Cases (EGEEIII) WLCG/EGEE Pre Production: Service Description (EGEEIII) PPS task tracker All Available in the PPS web site EGEE – 19th January 2009

Enabling Grids for E-sciencE EGEE-III INFSO-RI Effort breackdown (excl.deployment testing) EGEE – 19th January