The Scaling and Validation Programme PoC David Groep & vle-pfour-team VL-e Workshop NIKHEF SARA LogicaCMG IBM

PoC ToC What is the Scaling and Validation Program? Activities in the S&V programme Environments & infrastructure  Rapid Prototyping environment  Certification test bed  PoC: stable systems Need Help?

Positioning of the PoC in VL-E Grid Middleware Surf net Network Service (lambda networking) Application specific service Application Potential Generic service & Virtual Lab. services Grid & Network Services Virtual Laboratory VL-e Experimental Environment VL-e Proof of concept Environment Telescience Medical Application Bio ASP Virtual Lab. rapid prototyping (interactive simulation) Additional Grid Services (OGSA services)

Scaling & Validation (S&V) Aims Build environments for experimentation  different scales, with a variety of resources  stable quasi-production Proof-of-Concept (PoC) Support applications  stable, but also extend (and improve) continuously  deploy VL software and components from elsewhere Disseminate knowledge about them  tutorials, events, helpdesk Learn ourselves from the deployment  close the cycle, improve with developers and users  S&V needs applications for a realistic workload

Three activity tracks Software engineering: a timeline  Rapid Prototyping o basic research & evaluating innovative ideas   Certification o quality control and engineering process: Ronald S o testing: Chris Schotanus  PoC o stable environment for application development o common base for incremental development o Deploying a national-scale infrastructure Dissemination and knowledge import

Implementation the process Application development NL-Grid production cluster Central mass-storage facilities + SURFnet Initial compute platform Stable, reliable, tested Cert. releases Grid MW & VL- software VL-e Proof of Concept Environment VL-e Rapid Prototyping Environment DAS-2, local resources VL-e Certification Environment NL-Grid Fabric Research Cluster Test & Cert. Grid MW & VL-software Compatibility Flexible, test environment Environments Usage Characteristics Virtual Lab. rapid prototyping (interactive simulation) Flexible, ‘unstable’ Download Repository PoC Installer Cluster Tools Developer CVS Nightly builds Unit tests stable, tested releases Integration tests Functionality tests Adventurous application people PoC Release nRelease Candidate n+1 Developers environment Tagged Release Candidates Rapid Prototyping Environment

Rapid Prototyping Environment Central services: DAS-2 distributed clusters  VU, UvA, Leiden, TUDelft, Utrecht Specific services  database servers (Oracle, Matisse) integrated in UvA DAS-2 cluster ~1.3 TByte storage available.  core VL services on dedicated nodes Local systems  Your own workstations, test clusters &c.

Certification test bed Smallish setup to validate new releases  core: ~10 node dual-CPU cluster  some test disk space (as needed)  extensible with many more systems Characteristics  highly flexible  but managed the same as the ‘real thing’  same network/typology constraints  validate release n+1 of the PoC s/w suite

P4CTB configuration via Quattor Managed software  know exactly what is installed where  central configuration control (via Quattor)  higher availability re-assign nodes on demand to stand in for failures & capacity problems  flexible environment can run older versions on-demand reinstalls in ~15 min including grid software & configuration! Same system is used for real PoC

PoC: Resources and systems Central resource sites today  SARA: NCF NL-Grid Matrix cluster  SARA: Storage (Teras), SRB Matrix  NIKHEF: NDPF LCG2PROD + NCF GFRC  IBM: in preparation User Help Needed? SARA can get you up-and-running. Access node install via PoC Installer  ‘keep pressing enter and you get there…’ Supported OS’s  RedHat Enterprise 3 + clones (CentOS, SL) (legacy support: RedHat 7.3) Subject to change coordinated and managed with fixed cut-ff dates (timeboxed)

Dissemination & Support Core Grid and GT2 tutorials Hands-on web services event: Grid Admin Nerd Group (GANG) mmv. User help-desk for the PoC  (020) and Technology pilots: Storage Resource Broker, …

Summary Infrastructure: the PoC is there for you  hardware, Grid software, DBs, VLAM-G s/w Software engineering HEAR ALL ABOUT IT IN THE NEXT TWO TALKS Support and dissemination  type of support, tools, …  we could take the PoC to your site (if you want to)  work together on common central services you need

Contacts Reach all of us at poc.vl-e.nl or via the internal web site Other contact addresses  – services, PoC, web, PoC-installer  – certification, testing, tooling, …  – SRB pilot, …  – user questions