1. TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007

2. October 2007OGF212 Software Build Final step of middleware build Deployment Administrator performs at least 1 manual functional tests Pre-Production and Production Routine (where extensive TeraGrid testing happens) Regression (opportunity) Testing Stages/Types

3. October 2007OGF213 Inca - User-level Grid monitoring Testing and performance measurement from a generic, impartial users perspective in order to detect and fix Grid infrastructure problems before the users notice them. User-level Grid monitoring system: –Runs from a standard user account –Executes using a standard GSI credential –Uses tests that are developed and configured based on user documentation –Verifies user-accessible Grid access points

4. October 2007OGF214 Inca Architecture

5. October 2007OGF215 Collecting Monitoring Data Reporters –Executable program that measures some aspect of the system or installed software –Requirements: Supports specific command-line options Writes XML (Inca Reporter schema) to stdout –Supports multiple types of data –Extensive library support for perl scripts –Most reporters < 30 lines of code –Independent of other Inca components

6. October 2007OGF216 Sharing Reporters Repositories: collection of reporters available via a URL –Supports package dependencies (Perl modules, Makefile, autoconf) Packages versioned to allow for automatic updates Inca repository contains 157 reporters Version, unit test, performance benchmark reporters Grid middleware and tools, compilers, math libraries, data tools, and viz tool Screenshot of a repository using Inca GUI tool

7. October 2007OGF217 Centralized configuration and deployment Incat –GUI interface to enable a large number of monitoring results to be collected with a minimum of effort –Configure the reporters to execute on a set of resources –Configuration stored in a XML file and sent to Agent Agent –Implements the configuration specified by Inca administrator –Stages and launches a reporter manager on each resource –Sends package and configuration updates

8. October 2007OGF218 Storing data Depot –Stores configuration information and monitoring results –Uses relational database backend via Hibernate –Provides full archiving of reporter output –Supports SQL queries and provides predefined queries for latest monitoring results, report instance, and report history –Supports notifications

9. October 2007OGF219 Displaying and publishing data Data Consumer –Web application that queries and displays monitoring data –Packaged with Jetty –JSP tags to query data and format using XSL Web services –Query data from depot and return as XML

10. October 2007OGF2110 Inca in Use: TeraGrid Currently monitoring all 18 allocated TeraGrid resources –Monitoring of CTSSv4 (in progress) –Grid jobs (Globus gatekeeper logs) –CA certificate and CRL checking (notify if 2 weeks from expiration) –Resource registration in MDS

11. October 2007OGF2111 Summary status status view

12. October 2007OGF2112 Historical data

13. October 2007OGF2113 Inca in use: Grid Assessment Probes Set of probes designed to emulate Grid applications Deployed using Inca to GEON and TeraGrid

14. October 2007OGF2114 Clients Information Services Cache WS/REST HTTP GET WS/SOAP WS MDS4 Tomcat WebMDS Apache 2.0 TeraGrid Wide Services TeraGrid Repositories WS/SOAP WS MDS4 Resource Provider Services

15. Resources and Available Kits

16. October 2007OGF2116 Information Services and Inca REST SOAP TeraGrid Capability Kit transition from Development --> Testing, Production Triggers Inca Testing

17. October 2007OGF2117 Extended regression testing Comprehensive functionality suite Scalability/load testing Multi-service grid interaction testing (TeraGrid does some already) (Reliability and failure testing) Tooling Inca, or Metronome, or Metronome mediated Inca? Sharing Multi-institution testing repositories Contributions from software providers, integrators, and users Testing Opportunities

18. October 2007OGF2118 Website: http://inca.sdsc.edu http://inca.sdsc.edu Announcements: inca-users@sdsc.edu inca-users@sdsc.edu Email: inca@sdsc.edu inca@sdsc.edu Supported by: More Inca Information