1. Test Harness & Website Mike Phenow Trilinos User Group Meeting November 4 th, 2004 - 9:30 am

2. Contents Test harness –Overview –Design –Nightly –Local –Future Website –Trilinos –Developer –Package Questions

3. Test Harness - Overview Test Harness ~ Overview Current test-harness.plx grew out of Jim Willenbring’s test- harness, which evolved from his earlier trilinos-check, which is based on Paul Lin's salsa-check, which was adapted from Gary Hennigan's Salsa-Check.sh Provides a standard framework for running tests (particularly for developers) Enables reasonable automation http://software.sandia.gov/trilinos/developer/test_harness.html Trilinos/testharness/README % perl test-harness.plx -h

4. Test Harness - Overview Test Harness ~ Overview Most important flags: - Currently provides no testing functionality - For successfully built packages, will run any executable test scripts in: Trilinos/packages/PACKAGE/tests/scripts/(dai ly|weekly)/(mpi|serial)/ -f FILE run with given config file -g FILE generate a default config file named FILE -h print help

5. Test Harness - Design Test Harness ~ Design configure invoke-configure build test report starttest harness config invoke-configure element fix create

6. Test Harness - Design Test Harness ~ Design dependencies: amesos = \ --enable-amesos \ --with-ml_amesos anasazi = \ --enable-anasazi \ --with-loca-anasazi aztecoo = \ --enable-aztecoo \ --enable-komplex \ --enable-ml_aztecoo \... potentially-broken package configure options to be removed, if broken

7. Anatomy of an invoke-configure: Test Harness - Design Test Harness ~ Design elements-machine/MACHINE_CONFIG_FILE + elements-trilinos/TRILINOS_CONFIG_FILE Trilinos/SERIAL_DIR/invoke-configure elements-machine/MACHINE_CONFIG_FILE elements-machine/MACHINE_MPI_CONFIG_FILE + elements-trilinos/TRILINOS_CONFIG_FILE Trilinos/MPI_DIR/invoke-configure

8. Most important config-file options –MACHINE_CONFIG_FILE –MACHINE_MPI_CONFIG_FILE –TRILINOS_CONFIG_FILE –REPORT_METHOD SEND_TO_DEFAULTS –SERIAL_DIR –MPI_DIR HOST_FILE MPI_STARTUP_CMD MPI_SHUTDOWN_CMD MPIGO_CMD Test Harness - Design Test Harness ~ Design

9. Test Harness - Nightly Test Harness ~ Nightly Platforms: –Linux: herouxsmp.cs.csbsju.edu –Linux: software.sandia.gov –SunOS: paunchy.sandia.gov –Dec/OSF1: stratus.sandia.gov Changing configure options: –Trilinos/test-harness/elements-trilinos/ –Trilinos/test-harness/elements-machine/ –e.g. osf-stratus

10. Test Harness - Local Test Harness ~ Local http://software.sandia.gov/trilinos/developer/test_harness.html create elements-machine/MY_MACHINE create elements-machine/MY_MACHINE_MPI create elements-trilinos/MY_OPTIONS perl test-harness.plx –g config/MY_CONFIG edit config/MY_CONFIG perl test-harness.plx –p config/MY_CONFIG perl test-harness.plx –f config/MY_CONFIG

11. Test Harness - Future Test Harness ~ Future test machine database test machine Major PlatformsDeveloper Machines results queriesresults browser developer queriesresults

12. Website - Trilinos Website ~ Trilinos http://software.sandia.gov/trilinos First stop for many users Central location for information Needs to be continually re-evaluated

13. Website - Developer Website ~ Developer http://software.sandia.gov/trilinos/developer Source for developer information and tools Potential for more knowledge-sharing

14. Website - Package Website ~ Package http://software.sandia.gov/trilinos/packages Natural place for posting critical information for users Doxygen documentation: –Trilinos/packages/PACKAGE/DoxyfileWeb –(Trilinos/packages/common) –http://software.sandia.gov/trilinos/developer/doxygen.htmlhttp://software.sandia.gov/trilinos/developer/doxygen.html Package pages: –TrilinosWeb/packages/PACKAGE/

15. Questions Test Harness & Website