1. The perfSONAR Test Harness Brian Tierney, LBNL/ESnet

2. Goals Provide an easy framework to test client requests for expected results Work with any perfSONAR service Perform performance testing –from a ‘user perspective’ Non-goals: –schema validation –unit tests

3. Current Status Part of the perfSONAR-PS svn repository under “test_harness” –See README.txt file for instructions on how to use Uses simple perl client (client.pl) to make the request Uses XML config file to specify requests / expected results –Example: SetupDataRequest/SetupDataRequest_1.xml Test simple data query datum Tested with the following services so far: –Perl: snmpMA, LS, perfSONARBOUY, TS –Java: MeasurementArchiveService includes script to generate fake data for test snmpMA option to generate ‘cvs’ file of performance results –makes it easy to analyze results in excel, etc

4. Performance Results Notes: –test 1: get all interfaces (1000 interfaces) –tests 2-17: metadata request –tests 18-29: data request (8000-17000 results returned)

5. Future work Test with additional services –pingER-MA, etc More testing for error conditions Additional support for ‘fake’ services

6. More Test Details Results are an average of 3 runs Client at LBL Servers both on same host at Internet2: –http://dc211.internet2.edu:8082/geant2_java-rrd-max86_32- 3.0rc4/services/MeasurementArchiveService –http://dc211.internet2.edu:8083/perfSONAR_PS/services/snmpMA Performance Observations –Java and Perl implementations perform basically the same except for ‘get all interfaces’ request, which is 10X slower using the Java MA –Should seriously consider a non-XML solution for returning large amounts of data 3.5 seconds is far to slow to return only 18K data points