The perfSONAR Test Harness Brian Tierney, LBNL/ESnet

Goals Provide an easy framework to test client requests for expected results Work with any perfSONAR service Perform performance testing –from a ‘user perspective’ Non-goals: –schema validation –unit tests

Current Status Part of the perfSONAR-PS svn repository under “test_harness” –See README.txt file for instructions on how to use Uses simple perl client (client.pl) to make the request Uses XML config file to specify requests / expected results –Example: SetupDataRequest/SetupDataRequest_1.xml Test simple data query datum Tested with the following services so far: –Perl: snmpMA, LS, perfSONARBOUY, TS –Java: MeasurementArchiveService includes script to generate fake data for test snmpMA option to generate ‘cvs’ file of performance results –makes it easy to analyze results in excel, etc

Performance Results Notes: –test 1: get all interfaces (1000 interfaces) –tests 2-17: metadata request –tests 18-29: data request ( results returned)

Future work Test with additional services –pingER-MA, etc More testing for error conditions Additional support for ‘fake’ services

More Test Details Results are an average of 3 runs Client at LBL Servers both on same host at Internet2: – 3.0rc4/services/MeasurementArchiveService – Performance Observations –Java and Perl implementations perform basically the same except for ‘get all interfaces’ request, which is 10X slower using the Java MA –Should seriously consider a non-XML solution for returning large amounts of data 3.5 seconds is far to slow to return only 18K data points