1. Rapid fire performance testing of 250 websites
Dharmit Shah (Performance Test Manager)
LTI

2. Abstract
Leading Auto spare parts supplier in US was undergoing a organizational IT upgrade and decided to take advantage of Cloud processing.
So it was decided to move a set of 250 different Static IT applications over to Cloud environment from current on-premise facilities.
The requirement was to performance test all the 250 websites, in cost effective way, which majorly contained static contents, in 6 months to have optimum time to market.
This was not possible with standard performance testing approach and hence out of the box arrangement was thought of creating custom performance testing tool. Tool created was using the MS Excel and industrial leader open-source performance testing tool - JMeter, to reduce Performance testing time.

3. Business Requirement & Challenges
Exhaustive performance testing of 250 websites in 6 months
Multiple cycles of Performance testing
Non-feasibility with normal performance testing tool cycle
Cost Effective performance testing
Extension to non-technical users
Lower maintenance efforts

4. Approach Details
Considering short duration & cost constraints, the traditional performance testing cycle/tool will not be able to achieve the required results.
Also the tool was needed to be extended to non-technical users for execution. This would provide benefits of location based testing.
Creation of Tool, which would sit on top of Industrial Leader Open source Performance testing tool – Jmeter with following features was conceptualized:

5. Benefits
Automatic & Dynamic script generation of the application under test.
Usage of Open source tool to reduce license cost.
Easy Configuration along with execution and result viewing through Excel file
Option of URLs to be configured for execution on the basis of URL Domain / specific URL.
Feature to validate all the URL Navigations before actual load test
Capturing Single user response times with all User content objects.
Storage of multiple version of single test to be stored for comparison
Error details for analyzing load test errors

6. Tool Life Cycle
Creates IE handle of the base URL and extracts all the child URLs and domains available
URLs and domain can be configured to be executed
Validates all the URLs by executing all the URLs sequentially.
The Page title of all the URLs are captured and can be used to validate the URL functionally.
User can configure the load settings like:
Number of Users
Proxy settings
Wait Time
Test Duration
Generates a Jmeter script based on User configuration
Jmeter script can be directly executed from Utility and live results can be monitored
Provide Base URL
Automated Child URLs extraction
Configure URLs to be executed
Automated Validation of each URL
Configure Load Settings
Automated Jmeter Script Generation
Execute Load Test
View Test Results
Start

7. Primary Domain Under target
Step1: Extraction
Enter the Base URL and
Primary Domain Under target
Click Extract URLs
to obtain child URLS

8. Step 2: Configure the URLs / Domain to execute
Domain containing base
domain would be
defaulted to Yes for execution.
All the Domain along with number of urls
under each domain would be listed
and can be configured
to be executed or not.
Details of all the URLs
can be located here.

9. Step2: Configure the URLs / Domain to execute
Details of All the URLs Captured.
Can be configured to Execute

10. Step 3: Execute individual URLs
Run URLs to execute all the
URLs sequentially for single user

11. Response Time of each URL
Step4: Configure Load Settings
Response Time of each URL
Title of Page Returned
If File Download URL,
then type of File

12. Step3: Validate Each URL for Single User (Optional)
Errors can be easily identified.
Before actual load tests

13. Configure Load Test Settings
Step4: Configure Load Settings
Configure Load Test Settings
Create Jmeter Script

14. Step4: Configure Load Settings
Script Generated
Script can be directly
Executed from Utility

15. Result file created for
Step4: Performance Test Results – Response time
Data can be refreshed
Live Results
Result file created for
each execution

16. Error Details during test run
Step4: Performance Test Results - Errors
Error Details during test run
Error tab created for
each execution

17. Dharmit Shah is the Performance Test Manager at LTI
Has nearly 12 years of IT experience and has extensively worked on different areas of Software Testing including performance testing, performance engineering, software test automation, test consultancy, etc.
He has authored multiple papers & participated in various conferences. Whitepaper on batch performance test & Auto Framework is listed on various sites
After Completing his Computer Engineering from Gujarat University he has worked with multiple leading IT Companies.
He loves playing cricket & watching movies.

18. References

19. Thank You!!!