1. Continuous Performance Engineering
Anukampa Pattnaik
Senior Manager Quality Engineering
Manhattan Associates
Prasad Borole
Quality Engineer

2. Abstract
Ad In Today’s rapid application development World , performance of the application has been a key factor as part of user expectation. Performance Bottlenecks can have negative impact on the business. As we are moving towards Agile world , it is important that Performance testing is conducted at the early stage of development in an automated, integrated, continuous way.Continuous Performance engineering test strategy helps to build production ready software which is always up to the performance benchmarks set.
This presentation provides insight as to how Continuous Performance Engineering was achieved

3. Overview
Continuous Performance Engineering Continuous Delivery is a software engineering approach where teams keep producing valuable software in short cycles to ensure that the software can be reliably released any time. To achieve this reliability, testing techniques such as automated testing and continuous integration (CI) allow software to be developed to high standards that can be easily packaged and deployed to test environments, thus resulting in a rapid, reliable, and repeatable push out enhancements along with bug fixes for customers at low risk with minimal manual overhead.

4. Authentication Server
Performance Test Process
Test Environment Architecture :
Load Generator 1 VM
Core : 8
RAM : 16GB
Load Generator 2 VM
Core : 8
RAM : 16GB
F5 Load Balancer
Authentication Server
APP 1 VM
Core : 16
RAM : 32GB
APP 2 VM
Core : 16
RAM : 32GB
APP 3 VM
Core : 8
RAM : 16GB
1. Load Generator is where jmeter runs VM
Core : 8
RAM : 24 GB
JMS
DB Box
CPU : 16
RAM : 48GB

5. Performance Test Process
Deployment Architecture :
Start
End user receives notification for any failure
Shutdown all Apps
Send of the Report
Run Reporting Birt Tool
Restore Gold DB Dump
END USER
Upgrade DB to Latest Build
Run Seed Script
Pull and Deploy latest App Binaries
And start application
Launch Jmeter server & trigger the scripts

6. Application Under Test
Performance Test Process
Test Run Architecture :
Load Generators
Application Under Test
App Server
Load Agent 1
Concurrent Users
DB Server
Load Agent 2
Metrics Collector
UI Report for End User view
Monitoring Tools
Persist in MySQL DB
AWR DB Report

7. Tools
Jmeter :
Apache Jmeter is pure Java open source software use to analyze and Measure performance
of the application. Jmeter can simulate multiple users with concurrent threads, create a heavy
load against application under Test.
MySQL :
MySQL is Open Source Relational SQL Database Management System and works well
with large data sets.
DynaTrace :
DynaTrace provides deepest, most accurate, granular tracing of every single transaction. It is used
to analyze application performance throughout your application’s full stack, down to each
individual transaction across all layers and technologies.
Nmon analyzer :
An Excel spreadsheet that takes an output file from nmon and produces some
nice graphs to aid in analysis and report writing.

8. Tools Birt (Business Intelligence and Reporting Tool) :
Birt is flexible, open source, and 100% pure Java reporting tool for building and
publishing reports against data sources ranging from typical business relational
databases
UI Snap of the Birt Tool Dashboard

9. Typical Business Day Data Flow
Ongoing Process throughout the Run
After Waiting for X amount of Time
Create Transactional Data required for subsequent Modules
N number of users trigger UI operations
Filter Data
View Data
N numbers users starts performing action on the Transactional Data Created
Updates on the same Transactional Data keeps on coming from the system

10. Benefits Business application Confidence Effort Saving
Cost Saving as most of tools are open source
Improved customer satisfaction
Better Quality
Performance Issue Identification at early stage rather than from Production

11. Take Away Start Performance Testing in early days
Simulate Business Day Scenario for early catch of issues
Try to Reduce Manual Intervention as much as possible
Select right performance Testing Tool
Have correct Performance Monitoring Tools in Place
Have right set of data flowing.

12. Bibliography

13. Author Biography
Anukampa Pattnaik works as Senior Manager at Manhattan Associates and has 15 years of Industry experience in all phases of software development life cycle. 10 years of experience in quality engineering and supply chain expertise Rich experience in Transportation, understanding business challenges of transportation and how to leverage technology platform to provide solution. Very strong product development expertise using Agile methodologies. Strong experience in Automation , Good knowledge on TestNG, Junit, Selenium,Protrator REST API & Web services automation. Expertise in Performance engineering using Jmeter. Actively contributing to external forums by presenting white papers and formal presentation
Prasad Borole works as Quality Engineer at Manhattan Associates and has 3+ years of experience in Transportation Life cycle Management product at Manhattan associates . Expertise in Development of Framework on Jmeter and profiling tools - Nmon , Dynatrace , AWR. Strong Experience in automation using Groovy. Good knowledge on Selenium.