1. Agility with Component Based Test Design
Anand Arumilli, Group Manager
Akash Gupta, Senior QA Engineer
Satya Surya Naga Prasad Chilukuri, Project Lead
Oracle India Pvt Ltd
Logo of your organiatin

2. Abstract
Software systems have been constantly growing in complexity. The software development processes have been consistently evolving towards the goal of more agility and shorter release cycles.
In light of these developments; handling complexity with ease, nimbleness in accommodating the changes to test inventory, improved turnaround time for automation of Regression cases and improvement in productivity of human resources and be able to make quality releases in short time spans becomes paramount.
In this paper, a design approach to create and organize test templates, and a process to build test inventory using test templates to achieve the above mentioned objectives will be discussed.

3. References & Appendix Agile Testing The Art of Software Testing
Book by Lisa Crispen & Janet Gregory
The Art of Software Testing
Book by Glenford Myers
HP ALM User Guide

4. Agenda The Tester’s Predicament
The Panacea- Component based Test Design
How did it help in Test Inventory Management

5. The Tester’s Predicament
…in an AGILE world
Rapidly changing system
Test authoring cycle time
Impact analysis paralysis
Tedious documentation of tests
Automation not in synch

6. Building Blocks
L0 (Flows) High level lightweight test cases for any incoming new feature
Example: Verify learner is able to enroll into a course. (L3/L2 not used)
L2 (Transactions ) A transactional flow which has calls to L3/L2.
Example: Creating a Course.
L3 (Actions) An atomic entity which performs a set of actions.
Example: searching a course, clicking a menu/button.
L1 (Tests) An executable test which has an objective to validate a workflow. An L1 makes calls to L2s and L3s. It ingests data and has data specific assertions.
Example: Admin creates a course (L2). Learner searches for this course (L3) and enrolls (L2). Verify the assignment status.
Note: Examples from Learning management app

8. The FITSAA Way
Frame
Identify
Templatize
Structure
Automate
Adapt

9. Frame Review Functional design Design L0s Review L0s
Generated Artifact
L0 (Flows) High level lightweight test cases for any incoming new feature
Example: Verify learner is able to enroll into a course. (L3/L2 not used)

10. Frame
Generated Artifact Example (L0s)

11. Identify Identify which L0s get promoted to L1s Review Artifact
L1 candidate list - These are high level lightweight test cases identified for L1 design.

12. Identify

13. Templatize Review the scope for reusability Identify L2/L3s
Design the Templatized tests
Tooling
ALM - Use the inbuilt templates feature in ALM
Artifact
L2 (Transactions) - A transactional flow which has calls to L3/L2. Example: Creating a Course.
L3 (Actions) - An atomic entity which performs a set of actions. Example: searching a course, clicking a menu/button.

14. Templatize
Tooling
Use the inbuilt templates feature in ALM

15. Structure Design L1s Review Artifact
L1 (Tests) An executable test which has an objective to validate a workflow. An L1 makes calls to L2s and L3s. It ingests data and has data specific assertions.
Example: Admin creates a course (L2). Learner searches for this course (L3) and enrolls (L2). Verify the assignment status.

16. Structure

17. Automate Develop L2/L3 automated scripts Develop L1 automated scripts
Prerequisite: The automation is built on a function based approach that mimics the components used in the manual inventory.
Develop L2/L3 automated scripts
Develop L1 automated scripts
Artifact
L1/L2/L3 automated scripts

18. Automation Flow Excel Input Actions Input Data Test (L1)
Interprets Action
Invokes L2/L3 with Data
Components (L2/L3)
Runs atomic OATS actions
Navigation
Set Text
Click
Returns Data (if any)
Artifact
L1/L2/L3 automated scripts

19. Adapt Analyze impact on L3/L2/L1 Update/Develop L3/L2/L1
Prerequisite: L1 inventory
Analyze impact on L3/L2/L1
Update/Develop L3/L2/L1
Artifact
Updated/New L3/L2/L1s

20. Adapt

21. Results Achieved Reusable test steps Reduced redundancy
Quick Impact Analysis
Quick Automation Turn Around
Quick Estimation
Faster Test Case Authoring
Maintainability of Test Inventory

22. Field Study L2 & L3 Calls In L1`s L1 Scenario`s
Count of Call in L1`s (Includes L2 & L3)
LRN_CU_035_S001_Setup for Specialist Communities 23
LRN_CU_049_S005_Verify duplicate community membership 20
LRN_TL_003_S001_Uploading various types of content 24
LRN_TL_003_S002_Create course with all attributes
220
LRN_TL_003_S003_Create and View Secret and Closed Courses 44
LRN_TL_003_S004_Create Specialization with Outcomes and Required Assignment 30
LRN_TL_003_S005_Create and View Secret and Closed Specializations 34
LRN_TL_006_S001_SETUP_Offering without Evaluation 50
LRN_TL_006_S003_SETUP_Offering with Mandatory Evaluation 53
LRN_TL_006_S005_SETUP_Specialization 48
LRN_TL_006_S007_Spec_Manage Learners 31
LRN_TL_040_S001_SETUP Create Course and Self Paced online Offering 46
LRN_TL_051_S001_set up cases for assignment
LRN_TL_CA_071_001_Setup Course and Offerings 22
LRN_TL_FLX_001_Flex Field setup for Learning Items

23. Field Study Metric Definition Without FITSAA With FITSAA
Time Saving With FITSAA
Test authoring (90 Complex Test Cases)
~90 Hrs
~50 Hrs
~40%
Impact analysis and Incorporating changes
~40 Hrs
~10 hrs
~75%
Automation turnaround time
~130 Hrs
~ 70 hrs
~45%

24. How did it help ~40 % Time Saved Rapidly changing system
Quick adaptability using L1/L2/L3
~40 % Time Saved
Rapidly changing system
Test authoring cycle time
Impact analysis paralysis
Tedious documentation of tests
Automation not in synch
~75% Time Saved
~430 reusable components
~45% Time Saved

25. Author’s Biography Author: Anand Arumilli
Anand is a QA Group Manager in Oracle India. He has an avid interest in Test Design and Optimization Techniques in Testing.. He has 14 years of experience in QA and a strong development background of 2 years. Anand is a test enthusiast and has been an active participant in the various QA Forums in India and abroad- EXPOQA (Spain), Software Testing Conference (QAI), Step-IN Forum Hyderabad Chapter. His paper on Test Design won the QAI Testing Leadership award in 2011.
Co-Author: Akash Gupta
Akash has 5 years of experience in Quality Assurance. He has done B Tech in Electrical Engineering from IIT (BHU), Varanasi. He has an avid interest in quality process and automation.
Co-Author: Satya Chilukuri
Satya has 9+ years of experience in Quality Assurance. He is M Tech from NIT – Trichy. His past experience as a Tester/Test Lead in Capgemini for 5+ years and Senior Member Technical in Broadridge for 2+ Years. He is an innovator in test design.

26. Logo of your organization
Thank You!!!
Logo of your organization