Testing Smart Report Template By: Kashif Masud

Topics Smart Report Template overview Testing techniques used and why Number of test cases generated Effort (in hours) of execution Number of defects found Analysis of defects Follow-up actions

What is Smart Report? The Smart Report Template is an interactive application used to perform trades by Specialists in the New York Stock Exchange in order to maintain a fair, balanced and orderly trading market. The Smart Report Template facilitates the Specialist’s decision-making by performing calculations, displaying market data, processing input and verifying data based on business rules. It makes the trading process more efficient and reduces the risk for errors.

What does Smart Report Template look like? How do we test such an application?

Let’s use heuristic analysis The Smart Report Template is an interactive application used to perform trades by Specialists in the New York Stock Exchange in order to maintain a fair, balanced and orderly trading market. The Smart Report Template facilitates the Specialist’s decision-making by performing calculations, displaying market data, processing input and verifying data based on business rules. It makes the trading process more efficient and reduces the risk for errors. What does all this imply?

Interactive  Interaction between application and user Application provides data User provides some input Application performs calculations Application performs actions Perform Calculations  Boundary testing; DFT Display Market Data  GUI testing / List-based testing Process Input  Partition testing; Boundary testing Verify Data  GUI testing; DFT  Control Flow Testing

Control Flow Graph for Smart Report We want to: 1. Test each state 2. Test each transition 3. Test each path List-based testing Partition-based testing Let’s zoom in on this area

= Input Fields = Calculated Fields  Partition-based testing, Boundary testing  Boundary testing, Data flow testing How do we test all these fields? Answer: -Verify that values selected from set of valid/invalid values correctly handled -Verify field capacities by inputting extreme field values -Verify field capacities by pushing calculated field values to extremes -Verify fields correctly calculated based on data dependencies; use data-dependency graphs (DDG)

Example: DDG for ‘Book Buyer Row’ field

Control Flow Graph for Smart Report We want to: 1. Test each state 2. Test each transition 3. Test each path List-based testing; DFT GUI testing List-based testing; Partition testing Partition-based testing

Total # TCs = 168 Test Case Distribution (Defects = 4) (Defects = 2) Total # Defects = 8 Effort: 16 hours of execution

Defect Analysis – What, Where and When? Most defects are in calculation area

Possible Reasons for Defects: Lack of business knowledge Misunderstanding of requirements Coding standards not being followed Oversight Follow-up Actions: Perform detailed causal analysis Provide analysis results to management Create plan-of-action based on management feedback

Thank You!