RANJAN BHAMBROO Experimental Investigation of Effectiveness of Logical Expressions Using t-way Testing

Introduction Experimental Evaluation of logical expressions. Same idea but continued on new path. T – way testing instead of pair-wise testing. New tool for generating logical expressions. New tool from NIST to construct t-way test sets.

T-way Testing T-way Pair – wise = 2-way T-way where t=2,3,4,5,6. T- way more effective than pairwise. But test cases not enough need more test cases.

T-way Testing Example: For 15 variables total number of combinations = = combinations T-way valuesTest Cases 2-way10 3-way24 4-way58 5-way131 6-way296

Tools Used Boolean Expression Generator – ECU( Developed by Ranjan Bhambroo) Advanced Combinatorial Testing System(ACTS) for constructing t-way combinatorial test sets – NIST Fault Evaluator – ECU

Boolean Expression Generator(New Tool) Generates Logical Expressions Automatically. Simple and user friendly interface. Different Modes to generate Expressions: a)Random Number of variables. b)Fixed Number of variables. c)Interval of variables Can Control complexity of expressions. Allows user to save expressions in a text file.

Experimental Results Of T-way Testing Fault Evaluator Boolean Expression Generator Advanced Combinatorial Testing System Logical Expressions T-way Test Sets Effectiveness

Experimental Results Of T-way Testing Note Using Pair Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set Set Set Set Set Average Std. Deviation

Experimental Results Of T-way Testing Note Using 3-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set Set Set Set Set Average Std. Deviation

Experimental Results Of T-way Testing Note Using 4-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set Set Set Set Set Average Std. Deviation

Experimental Results Of T-way Testing Note Using 5-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set Set Set Set Set Average Std. Deviation

Experimental Results Of T-way Testing Note Using 6-Wise Test Cases 10 expressions/setVNFORFVRF(ENF)ASF All Fault Types (weighted avg.) Set Set Set Set Set Average Std. Deviation

Experimental Results Of T-way Testing 2-way 3-way

Experimental Results Of T-way Testing 4-way 5-way

Experimental Results Of T-way Testing

THANK YOU