Test Process Improvement Chen Xiantong (u ) Wang Jinwei (u )

COMP Chen Xiantong The need for Test Process Improvement The weak points of test: Too expensive. Resource. Cost. Time. Uncontrollable. New business needs: Shorten time-to-market. Reduced costs for resources and infrastructure. A more controllable test process.

COMP Chen Xiantong Test Process Improvement Definition: Optimizing the quality, costs and lead time of the test process, in relation to the total information services. (Koomen & Pol, 1999) Steps: 1. Determining target and area of consideration. 2. Determining current situation. 3. Determining required situation. 4. Implementing changes. (Koomen & Pol, 1999)

COMP Chen Xiantong Models Focus on whole software process: IEEE CMM(I) ISO-9000 Focus on test process: TMM: Testing Maturity Model. TPI: Test Process Improvement Model. TIM: Test Improvement Model. TSM: Testability Support Model.

COMP Chen Xiantong TPI The outstanding advantages: 1. Offer a sufficient frame of reference for stepwise improvement of the test process. 2. Provide sufficient practical improvement steps, details and instructions.

COMP Chen Xiantong TPI Key Areas Maturity Levels Checkpoints Improvement suggestions Test Maturity Matrix

COMP Chen Xiantong TPI Key Areas Aspect life-cycle: Test strategy Life-cycle model Moment of involvement Aspect organization: Commitment and motivation Testing functions and training Scope of methodology Communication Reporting Defect management Testware management Test process management Aspect techniques: Estimating and planning Test specification techniques Static test techniques Metrics Aspect infrastructure: Test tools Test environment Office environment Special: Evaluation Low-level testing

COMP Chen Xiantong TPI Maturity Matrix

COMP Chen Xiantong TPI Maturity Matrix Current situation Required situation