Managing the Test Process CS 4501 / 6501 Software Testing [Ammann and Offutt, “Introduction to Software Testing,” Ch. 9.5]

Late Testing Postpone testing activity Compromised testing Wait until late in the development process Compromised testing Not enough resources (time and budget) Instead of planning and designing test, only have time to run tests Testers cannot show up the last minute and make a bad product good; high quality has to be part of the process from the beginning

Integrating Testing Process Requirements analysis and specification System and software design Intermediate design Detailed design Implementation Integration System deployment Operation and maintenance

Integrating Testing Process Testing objectives and activities during requirements analysis Objectives Activities Ensure requirements are testable Ensure requirements are correct Ensure requirements are complete Influence the software architecture Set up testing requirements Choose testing criteria Obtain or build support software Define testing plans at each level Build test prototypes Clarify requirement items and test criteria Develop project test plan [AO, p. 287]

Integrating Testing Process Testing objectives and activities during system and software design Objectives Activities Verify mapping between requirement specification and system design Ensure traceability and testability Influence interface design Validate design and interface Design system testes Develop coverage criteria Design acceptance test plan Design usability test [AO, p. 288]

Integrating Testing Process Testing objectives and activities during intermediate design Objectives Activities Avoid mismatches of interfaces Prepare for unit testing Specify system test cases Develop integration and unit test plans Build or collect test support tools Suggest ordering of class integration Testing objectives and activities during Detailed design Objectives Activities Be ready to test when modules are ready Create test cases (unit) Build test specifications (integration) [AO, p. 289]

Integrating Testing Process Testing objectives and activities during implementation Objectives Activities Efficient unit testing Automatic test data generation Create test case values Conduct unit testing Report problems properly Testing objectives and activities during integration Objectives Activities Efficient integration testing Perform integration testing [AO, p. 290]

Integrating Testing Process Testing objectives and activities during system deployment Objectives Activities Efficient system testing Efficient acceptance testing Efficient usability testing Perform system testing Perform acceptance testing Perform usability testing Testing objectives and activities during operation and maintenance Objectives Activities Efficient regression testing Capture user problems Perform regression testing [AO, p. 291]