1. Integration and system test
Chapter 9

2. CONTENTS Testing Principles The TSPi Testing Strategy
Build and Integration Strategy
System Test Strategy
Test Planning
Tracking and Measuring Testing
Documentation
The Test Process

3. Testing Principles
In TSPi, the purpose of testing is to assess the product and not to fix it.
You should have found and fixed almost all the defects before the testing phase.
The quality of a product is determined when it is developed.
When you put a poor-quality product into test, you generally get a poor-quality product out of test.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

4. TSPi Testing Strategy Build the System Integration Test System Test
Using the developed and unit-tested parts, build the system
Integration Test
Integration-test the system to verify that it is properly built, that all the parts are present, and that they function together
System Test
System-test the product to validate that it does what the system requirements call for；
Regression Test
In subsequent cycles, regression tests are also needed to ensure that the development work for this cycle has not unintentionally changed the functionality or performance produced in prior cycles.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

5. Build & Integration Strategy
The purpose of the build process is to ensure that all needed parts are present, to assemble a working system, and to provide this system to integration and system test.
Integration testing should merely check that all the components are present and that all their calls and other interactions work.
You should not test the components’ functions.
You should not test the components’ functions.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

6. Build & Integration Strategy Big-Bang Strategy
Put all the parts together and see whether they work.
Advantage: it requires the least amount
of test development；
Disadvantage: it is rarely successful, particularly with poor-quality systems.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

7. Build & Integration Strategy The One-at-a-time Strategy
Put all the parts together and see whether they work.
Advantage: With each addition, you look for problems with the newly added parts
Disadvantage: This strategy requires more test development work.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

8. Build & Integration Strategy The Cluster Strategy
This strategy is to add parts in clusters.
You identify a class of related components and integrate them.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

9. Build & Integration Strategy The Flat-system Strategy
This strategy is to integrate all the highest level parts first and then delve down into successive system layers in parallel. You identify a class of related components and integrate them.
Advantage: You can detect system-wide issues early；
Disadvantage: it usually requires large numbers of stubs or special scaffolding to provide dummy returns for all the functions that are not yet available.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

10. The Function-first Strategy
System Test Strategy
The Function-first Strategy
Firstly, test each of the system’s intended functions
Check operation under stress conditions, evaluate usability
Finally, measure performance.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

11. The Functional Area Strategy
System Test Strategy
The Functional Area Strategy
Cover all aspects of each functional area before moving to the next functional area.
You might start by testing
Numerical calculations for normal and adverse operation；
Usability
Performance
Quality
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

12. Combining the Preceding-two Strategy
System Test Strategy
Combining the Preceding-two Strategy
Test lower level functions for normal, abnormal and stress behavior；
Move to the next higher level and test functional aggregates to ensure that they work together. Check them under various normal and stress conditions；
Continue testing at progressively higher levels until you have covered the full system.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

13. Reversing the Preceding Strategy
System Test Strategy
Reversing the Preceding Strategy
Test the highest level functions and work down, doing normal and stress tests
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

14. Test Planning The completed testing plan should have…
A list of all the testing steps to be performed
The supporting materials required for each test
The results that the tests are to produce
An estimate of the defect-free run time, the defects to be found, and total time for each test
An estimate of the work required to develop each item in the test plan.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

15. Tracking and Measuring Testing
The test log (LOGTEST FORM) contains a summary of the tests run and the results obtained
With the test log data, you can readily determine which tests were run and which found the most defects
You can also determine the test run time and the defects found per testing hour
Data from this log can help you select the most efficient strategy for regression-testing modified programs
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

16. Documentation
In the TSPi test phase, part of the team drafts and reviews the user documentation while the rest of the team conducts the tests.
A well-designed manual should be organized around the reader’s needs and not the product’s structure. Generally
The first section should address what the user needs to know first: how to get started
Next, you might explain what the user can do with the product
Finally, make it easy for people to find what they want to know.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

17. Documentation Writing Style Write short sentences；
Use simple words and phrases；
Use lots of lists and bulleted items.
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

18. Documentation Document Review Document Organization
Document Terminology
Document Content
Accuracy
Readability
Understandability
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

19. The Test Process http://casper.cii.saxion.nl/se/SEscripts/test.html
Testing Principles The TSPi Testing Strategy Build and Integration Strategy System Test Strategy Test Planning Tracking and Measuring Testing Documentation The Test Process

22. Test Scripts Test script includes:
Develop build, integration test, and system test procedures
Determine size, time, and materials needed for each test
Build the product
Conduct integration testing
Conduct system testing
From Glenn Booker INFO 637

23. Test Scripts Outputs include
Produce user documentation, review and fix it
Outputs include
An integrated and tested product for this cycle
Completed LOGD and LOGTEST forms for all tests
Completed user documentation
Time, size, and defect data in TSP system

24. Have a nice day!