Non-Functional Testing Standards Workshop EuroSTAR 2001 Stockholm – Sweden Graham Thomas Wall Street Systems

2 Agenda l Introduction l History of the BCS SIGIST SWP l Work of the Group l Workshop m Procedure Testing m Performance Testing m Security Testing l Summary

3 Introduction l Who are we? l What do we do? l Why are we here today? l What can we do for you? l What can you do to help the group?

4 BCS SIGIST SWP history l Group established for 10+ years l Generated existing British Standards for Software Testing m BS7925-1Vocabulary of terms in software testing m BS7925-2Software component testing l Non-Functional Testing Techniques

5 Non-Functional testing techniques l Memory Management l Reliability l Usability l Maintainability l Configuration l Portability l Recovery l Disaster Recovery l Performance l Stress l Security l Procedure l Interoperability l Compatibility l Installability l Conversion

6 Work of the group l About a year ago... m Single threaded m 8 meetings per year m Low response rate m Possibility of another 8 years l A change of plan m Multi threaded m Team based approach m 12 meetings per year m Higher response rate

7 Work of group l To produce standards that are good enough l To ensure that they are workable l To produce them to a standard format l Structure of a technique l Normative m Analysis m Design m Measurement m Guidelines m Examples

8

9 Procedure Testing

10 Procedure Testing 1. Input 2. Output 3. Loop 4. Continuous 5. Workflow

11 Performance Testing

12 Performance Testing Computer System Application Security Layer InputsOutputs Test Tools Test Environment Performance Specialists Expected Load Required Level of Performance Test Cases Industry Standard Benchmarks Measured Performance

13 Security Testing

14 Summary l Introduced the BCS SIGIST SWP l Explained the work of the group l Three technique workshops l Help us to help you l Bookmark this site