2. AXIOMS Paul Gerrard THE TESTING OF

16. A foundation for thinking and behaviour

20. There is no agreed set of laws. Is our profession based on weak foundations? I REPEAT….

21. American Heritage Dictionary: Test: (noun) A procedure for critical evaluation; A means of determining the presence, quality, or truth of something; A trial.

24. Many books on software testing… And there appear to be 713 of them …

37. Testing as a lifecycle activity Model-based testing Test-obsessed Testing as exploration Business goal-based testing Agile testing Test-first, test- driven Risk-based testing Testing as learning

56. Practices are always context- sensitive

63. Different approaches reflect a different emphasis on the same axioms

65. “Murder is wrong” is axiomatic.

66. ALL the Axioms have been compared with the writings of the folk who have objected.

67. Too many schools push dogma, demand obedience to school rules and mark people for life. They put up barriers to entry and exit and require members to sing the same school song. No thanks.

72. The Axiom Axioms are one-liners that succinctly state the principle.

73. Testing has no meaning without stakeholders

74. You need a source of knowledge to select things to test

75. Test needs a source of knowledge to evaluate actual behaviour

76. Your sources of knowledge are fallible and incomplete

77. If you don’t manage scope, you may never meet stakeholder expectations

78. Test design is based on models

79. Testing requires a coverage model or models

80. The usefulness of the intelligence produced by test determines the value of testing

81. Test execution requires a known, controlled environment

82. Testing never goes as planned

83. The most important tests are those that uncover the best intelligence, fast

84. Run your most important tests first – you may not have time to run them later

85. Repeated tests are inevitable

86. Acceptance is always a compromise

87. Testing never finishes; it stops

88. The value of intelligence is independent of who produces it

89. Suggestions?

91. Think of the Axioms as thinking tools

93. Test Strategy Test Strategy Risks Goals Constraints Human resource Environment Timescales Process (lack of?) Contract Culture Opportunities User involvement Automation De- Duplication Early Testing Skills Communication Axioms Artefacts

94. Design Coverage Value Scope Prioritisation Fallibility Event Oracle Never-Finished Good-Enough Environment Basis Repeat-Test Delivery Sequencing Stakeholder

95. Sequencing Stakeholder What tests do the different stakeholders value most? What information do the different stakeholders want first?

98. Much better than generic ‘maturity models’ that MUST BE context-dependent

99. Who are they? What intelligence do they want? What do they need it for? When do they want it? In what format? How often? Etc.

101. Risk Management Risk Management Coverage Stakeholder Event Never Finished Never Finished Managing Uncertainty Facilitation, influencing and reporting Expectation management Crisis management

106. The words software, system, technology, methodology, v- model, entry/exit criteria, risk – do not appear

107. Testers test software, systems, interfaces, documents, processes, buildings, people etc… (Should they apply to testing anything? Discuss!)

108. A procedure for critical evaluation A means of determining the presence, quality, or truth of something A trial.

109. Refinement Examples Applications

110. www.gerrardconsulting.co m

111. Thank-You! THE TESTING OF