1. Why Are My Tests Dumb? Jeff Offutt George Mason University

2. Old Style Tests AMOST 2015 © Jeff Offutt2 Values invented by humans Scripts were pieces of paper with steps 1.Turn on computer 2.Type : “Run myProgram” 3.Enter name : “George P. Burdell” 4.Enter age : “-25” Simple directions to humans Slow! Error prone! Limited repeatability! Almost impossible to integrate criteria These are as dumb as single-cell organisms !!

3. Limitations AMOST 2015 © Jeff Offutt3 Single-cell tests are incompatible with model-based testing

4. Modern Dumb Tests Test values –Created by a mix of humans and test data generators –Satisfy well-documented goals, test criteria, or specialized domain needs Integrated into automated test scripts (eg, JUnit) Includes a small amount of brain power … these tests know what results to expect (eg, JUnit assertions) Fast … repeatable … AMOST 2015 © Jeff Offutt4 These multi-cellular tests show the first signs of intelligence!

5. Multicellular Tests AMOST 2015 © Jeff Offutt5 Test Values Expected results Before values After values Why is it there? But this test does not know When should it run? When should it change? When should it die?

6. Intelligent Tests AMOST 2015 © Jeff Offutt6 Intelligent tests need self-awareness and self-determination!